Structures with Small Orbit Growth