Inverted initial conditions: Exploring the growth of cosmic structure and voids