How (non-)linear is the hydrodynamics of heavy ion collisions?