On the universality of AdS2 diffusion bounds and the breakdown of linearized hydrodynamics