Universality of the Abraham-Minkowski dilemma for photon momenta beyond dielectric materials