Physically agnostic quasi normal mode expansion in time dispersive structures: From mechanical vibrations to nanophotonic resonances