Serre functors of residual categories via hybrid models