Unitarity at infinity and topological holography