Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling