Generalizing User Models through Hybrid Hierarchical Control