Prepared for submission to JHEP Extended higher spin holography and Grassmannian models