Task-specific Scene Structure Representations