Learning Deep Features for Robotic Inference From Physical Interactions