Know Your Surroundings: Exploiting Scene Information for Object Tracking