Mobile control interface for modular robots

The goal of this project was to create an augmented reality (AR) interface for modular robots called Roombots. Currently a 3D simulation of Roombots exists but it doesn’t use the capability of augmented reality to improve the user experience. We envision an application that allow the user to watch the simulated Roombots superimpressed to the real view from the camera, from any points of view by just moving in the environment as if there were real Roombots in the room. We considered many possibilities and we chose to use a SLAM-like algorithm because this doesn’t rely on any sensors or external beacons except the camera to works. I first begin to implement such tool and finally decided to modify an augmented reality software from Oxford called PTAM (Parallel Tracking and Mapping) to match our needs.