Real-time cloud-based 3D reconstruction and interaction with a stereo smartphone

In this demonstration, we present a novel cloud-based system for casual users, which enables real-time 3D reconstruction and interaction based on stereo smartphones. The client is an Android application that captures scene in real-world, displays reconstructed 3D model and supports interaction. The server receives captured data from client and reconstructs 3D model in real-time. While users capturing data, both the reconstructed scenes and the marked uncertainty regions are visualized on the phones. So, it allows users to continuously update the reconstructed model in real-time by interaction. Meanwhile our system is implemented based on smartphones, which are accessible to casual users, while many existing systems always require extra or expensive specialized equipment. Also, we proposed multiple innovative methods to achieve continuously repairing model through interaction and address the challenge brought by the phone hardware limitations.