Projection-based augmented reality with automated shape scanning

This paper presents a new framework for interactive Augmented Reality(AR) and Mixed Reality(MR) representation using both visible and invisible projection onto physical target objects. Projection-based approach for constructing AR/MR uses physical objects such as walls, books, plaster ornaments and whatever the computer generated contents can be optically projected onto, namely, projection makes it possible to use real objects as displays. What we demonstrate in this study is to employ near-infrared pattern projection for triangulation so that scanning and updating the geometry data of the object is automatically performed in background process, thus parallel processing to provide AR/MR representation can be achieved according to dynamic physical geometry changes.