Exploring the Museum with a Handheld Projector in Your Own Room

With the development of information technology, digital museum has already been a quite beneficial method for the protection and communication of cultural heritage. For digital museums, interactive and multimedia technologies of exhibition greatly enrich visitor's experience, and make it easier to gain insight into the connotation of different cultural exhibits vividly. With the consideration of balancing the tradeoff between the device cost and display effect, in this paper, we propose a digital museum exhibition system based on the combination of handheld projector and depth sensor. We treat the walls of common rooms as the projection screen, and then mapping virtual images, which reflect the real museum exhibitions, on these "walls". Users can walk in the room freely, and browse images by changing the irradiation area of projector; furthermore, they can explore different virtual exhibition rooms by interacting with the projected virtual interface. Key procedures to realize the proposed virtual exploring system are described, and several experiments have been taken to test the usability and user experience of the proposed system, which is of low cost and easy to use, especially suitable for individual users and small organizations.

[1]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Karl D. D. Willis A pre-history of handheld projector-based interaction , 2011, Personal and Ubiquitous Computing.

[4]  Rahul Sukthankar,et al.  Smarter presentations: exploiting homography in camera-projector systems , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[6]  Alan Wee-Chung Liew,et al.  The digital museum: Challenges and solution , 2012, 2012 8th International Conference on Information Science and Digital Content Technology (ICIDT2012).

[7]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Gilson A. Giraldi,et al.  A System to Interact with CAVE Applications Using Hand Gesture Recognition from Depth Data , 2014, 2014 XVI Symposium on Virtual and Augmented Reality.

[9]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .