Interacting with the past: Creating a time perception journey experience using kinect-based breath detection and deterioration and recovery simulation technologies

We propose an application that allows a museum audience to interact with the past and to appreciate the value of antique objects through multimedia installations. Discussions in this article are based on our experiences in developing the Mao-Kung Cauldron time perception journey multimedia application. This installation was inspired by the Mao-Kung Cauldron, an ancient bronze cauldron in the collection of the National Palace Museum known for its historical significance. The question, however, lies in how to create an experience in which the audiences can interact with the past. To address this issue, the research team used the Kinect-based breath detection and deterioration/recovery simulation technologies to develop the application. This installation is the first application linked to Kinect-based breath detection and deterioration/recovery simulation technologies. The main contribution of this work is the analysis of design concepts, design decisions, and evaluations in a museum setting. We conduct a control group study to compare the outcomes between the experimental group (Mao-Kung Cauldron time perception journey multimedia application) and control group (asynchronous web-based kiosk). Both the quantitative (questionnaire survey) and qualitative methods (observation) are used to analyze the collected data. This work proposes a feasibility design to let museum audiences experience the features of cultural object by the virtual time perception journey application.

[1]  Richard J. Gerrig,et al.  Experiencing Narrative Worlds: On the Psychological Activities of Reading , 1993 .

[2]  Eugene Ch'ng,et al.  Experiential archaeology: Is virtual time travel possible? , 2009 .

[3]  D. Hoyer,et al.  Nonlinear analysis of heart rate and respiratory dynamics , 1997, IEEE Engineering in Medicine and Biology Magazine.

[4]  Andrew Gardner,et al.  Linear light source reflectometry , 2003, ACM Trans. Graph..

[5]  Mark T. Bolas,et al.  Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect , 2012, VR.

[6]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[7]  Ava Fatah gen. Schieck,et al.  ArCHI: engaging with museum objects spatially through whole body movement , 2012, MindTrek.

[8]  Alexander Mehler,et al.  WikiNect: towards a gestural writing system for kinetic museum wikis , 2012, UXeLATE '12.

[9]  Yi-Ping Hung,et al.  Multimedia feedback for improving breathing habit , 2008, 2008 First IEEE International Conference on Ubi-Media Computing.

[10]  Pat Hanrahan,et al.  Modeling and rendering of metallic patinas , 1996, SIGGRAPH.

[11]  Zhao Lei,et al.  Immersive Display and Interactive Techniques for the Modeling and Rendering of Virtual Heritage Environments , 2009, 2009 International Conference on Information Management and Engineering.

[12]  I.Y. Immoreev,et al.  Practical Application of Ultra-Wideband Radars , 2006, 2006 3rd International Conference on Ultrawideband and Ultrashort Impulse Signals.

[13]  Chen Xu,et al.  Observing and Transferring Material Histories , 2005 .

[14]  Ferhat Sen,et al.  A novel gesture-based interface for a VR simulation: Re-discovering Vrouw Maria , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[15]  Fabio Remondino,et al.  Hands-Off: Using Kinect to virtually query the ancient Maya city of Copan, Honduras , 2011 .

[16]  Ming-Sui Lee,et al.  Transformational Breathing between Present and Past: Virtual Exhibition System of the Mao-Kung Ting , 2010, MMM.

[17]  Yi-Ping Hung,et al.  Turning Rust into Gold: An ancient artifact as an interactive artwork , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[18]  H. Shum,et al.  Appearance manifolds for modeling time-variant appearance of materials , 2006, SIGGRAPH 2006.

[19]  J. Fermaglich.  Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[20]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[21]  Shree K. Nayar,et al.  Time-varying surface appearance: acquisition, modeling and rendering , 2006, ACM Trans. Graph..

[22]  Thomas E. Levy,et al.  Demo paper: Virtual and immersive experience presentation of Cultural Heritage Sites , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[23]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[24]  Ming-Sui Lee,et al.  Noncontact respiratory measurement of volume change using depth camera , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Hui-mei Justina Hsu.  The Potential of Kinect as Interactive Educational Technology , 2011 .

[26]  Elisa Bertino,et al.  Dissemination of Cultural Heritage Content through Virtual Reality and Multimedia Techniques: A Case Study , 2005, 11th International Multimedia Modelling Conference.

[27]  Doris Jung,et al.  .cyclic.: an interactive performance combining dance, graphics, music and kinect-technology , 2012, CHINZ '12.

[28]  Sarah Kenderdine,et al.  Dramaturgies of PLACE: evaluation, embodiment and performance in PLACE-Hampi , 2009, Advances in Computer Entertainment Technology.