Towards Immersive Motion Capture Acting : Design, Exploration and Development of an Augmented System Solution

Current and future animations crave for realistic motions to create a perception of motions that are close to a realistic human-like performance. To create such human-like animations, motion capture actors enrich the movements of digital avatars with realistic and believable motions and emotions. Acting for motion capture, as it is performed today, implies certain challenges. In this paper we address these challenges and argue how to support motion capture actors especially when acting for computer games. We discuss the nature of motion capture acting in the view of Stanislavski’s acting principles and point out the actors’ skills and demands. We conclude that the developed principles should be: ’Imagination’, ’Objectives’, ’Information & Visual References’, ’Magic if’, ’Adaptation’ and ’Relaxation’ to support motion capture actors with their work.

[1]  K. Krippendorff The Semantic Turn: A New Foundation For Design , 2005 .

[2]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[3]  Olivier Nannipieri,et al.  New Augmented Reality Taxonomy: Technologies and Features of Augmented Environment , 2011, Handbook of Augmented Reality.

[4]  Kristina Höök,et al.  Strong concepts: Intermediate-level knowledge in interaction design research , 2012, TCHI.

[5]  Jonas Löwgren Interaction design, research practices and design research on the digital materials , 2015 .

[6]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, VR.

[7]  Bernard D. Adelstein,et al.  Perception of image motion during head movement , 2006, APGV '06.

[8]  Ruzena Bajcsy,et al.  Precise indoor localization using smart phones , 2010, ACM Multimedia.

[9]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[10]  Kishore V. Chellappan,et al.  Laser-based displays: a review. , 2010, Applied optics.

[11]  Sten Jönsson,et al.  Doing interventionist research in management accounting , 2005 .

[12]  Rikard Lindell,et al.  Towards Stanislavski-based Principles for Motion Capture Acting in Animation and Computer Games , 2013 .

[13]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[14]  Stefan M. Grünvogel,et al.  How Realistic is Realism? Considerations on the Aesthetics of Computer Games , 2004, ICEC.

[15]  Gavriel Salvendy,et al.  Measuring Player Immersion in the Computer Game Narrative , 2009, Int. J. Hum. Comput. Interact..

[16]  R. Sukthankar,et al.  Towards Ambient Projection for Intelligent Environments , 2005, Computer Vision for Interactive and Intelligent Environment (CVIIE'05).

[17]  Barbara B. Kawulich Participant Observation as a Data Collection Method , 2005 .

[18]  Jannick P. Rolland,et al.  A compact optical see-through head-worn display with occlusion support , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[19]  Claudio Redavid Virtual Test Environment for Motion Capture Shoots , 2012 .

[20]  Rikard Lindell Crafting interaction: The epistemology of modern programming , 2013, Personal and Ubiquitous Computing.

[21]  Joruts LBwgret Applying Design Methodology to Software Development , 1999 .

[22]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[23]  Walter F. Tichy,et al.  Should Computer Scientists Experiment More? , 1998, Computer.

[24]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[25]  J. Gruzelier,et al.  Acting performance and flow state enhanced with sensory-motor rhythm neurofeedback comparing ecologically valid immersive VR and training screen scenarios , 2010, Neuroscience Letters.

[26]  John R. Wilson,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999, Presence: Teleoperators & Virtual Environments.

[27]  Steve Dixon,et al.  Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation , 2007 .

[28]  Joe Geigel,et al.  Theatrical storytelling in a virtual space , 2004, SRMC '04.

[29]  A. Yalçinkaya,et al.  Two-axis electromagnetic microscanner for high resolution displays , 2006, Journal of Microelectromechanical Systems.

[30]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[31]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[32]  Yunfei Ma,et al.  Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics , 2010, MOEMS-MEMS.

[33]  Mel Slater,et al.  Body Centred Interaction in Immersive Virtual Environments , 1994 .

[34]  J. Murray Hamlet on the Holodeck , 1997 .

[35]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[36]  Midori Kitagawa,et al.  MoCap for Artists: Workflow and Techniques for Motion Capture , 2008 .

[37]  Gordana Dodig Crnkovic,et al.  Constructive Research and Info-computational Knowledge Generation , 2010 .

[38]  E. C. Regan,et al.  The frequency of occurrence and severity of side-effects of immersion virtual reality. , 1994, Aviation, space, and environmental medicine.

[39]  John Zimmerman,et al.  Video sketches: exploring pervasive computing interaction designs , 2005, IEEE Pervasive Comput..

[40]  Paul A. Watters,et al.  Estimating Cybersickness of Simulated Motion Using the Simulator Sickness Questionnaire (SSQ): A Controlled Study , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[41]  Dimitrios Christopoulos,et al.  Real-Time Motion Capture Technology on a Live Theatrical Performance with Computer Generated Scenery , 2010, 2010 14th Panhellenic Conference on Informatics.

[42]  J. Howell,et al.  Acting in virtual reality , 2000, CVE '00.

[43]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.