Virtual humanoids and presence in virtual environments

The broad range of methods for virtual humanoids and their evaluation as avatars in virtual environments is handled in this thesis. The enabling methods, as well as experimental evaluations are the main contributions of the thesis. The central conclusion of the work can be summed up as the fact that virtual humanoids are beneficial for a number of interaction scenarios typically found in virtual environments. The thesis presents the technology required for an interactive simulation of virtual humanoids in virtual environments. It presents the VRZula toolkit and its main features, mainly a layered data structure derived from functional anatomy, separation of data and simulation algorithms, and the control and propagation of modifications to the data. This elementary approach leads to an extendible and flexible system for virtual humanoids. The toolkit is capable of simulating even sophisticated models of virtual humanoids in complex distributed virtual environments. It integrates a variety of current approaches to the representation of virtual humanoids, as well as methods for kinematic and physiology simulation. Substantial improvements and novel approaches are introduced in the areas of deformation of musculature, multimodal representation and synchronization, construction of motion graphs, and synchronous body tracking. Within the scope of this work, the VRZula toolkit is used for the evaluation of several hypotheses regarding the application of virtual humanoids in virtual environments. The two studies presented contribute to the understanding of the influence of virtual humanoids on the sensation of presence. It has been shown that avatars equipped with synchronous kinematics affect the real motion of the user and optimize the kinematics in the virtual world. Even though the mental and attentional resources bound to the exocentric virtual body representation led to a decrease of presence scores in room-mounted virtual environments, a strong identification of the user with the avatar has been shown. In addition, correlations between presence scores and physiological, as well as performance measures have been found. The results of the two studies are the basis of the evaluation of virtual humanoids used as avatars in typical interaction scenarios of virtual environments, and identify beneficial areas of application in certain navigation tasks and most manipulation scenarios. The use of avatars equipped with synchronous kinematics is clearly recommended. The VRZula toolkit developed within this work and the experimental evaluations have contributed to the prevailing knowledge on virtual humanoids and their ap-

[1]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[2]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[3]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[4]  Lawrence W. Stark,et al.  The Effects of Pictorial Realism, Delay of Visual Feedback, and Observer Interactivity on the Subjective Sense of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[5]  Gordon Clapworthy,et al.  An Anatomy-Based Approach to Human Muscle Modeling and Deformation , 2002, IEEE Trans. Vis. Comput. Graph..

[6]  Stefan Kopp,et al.  Synthesizing multimodal utterances for conversational agents , 2004, Comput. Animat. Virtual Worlds.

[7]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[8]  C O Bechtol,et al.  Biomechanics of the shoulder. , 1980, Clinical orthopaedics and related research.

[9]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[10]  David Jacobson,et al.  Presence Revisited: Imagination, Competence, and Activity in Text-Based Virtual Worlds , 2001, Cyberpsychology Behav. Soc. Netw..

[11]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[12]  Nancy S. Pollard,et al.  Evaluating motion graphs for character navigation , 2004, SCA '04.

[13]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[14]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[15]  A. Paans,et al.  Brain Activation Related to the Representations of External Space and Body Scheme in Visuomotor Control , 2001, NeuroImage.

[16]  David W. Schloerb,et al.  A Quantitative Measure of Telepresence , 1995, Presence: Teleoperators & Virtual Environments.

[17]  Thoma Elizabeth,et al.  Body image and personality , 1963 .

[18]  Evangelos Kokkevis,et al.  Skinning Characters using Surface Oriented Free-Form Deformations , 2000, Graphics Interface.

[19]  Daniel Thalmann,et al.  Modeling and deformation of the human body using an anatomically-based approach , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[20]  Erik B. Dam,et al.  Quaternions, Interpolation and Animation , 2000 .

[21]  Kwang-Jin Choi,et al.  On-line motion retargetting , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[22]  Emil Slusanschi,et al.  Automatic Differentiation of the General-Purpose Computational Fluid Dynamics Package FLUENT , 2007 .

[23]  Edwin H. Blake,et al.  A direct comparison of presence levels in text-based and graphics-based virtual environments , 2003, AFRIGRAPH '03.

[24]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[25]  C. Galletti,et al.  Arm Movement‐related Neurons in the Visual Area V6A of the Macaque Superior Parietal Lobule , 1997, The European journal of neuroscience.

[26]  P. Battaglini,et al.  Visuomotor deficits and fast recovery after area V6A lesion in monkeys , 2003, Behavioural Brain Research.

[27]  I. Wickram.  Biofeedback: A Practitioner's Guide , 1987 .

[28]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[29]  M. Perenin,et al.  Optic ataxia: a specific disruption in visuomotor mechanisms. I. Different aspects of the deficit in reaching for objects. , 1988, Brain : a journal of neurology.

[30]  Martijn J. Schuemie,et al.  Research on Presence in Virtual Reality: A Survey , 2001, Cyberpsychology Behav. Soc. Netw..

[31]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[32]  Lizhuang Ma,et al.  Motion normalization: the preprocess of motion data , 2005, VRST '05.

[33]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[34]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[35]  F. Lacquaniti,et al.  Early coding of reaching in the parietooccipital cortex. , 2000, Journal of neurophysiology.

[36]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[37]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[38]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[39]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[40]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[41]  Paul A. Viola,et al.  Learning silhouette features for control of human motion , 2004, SIGGRAPH '04.

[42]  Norman I. Badler,et al.  Kinematic control of human postures for task simulation , 1996 .

[43]  B K Wiederhold,et al.  The effects of immersiveness on physiology. , 1998, Studies in health technology and informatics.

[44]  Leif Kobbelt,et al.  Self-calibrating optical motion tracking for articulated bodies , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[45]  J. F. Soechting,et al.  Coordination of arm movements in three-dimensional space. Sensorimotor mapping during drawing movement , 1986, Neuroscience.

[46]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[47]  Michael Vorländer,et al.  Virtual Reality System with Integrated Sound Field Simulation and Reproduction , 2007, EURASIP J. Adv. Signal Process..

[48]  Torsten Kuhlen,et al.  Comparative Evaluation of User Performance for Modeling Tasks in Non-immersive and Immersive Virtual Environments , 2005 .

[49]  Norman I. Badler,et al.  Inverse kinematics positioning using nonlinear programming for highly articulated figures , 1994, TOGS.

[50]  Jessica K. Hodgins,et al.  Automatic Joint Parameter Estimation from Magnetic Motion Capture Data , 2023, Graphics Interface.

[51]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[52]  Robert van Liere,et al.  An analysis of orientation prediction and filtering methods for VR/AR , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[53]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[54]  Gregory M. P. O'Hare,et al.  Presence Equation: An Investigation into Cognitive Factors Underlying Presence , 2003, Presence: Teleoperators & Virtual Environments.

[55]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[56]  Mel Slater,et al.  Representations Systems, Perceptual Position, and Presence in Immersive Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[57]  F. Biocca,et al.  The cyborg's dilemma: embodiment in virtual environments , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.

[58]  Wei Wang,et al.  Human motion estimation from a reduced marker set , 2006, I3D '06.

[59]  D T Davy,et al.  An investigation of muscle lines of action about the hip: a centroid line approach vs the straight line approach. , 1975, Journal of biomechanics.

[60]  John P. Lewis,et al.  Reducing blendshape interference by selected motion attenuation , 2005, I3D '05.

[61]  Yoshihiko Nakamura,et al.  Inverse kinematic solutions with singularity robustness for robot manipulator control , 1986 .

[62]  C. Galletti,et al.  Brain location and visual topography of cortical area V6A in the macaque monkey , 1999, The European journal of neuroscience.

[63]  Mark S. Schwartz,et al.  Biofeedback: A Practitioner's Guide , 1987 .

[64]  Arie E. Kaufman,et al.  Real‐time Biomechanically‐based Muscle Volume Deformation using FEM , 1998, Comput. Graph. Forum.

[65]  Norman I. Badler,et al.  Virtual humans for validating maintenance procedures , 2002, CACM.

[66]  Min-Hyung Choi,et al.  Fast Volume Preservation for a Mass-Spring System , 2006, IEEE Computer Graphics and Applications.

[67]  Bobby Bodenheimer,et al.  An evaluation of a cost metric for selecting transitions between motion segments , 2003, SCA '03.

[68]  Mark Mizuguchi,et al.  Data driven motion transitions for interactive games , 2001, Eurographics.

[69]  Elizabeth Towell,et al.  Presence in Text-Based Networked Virtual Environments or MUDS , 1997, Presence: Teleoperators & Virtual Environments.

[70]  Daniel Thalmann,et al.  Human Motion Capture Driven by Orientation Measurements , 1999, Presence: Teleoperators & Virtual Environments.

[71]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[72]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[73]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[74]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[75]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[76]  Chris Welman,et al.  INVERSE KINEMATICS AND GEOMETRIC CONSTRAINTS FOR ARTICULATED FIGURE MANIPULATION , 1993 .

[77]  Hans-Peter Seidel,et al.  Reanimating the dead: reconstruction of expressive faces from skull data , 2003, ACM Trans. Graph..

[78]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[79]  Holger Regenbrecht,et al.  Real and Illusory Interactions Enhance Presence in Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[80]  John H. Bailey,et al.  Learning and Transfer of Spatial Knowledge in a Virtual Environment , 1994 .

[81]  Zheng Guo,et al.  Skinning With Deformable Chunks , 2005, Comput. Graph. Forum.

[82]  Christian Bischof,et al.  The ADIFOR 2.0 system for the automatic differentiation of Fortran 77 programs , 1997 .

[83]  H. Hatze.  The complete optimization of a human motion , 1976 .

[84]  William Todd Stinson,et al.  Bulging muscles and sliding skin: deformation systems for Hellboy , 2004, SIGGRAPH '04.

[85]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[86]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[87]  Angela Barbanente.  Skin them bones: game programming for the web generation , 1998 .

[88]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[89]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[90]  Andrea H. Mason,et al.  The Role of Graphical Feedback About Self-Movement when Receiving Objects in an Augmented Environment , 2004, Presence: Teleoperators & Virtual Environments.

[91]  Christian H. Bischof,et al.  Interactive Biomechanical Modeling and Simulation of Realistic Human Musculature in Virtual Environments , 2006, Bildverarbeitung für die Medizin.

[92]  Robert C. Allen,et al.  Terrain Appreciation in Virtual Environments: Spatial Knowledge Acquisition. , 1997 .

[93]  Norman I. Badler,et al.  Parametric keyframe interpolation incorporating kinetic adjustment and phrasing control , 1985, SIGGRAPH.

[94]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[95]  Daniel Thalmann,et al.  The Elastic Surface Layer Model for Animated Character Construction , 1993 .

[96]  Oliver Schneider,et al.  Virtual Human: Storytelling and Computer Graphics for a Virtual Human Platform , 2004, TIDSE.

[97]  Pieter Jorissen,et al.  Dynamic interactions in physically realistic collaborative virtual environments , 2005, IEEE Transactions on Visualization and Computer Graphics.

[98]  Neil A. Dodgson,et al.  Variation and extrema of human interpupillary distance , 2004, IS&T/SPIE Electronic Imaging.

[99]  Bert Jüttler,et al.  Sweep-based human deformation , 2005, The Visual Computer.

[100]  C. Galletti,et al.  The cortical visual area V6: brain location and visual topography , 1999, The European journal of neuroscience.

[101]  Lizhuang Ma,et al.  A 12-DOF Analytic Inverse Kinematics Solver for Human Motion Control? , 2004 .

[102]  Francisco J. Serón,et al.  Adding Support for High-Level Skeletal Animation , 2002, IEEE Trans. Vis. Comput. Graph..

[103]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[104]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[105]  James F. Blinn,et al.  A Generalization of Algebraic Surface Drawing , 1982, TOGS.

[106]  J. Winters.  Hill-Based Muscle Models: A Systems Engineering Perspective , 1990 .

[107]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[108]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[109]  George Papagiannakis,et al.  VHD++ development framework: towards extendible, component based VR/AR simulation engine featuring advanced virtual character technologies , 2003, Proceedings Computer Graphics International 2003.

[110]  Jean-Paul Laumond,et al.  Animation planning for virtual characters cooperation , 2006, TOGS.

[111]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[112]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[113]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[114]  Mel Slater,et al.  An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience , 2004, Comput. Graph. Forum.

[115]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.

[116]  S L Delp,et al.  A graphics-based software system to develop and analyze models of musculoskeletal structures. , 1995, Computers in biology and medicine.

[117]  Rüdiger J Seitz,et al.  Body scheme gates visual processing. , 2004, Journal of neurophysiology.

[118]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[119]  Luca Chittaro,et al.  A virtual human architecture that integrates kinematic, physical and behavioral aspects to control H-Anim characters , 2005, Web3D '05.

[120]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[121]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[122]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[123]  Hans-Christoph Nuerk,et al.  NeuroMan - a comprehensive software system for neuropsychological experiments , 2005 .

[124]  G. Riva,et al.  Virtual reality for the treatment of body image disturbances. , 1997, Studies in health technology and informatics.

[125]  Andrew P. Witkin,et al.  Energy constraints on parameterized models , 1987, SIGGRAPH.

[126]  Zhigang Deng,et al.  Animating blendshape faces by cross-mapping motion capture data , 2006, I3D '06.

[127]  J. Flanagan,et al.  The Inertial Anisotropy of the Arm Is Accurately Predicted during Movement Planning , 2001, The Journal of Neuroscience.

[128]  Nicole Beringer,et al.  PROMISE - A Procedure for Multimodal Interactive System Evaluation , 2002 .

[129]  Jehee Lee,et al.  Motion patches: building blocks for virtual environments annotated with motion data , 2006, ACM Trans. Graph..

[130]  Torsten Kuhlen,et al.  How VR-Based Reach-to-Grasp Experiments Can Help to Understand Movement Organization within the Human Brain , 2000, Presence: Teleoperators & Virtual Environments.

[131]  Floris P. de Lange,et al.  Motor Imagery in Mental Rotation: An fMRI Study , 2002, NeuroImage.

[132]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[133]  J. Milde.  Lokutor: towards a believable communicative agent , 2000 .

[134]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[135]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[136]  Vassili Hurmusiadis,et al.  Visualization of muscle function for medical education. , 2004, Studies in health technology and informatics.

[137]  Dinesh Manocha,et al.  Efficient inverse kinematics for general 6R manipulators , 1994, IEEE Trans. Robotics Autom..

[138]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[139]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[140]  Norbert Pfleger,et al.  Synchronizing dialogue contributions of human users and virtual characters in a virtual reality environment , 2005, INTERSPEECH.

[141]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[142]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[143]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[144]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[145]  G. Riva,et al.  Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments , 2003 .

[146]  Anthony A. Maciejewski,et al.  Dealing with the ill-conditioned equations of motion for articulated figures , 1990, IEEE Computer Graphics and Applications.

[147]  David Poeppel,et al.  Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony , 2004, Speech Commun..

[148]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[149]  Umberto Castiello,et al.  Posterior parietal cortex control of reach‐to‐grasp movements in humans , 2002, The European journal of neuroscience.

[150]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[151]  Giancarlo Ferrigno,et al.  Elite: A Digital Dedicated Hardware System for Movement Analysis Via Real-Time TV Signal Processing , 1985, IEEE Transactions on Biomedical Engineering.

[152]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[153]  W. Prinz,et al.  Perceptual basis of bimanual coordination , 2001, Nature.

[154]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[155]  Norman I. Badler,et al.  JACK: a toolkit for manipulating articulated figures , 1988, UIST '88.

[156]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[157]  Demetri Terzopoulos,et al.  Heads up!: biomechanical modeling and neuromuscular control of the neck , 2006, ACM Trans. Graph..

[158]  J. F. Soechting,et al.  An algorithm for the generation of curvilinear wrist motion in an arbitrary plane in three-dimensional space , 1986, Neuroscience.

[159]  Christian Bischof,et al.  NeuroVRAC--a comprehensive approach to virtual reality-based neurological assessment and treatment systems. , 2003, Studies in health technology and informatics.

[160]  Norbert Reithinger,et al.  SmartKom: adaptive and flexible multimodal access to multiple applications , 2003, ICMI '03.

[161]  Margaret S. Geroch.  Motion capture for the rest of us , 2004 .

[162]  H. Brenton,et al.  The Uncanny Valley : does it exist ? , 2005 .

[163]  F. Zajac.  Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[164]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[165]  Michael I. Jordan,et al.  The Role of Inertial Sensitivity in Motor Planning , 1998, The Journal of Neuroscience.

[166]  Torsten Kuhlen,et al.  Reaction-time measurement and real-time data acquisition for neuroscientific experiments in virtual environments. , 2004, Studies in health technology and informatics.

[167]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[168]  Aaron P. Ferguson.  Skin Deep Beauty A production friendly creature geometry pipeline used on HULK , 2003 .

[169]  G. Fink,et al.  Being with virtual others: Neural correlates of social interaction , 2006, Neuropsychologia.

[170]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[171]  Laurie N. Taylor.  VIDEO GAMES: PERSPECTIVE, POINT-OF-VIEW, AND IMMERSION , 2002 .

[172]  Rod McCall,et al.  Measuring presence in virtual environments , 2004, CHI EA '04.

[173]  Ziaul Hasan,et al.  Circle-drawing movements at different speeds: role of inertial anisotropy. , 2002, Journal of neurophysiology.

[174]  Taku Komura,et al.  Creating and retargetting motion by the musculoskeletal human body model , 2000, The Visual Computer.

[175]  W. W. Schrader,et al.  Efficient Computation of the Jacobian for Robot Manipulators , 1984 .

[176]  Francesco Lacquaniti,et al.  Early motor influences on visuomotor transformations for reaching: a positive image of optic ataxia , 1998, Experimental Brain Research.

[177]  Victor Ng-Thow-Hing,et al.  Application-Specific Muscle Representations , 2002, Graphics Interface.

[178]  Nadim Joni Shah,et al.  Neural Representations of Self versus Other: Visual-Spatial Perspective Taking and Agency in a Virtual Ball-tossing Game , 2006, Journal of Cognitive Neuroscience.

[179]  K. Zilles,et al.  Neural Correlates of First-Person Perspective as One Constituent of Human Self-Consciousness , 2004, Journal of Cognitive Neuroscience.

[180]  James E. Gain,et al.  Animation space: A truly linear framework for character animation , 2006, TOGS.

[181]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[182]  Michael J. Singer,et al.  Task Performance in Virtual Environments: Stereoscopic Versus Monoscopic Displays and Head-Coupling. , 1995 .

[183]  Peter Poller,et al.  Distributed audio-visual speech synchronization , 2002, INTERSPEECH.

[184]  Paul Taylor,et al.  The architecture of the Festival speech synthesis system , 1998, SSW.

[185]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[186]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[187]  V. Spitzer,et al.  The visible human male: a technical report. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[188]  Nadia Magnenat-Thalmann,et al.  Simulation of static and dynamic wrinkles of skin , 1996, Proceedings Computer Animation '96.

[189]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[190]  Christian H. Bischof,et al.  ADIC: an extensible automatic differentiation tool for ANSI‐C , 1997, Softw. Pract. Exp..

[191]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[192]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[193]  M. Whitton,et al.  Physiological Measures of Presence in Virtual Environments , 2001 .

[194]  Nadia Magnenat-Thalmann,et al.  Modelling and Motion Capture Techniques for Virtual Environments , 1998, Lecture Notes in Computer Science.

[195]  Daniel Thalmann,et al.  Real-Time Animation of Realistic Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[196]  Karan Singh,et al.  Outside-in anatomy based character rigging , 2005, SCA '05.

[197]  Ronald Fedkiw,et al.  Robust quasistatic finite elements and flesh simulation , 2005, SCA '05.

[198]  G. Hirzinger,et al.  Singularity Consistent Inverse Kinematics by Enhancing the Jacobian Transpose , 1998 .

[199]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[200]  C. Karen Liu,et al.  Momentum-based parameterization of dynamic character motion , 2004, SCA '04.

[201]  Paula J. Durlach,et al.  Effect of Variations in Sensory Feedback on Performance in a Virtual Reaching Task , 2005, Presence: Teleoperators & Virtual Environments.

[202]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[203]  Taku Komura,et al.  An inverse kinematics method based on muscle dynamics , 2001, Proceedings. Computer Graphics International 2001.

[204]  Luc Van Gool,et al.  Blue-c: a spatially immersive display and 3D video portal for telepresence , 2003, IPT/EGVE.

[205]  Mathieu Desbrun,et al.  Learning controls for blend shape based realistic facial animation , 2003, SIGGRAPH '03.

[206]  Themis Panayiotopoulos,et al.  SimHuman: A Platform for Real-Time Virtual Agents with Planning Capabilities , 2001, IVA.

[207]  Masayuki Nakajima,et al.  Realistic articulated character positioning and balance control in interactive environments , 1999, Proceedings Computer Animation 1999.

[208]  James Maida,et al.  Effects of Lighting on Human Performance in Training , 1997, HCI.

[209]  Torsten Kuhlen,et al.  High ecological validity and accurate stimulus control in VR-based psychological experiments , 2007, EGVE'07.

[210]  Daniel Thalmann,et al.  Using an Intermediate Skeleton and Inverse Kinematics for Motion Retargeting , 2000, Comput. Graph. Forum.

[211]  Thierry Dutoit,et al.  High-quality text-to-speech synthesis : an overview , 2004 .

[212]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[213]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[214]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[215]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[216]  Torsten Kuhlen,et al.  Binaural acoustics for CAVE-like environments without headphones , 2005, EGVE'05.

[217]  G. Ferrigno,et al.  Real-time human motion estimation using biomechanical models and non-linear state-space filters , 2006, Medical and Biological Engineering and Computing.

[218]  Slim Ouni,et al.  A Multilingual Embodied Conversational Agent , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[219]  Mark Billinghurst,et al.  Interaction With Partially Transparent Hands And Objects , 2005, AUIC.

[220]  Pascal Fua,et al.  Skeleton-based motion capture for robust reconstruction of human motion , 2000, Proceedings Computer Animation 2000.

[221]  Michael Vorländer,et al.  Integrating Real-time Binaural Acoustics into VR Applications , 2004, EGVE.

[222]  C. Galletti,et al.  The cortical connections of area V6: an occipito‐parietal network processing visual information , 2001, The European journal of neuroscience.

[223]  B. J. Ferro Castro,et al.  Pattern-Oriented Software Architecture: A System of Patterns , 2009 .

[224]  R. Raikova.  A general approach for modelling and mathematical investigation of the human upper limb. , 1992, Journal of biomechanics.

[225]  Sung Yong Shin,et al.  A general construction scheme for unit quaternion curves with simple high order derivatives , 1995, SIGGRAPH.

[226]  Michela Gamberini,et al.  ‘Arm‐reaching’ neurons in the parietal area V6A of the macaque monkey , 2001, The European journal of neuroscience.

[227]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[228]  Marc Jeannerod,et al.  Modulating the experience of agency: a positron emission tomography study , 2003, NeuroImage.

[229]  Alistair G. Sutcliffe,et al.  Presence, memory and interaction in virtual environments , 2005, Int. J. Hum. Comput. Stud..

[230]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[231]  R. Paul,et al.  Kinematic control equations for simple manipulators , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[232]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[233]  Daniel Thalmann,et al.  Fast Human Body Deformations for Animation and VR Applications , 1994 .

[234]  Victor B. Zordan,et al.  Mapping optical motion capture data to skeletal motion using a physical model , 2003, SCA '03.

[235]  Kyo Chul Kang,et al.  Software engineering of virtual worlds , 1998, VRST '98.

[236]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[237]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[238]  K. Saladin.  Anatomy & Physiology: The Unity of Form and Function , 1997 .

[239]  N. A. Borghese,et al.  Different Brain Correlates for Watching Real and Virtual Hand Actions , 2001, NeuroImage.

[240]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[241]  Jack M. Loomis,et al.  Distal Attribution and Presence , 1992, Presence: Teleoperators & Virtual Environments.

[242]  Hiroshi Ishii,et al.  Bottles: A Transparent Interface as a Tribute to Mark Weiser , 2004, IEICE Trans. Inf. Syst..

[243]  Daniel Thalmann.  The virtual human as a multimodal interface , 2000, AVI '00.

[244]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[245]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, SIGGRAPH '08.

[246]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[247]  G Ferrigno,et al.  Kinematical models to reduce the effect of skin artifacts on marker-based human motion estimation. , 2005, Journal of biomechanics.

[248]  R. C. Oldfield.  THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[249]  Bruno Siciliano,et al.  Closed-Loop Inverse Kinematics Schemes for Constrained Redundant Manipulators with Task Space Augmentation and Task Priority Strategy , 1991, Int. J. Robotics Res..

[250]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[251]  F M van Krieken,et al.  A model of lower extremity muscular anatomy. , 1982, Journal of biomechanical engineering.

[252]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[253]  Kyo Chul Kang,et al.  A real world object modeling method for creating simulation environment of real-time systems , 2000, OOPSLA '00.

[254]  Victor Ng-Thow-Hing,et al.  Interactive display and animation of B-spline solids as muscle shape primitives , 1997, Computer Animation and Simulation.

[255]  Daniel Thalmann,et al.  Interactive Shape Design Using Metaballs and Splines , 1995 .

[256]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[257]  Daniel Thalmann,et al.  The HUMANOID Environment for Interactive Animation of Multiple Deformable Human Characters , 1995, Comput. Graph. Forum.

[258]  Gavriel Salvendy,et al.  Aftereffects and Sense of Presence in Virtual Environments: Formulation of a Research and Development Agenda , 1998, Int. J. Hum. Comput. Interact..

[259]  Steve C. Maddock,et al.  Real-Time Inverse Kinematics: The Return of the Jacobian , 2004 .

[260]  Barnabás Takács,et al.  The Virtual Human Interface: A Photorealistic Digital Human , 2003, IEEE Computer Graphics and Applications.

[261]  Thomas Martin Deserno,et al.  Subject-Based Regional Anaesthesia Simulator Combining Image Processing and Virtual Reality , 2007, Bildverarbeitung für die Medizin.

[262]  David E. Hardt,et al.  Determining Muscle Forces in the Leg During Normal Human Walking—An Application and Evaluation of Optimization Methods , 1978 .