Behavioural Biometrics in VR: Identifying People from Body Motion and Relations in Virtual Reality

Every person is unique, with individual behavioural characteristics: how one moves, coordinates, and uses their body. In this paper we investigate body motion as behavioural biometrics for virtual reality. In particular, we look into which behaviour is suitable to identify a user. This is valuable in situations where multiple people use a virtual reality environment in parallel, for example in the context of authentication or to adapt the VR environment to users' preferences. We present a user study (N=22) where people perform controlled VR tasks (pointing, grabbing, walking, typing), monitoring their head, hand, and eye motion data over two sessions. These body segments can be arbitrarily combined into body relations, and we found that these movements and their combination lead to characteristic behavioural patterns. We present an extensive analysis of which motion/relation is useful to identify users in which tasks using classification methods. Our findings are beneficial for researchers and practitioners alike who aim to build novel adaptive and secure user interfaces in virtual reality.

[1]  Robert J. Teather,et al.  A system for evaluating 3D pointing techniques , 2012, VRST '12.

[2]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[3]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[4]  Colin Ware,et al.  An evaluation of an eye tracker as a device for computer input2 , 1987, CHI 1987.

[5]  Philippe Coiffet,et al.  Virtual Reality Technology , 1992 .

[6]  Song Wang,et al.  Person Identification Using Full-Body Motion and Anthropometric Biometrics from Kinect Videos , 2012, ECCV Workshops.

[7]  C. Ware,et al.  An evaluation of an eye tracker as a device for computer input2 , 1987, CHI '87.

[8]  Zhaoxiang Zhang,et al.  A Survey of On-line Signature Verification , .

[9]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[10]  Xiang-Yang Li,et al.  SilentSense: silent user identification via touch and movement behavioral biometrics , 2013, MobiCom.

[11]  Wenyao Xu,et al.  Brain Password: A Secure and Truly Cancelable Brain Biometrics for Smart Headwear , 2018, MobiSys.

[12]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[13]  L. Miles,et al.  2000 , 2000, RDH.

[14]  Florian Alt,et al.  Improving Accuracy, Applicability and Usability of Keystroke Biometrics on Mobile Touchscreen Devices , 2015, CHI.

[15]  Antonio Krüger,et al.  Selection-based Text Entry in Virtual Reality , 2018, CHI.

[16]  J. Massion.  Movement, posture and equilibrium: Interaction and coordination , 1992, Progress in Neurobiology.

[17]  H. Hussmann,et al.  Seamless and Secure VR: Adapting and Evaluating Established Authentication Systems for Virtual Reality , 2017 .

[18]  Richard Matovu,et al.  Unsure How to Authenticate on Your VR Headset?: Come on, Use Your Head! , 2018, IWSPA@CODASPY.

[19]  Mark Billinghurst,et al.  Spatial Information Displays on a Wearable Computer , 1998, IEEE Computer Graphics and Applications.

[20]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[21]  Larry S. Davis,et al.  View-invariant Estimation of Height and Stride for Gait Recognition , 2002, Biometric Authentication.

[22]  Heinrich Hußmann,et al.  Touch me once and i know it's you!: implicit authentication based on touch screen patterns , 2012, CHI.

[23]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[24]  James S. Lipscomb,et al.  Making nested rotations convenient for the user , 1978, SIGGRAPH.

[25]  Yunhong Wang,et al.  A Survey of Advances in Biometric Gait Recognition , 2011, CCBR.

[26]  E. Brenner,et al.  Combining eye and hand in search is suboptimal , 2009, Experimental Brain Research.

[27]  Pedro Lopes,et al.  Proprioceptive Interaction , 2015, CHI.

[28]  Ricardo Matsumura de Araújo,et al.  Person Identification Using Anthropometric and Gait Data from Kinect Sensor , 2015, AAAI.

[29]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[30]  V. Gurfinkel,et al.  [Control elements of voluntary movements]. , 1967, Biofizika.

[31]  F. Tenore,et al.  Low-cost electroencephalogram (EEG) based authentication , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[32]  Sean Banerjee,et al.  Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments , 2018, MMM.

[33]  Georgios Kambourakis,et al.  Introducing touchstroke: keystroke-based authentication system for smartphones , 2016, Secur. Commun. Networks.

[34]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[35]  Wen Hu,et al.  GaitLock: Protect Virtual and Augmented Reality Headsets Using Gait , 2019, IEEE Transactions on Dependable and Secure Computing.

[36]  Senaka Buthpitiya,et al.  Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts , 2015, CHI.

[37]  G. Jantzen.  1988 , 1988, The Winning Cars of the Indianapolis 500.

[38]  Mark S. Nixon,et al.  Using comparative human descriptions for soft biometrics , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[39]  Ashwin Ashok,et al.  Whose move is it anyway? Authenticating smart wearable devices using unique head movement patterns , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[40]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[41]  Qun Li,et al.  GlassGesture: Exploring head gesture interface of smart glasses , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[42]  James S. Okolica,et al.  User identification and authentication using multi-modal behavioral biometrics , 2014 .

[43]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[44]  John Shawe-Taylor,et al.  Handbook of Phenomenology and Cognitive Science , 1996 .

[45]  Ivan Martinovic,et al.  Evaluating Behavioral Biometrics for Continuous Authentication: Challenges and Metrics , 2017, AsiaCCS.

[46]  Jiankun Hu,et al.  Continuous Authentication Using Eye Movement Response of Implicit Visual Stimuli , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[47]  Mark Lehto,et al.  A review of: “Virtual Reality Technology” Grigore Burdea and Philippe Coiffet John Wiley & Sons, Inc., 1994 , 1996 .

[48]  E. Jeges,et al.  Measuring human height using calibrated cameras , 2008, 2008 Conference on Human System Interactions.

[49]  Robert J. Teather,et al.  Pointing at 3D targets in a stereo head-tracked virtual environment , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).