Towards standardisation of user models for simulation and adaptation purposes

The use of user models can be very valuable when trying to develop accessible and ergonomic products and services taking into account users’ specific needs and preferences. Simulation of user–product interaction using user models may reveal accessibility issues at the early stages of design and development, and this results to a significant reduction in costs and development time. Moreover, user models can be used in adaptive interfaces enabling the personalised customisation of user interfaces that enhances the accessibility and usability of products and services. This paper presents the efforts of the Virtual User Modelling and Simulation Standardisation ‘VUMS’ cluster of projects towards the development of an interoperable user model, able to describe both able-bodied and people with various kinds of disabilities. The VUMS cluster is consisted by the VERITAS, MyUI, GUIDE, and VICON FP7 European projects, all involved in user modelling from different perspectives. The main goal of the VUMS cluster was the development of a unified user model that could be used by all the participant projects and that could be the basis of a new user model standard. Currently, within the VUMS cluster, a common user model has been defined and converters that enable the transformation from each project’s specific user model to the VUMS user model and vice versa have been developed enabling, thus, the exchange of user models between the projects.

[1]  Fabio Paternò,et al.  MARIA: A universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments , 2009, TCHI.

[2]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[3]  William W. McMillan,et al.  Computing for users with special needs and models of computer-human interaction , 1992, CHI.

[4]  Richard L. Lewis,et al.  Cognitive Constraint Modeling: A Formal Approach to Supporting Reasoning About Behavior , 2004 .

[5]  G. Harris,et al.  Design and validation of an upper extremity kinematic model for application in stroke rehabilitation , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[6]  Audrey Serna,et al.  Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes , 2007, User Modeling and User-Adapted Interaction.

[7]  Terry K K Koo,et al.  In vivo determination of subject-specific musculotendon parameters: applications to the prime elbow flexors in normal and hemiparetic subjects. , 2002, Clinical biomechanics.

[8]  Constantine Stephanidis,et al.  Unified user interface design: designing universally accessible interactions , 2004, Interact. Comput..

[9]  Lars Hanson,et al.  A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles , 2009 .

[10]  Wynne A. Lee,et al.  Relative stability improves with experience in a dynamic standing task , 2000, Experimental Brain Research.

[11]  Arthur F T Mak,et al.  Feasibility of using EMG driven neuromusculoskeletal model for prediction of dynamic movement of the elbow. , 2005, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[12]  Reinhard Oppermann,et al.  Adaptively supported adaptability , 1994, Int. J. Hum. Comput. Stud..

[13]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[14]  Vincent G. Duffy,et al.  Handbook of Digital Human Modeling: Research for Applied Ergonomics and Human Factors Engineering , 2008 .

[15]  Yehya Mohamad,et al.  Supporting Inclusive Design of User Interfaces with a Virtual User Model , 2011, HCI.

[16]  Brian A. Garner,et al.  Estimation of Musculotendon Properties in the Human Upper Limb , 2003, Annals of Biomedical Engineering.

[17]  Richard L. Lewis,et al.  Generating automated predictions of behavior strategically adapted to specific performance objectives , 2006, CHI.

[18]  Federica Cena,et al.  User model interoperability: a survey , 2011, User Modeling and User-Adapted Interaction.

[19]  Fabio Paternò,et al.  Authoring pervasive multimodal user interfaces , 2008, Int. J. Web Eng. Technol..

[20]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[21]  Joëlle Coutaz,et al.  User interface plasticity: model driven engineering to the limit! , 2010, EICS '10.

[22]  Yannick Lallement,et al.  Cognitive Aspects of Neurosymbolic Integration , 2007 .

[23]  P. Johnson-Laird.  The computer and the mind: an introduction to cognitive science , 1988 .

[24]  Anthony J. Hornof,et al.  Cognitive modeling reveals menu search in both random and systematic , 1997, CHI.

[25]  Johan Stahre,et al.  A Production Simulation Tool for Joint Assessment of Ergonomics, Level of Automation and Environmental Impacts , 2008 .

[26]  Jeffrey Nichols,et al.  UNIFORM: automatically generating consistent remote control user interfaces , 2006, CHI.

[27]  Anthony Jameson,et al.  Systems That Adapt to Their Users , 2012 .

[28]  Maria Gemou,et al.  From "Design for All" Towards "Design for One" - A Modular User Interface Approach , 2007, HCI.

[29]  F. Lavaste,et al.  Functional gait analysis of trans-femoral amputees using two different single-axis prosthetic knees with hydraulic swing-phase control: Kinematic and kinetic comparison of two prosthetic knees , 2008, Prosthetics and orthotics international.

[30]  Maurice Bonney,et al.  Computer aided ergonomics design of automobiles , 1993 .

[31]  Jennifer Mankoff,et al.  Title Evaluating accessibility through simulating the experiences of user users with vision or motor impairments Authors , 2005 .

[32]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[33]  A. Newell.  Unified Theories of Cognition , 1990 .

[34]  Peter Robinson,et al.  Designing Inclusive Interfaces Through User Modeling and Simulation , 2012, Int. J. Hum. Comput. Interact..

[35]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[36]  Jeffrey Nichols,et al.  Creating a lightweight user interface description language: An overview and analysis of the personal universal controller project , 2009, TCHI.

[37]  D. Winter,et al.  Gait in the elderly , 1997 .

[38]  Taku Komura,et al.  Creating and retargetting motion by the musculoskeletal human body model , 2000, The Visual Computer.

[39]  James L. Patton,et al.  A simple model of the feasible limits to postural stability , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[40]  J. Mark Porter,et al.  Computer aided ergonomics , 1999 .

[41]  Jeffrey Nichols,et al.  Huddle: automatically generating interfaces for systems of multiple connected appliances , 2006, UIST.

[42]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[43]  Jaewon Choi,et al.  Developing a 3-Dimensional Kinematic Model of the Hand for Ergonomic Analyses of Hand Posture, Hand Space Envelope, and Tendon Excursion. , 2008 .

[44]  Y. Pai,et al.  Static versus dynamic predictions of protective stepping following waist-pull perturbations in young and older adults. , 1998, Journal of biomechanics.

[45]  Thomas P. Moran,et al.  The Command Language Grammar: A Representation for the User Interface of Interactive Computer Systems , 1981, Int. J. Man Mach. Stud..

[46]  Lars Laitila,et al.  Datormanikinprogram som verktyg vid arbetsplatsutformning : en kritisk studie av programanvändning , 2005 .

[47]  Richard L. Lewis,et al.  Supporting efficient development of cognitive models at multiple skill levels: exploring recent advances in constraint-based modeling , 2005, CHI.

[48]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[49]  R Feyen,et al.  Computer-aided ergonomics: a case study of incorporating ergonomics analyses into workplace design. , 2000, Applied ergonomics.

[50]  Vincent G. Duffy,et al.  Motion Capture for Job Risk Classifications Incorporating Dynamic Aspects of Work , 2006 .

[51]  Krzysztof Z. Gajos,et al.  Automatically generating user interfaces adapted to users' motor and vision capabilities , 2007, UIST.

[52]  Natsuki Oka,et al.  Hybrid cognitive model of conscious level processing and unconscious level processing , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[53]  Jean Vanderdonckt,et al.  A Unifying Reference Framework for multi-target user interfaces , 2003, Interact. Comput..

[54]  Kees C. J. Overbeeke,et al.  A natural human hand model , 2007, The Visual Computer.

[55]  E Pennestrì,et al.  Virtual musculo-skeletal model for the biomechanical analysis of the upper limb. , 2007, Journal of biomechanics.

[56]  Vijay Kumar,et al.  Kinematic modeling of head-neck movements , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[57]  Patrick Langdon,et al.  Developing Multimodal Adaptation Algorithm for Mobility Impaired Users by Evaluating Their Hand Strength , 2012, Int. J. Hum. Comput. Interact..

[58]  Jean-Sébastien Sottet,et al.  Model-Driven Adaptation for Plastic User Interfaces , 2007, INTERACT.

[59]  Joëlle Coutaz,et al.  CAMELEON-RT: A Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces , 2004, EUSAI.

[60]  Don B. Chaffin,et al.  Working Postures and Movements: Tools for Evaluation and Engineering , 2005 .

[61]  Allen Newell,et al.  Cognitive architectures , 1989 .

[62]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[63]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[64]  Jacob O. Wobbrock,et al.  Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces , 2008, Mobile HCI.

[65]  Krzysztof Z. Gajos,et al.  Automatically generating personalized user interfaces with Supple , 2010, Artif. Intell..

[66]  Norman I. Badler,et al.  JACK: a toolkit for manipulating articulated figures , 1988, UIST '88.

[67]  W. E. Hick.  Quarterly Journal of Experimental Psychology , 1948, Nature.

[68]  D. Winter,et al.  Kinetic analysis of the lower limbs during walking: what information can be gained from a three-dimensional model? , 1995, Journal of biomechanics.

[69]  Demetri Terzopoulos,et al.  Heads up!: biomechanical modeling and neuromuscular control of the neck , 2006, SIGGRAPH 2006.

[70]  Stephan Weibelzahl,et al.  Evaluation of Adaptive Systems , 2001, User Modeling.

[71]  Victor B. Zordan,et al.  Laughing out loud: control for modeling anatomically inspired laughter using audio , 2008, SIGGRAPH 2008.

[72]  Andreas Seidl,et al.  Ramsis - The Leading Cad Tool for Ergonomic Analysis of Vehicles , 2007, HCI.

[73]  Y. Pai,et al.  Center of mass velocity-position predictions for balance control. , 1997, Journal of biomechanics.

[74]  Matthias Peissner,et al.  MyUI: generating accessible user interfaces from multimodal design patterns , 2012, EICS '12.

[75]  Victor Ng-Thow-Hing,et al.  Dynamic Animation and Control Environment , 2005, Graphics Interface.

[76]  J Perry,et al.  Three-dimensional kinematics of wheelchair propulsion. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[77]  Keith Case,et al.  Using HADRIAN for eliciting virtual user feedback in ‘design for all’ , 2004 .

[78]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[79]  Peter Robinson,et al.  Investigating the applicability of user models for motion-impaired users , 2000, Assets '00.

[80]  Constantine Stephanidis,et al.  Adaptable and Adaptive User Interfaces for Disabled Users in the AVANTI Project , 1998, IS&N.

[81]  Philip Constantinou,et al.  Designing human-computer interfaces for quadriplegic people , 2003, TCHI.

[82]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[83]  Margaret A. Boden,et al.  Computer Models of Mind: Computational approaches in theoretical psychology , 1988 .

[84]  Eliseo Stefano Maini,et al.  Kinematic characterization of functional reach to grasp in normal and in motor disabled children. , 2007, Gait & posture.

[85]  J. Apkarian,et al.  A three-dimensional kinematic and dynamic model of the lower limb. , 1989, Journal of biomechanics.