Interfacing human and computer with wireless body area sensor networks: the WiMoCA solution

Wireless Body Area Sensor Networks (WBASN) are an emerging technology enabling the design of natural human–computer interfaces (HCI). Automatic recognition of human motion, gestures, and activities is studied in several contexts. For example, mobile computing technology is being considered as a replacement of traditional input systems. Moreover, body posture and activity monitoring can be used for entertainment and health-care applications. However, until now, little work has been done to develop flexible and efficient WBASN solutions suitable for a wide range of applications. Their requirements pose new challenges for sensor network designs, such as optimizing traditional solutions for use as environmental monitoring-like applications and developing on-the-field stress tests. In this paper, we demonstrate the flexibility of a custom-designed WBASN called WiMoCA with respect to a wide range of posture and activity recognition applications by means of practical implementation and on-the-field testing. Nodes of the network mounted on different parts of the human body exploit tri-axial accelerometers to detect its movements. The advanced digital Micro-electro-mechanical system (MEMS) based inertial sensor has been chosen for WiMoCA because it demonstrated high flexibility of use in many different situations, providing the chance to exploit both static and dynamic acceleration components for different purposes. Furthermore, the sensibility and accuracy of the sensing element is perfectly adequate for monitoring human movement, while keeping cost low and size compact, thus meeting our requirements. We implemented three types of applications, stressing the WBASN in many aspects. In fact, they are characterized by different requirements in terms of accuracy, timeliness, and computation distributed on sensing nodes. For each application, we describe its implementation, and we discuss results about performance and power consumption.

[1]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[2]  F. Horak,et al.  Effects of deep brain stimulation and levodopa on postural sway in Parkinson's disease , 2002, Journal of neurology, neurosurgery, and psychiatry.

[3]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[4]  Randy H. Katz,et al.  Emerging challenges: Mobile networking for “Smart Dust” , 2000, Journal of Communications and Networks.

[5]  Joseph A. Paradiso,et al.  Shoe-integrated sensor system for wireless gait analysis and real-time feedback , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[6]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[7]  P H Veltink,et al.  Detection of static and dynamic activities using uniaxial accelerometers. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[9]  Carolina Cruz-Neira,et al.  Developing an integrated wireless system for fully immersive virtual reality environments , 2004, Eighth International Symposium on Wearable Computers.

[10]  Davide Cattaneo,et al.  Head control: volitional aspects of rehabilitation training in patients with multiple sclerosis compared with healthy subjects. , 2005, Archives of physical medicine and rehabilitation.

[11]  G M Lyons,et al.  Accelerometers in rehabilitation medicine for older adults. , 2005, Age and ageing.

[12]  Kamiar Aminian,et al.  Motion Analysis in Clinical Practice Using Ambulatory Accelerometry , 1998, CAPTECH.

[13]  Luca Benini,et al.  Gesture Signature for Ambient Intelligence Applications: A Feasibility Study , 2006, Pervasive.

[14]  Lorenzo Chiari,et al.  Audio-biofeedback for balance improvement: an accelerometry-based system , 2005, IEEE Transactions on Biomedical Engineering.

[15]  Kristofer S. J. Pister,et al.  Acceleration Sensing Glove , 1999 .

[16]  K. Thorngren,et al.  Standing balance in hip fracture patients. 20 middle-aged patients compared with 20 healthy subjects. , 1991, Acta orthopaedica Scandinavica.

[17]  Kamiar Aminian,et al.  Stair climbing detection during daily physical activity using a miniature gyroscope. , 2005, Gait & posture.

[18]  Heikki Ailisto,et al.  Identifying users of portable devices from gait pattern with accelerometers , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[19]  Deborah Estrin,et al.  Proceedings of the 1st international conference on Embedded networked sensor systems , 2003 .

[20]  B. E. Maki,et al.  Postural control in the older adult. , 1996, Clinics in geriatric medicine.

[21]  Luca Benini,et al.  Bio-feedback system for rehabilitation based on a wireless body area network , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[22]  Neal Lesh,et al.  Indoor navigation using a diverse set of cheap, wearable sensors , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[23]  Zhaoying Zhou,et al.  A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package. , 2004, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Taketoshi Mori,et al.  Portable orientation estimation device based on accelerometers, magnetometers and gyroscope sensors for sensor network , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[25]  Luca Benini,et al.  3dID: a low-power, low-cost hand motion capture device , 2006, Proceedings of the Design Automation & Test in Europe Conference.

[26]  Michael Zyda,et al.  Design and implementation of MARG sensors for 3-DOF orientation measurement of rigid bodies , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[27]  Beatrice Gralton,et al.  Washington DC - USA , 2008 .

[28]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[29]  M. Grgic,et al.  A survey of biometric recognition methods , 2004, Proceedings. Elmar-2004. 46th International Symposium on Electronics in Marine.

[30]  Lui Sha,et al.  Real-time communication and coordination in embedded sensor networks , 2003, Proc. IEEE.

[31]  Luca Benini,et al.  Design and implementation of WiMoCA node for a body area wireless sensor network , 2005, 2005 Systems Communications (ICW'05, ICHSN'05, ICMCS'05, SENET'05).

[32]  George Coulouris,et al.  Supporting gestural input for users on the move , 2003 .

[33]  E. Taub,et al.  Objective measurement of functional upper-extremity movement using accelerometer recordings transformed with a threshold filter. , 2000, Stroke.

[34]  R. Moe-Nilssen,et al.  A new method for evaluating motor control in gait under real-life environmental conditions. Part 1: The instrument. , 1998, Clinical biomechanics.

[35]  Deborah Estrin,et al.  An energy-efficient MAC protocol for wireless sensor networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[36]  L. Benini,et al.  A low-power motion capture system with integrated accelerometers [gesture recognition applications] , 2004, First IEEE Consumer Communications and Networking Conference, 2004. CCNC 2004..

[37]  J. B. J. Bussmann,et al.  Measuring daily behavior using ambulatory accelerometry: The Activity Monitor , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[38]  Kenji Mase,et al.  Recognition of walking behaviors for pedestrian navigation , 2001, Proceedings of the 2001 IEEE International Conference on Control Applications (CCA'01) (Cat. No.01CH37204).

[39]  Paul Lukowicz,et al.  PadNET: wearable physical activity detection network , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[40]  D. Winter,et al.  Unified theory regarding A/P and M/L balance in quiet stance. , 1996, Journal of neurophysiology.

[41]  Joseph A. Paradiso FootNotes: Personal Reflections on the Development of Instrumented Dance Shoes and their Musical Applications , 2000 .

[42]  Michael A. Riley,et al.  Dynamic patterns of postural sway in ballet dancers and track athletes , 2005, Experimental Brain Research.

[43]  Luca Benini,et al.  Pervasive computing for interactive virtual heritage , 2005, IEEE MultiMedia.

[44]  Aleksandar Milenkovic,et al.  Journal of Neuroengineering and Rehabilitation Open Access a Wireless Body Area Network of Intelligent Motion Sensors for Computer Assisted Physical Rehabilitation , 2005 .

[45]  Lui Sha,et al.  An implicit prioritized access protocol for wireless sensor networks , 2002, 23rd IEEE Real-Time Systems Symposium, 2002. RTSS 2002..

[46]  Merryn J Mathie,et al.  Accelerometry: providing an integrated, practical method for long-term, ambulatory monitoring of human movement , 2004, Physiological measurement.

[47]  Ian Oakley,et al.  Tilt and Feel: Scrolling with Vibrotactile Display , 2004 .

[48]  Michael Harrington,et al.  WearTrack: a self-referenced head and hand tracker for wearable computers and portable VR , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[49]  Koen Langendoen,et al.  An adaptive energy-efficient MAC protocol for wireless sensor networks , 2003, SenSys '03.

[50]  Adrian David Cheok,et al.  Micro-accelerometer based hardware interfaces for wearable computer mixed reality applications , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.