Action capture with accelerometers

We create a performance animation system that leverages the power of low-cost accelerometers, readily available motion capture databases, and construction techniques from e-textiles. Our system, built with only off-the-shelf parts, consists of five accelerometers sewn into a comfortable shirt that streams data to a computer. The accelerometer readings are continuously matched against accelerations computed from existing motion capture data, and an avatar is animated with the closest match. We evaluate our system visually and using simultaneous motion and accelerometer capture.

[1]  Sang-Hyun Cho,et al.  Wearable Accelerometer System for Measuring the Temporal Parameters of Gait , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, ACM Trans. Graph..

[3]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[4]  Neil Gershenfeld,et al.  E-broidery: Design and fabrication of textile-based computing , 2000, IBM Syst. J..

[5]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[6]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[7]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.

[8]  Jihong Lee,et al.  Sensor fusion and calibration for motion captures using accelerometers , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Jörn Loviscach,et al.  A Mobile Low-Cost Motion Capture System Based on Accelerometers , 2006, ISVC.

[10]  Paul A. Viola,et al.  Learning silhouette features for control of human motion , 2004, SIGGRAPH '04.

[11]  Ramesh Raskar,et al.  Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators , 2007, ACM Trans. Graph..

[12]  Peter H Veltink,et al.  Accelerometer and rate gyroscope measurement of kinematics: an inexpensive alternative to optical motion analysis systems. , 2002, Journal of biomechanics.

[13]  Joan Truckenbrod.  IEEE international symposium on wearable computers , 1998, COMG.

[14]  Markus H. Gross,et al.  Combining body sensors and visual sensors for motion training , 2005, ACE '05.

[15]  A. Rissanen,et al.  Physical Inactivity and Obesity: A Vicious Circle , 2008, Obesity.

[16]  Dinesh K. Pai,et al.  FootSee: an interactive animation system , 2003, SCA '03.

[17]  Patrick Boissy,et al.  User-based motion sensing and fuzzy logic for automated fall detection in older adults. , 2007, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[18]  Kenneth Mackenzie,et al.  The wearable motherboard: a framework for personalized mobile information processing (PMIP) , 2002, DAC '02.

[19]  C. Cobelli,et al.  A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach , 2006, Annals of Biomedical Engineering.

[20]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[21]  Gerhard Tröster,et al.  SMASH: a distributed sensing and processing garment for the classification of upper body postures , 2008, BODYNETS.

[22]  Leah Buechley,et al.  A Construction Kit for Electronic Textiles , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[23]  Luca Benini,et al.  MOCA: A Low-Power, Low-Cost Motion Capture System Based on Integrated Accelerometers , 2007, Adv. Multim..

[24]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[25]  Paul Lukowicz,et al.  PadNET: wearable physical activity detection network , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[26]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[27]  Ramesh Raskar,et al.  Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators , 2007, SIGGRAPH 2007.