SpinalLog: Visuo-Haptic Feedback in Musculoskeletal Manipulation Training

Current techniques for teaching spinal mobilisation follow the traditional classroom approach: an instructor demonstrates a technique and students attempt to emulate it by practising on each other while receiving feedback from the instructor. This paper introduces SpinalLog, a novel tangible user interface (TUI) for teaching and learning spinal mobilisation. The system was co-designed with physiotherapy experts to look and feel like a human spine, supporting the learning of mobilisation techniques through real-time visual feedback and deformation based passive haptic feedback. We evaluated Physical Fidelity, Visual Feedback, and Passive Haptic Feedback in an experiment to understand their effects on physiotherapy students' ability to replicate a mobilisation pattern recorded by an expert. We found that simultaneous feedback has the largest effect, followed by passive haptic feedback. The high fidelity of the interface has little effect, but it plays an important role in the perception of the system's benefit.

[1]  S Kumar,et al.  Use of a spinal model to quantify the forces and motion that occur during therapists' tests of spinal motion. , 1995, Physical therapy.

[2]  Hyunjeong Lee,et al.  Evaluation of human tangential force input performance , 2012, CHI.

[3]  Woohun Lee,et al.  Motion Echo Snowboard: Enhancing Body Movement Perception in Sport via Visually Augmented Feedback , 2016, Conference on Designing Interactive Systems.

[4]  Keith Nesbitt Designing multi-sensory displays for abstract data , 2003 .

[5]  Faisal Taher,et al.  An Empirical Characterization of Touch-Gesture Input-Force on Mobile Devices , 2014, ITS '14.

[6]  Hugo Fuks,et al.  Qualitative activity recognition of weight lifting exercises , 2013, AH.

[7]  Steven van de Par,et al.  Temporal interval discrimination thresholds depend on perceived synchrony for audio-visual stimulus pairs. , 2009, Journal of experimental psychology. Human perception and performance.

[8]  Marcus Carter,et al.  HandLog: a deformable tangible device for continuous input through finger flexion , 2016, OZCHI.

[9]  R. Schmidt,et al.  Knowledge of results and motor learning: a review and critical reappraisal. , 1984, Psychological bulletin.

[10]  Shoichi Hasegawa,et al.  SPIDAR G&G: A Two-Handed Haptic Interface for Bimanual VR Interaction , 2004 .

[11]  Ross T. Smith,et al.  Digital foam interaction techniques for 3D modeling , 2008, VRST '08.

[12]  Martin Descarreaux,et al.  Kinetic analysis of expertise in spinal manipulative therapy using an instrumented manikin. , 2005, Journal of chiropractic medicine.

[13]  J. Adams,et al.  A closed-loop theory of motor learning. , 1971, Journal of motor behavior.

[14]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[15]  Geehyuk Lee,et al.  Force gestures: augmenting touch screen gestures with normal and tangential forces , 2011, UIST.

[16]  Timothy R. Coles,et al.  Investigating Augmented Reality Visio-Haptic Techniques for Medical Training , 2011 .

[17]  Michael Rohs,et al.  Characteristics of pressure-based input for mobile devices , 2010, CHI.

[18]  Ross T. Smith,et al.  Tech Note: Digital Foam , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[19]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[20]  Makoto Sato,et al.  Tension based 7-DOF force feedback device: SPIDAR-G , 2002, Proceedings IEEE Virtual Reality 2002.

[21]  Stephen A. Brewster,et al.  Pressure-based menu selection for mobile devices , 2010, Mobile HCI.

[22]  Hans-Werner Gellersen,et al.  MotionMA: motion modelling and analysis by demonstration , 2013, CHI.

[23]  Jeffrey C. Ives Motor Behavior: Connecting Mind and Body for Optimal Performance , 2013 .

[24]  Hrvoje Benko,et al.  LightGuide: projected visualizations for hand movement guidance , 2012, CHI.

[25]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[26]  B. Stainsby,et al.  Learning spinal manipulation: A best-evidence synthesis of teaching methods. , 2016, The Journal of chiropractic education.

[27]  Frank Vetere,et al.  Onebody: Remote Posture Guidance System using First Person View in Virtual Environment , 2016, NordiCHI.

[28]  Yang Zhang,et al.  Passive Haptic Training to Improve Speed and Performance on a Keypad , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[29]  Hiroshi Ishii,et al.  Andantino: Teaching Children Piano with Projected Animated Characters , 2016, IDC.

[30]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[31]  Daniel Medeiros,et al.  SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback , 2016, IUI.

[32]  Darren A Rivett,et al.  Learning lumbar spine mobilization: the effects of frequency and self-control of feedback. , 2012, The Journal of orthopaedic and sports physical therapy.

[33]  Kai Kunze,et al.  Towards performance feedback through tactile displays to improve learning archery , 2015, UbiComp/ISWC Adjunct.