Visuohaptic experiments: Exploring the effects of visual and haptic feedback on students’ learning of friction concepts

In this study, we analyzed students’ reasoning and explanations of friction concepts before and after engaging in guided experimentation with visuohaptic (VH) simulations. The VH experimentation included two affordances: visual cues and haptic feedback. Specifically, we analyzed the outcomes of two treatment groups with different sequences of affordance introduction. The first treatment group started with visual cues, with haptic feedback added later, while the second treatment group started with haptic feedback and added the visual cues later. We recruited 48 students who had previously taken at least one physics course. Participants completed a pre‐ and posttest assessment, which included both procedural and conceptual questions about friction before and after the guided experimentation task. The results show that the participants from both treatment groups benefited from using VH simulations. Both treatment groups showed statistically significant pre/post improvements in their understanding of friction. Moreover, both treatment groups showed a statistically significant increase in the conceptual understanding of friction concepts from pretest to posttest with moderate to strong effect sizes. Implications for laboratory instruction are also discussed.

[1]  T. A. Harris,et al.  On Effective Methods to Teach Mechanical Design , 1995 .

[2]  James Minogue,et al.  Measuring the Impact of Haptic Feedback Using the SOLO Taxonomy , 2009 .

[3]  Mitchell J. Nathan,et al.  The Real Story Behind Story Problems: Effects of Representations on Quantitative Reasoning , 2004 .

[4]  Alejandra J. Magana,et al.  A sequenced multimodal learning approach to support students' development of conceptual learning , 2019, J. Comput. Assist. Learn..

[5]  Thomas W. Shiland.  Probing for Understanding. , 2002 .

[6]  B. Rittle-Johnson,et al.  Developing Conceptual Understanding and Procedural Skill in Mathematics: An Iterative Process. , 2001 .

[7]  Peggy Noel Van Meter,et al.  Applying knowledge from educational psychology and cognitive science to a first course in thermodynamics , 2011 .

[8]  R. Clark.  Media will never influence learning , 1994 .

[9]  James Minogue,et al.  Investigating Students’ Ideas About Buoyancy and the Influence of Haptic Feedback , 2016 .

[10]  Heinz Handels,et al.  Efficient patient modeling for visuo-haptic VR simulation using a generic patient atlas , 2016, Comput. Methods Programs Biomed..

[11]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .

[12]  Gábor Székely,et al.  Visuo-haptic collaborative augmented reality ping-pong , 2007, ACE '07.

[13]  William Winn,et al.  Learning Oceanography from a Computer Simulation Compared with Direct Experience at Sea. , 2006 .

[14]  Zacharias C. Zacharia,et al.  The Effects on Students’ Conceptual Understanding of Electric Circuits of Introducing Virtual Manipulatives Within a Physical Manipulatives-Oriented Curriculum , 2014 .

[15]  Geetha B. Ramani,et al.  Promoting broad and stable improvements in low-income children's numerical knowledge through playing number board games. , 2008, Child development.

[16]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[17]  Michael D. Lee,et al.  Towards a dynamic connectionist model of memory , 1997, Behavioral and Brain Sciences.

[18]  John B. Black,et al.  Incorporating haptic feedback in simulation for learning physics , 2011, Comput. Educ..

[19]  Xudong Wang,et al.  Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill , 2014, J. Biomed. Informatics.

[20]  Hong Z. Tan,et al.  EXPLORING MULTIMEDIA PRINCIPLES FOR SUPPORTING CONCEPTUAL LEARNING OF ELECTRICITY AND MAGNETISM WITH VISUOHAPTIC SIMULATIONS , 2017 .

[21]  Y. Hsu,et al.  The impacts of a web-aided instructional simulation on science learning , 2002 .

[22]  Bedrich Benes,et al.  Improving the learning of physics concepts by using haptic devices , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[23]  Alejandra J. Magana,et al.  Investigating The Impact Of Visuohaptic Simulations For Conceptual Understanding In Electricity And Magnetism , 2013 .

[24]  Michael Gasser,et al.  The Development of Embodied Cognition: Six Lessons from Babies , 2005, Artificial Life.

[25]  Zacharias C. Zacharia,et al.  Examining whether touch sensory feedback is necessary for science learning through experimentation: A literature review of two different lines of research across K-16 , 2015 .

[26]  L. Borghi,et al.  How to teach friction: Experiments and models , 2007 .

[27]  Jim Minstrell,et al.  Inquiring into Inquiry Learning and Teaching in Science , 2000 .

[28]  Miriam Reiner,et al.  Sensory Cues, Visualization and Physics Learning , 2009 .

[29]  Anders Ynnerman,et al.  Designing and Evaluating a Haptic System for Biomolecular Education , 2007, 2007 IEEE Virtual Reality Conference.

[30]  Z. Zacharia,et al.  Physical and Virtual Laboratories in Science and Engineering Education , 2013, Science.

[31]  Idalis Villanueva,et al.  Cognitive strategies and misconceptions in introductory statics problems , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[32]  Hasan Ozgur Kapici,et al.  Using Hands-On and Virtual Laboratories Alone or Together―Which Works Better for Acquiring Knowledge and Skills? , 2019, Journal of Science Education and Technology.

[33]  Jie Chao,et al.  Sensor-Augmented Virtual Labs: Using Physical Interactions with Science Simulations to Promote Understanding of Gas Behavior , 2016 .

[34]  Hong Z. Tan,et al.  An initial study of visuohaptic simulation of point-charge interactions , 2010, 2010 IEEE Haptics Symposium.

[35]  S. Petcharatana,et al.  Does computer‐assisted instruction really help to improve the learning process? , 2001, Medical education.

[36]  Dorin M. Popovici,et al.  A Survey of Visuo-Haptic Simulation in Surgical Training , 2011, ArXiv.

[37]  Helen Farley,et al.  A quest for the holy grail: tactile precision, natural movement and haptic feedback in 3D virtual spaces , 2009 .

[38]  Constantinos P. Constantinou,et al.  Comparing the influence of physical and virtual manipulatives in the context of the Physics by Inquiry curriculum: The case of undergraduate students’ conceptual understanding of heat and temperature , 2008 .

[39]  Greg Hallman,et al.  Possibilities of Haptic Feedback Simulation for Physics Learning , 2009 .

[40]  Katherine M. Steele,et al.  Feedback from in-class worksheets and discussion improves performance on the statics concept inventory , 2014 .

[41]  Peter Maurer,et al.  The Cambridge Handbook of the Learning Sciences , 2022 .

[42]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[43]  M. McHugh.  Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[44]  Lena A. E. Tibell,et al.  Do haptic representations help complex molecular learning , 2011 .

[45]  R. Gibbs.  Embodiment and Cognitive Science: Concepts , 2005 .

[46]  Dor Abrahamson,et al.  Embodiment and embodied design , 2014 .

[47]  S. Balachandran,et al.  Unpacking students' conceptualizations through haptic feedback , 2017, J. Comput. Assist. Learn..

[48]  P.S. Steif,et al.  An articulation of the concepts and skills which underlie engineering statics , 2004, 34th Annual Frontiers in Education, 2004. FIE 2004..

[49]  F. Paas,et al.  An Evolutionary Upgrade of Cognitive Load Theory: Using the Human Motor System and Collaboration to Support the Learning of Complex Cognitive Tasks , 2012 .

[50]  José Cravino,et al.  Contribution of a Computer Simulation to Students’ Learning of the Physics Concepts of Weight and Mass , 2014 .

[51]  Wen Hua Chang,et al.  A Comparison of Students’ Approaches to Inquiry, Conceptual Learning, and Attitudes in Simulation‐Based and Microcomputer‐Based Laboratories , 2014 .

[52]  Scott Danielson,et al.  Math Statics Baseline (Msb) Test: Phase I , 2002 .

[53]  Zacharias C. Zacharia,et al.  Beliefs, attitudes, and intentions of science teachers regarding the educational use of computer simulations and inquiry‐based experiments in physics , 2003 .

[54]  D. Hestenes,et al.  Force concept inventory , 1992 .

[55]  Ibrahim A. Halloun,et al.  Common sense concepts about motion , 1985 .

[56]  Miriam Reiner,et al.  Conceptual Construction of Fields Through Tactile Interface , 1999, Interact. Learn. Environ..

[57]  Alejandra J. Magana,et al.  Students’ Development of Representational Competence Through the Sense of Touch , 2017 .

[58]  Paul S. Steif,et al.  Comparisons Between Performances in a Statics Concept Inventory and Course Examinations , 2006 .

[59]  Sophie Keller,et al.  Statistics For Evidence Based Practice And Evaluation , 2016 .

[60]  Richard Dufour.  Learning by Doing: A Handbook for Professional Learning Communities at Work , 2006 .

[61]  M. Gail Jones,et al.  Learning at the nanoscale: The impact of students' use of remote microscopy on concepts of viruses, scale, and microscopy , 2003 .

[62]  Simon Penny,et al.  Embodied Mind: Cognitive Science and Human Experience by Francisco J. Varela, Evan Thompson, Eleanor Rosch (review) , 2017 .

[63]  J. Wellington.  Educational Research: Contemporary Issues and Practical Approaches , 2001 .

[64]  Z. Zacharia,et al.  The effects of an interactive computer-based simulation prior to performing a laboratory inquiry-based experiment on science teachers' conceptual understanding of physics , 2002 .

[65]  Bedrich Benes,et al.  Board # 39 : Identifying Affordances of Physical Manipulative Tools for the Design of Visuo-haptic Simulations , 2017 .

[66]  Stella Vosniadou,et al.  International handbook of research on conceptual change , 2013 .

[67]  Mirko Farina.  Supersizing the Mind: Embodiment, Action and Cognitive Extension. , 2010 .

[68]  Bedrich Benes,et al.  Undergraduate students’ conceptual interpretation and perceptions of haptic-enabled learning experiences , 2017, International Journal of Educational Technology in Higher Education.

[69]  Geetha B. Ramani,et al.  Playing linear numerical board games promotes low-income children's numerical development. , 2008, Developmental science.

[70]  Björn B. de Koning,et al.  Facilitating Understanding of Movements in Dynamic Visualizations: an Embodied Perspective , 2011 .

[71]  Russell M. Taylor,et al.  Remote atomic force microscopy of microscopic organisms: Technological innovations for hands-on science with middle and high school students , 2004 .

[72]  David J. M. Kraemer,et al.  Grounded understanding of abstract concepts: The case of STEM learning , 2017, Cognitive Research: Principles and Implications.

[73]  Richard Gunstone,et al.  The Process of Conceptual Change in 'Force and Motion'. , 1997 .

[74]  Z. C. Zacharia,et al.  Comparing and combining real and virtual experimentation: an effort to enhance students' conceptual understanding of electric circuits , 2007, J. Comput. Assist. Learn..

[75]  Richard Steinberg.  Computers in teaching science: To simulate or not to simulate? , 2000 .

[76]  Paul S. Steif,et al.  INTEGRATING EFFECTIVE GENERAL CLASSROOM TECHNIQUES WITH DOMAIN-SPECIFIC CONCEPTUAL NEEDS , 2004 .

[77]  Paul S. Steif,et al.  A Statics Concept Inventory: Development and Psychometric Analysis , 2005 .

[78]  Bedrich Benes,et al.  Exploration of affordances of visuo-haptic simulations to learn the concept of friction , 2017, 2017 IEEE Frontiers in Education Conference (FIE).

[79]  Bedrich Benes,et al.  A Review of Simulators with Haptic Devices for Medical Training , 2016, Journal of Medical Systems.

[80]  Jill A. Marshall,et al.  Preservice teachers' theory development in physical and simulated environments , 2006 .

[81]  Lara M. Triona,et al.  Point and Click or Grab and Heft: Comparing the Influence of Physical and Virtual Instructional Materials on Elementary School Students' Ability to Design Experiments , 2003 .

[82]  Stanley B Klein,et al.  What memory is. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[83]  Konrad J. Schönborn,et al.  Exploring relationships between students' interaction and learning with a haptic virtual biomolecular model , 2011, Comput. Educ..

[84]  Thomas R. Tretter,et al.  Haptic Augmentation of Science Instruction: Does Touch Matter? , 2006 .

[85]  G. Lakoff.  Philosophy in the flesh , 1999 .

[86]  M. Chi.  Three Types of Conceptual Change: Belief Revision, Mental Model Transformation, and Categorical Shift , 2009 .

[87]  Heinz Handels,et al.  A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data , 2016, IEEE Journal of Biomedical and Health Informatics.

[88]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.

[89]  Scott Danielson,et al.  Statics Concept Questions For Enhancing Learning , 2000 .

[90]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[91]  Lara K. Smetana,et al.  Simplifying Inquiry Instruction , 2005 .

[92]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[93]  Ton de Jong,et al.  Learning and Instruction with Computer Simulations: Learning Processes Involved , 1992 .