EXPLORING MULTIMEDIA PRINCIPLES FOR SUPPORTING CONCEPTUAL LEARNING OF ELECTRICITY AND MAGNETISM WITH VISUOHAPTIC SIMULATIONS

This paper explores multimedia principles for a visuohaptic simulation-based approach to improve students’ understanding of electricity and magnetism concepts. The study implemented different multimedia principles for incorporating visuohaptic simulations for learning guided byMultimedia Learning Theory. This study compared the use of visuohaptic simulations to a visual-only simulation and to instructional multimedia-only materials. The results indicated that students in the visuohaptic simulation group out-performed students in the visual-only simulation group and the instructional multimedia-only group; although not significantly. This paper discusses implications for teaching and learning with touch technologies.

[1]  James Minogue,et al.  Measuring the Impact of Haptic Feedback Using the SOLO Taxonomy , 2009 .

[2]  M. Gail Jones,et al.  Learning at the nanoscale: The impact of students' use of remote microscopy on concepts of viruses, scale, and microscopy , 2003 .

[3]  George E. Glasson,et al.  The effects of hands-on and teacher demonstration laboratory methods on science achievement in relation to reasoning ability and prior knowledge , 1989 .

[4]  Joseph Biederman,et al.  ADHD and Dyscalculia , 2005, Journal of learning disabilities.

[5]  Konrad J. Schönborn,et al.  Exploring relationships between students' interaction and learning with a haptic virtual biomolecular model , 2011, Comput. Educ..

[6]  Autumn B. Hostetter,et al.  Visible embodiment: Gestures as simulated action , 2008, Psychonomic bulletin & review.

[7]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[8]  Thomas R. Tretter,et al.  Haptic Augmentation of Science Instruction: Does Touch Matter? , 2006 .

[9]  G. Révész,et al.  Psychology and art of the blind , 1950 .

[10]  H. Gelhorn,et al.  The Co-occurrence of Reading Disorder and ADHD , 2012, Journal of learning disabilities.

[11]  Sara Druyan.  Effect of the kinesthetic conflict on promoting scientific reasoning , 1997 .

[12]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Principles for Reducing Extraneous Processing in Multimedia Learning : Coherence, Signaling, Redundancy, Spatial Contiguity, and Temporal Contiguity Principles , 2005 .

[13]  Rolf Ploetzner,et al.  What contributes to the split-attention effect? The role of text segmentation, picture labelling, and spatial proximity , 2010 .

[14]  Bedrich Benes,et al.  A Review of Simulators with Haptic Devices for Medical Training , 2016, Journal of Medical Systems.

[15]  Z. Zacharia,et al.  Physical and Virtual Laboratories in Science and Engineering Education , 2013, Science.

[16]  Lara M. Triona,et al.  Point and Click or Grab and Heft: Comparing the Influence of Physical and Virtual Instructional Materials on Elementary School Students' Ability to Design Experiments , 2003 .

[17]  Bekele Gashe Dega,et al.  Students' conceptual change in electricity and magnetism using simulations: A comparison of cognitive perturbation and cognitive conflict , 2013 .

[18]  Thenkurussi Kesavadas,et al.  Motor skill training assistance using haptic attributes , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[19]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[20]  Lennart Thurfjell,et al.  Haptic interaction with virtual objects: the technology and some applications , 2002 .

[21]  Cristian Raduta,et al.  General students' misconceptions related to Electricity and Magnetism , 2005, physics/0503132.

[22]  John Cohen.  The World of Touch , 1952, Nature.

[23]  Jenaro Guisasola,et al.  Difficulties in learning the concept of electric field , 1998 .

[24]  J. Hedberg.  The Cambridge handbook of multimedia learning , 2007 .

[25]  Raquel Viciana-Abad,et al.  Effects of Co-location and Crossmodal Interaction between Haptic, Auditory and Visual Cues in Presence , 2008, EuroHaptics.

[26]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[27]  Bruce Sherwood,et al.  Restructuring the introductory electricity and magnetism course , 2006 .

[28]  J. Sweller.  COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[29]  Bedrich Benes,et al.  Undergraduate students’ conceptual interpretation and perceptions of haptic-enabled learning experiences , 2017, International Journal of Educational Technology in Higher Education.

[30]  Virginie Albe,et al.  Electromagnetic Concepts in Mathematical Representation of Physics , 2001 .

[31]  Richard E. Mayer,et al.  Multimedia Learning: INTRODUCTION TO MULTIMEDIA LEARNING , 2009 .

[32]  Igal Galili,et al.  Mechanics background influences students’ conceptions in electromagnetism , 1995 .

[33]  Sabine U. König,et al.  Embodied cognition , 2018, 2018 6th International Conference on Brain-Computer Interface (BCI).

[34]  Tsuneo Yoshikawa,et al.  Toward machine mediated training of motor skills. Skill transfer from human to human via virtual environment , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[35]  Karljohan E. Lundin Palmerius,et al.  The impact of feedback design in haptic volume visualization , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[36]  R. Mayer,et al.  Interactive Multimodal Learning Environments , 2007 .

[37]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[38]  Ileana María Greca,et al.  The kinds of mental representations‐‐models, propositions and images‐‐used by college physics students regarding the concept of field , 1997 .

[39]  M. Gail Jones,et al.  Putting Practice Into Theory: Changes in the Organization of Preservice Teachers’ Pedagogical Knowledge , 1996 .

[40]  Alejandra J. Magana,et al.  Investigating The Impact Of Visuohaptic Simulations For Conceptual Understanding In Electricity And Magnetism , 2013 .

[41]  Milena K. Nigam,et al.  The Equivalence of Learning Paths in Early Science Instruction: Effects of Direct Instruction and Discovery Learning , 2022 .

[42]  M. Gail Jones,et al.  The impact of haptic augmentation on middle school students’ conceptions of the animal cell , 2006, Virtual Reality.

[43]  Bat-Sheva Eylon,et al.  From problem solving to a knowledge structure: An example from the domain of electromagnetism , 1997 .

[44]  Konrad J. Schönborn,et al.  Developing an Interactive Virtual Environment for Engendering Public Understanding About Nanotechnology: From Concept to Construction , 2013 .

[45]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[46]  Mina Johnson-Glenberg,et al.  Emboldened by Embodiment , 2013 .

[47]  Kerstin Pettersson,et al.  Confusion by representation: On student’s comprehension of the electric field concept , 1993 .

[48]  M. G. Jones,et al.  Haptics in Education: Exploring an Untapped Sensory Modality , 2006 .

[49]  José Luis Zubimendi,et al.  Difficulties in Learning the Introductory Magnetic Field Theory in the First Years of University. , 2004 .

[50]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[51]  Alejandra J. Magana,et al.  Students’ Development of Representational Competence Through the Sense of Touch , 2017 .

[52]  Jeffrey David Marx,et al.  Creation of a diagnostic exam for introductory, undergraduate electricity and magnetism , 1998 .

[53]  S. Balachandran,et al.  Unpacking students' conceptualizations through haptic feedback , 2017, J. Comput. Assist. Learn..