Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps

The education system evolves and transforms towards interactive and immersive learning tools in this digital age. Augmented reality has also evolved as a ubiquitous, robust, and effective technology for providing innovative educational tools. In engineering education, many abstract concepts require technological intervention for conceptual understanding and better instructional content. While learning through the immersive tools, system usability has great importance in terms of effectiveness, efficiency, and satisfaction. Effectiveness refers to users' accuracy and completeness in achieving defined goals; efficiency relates to expended resources about the precision and completeness with which users achieve their objectives; satisfaction deals with a positive attitude towards using the product. If the system fails to provide good usability, it may cause adverse effects such as increasing stress, lacking necessary features, increasing the users' cognitive load, and negatively impacting the student's motivation. In this study, two mobile augmented reality (MAR) applications were developed as an instructional tool to teach the students about Karnaugh maps in the digital electronics course. The first application is a Keypad-based MAR application that uses a keypad matrix for user interaction and the second application is a Marker-based MAR application that uses multiple markers to solve K-Map for producing an optimum solution of the given problem. An experimental study was conducted to determine the student's opinion of the developed MAR applications. The study was designed to determine the system usability of the two MAR applications using the System Usability Score (SUS) and Handheld Augmented Reality Usability Score (HARUS) models. 90 engineering students participated in the study, and they were randomly divided into two different groups: keypad-based group and Marker-based group. The keypad-based group included 47 students who had hands-on experience with a keypad-based MAR application, whereas the marker-based group included 43 students who had hands-on experience with multiple marker-based MAR applications. The experimental outcomes indicated that the keypad-based MAR application has better SUS and HARUS scores than the marker-based MAR application which suggests that the keypad-based MAR application has provided better user interaction.

[1]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Panayiotis Zaphiris,et al.  Learning and Collaboration Technologies: Third International Conference, LCT 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings , 2016, HCI.

[3]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[4]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[5]  Vicente Nacher,et al.  Evaluating a tactile and a tangible multi-tablet gamified quiz system for collaborative learning in primary education , 2018, Comput. Educ..

[6]  Ann Heylighen,et al.  How relative absolute can be: SUMI and the impact of the nature of the task in measuring perceived software usability , 2007, AI & SOCIETY.

[7]  Alex Koohang,et al.  Users' views about the usability of digital libraries , 2005, Br. J. Educ. Technol..

[8]  Hanifah Muslimah Az-zahra,et al.  Evaluating E-marketplace Mobile Application Based on People At the Center of Mobile Application Development (PACMAD) Usability Model , 2019, 2019 International Conference on Sustainable Information Engineering and Technology (SIET).

[9]  Marta S. Tabares-Betancur,et al.  A systematic mapping review of context-aware analysis and its approach to mobile learning and ubiquitous learning processes , 2021, Comput. Sci. Rev..

[10]  Yucong Duan,et al.  Towards Measuring of E-Learning Usability through User Interface , 2013, 2013 Second IIAI International Conference on Advanced Applied Informatics.

[11]  Maiga Chang,et al.  Smart learning environments , 2015 .

[12]  Poorva Gohiya,et al.  E -learning during Covid 19 Pandemic. , 2020 .

[13]  Kenneth D. Eason,et al.  Ergonomic perspectives on advances in human-computer interaction , 1991 .

[14]  Laura M. Leventhal,et al.  Universal Usability , 2008, Web Accessibility.

[15]  Omid Noroozi,et al.  Introduction paper special issue computers in human behavior multidisciplinary innovations and technologies for facilitation of self-regulated learning , 2019, Comput. Hum. Behav..

[16]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[17]  Amit Kumar,et al.  Impact of Flipped Learning Approach on Students Motivation for Learning Digital Electronics Course , 2020, Integration of Education.

[18]  Chiu-Lin Lai,et al.  Trends and research issues of mobile learning studies in nursing education: A review of academic publications from 1971 to 2016 , 2018, Comput. Educ..

[19]  Ben Horan,et al.  A Framework Utilizing Augmented Reality to Enhance the Teaching–Learning Experience of Linear Control Systems , 2018, IETE Journal of Research.

[20]  Leonardo Frizziero,et al.  Augmented Reality for virtual user manual , 2018 .

[21]  Murat Selek,et al.  Implementation of the augmented reality to electronic practice , 2020, Comput. Appl. Eng. Educ..

[22]  Juan Villegas-Cortez,et al.  A smartphone‐based augmented reality system for university students for learning digital electronics , 2019, Comput. Appl. Eng. Educ..

[23]  Zainab H. Majeed,et al.  A review of augmented reality in educational applications , 2020 .

[24]  Panayiotis Zaphiris,et al.  Learning and Collaboration Technologies , 2015, Lecture Notes in Computer Science.

[25]  Ramazan Yilmaz,et al.  Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classroom , 2017, Comput. Hum. Behav..

[26]  Archana Mantri,et al.  Development of an augmented reality‐based scaffold to improve the learning experience of engineering students in embedded system course , 2020, Comput. Appl. Eng. Educ..

[27]  Christian Sandor,et al.  A usability scale for handheld augmented reality , 2014, VRST '14.

[28]  Chi-Chang Chen,et al.  Effects of an augmented reality-based educational game on students' learning achievements and attitudes in real-world observations , 2016, Interact. Learn. Environ..

[29]  Archana Mantri,et al.  Evaluating the impact of the augmented reality learning environment on electronics laboratory skills of engineering students , 2019, Comput. Appl. Eng. Educ..

[30]  Chih-Hung Chen,et al.  An augmented reality-based learning approach to enhancing students' science reading performances from the perspective of the cognitive load theory , 2018, Br. J. Educ. Technol..

[31]  Kevin White,et al.  Augmented reality in education and training: pedagogical approaches and illustrative case studies , 2018, J. Ambient Intell. Humaniz. Comput..

[32]  Min-Chai Hsieh,et al.  Establishment and Usability Evaluation of an Interactive AR Learning System on Conservation of Fish , 2011 .

[33]  James R. Lewis,et al.  The System Usability Scale: Past, Present, and Future , 2018, Int. J. Hum. Comput. Interact..

[34]  Murat Akçayır,et al.  Advantages and challenges associated with augmented reality for education: A systematic review of the literature , 2017 .

[35]  Oscar de Bruijn,et al.  The effects of visual information on users' mental models: an evaluation of pathfinder analysis as a measure of icon usability. , 2001 .

[36]  Gwo-Jen Hwang,et al.  Impacts of an augmented reality-based flipped learning guiding approach on students' scientific project performance and perceptions , 2018, Comput. Educ..

[37]  Kurt Squire,et al.  Mad City Mystery: Developing Scientific Argumentation Skills with a Place-based Augmented Reality Game on Handheld Computers , 2007 .

[38]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..