Educational software usability: Artifact or Design?

Online educational technologies and e‐learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e‐learning tool success is based on more than just user satisfaction and preliminary learning outcomes—rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e‐learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e‐learning tool success. To assess the usability of an e‐learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e‐learning tool use is essential in ensuring e‐learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e‐learning tool's life cycle. Anat Sci Educ 10: 190–199. © 2016 American Association of Anatomists.

[1]  Aymeric Guillot,et al.  Effectiveness of three‐dimensional digital animation in teaching human anatomy in an authentic classroom context , 2014, Anatomical sciences education.

[2]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[3]  Paul Anderson,et al.  Design and Implementation of Augmented Reality Environment for Complex Anatomy Training: Inguinal Canal Case Study , 2009, HCI.

[4]  A. Khurana,et al.  The anatomy of anatomy: A review for its modernization , 2010, Anatomical sciences education.

[5]  Giovanni Mandarano,et al.  Less is more: Development and evaluation of an interactive e‐atlas to support anatomy learning , 2015, Anatomical sciences education.

[6]  Nigel Bevan.  Using the Common Industry Format to Document the Context of Use , 2013, HCI.

[7]  John Sandars,et al.  Twelve Tips on usability testing to develop effective e-learning in medical education , 2010, Medical teacher.

[8]  Lauren K. Allen,et al.  Development of an interactive anatomical three‐dimensional eye model , 2015, Anatomical sciences education.

[9]  Douglas J Gould,et al.  A usability study of users' perceptions toward a multimedia computer‐assisted learning tool for neuroanatomy , 2008, Anatomical sciences education.

[10]  Heather Kimberly Holden.  Assessing teachers' acceptance and usage behavior of current job -related technologies , 2009 .

[11]  John Sandars,et al.  The importance of usability testing to allow e-Learning to reach its potential for medical education , 2010, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors.

[12]  S. Daniel,et al.  Can virtual reality improve anatomy education? A randomised controlled study of a computer‐generated three‐dimensional anatomical ear model , 2006, Medical education.

[13]  Scotty D. Craig,et al.  Usability evaluation of intelligent tutoring system , 2015 .

[14]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[15]  Masaaki Kurosu,et al.  Human-Computer Interaction. Human-Centred Design Approaches, Methods, Tools, and Environments , 2013, Lecture Notes in Computer Science.

[16]  Heather K. Holden,et al.  Understanding the Influence of Perceived Usability and Technology Self-Efficacy on Teachers’ Technology Acceptance , 2011 .

[17]  Michel C. Desmarais,et al.  Toward a Refined Paradigm for Architecting Usable Systems , 2009, Human-Centered Software Engineering.

[18]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[19]  Kevin Fung,et al.  Development of a computer‐assisted cranial nerve simulation from the visible human dataset , 2011, Anatomical sciences education.

[20]  Maria Virvou,et al.  On the usability and likeability of virtual reality games for education: The case of VR-ENGAGE , 2008, Comput. Educ..

[21]  Monika Kastner,et al.  Usability evaluation of a clinical decision support tool for osteoporosis disease management , 2010, Implementation science : IS.

[22]  Anne Patry,et al.  The development of interactive online learning tools for the study of Anatomy , 2008, Medical teacher.

[23]  I. E. Allen,et al.  Grade Level: Tracking Online Education in the United States. , 2015 .

[24]  Mark Terrell,et al.  Anatomy of learning: instructional design principles for the anatomical sciences. , 2006, Anatomical record. Part B, New anatomist.

[25]  Peter Rich,et al.  A “Do‐It‐Yourself” interactive bone structure module: Development and evaluation of an online teaching resource , 2013, Anatomical sciences education.

[26]  Jørgen G. Nielsen,et al.  Two New Bathyl Neobythites spp. from the Caribbean Sea (Pisces, Ophidiidae) , 1994 .

[27]  V. Mathiowetz,et al.  Comparison of a gross anatomy laboratory to online anatomy software for teaching anatomy , 2016, Anatomical sciences education.

[28]  Hae-Deok Song,et al.  Make E-Learning Effortless! Impact of a Redesigned User Interface on Usability through the Application of an Affordance Design Approach , 2015, J. Educ. Technol. Soc..

[29]  Teresa Roselli,et al.  An approach to usability evaluation of e-learning applications , 2006, Universal Access in the Information Society.

[30]  Wojciech Pawlina,et al.  Virtual pelvic anatomy simulator: a pilot study of usability and perceived effectiveness. , 2010, The Journal of surgical research.

[31]  Yvonne Steinert,et al.  Development and impact evaluation of an e-learning radiation oncology module. , 2012, International journal of radiation oncology, biology, physics.

[32]  John Sandars,et al.  E‐learning: the essential usability perspective , 2013, The clinical teacher.

[33]  Wilhelm Kirch,et al.  Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older , 2014, Journal of medical Internet research.

[34]  George Ghinea,et al.  Software development methods and usability: Perspectives from a survey in the software industry in Norway , 2008, Interact. Comput..

[35]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[36]  Gustavo Faria de Oliveira,et al.  Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability , 2015, Int. J. Medical Informatics.

[37]  I. E. Allen,et al.  Going the Distance: Online Education in the United States, 2011. , 2011 .

[38]  Jodie Jenkinson,et al.  Interpreting three-dimensional structures from two-dimensional images: a web-based interactive 3D teaching model of surgical liver anatomy. , 2009, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[39]  Alexander W. Wiseman,et al.  The Impact and Transformation of Education Policy in China , 2011 .

[40]  Jennifer Preece,et al.  Predicting quality in educational software: Evaluating For Learning, Usability and the Synergy between Them , 1999, Interact. Comput..

[41]  William D Hendricson,et al.  Evaluation of a 3-D interactive tooth atlas by dental students in dental anatomy and endodontics courses. , 2010, Journal of dental education.

[42]  Clyde W. Holsapple,et al.  Defining, Assessing, and Promoting E‐Learning Success: An Information Systems Perspective* , 2006 .

[43]  R. Garrett.  The observatory on borderless higher education , 2003 .

[44]  G. Norman,et al.  Virtual reality and brain anatomy: a randomised trial of e‐learning instructional designs , 2007, Medical education.

[45]  Richard E. Mayer,et al.  Cognitive Theory of Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[46]  Vivian H. Wright,et al.  Improving Online Course Design through Usability Testing , 2010 .

[47]  Timothy D Wilson,et al.  A head in virtual reality: Development of a dynamic head and neck model , 2009, Anatomical sciences education.

[48]  R. Mayer.  Applying the science of learning: evidence-based principles for the design of multimedia instruction. , 2008, The American psychologist.

[49]  Jakob Nielsen,et al.  The usability engineering life cycle , 1992, Computer.

[50]  Jan Bosch,et al.  Architecting for usability: a survey , 2004, J. Syst. Softw..

[51]  Patricia S O'Sullivan,et al.  Comparison of traditional methods with 3D computer models in the instruction of hepatobiliary anatomy , 2011, Anatomical sciences education.

[52]  Luca Botturi,et al.  MiLE : Systematic Usability Evaluation for E-learning Web Applications , 2004 .

[53]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[54]  Cary J. Roseth,et al.  Human cadavers Vs. multimedia simulation: A study of student learning in anatomy , 2014, Anatomical sciences education.

[55]  Curtis J. Bonk,et al.  Applying collaborative and e-learning tools to military distance learning: A research framework , 2000 .

[56]  Kevin Fung,et al.  Three-dimensional educational computer model of the larynx: voicing a new direction. , 2009, Archives of otolaryngology--head & neck surgery.

[57]  Deepa A. Mathew.  A Mobile Tablet App for Clinical Evaluation and Medical Education: Development and Usability Evaluation , 2012 .

[58]  Alain Abran,et al.  Usability Meanings and Interpretations in ISO Standards , 2003, Software Quality Journal.

[59]  Author,et al.  (RECHPEC) of UNESCO Asia and Pacific Regional Bureau for Education , 1994 .

[60]  Timothy D. Wilson,et al.  Virtual cerebral ventricular system: An MR‐based three‐dimensional computer model , 2011, Anatomical sciences education.

[61]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[62]  Laura K. Allen,et al.  The Writing Pal Intelligent Tutoring System: Usability Testing and Development , 2014 .

[63]  Frederic Venail,et al.  Enhancement of temporal bone anatomy learning with computer 3D rendered imaging softwares , 2010, Medical teacher.

[64]  Jon Cornwall,et al.  Evaluation of free i-applications for tertiary level gross anatomy education. , 2012, The Australasian medical journal.

[65]  Timothy D Wilson,et al.  Explorable three‐dimensional digital model of the female pelvis, pelvic contents, and perineum for anatomical education , 2010, Anatomical sciences education.

[66]  Ann Harrington,et al.  E-learning & information communication technology (ICT) in nursing education: A review of the literature. , 2014, Nurse education today.

[67]  J. Sweller,et al.  Cognitive load theory in health professional education: design principles and strategies , 2010, Medical education.

[68]  Aaron Marcus,et al.  User Interface Design's Return on Investment: Examples and Statistics , 2005 .

[69]  Stuart Stewart,et al.  Mobile technology: Creation and use of an iBook to teach the anatomy of the brachial plexus , 2015, Anatomical sciences education.

[70]  April Richardson-Hatcher,et al.  The cranial nerve skywalk: A 3D tutorial of cranial nerves in a virtual platform , 2014, Anatomical sciences education.

[71]  Alison F. Doubleday,et al.  The virtual anatomy laboratory: Usability testing to improve an online learning resource for anatomy education , 2011, Anatomical sciences education.

[72]  Jianfeng Lu,et al.  A Multimodal Virtual Anatomy E-Learning Tool for Medical Education , 2010, Edutainment.

[73]  Dongsong Zhang,et al.  Interactive Multimedia-Based E-Learning: A Study of Effectiveness , 2005 .

[74]  W. Lawton,et al.  Horizon scanning: what will higher education look like in 2020? , 2013 .

[75]  Sarah B. Williams,et al.  “Let's Get Physical”: Advantages of a physical model over 3D computer models and textbooks in learning imaging anatomy , 2013, Anatomical sciences education.

[76]  B. Wainman,et al.  The relative effectiveness of computer‐based and traditional resources for education in anatomy , 2013, Anatomical sciences education.

[77]  Andreas Holzinger,et al.  Usability engineering methods for software developers , 2005, CACM.

[78]  L. Cooke,et al.  Connecting usability education and research with industry needs and practices , 2005, IEEE Transactions on Professional Communication.

[79]  John Holden.  Taking action when things go wrong , 2009 .

[80]  Alfredo Soeiro,et al.  ASSESSMENT OF HIGHER EDUCATION LEARNING OUTCOMES - AHELO - FEASIBILITY STUDY REPORT. VOLUME 1 - DESIGN AND IMPLEMENTATION , 2012 .

[81]  Christopher Hass,et al.  A Practical Guide to Usability Testing , 2019, Consumer Informatics and Digital Health.

[82]  Roy Eagleson,et al.  Evaluation of an online three‐dimensional interactive resource for undergraduate neuroanatomy education , 2016, Anatomical sciences education.

[83]  Andrina Granic,et al.  Usability Testing and Expert Inspections Complemented by Educational Evaluation: A Case Study of an e-Learning Platform , 2011, J. Educ. Technol. Soc..

[84]  Beth Dietz-Uhler,et al.  Designing Online Courses to Promote Student Retention , 2007 .

[85]  Henry Been-Lirn Duh,et al.  Usability evaluation for mobile device: a comparison of laboratory and field tests , 2006, Mobile HCI.

[86]  Sergio L. Toral Marín,et al.  A technological acceptance of e-learning tools used in practical and laboratory teaching, according to the European higher education area 1 , 2008, Behav. Inf. Technol..

[87]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[88]  Bipasha Choudhury,et al.  Virtual reality anatomy: Is it comparable with traditional methods in the teaching of human forearm musculoskeletal anatomy? , 2011, Anatomical sciences education.

[89]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[90]  H. Rex Hartson,et al.  Remote evaluation for post-deployment usability improvement , 1998, AVI '98.

[91]  W. Noyes.  United Nations Educational, Scientific and Cultural Organization , 1946, International Organization.

[92]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[93]  Alex Koohang,et al.  Architecting Usability Properties in the E-Learning Instructional Design Process , 2004 .

[94]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[95]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[96]  John A McNulty,et al.  Evaluation of computer‐aided instruction in a gross anatomy course: A six‐year study , 2009, Anatomical sciences education.

[97]  Jean Scholtz,et al.  Quantifying Usability: The Industry Usability Reporting Project , 2002 .

[98]  Sunhea Choi,et al.  Interactive radiological anatomy eLearning solution for first year medical students: Development, integration, and impact on learning , 2014, Anatomical sciences education.

[99]  Johannes De Smedt,et al.  On the Move to Meaningful Internet Systems , 2014 .

[100]  Joseph S. Dumas,et al.  Usability assessment methods , 2006 .

[101]  K Bo Foreman,et al.  Design and utility of a web-based computer-assisted instructional tool for neuroanatomy self-study and review for physical and occupational therapy graduate students. , 2005, Anatomical record. Part B, New anatomist.

[102]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[103]  Chih-Hung Wu,et al.  The influence of using affective tutoring system in accounting remedial instruction on learning performance and usability , 2014, Comput. Hum. Behav..

[104]  Jean Vanderdonckt,et al.  Human-Centered Software Engineering - Software Engineering Models, Patterns and Architectures for HCI , 2009, Human-Computer Interaction Series.

[105]  Jakob Nielsen,et al.  Usability , 2009 .