Factors that influence academics’ intention to use mobile-based assessment in Higher Education in South Pacific

This Research Full paper presents finding of factors influencing the use of mobile-based assessments in higher education. With the growing popularity of mobile learning in higher education, there exists a potential of using mobile devices to deliver various types of assessments. The study aimed to find out factors influencing the adoption of mobile-based assessments, perspectives on types of assessments suitable to deliver such assessments and challenges faced by academics and students in South Pacific in using these assessments. An online survey was created using the case study approach with a blend of quantitative and qualitative questions assisted by Technology acceptance (TAM) and unified theory of acceptance and use of technology (UTAUT) models. The factors from TAM and UTAUT considered for this study were perceived usefulness, behavioral intension to use, perceived trust and attitude by introducing output quality and social influence as external variables. The participants (n = 35) comprised of science, business and economics, arts, law, education and technical and further education academics from a higher education institute in the South Pacific. The study revealed that focusing on mobile assessment quality design and trust are the important factors for academics to accept mobile-based assessments in higher education. Furthermore, game-based, self-and peer, classroom polling, formative, adaptive and personalized assessments were the types of assessment preferred by academics to be delivered through the mobile devices. The major challenges identified for academics were connectivity, lack of skills in designing effective mobile-based assessments, lack of e-teaching pedagogy and student cheating issues. For students’ the major challenges identified by academics were internet connectivity, device availability, distractions and device competency, readability and disability issues.

[1]  Anastasios A. Economides,et al.  Mobile-based assessment: Investigating the factors that influence behavioral intention to use , 2017, Comput. Educ..

[2]  Liu Liu,et al.  Exploring consumer perceived risk and trust for online payments: An empirical study in China's younger generation , 2015, Comput. Hum. Behav..

[3]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[4]  Bibhya Sharma,et al.  Effectiveness of tablet learning in online courses at University of the South Pacific , 2015, 2015 2nd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[5]  Kinshuk,et al.  Factors Impacting Teachers' Adoption of Mobile Learning , 2014, J. Inf. Technol. Educ. Res..

[6]  Dany Laveault,et al.  OECD Reviews of Evaluation and Assessment in Education: New Zealand 2011 , 2012 .

[7]  Muhammad Saleem Vighio,et al.  Extending UTAUT2 toward acceptance of mobile learning in the context of higher education , 2019, Universal Access in the Information Society.

[8]  Helen Crompton,et al.  The use of mobile learning in higher education: A systematic review , 2018, Comput. Educ..

[9]  Wynne W. Chin,et al.  On the use, usefulness, and ease of use of structural equation modeling in MIS research: a note of caution , 1995 .

[10]  Jeffrey R. Stowell,et al.  Use of clickers vs. mobile devices for classroom polling , 2015, Comput. Educ..

[11]  Jerry Chih-Yuan Sun,et al.  Influence of polling technologies on student engagement: An analysis of student motivation, academic performance, and brainwave data , 2014, Comput. Educ..

[12]  Julia Miller,et al.  Mobile learning in higher education: A comparative analysis of developed and developing country contexts , 2019, Br. J. Educ. Technol..

[13]  Chi-Cheng Chang,et al.  Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course , 2011, Comput. Educ..

[14]  S. Almalki,et al.  Integrating Quantitative and Qualitative Data in Mixed Methods Research--Challenges and Benefits. , 2016 .

[15]  Miguel P Caldas,et al.  Research design: qualitative, quantitative, and mixed methods approaches , 2003 .

[16]  Anastasios A. Economides,et al.  Factors that influence behavioral intention to use mobile-based assessment: A STEM teachers' perspective , 2019, Br. J. Educ. Technol..

[17]  B. Sharma,et al.  Mobile Learning Readiness and ICT Competency: A Case Study of Senior Secondary School Students in the Pacific Islands , 2017, 2017 4th Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[18]  M. Ehren,et al.  OECD reviews of evaluation and assessment in education: Luxembourg 2012 , 2012 .

[19]  Ahmad Abu-Al-Aish,et al.  International of Research in Open and Distributed Learning Factors Influencing Students’ Acceptance of M-Learning: An Investigation in Higher Education , 2022 .

[20]  Gavin Jahir Khan,et al.  Anonymous online peer assessment in an undergraduate course: An analysis of Students’ perceptions and attitudes in the South Pacific , 2019, 2019 IEEE International Conference on Engineering, Technology and Education (TALE).

[21]  Hüseyin Uzunboylu,et al.  Teacher perception for m-learning: scale development and teachers' perceptions , 2011, J. Comput. Assist. Learn..

[22]  I-Fan Liu,et al.  An Exploration into Improving Examinees' Acceptance of Participation in an Online Exam , 2015, J. Educ. Technol. Soc..

[23]  Ravneil Nand,et al.  Smart Learning in the Pacific: Design of New Pedagogical Tools , 2018, 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[24]  B. Waldrip,et al.  Upper Secondary Bruneian Science Students’ Perceptions of Assessment , 2007 .

[25]  Fernando Almeida,et al.  STRATEGIES TO PERFORM A MIXED METHODS STUDY , 2018 .

[26]  Tzu-Chien Liu,et al.  The effects of integrating mobile devices with teaching and learning on students' learning performance: A meta-analysis and research synthesis , 2016, Comput. Educ..

[27]  Anastasios A. Economides,et al.  The effect of emotional feedback on behavioral intention to use computer based assessment , 2012, Comput. Educ..

[28]  Sung Youl Park,et al.  University students' behavioral intention to use mobile learning: Evaluating the technology acceptance model , 2012, Br. J. Educ. Technol..

[29]  Ji-Hwan Lee,et al.  EFFECTS OF TRUST AND PERCEIVED RISK ON USER ACCEPTANCE OF A NEW TECHNOLOGY SERVICE , 2013 .

[30]  Gwo-Jen Hwang,et al.  An interactive peer-assessment criteria development approach to improving students' art design performance using handheld devices , 2015, Comput. Educ..

[31]  Alf Inge Wang,et al.  The wear out effect of a game-based student response system , 2015, Comput. Educ..

[32]  M. Mohammadi,et al.  Mobile Phone Use in Education and Learning by Faculty Members of Technical-Engineering Groups: Concurrent Mixed Methods Design , 2020, Frontiers in Education.

[33]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[34]  Michael M. Grant,et al.  Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media , 2013, Internet High. Educ..

[35]  Min Kyu Kim,et al.  Teacher Beliefs and Technology Integration. , 2013 .

[36]  Kleopatra Nikolopoulou,et al.  Secondary education teachers’ perceptions of mobile phone and tablet use in classrooms: benefits, constraints and concerns , 2020 .

[37]  Paul Black.  Formative assessment in the learning and teaching of design and technology , 2008 .

[38]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[39]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[40]  Juan José García,et al.  The importance of perceived trust, security and privacy in online trading systems , 2009, Inf. Manag. Comput. Secur..

[41]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[42]  Anastasios A. Economides,et al.  Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018 , 2018, Comput. Educ..

[43]  Laurel Evelyn Dyson,et al.  Mobile learning in higher education in the Asia-Pacific region: harnessing trends and challenging orthodoxies , 2017 .

[44]  Bibhya N. Sharma,et al.  Effectiveness of online presence in a blended higher learning environment in the Pacific , 2020, Studies in Higher Education.

[45]  Bibhya Sharma,et al.  Mobile Learning Perception and Attitude of Secondary School Students in the Pacific Islands , 2018, PACIS.

[46]  Bibhya Sharma,et al.  Student Readiness and Perception to the Use of Smart Phones for Higher Education in the Pacific , 2016, 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).