Analyzing the usability of the WYRED Platform with undergraduate students to improve its features

The WYRED ecosystem is a technological ecosystem developed as part of WYRED (netWorked Youth Research for Empowerment in the Digital society), a European Project funded by the Horizon 2020 program. The main aim of the project is to provide a framework for research in which children and young people can express and explore their perspectives and interests concerning digital society. The WYRED ecosystem supports this framework from a technological point of view. The WYRED Platform is one of the main software components of this complex technological solution; it is focused on supporting the social dialogues that take place between children, young people and stakeholders. The ecosystem, and in particular the Platform, are already developed, but it is vital to ensure the acceptance by the final users, the children and young people mainly. This work presents the usability test carried out to evolve the Platform through the System Usability Scale. This usability test allows the identification of the weaknesses of the Platform regarding its characteristics, also allowing the corresponding improvement of the WYRED Platform, and it will serve as a reference for further usability testing.

[1]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[2]  Harry N. Boone,et al.  Analyzing Likert Data , 2012, Journal of Extension.

[3]  Francisco José García-Peñalvo,et al.  Preface of Open Source Solutions for Knowledge Management and Technological Ecosystems , 2016 .

[4]  Tom Mens,et al.  Studying Evolving Software Ecosystems based on Ecological Models , 2014, Evolving Software Systems.

[5]  Jakob Nielsen,et al.  Prioritizing Web Usability , 2006 .

[6]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[7]  F. Nachira.  Towards a Network of Digital Business Ecosystems Fostering the Local Development , 2002 .

[8]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[9]  Taro Yamane.  Statistics: An Introductory Analysis , 1965 .

[10]  Mircea Lungu,et al.  Towards reverse engineering software ecosystems , 2008, 2008 IEEE International Conference on Software Maintenance.

[11]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[12]  Francisco J. García-Peñalvo,et al.  The evolution of the technological ecosystems: an architectural proposal to enhancing learning processes , 2013, TEEM '13.

[13]  Elizabeth Chang,et al.  Digital Ecosystems A Next Generation of the Collaborative Environment , 2006, iiWAS.

[14]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[15]  Francisco J. García-Peñalvo,et al.  Interaction Design Principles in WYRED Platform , 2017, HCI.

[16]  Walt Scacchi,et al.  Analyzing software licenses in open architecture software systems , 2009, 2009 ICSE Workshop on Emerging Trends in Free/Libre/Open Source Software Research and Development.

[17]  Alicia Garca-Holgado,et al.  Architectural pattern to improve the definition and implementation of eLearning ecosystems , 2016 .

[18]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[19]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[20]  Chen Wu,et al.  Exploring a Digital Ecosystem Conceptual Model and Its Simulation Prototype , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[21]  Wes McKinney,et al.  pandas: a Foundational Python Library for Data Analysis and Statistics , 2011 .

[22]  Kraig Finstad.  The system usability scale and non-native English speakers , 2006 .

[23]  Francisco J. García-Peñalvo,et al.  Delphi study to identify the young people priorities about digital society , 2018, TEEM.

[24]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[25]  María Luisa Sein-Echaluce,et al.  Epistemological and ontological spirals: From individual experience in educational innovation to the organisational knowledge in the university sector , 2015, Program.

[26]  Francisco J. García-Peñalvo,et al.  Networked youth research for empowerment in digital society: the WYRED project , 2016, TEEM.

[27]  Walt Scacchi,et al.  The Role of Software Licenses in Open Architecture Ecosystems , 2009, IWSECO@ICSR.

[28]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[29]  Mircea Lungu,et al.  Reverse engineering software ecosystems , 2009 .

[30]  Francisco J. García-Peñalvo,et al.  Preliminary validation of the metamodel for developing learning ecosystems , 2017, TEEM.

[31]  Francisco J. García-Peñalvo,et al.  A Metamodel Proposal for Developing Learning Ecosystems , 2017, HCI.

[32]  Francisco J. García-Peñalvo,et al.  Knowledge Spirals in Higher Education Teaching Innovation , 2014, Int. J. Knowl. Manag..

[33]  Antonio M. Seoane Pardo,et al.  GRIAL (GRupo de investigación en InterAcción y eLearning), USAL , 2012 .

[34]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[35]  Philip T. Kortum,et al.  Measuring the Usability of Mobile Applications for Phones and Tablets , 2015, Int. J. Hum. Comput. Interact..

[36]  Jeff Sauro,et al.  Quantifying the User Experience, Second Edition: Practical Statistics for User Research , 2016 .

[37]  Stefano Federici,et al.  Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience , 2015, Int. J. Hum. Comput. Interact..

[38]  Francisco José García-Peñalvo,et al.  Presentation of the paper “Human Interaction in Learning Ecosystems based on Open Source Solutions” in HCII 2018 , 2018 .

[39]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[40]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[41]  Enrique Rubio Royo,et al.  Web Knowledge Turbine as a Proposal for Personal and Professional Self-Organisation in Complex Times: Application to Higher Education , 2018, J. Inf. Technol. Res..

[42]  Alicia Garcia-Holgado,et al.  Architectural pattern for the definition of eLearning ecosystems based on Open Source developments , 2014, 2014 International Symposium on Computers in Education (SIIE).

[43]  Andrew Muddimer,et al.  The effect of experience on system usability scale ratings , 2012 .