Mixed-methods research: a new approach to evaluating the motivation and satisfaction of university students using advanced visual technologies

Abstract A mixed-methods study evaluating the motivation and satisfaction of Architecture degree students using interactive visualization methods is presented in this paper. New technology implementations in the teaching field have been largely extended to all types of levels and educational frameworks. However, these innovations require approval validation and evaluation by the final users, the students. In this paper, the advantages and disadvantages of applying mixed evaluation technology are discussed in a case study of the use of interactive and collaborative tools for the visualization of 3D architectonical models. The main objective was to evaluate Architecture and Building Science students’ the motivation to use and satisfaction with this type of technology and to obtain adequate feedback that allows for the optimization of this type of experiment in future iterations.

[1]  Christopher Cunningham,et al.  Gamification by Design - Implementing Game Mechanics in Web and Mobile Apps , 2011 .

[2]  Ernesto Redondo Domínguez,et al.  Uso de la Realidad Aumentada como Plataforma Educativa en la Visualización Arquitectónica. Evaluación del Grado de Satisfacción y Usabilidad por parte del Alumnado , 2012 .

[3]  Emmanuel Tsekleves,et al.  Investigating pay-as-you-go to address issues of trust, privacy and security around media use at home , 2013, Universal Access in the Information Society.

[4]  Marc Aurel Schnabel,et al.  Mixed Reality In Architecture, Design, And Construction , 2008 .

[5]  K. Brazil,et al.  Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research , 2002, Quality & quantity.

[6]  J. Castellar,et al.  Un método para el estudio experimental de las emociones: el International Affective Picture System (IAPS). Adaptación española , 1999 .

[7]  David Fonseca,et al.  Visualization Methods in Architecture Education Using 3D Virtual Models and Augmented Reality in Mobile and Social Networks , 2013 .

[8]  Daniel M. Russell.  Ubiquitous search for smart workspaces , 2011, Universal Access in the Information Society.

[9]  Jiejie Zhu,et al.  Virtual Reality and Mixed Reality for Virtual Learning Environments , 2006, Edutainment.

[10]  Donna Rogers,et al.  A paradigm shift: Technology integration for higher education in the new millennium , 2000 .

[11]  Jesús Valverde Berrocoso,et al.  ENSEÑAR Y APRENDER CON TECNOLOGÍAS: UN MODELO TEÓRICO PARA LAS BUENAS PRÁCTICAS EDUCATIVAS CON TIC , 2010 .

[12]  John Milliken,et al.  Teaching and technology in higher education: student perceptions and personal reflections , 2002, Comput. Educ..

[13]  David Fonseca,et al.  Relación entre calidad percibida y afinidad emocional de imágenes arquitectónicas en función del dispositivo de visualización. Recomendaciones para su uso docente. , 2013 .

[14]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[15]  Dag Svanæs,et al.  Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users , 2012, Universal Access in the Information Society.

[16]  Ramón Flecha García,et al.  Revista Electrónica Teoría de la Educación. Educación y Cultura en La Sociedad de la Información. , 2009 .

[17]  Miguel Nussbaum,et al.  Implementing collaborative learning activities in the classroom supported by one-to-one mobile computing: A design-based process , 2011, J. Syst. Softw..

[18]  Hans van Buuren,et al.  What stimulates teachers to integrate ICT in their pedagogical practices? The use of digital learning materials in education , 2013, Comput. Hum. Behav..

[19]  David Fonseca,et al.  User Experiences and Differences in Viewing Architectural Images with Various Interfaces , 2011, Int. J. Creative Interfaces Comput. Graph..

[20]  Austin Henderson,et al.  What you see, some of what's in the future, and how we go about doing it: HI at Apple Computer , 1995, CHI 95 Conference Companion.

[21]  Rosa María Rodríguez Izquierdo.  EL IMPACTO DE LAS TIC EN LA TRANSFORMACIÓN DE LA ENSEÑANZA UNIVERSITARIA: REPENSAR LOS MODELOS DE ENSEÑANZA Y APRENDIZAJE , 2010 .

[22]  David Fonseca,et al.  Relationship between student profile, tool use, participation, and academic performance with the use of Augmented Reality technology for visualized architecture models , 2014, Comput. Hum. Behav..

[23]  N. Bolger,et al.  Diary methods: capturing life as it is lived. , 2003, Annual review of psychology.

[24]  David Fonseca,et al.  Architectural Geo-E-Learning - Geolocated Teaching in Urban Environments with Mobile Devices: A Case Study and Work in Progress , 2013, HCI.

[25]  Panayiotis Zaphiris,et al.  Applying qualitative content analysis to study online support communities , 2010, Universal Access in the Information Society.

[26]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[27]  Víctor Abella García,et al.  Creación de un blog educativo como herramienta TIC e instrumento TAC en el ámbito universitario , 2011 .

[28]  Abbas Tashakkori,et al.  Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences , 2008 .

[29]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[30]  Kavita E. Thomas.  Investigation of age-differentiated spatial semantic elaboration strategies for communicating route instructions , 2012, Universal Access in the Information Society.

[31]  Chris Dede,et al.  Emerging influences of information technology on school curriculum , 2000 .

[32]  Pedro M. Vallejo.  Estadística aplicada a las ciencias sociales , 2008 .

[33]  Markel Vigo,et al.  Quantitative assessment of mobile web guidelines conformance , 2011, Universal Access in the Information Society.

[34]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..

[35]  Dino Bouchlaghem,et al.  Visualisation in architecture, engineering and construction (AEC) , 2005 .

[36]  David Fonseca,et al.  Alfabetización digital para la enseñanza de la arquitectura. Un estudio de caso Digital literacy for the teaching of architecture. A case study , 2012 .

[37]  Dirk T. Tempelaar,et al.  Investigating the relations between motivation, tool use, participation, and performance in an e-learning course using web-videoconferencing , 2013, Comput. Hum. Behav..

[38]  João Barroso,et al.  Providing accessibility to blind people using GIS , 2011, Universal Access in the Information Society.

[39]  Elena Fariña Vargas,et al.  BUENAS PRÁCTICAS DE AULAS VIRTUALES EN LA DOCENCIA UNIVERSITARIA SEMIPRESENCIAL , 2010 .

[40]  Hui Wang,et al.  Distributed Augmented Reality for Visualizing Collaborative Construction Tasks , 2009 .

[41]  Matthew J. Koehler,et al.  Teachers’ Technological Pedagogical Content Knowledge and Learning Activity Types , 2009 .

[42]  Vittorio F. Guidano,et al.  Constructivist psychotherapy: A theoretical framework. , 1995 .

[43]  R. B. Johnson,et al.  Educational Research: Quantitative, Qualitative, and Mixed Approaches , 2007 .

[44]  Bao-Yu Hu,et al.  Integrating technology into higher education , 2006, J. Educ. Technol. Soc..

[45]  Rosa María Rodríguez Izquierdo.  EL IMPACTO DE LAS TIC EN LA TRANSFORMACIÓN DE LA ENSEÑANZA UNIVERSITARIA: REPENSAR LOS MODELOS DE ENSEÑANZA Y APRENDIZAJE THE IMPACT OF ICT IN THE TRANSFORMATION OF UNIVERSITY TEACHING: RETHINKING THE MODELS OF TEACHING AND LEARNING , 2010 .

[46]  Dan Wang,et al.  Why are children attracted to the Internet? The role of need satisfaction perceived online and perceived in daily real life , 2013, Comput. Hum. Behav..

[47]  Margaret Volante.  Qualitative research. , 2008, Nurse researcher.

[48]  Jesús Valverde Berrocoso,et al.  ENSEÑAR Y APRENDER CON TECNOLOGÍAS: UN MODELO TEÓRICO PARA LAS BUENAS PRÁCTICAS CON TIC , 2015 .

[49]  Oscar Tomico,et al.  Bipolar laddering (BLA): a participatory subjective exploration method on user experience , 2007, DUX '07.

[50]  David FONSECA,et al.  QR-CODES APPLIED TO ARCHITECTURE DATA AND TEACHING , 2011 .

[51]  Carsten Röcker.  Universal access to awareness information: using smart artefacts to mediate awareness in distributed teams , 2011, Universal Access in the Information Society.

[52]  A. W. Bates,et al.  Effective Teaching with Technology in Higher Education: Foundations for Success , 2003 .

[53]  David Georgina,et al.  Integration of technology in higher education: A review of faculty self-perceptions , 2008, Internet High. Educ..

[54]  Xiangyu Wang,et al.  Compatibility issues in Augmented Reality systems for AEC: An experimental prototype study , 2006 .

[55]  Javier Irizarry,et al.  InfoSPOT: A mobile Augmented Reality method for accessing building information through a situation awareness approach , 2013 .

[56]  Peter C. Wright,et al.  Introduction: from usability to enjoyment , 2005 .

[57]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[58]  L. Shulman.  Those Who Understand: Knowledge Growth in Teaching , 1986 .

[59]  David J. Silverman,et al.  Qualitative Research, 3rd edition , 2010 .

[60]  Willem J. Pelgrum,et al.  Pedagogy and ICT Use : In Schools Around the World Findings from the IEA Sites 2006 Study , 2008 .

[61]  Donal A. Norman,et al.  La psicología de los objetos cotidianos , 1990 .

[62]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[63]  Catherine T. Amelink,et al.  Quantitative, Qualitative, and Mixed Research Methods in Engineering Education , 2009 .

[64]  Fabio Pittarello.  Accessing information through multimodal 3D environments: towards universal access , 2003, Universal Access in the Information Society.

[65]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[66]  P. Hekkert,et al.  Design and emotion : the experience of everyday things , 2004 .

[67]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[68]  Nm Bouchlaghem,et al.  From CAD to virtual reality: standards, data exchange and interactive 3D building design tools , 2000 .

[69]  Judi Harris,et al.  What Is Technological Pedagogical Content Knowledge , 2009 .

[70]  Marylène Gagné,et al.  Understanding e-learning continuance intention in the workplace: A self-determination theory perspective , 2008, Comput. Hum. Behav..

[71]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[72]  Francisco Gutiérrez,et al.  Comprensión lectora y memoria operativa: un estudio evolutivo , 1997 .

[73]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[74]  Javier Moltó.  Un nuevo método para el estudio experimental de las emociones: el International Affective Picture System (IAPS). Adaptación española. Baremos nacionales , 2000 .

[75]  Herman Neuckermans,et al.  IMPROVING ARCHITECTURAL DESIGN ANALYSIS USING 3D MODELING AND VISUALIZATION TECHNIQUES , 2008, VSMM 2008.

[76]  J. Salinas.  Innovación docente y uso de las TIC en la enseñanza universitaria , 2004 .

[77]  James H. McMillan,et al.  Educational Research: Fundamentals for the Consumer. Second Edition. , 1996 .

[78]  Cristina Guilarte Martín-Calero.  Innovación docente: docencia y TICs , 2008 .

[79]  Robert A. Neimeyer,et al.  Constructivism in Psychotherapy , 1995, Journal of Cognitive Psychotherapy.

[80]  Martin G Helander,et al.  Hedonomics—affective human factors design , 2003, Ergonomics.

[81]  David Fonseca,et al.  Developing an augmented reality application in the framework of architecture degree , 2012, UXeLATE '12.

[82]  M. Rivas,et al.  Estadística aplicada a las ciencias sociales , 1989 .

[83]  Anthony J. Onwuegbuzie,et al.  Typology of Analytical and Interpretational Errors in Quantitative and Qualitative Educational Research , 2003 .

[84]  Maia Engeli,et al.  "living-room": interactive, space-oriented augmented reality , 2004, MULTIMEDIA '04.