Developing expertise of those handling temperature-sensitive pharmaceutical products using e-learning

The use of e-learning as a means of providing academic and professional education and training continues to expand. New technologies allow for innovative instructional approaches, while different instructional approaches catalyze the development of alternative technologies or the repurposing of existing ones. The effort and expense of creating e-learning courses demand that instead of a haphazard design approach or simply duplicating a course using a model that currently exists, developers consider and incorporate a valid theoretical foundation for what they produce. The purpose of this research was to create an e-learning course—based on theoretical design principles derived from the research literature—that would contribute to the expertise of those handling time- and temperature-sensitive pharmaceutical products (such as vaccines). The e-learning course was based on an existing physical course conducted annually by the World Health Organization in Turkey, but the approach adopted was based on theory and practice more appropriate to online learning. Three learning theories provided the theoretical underpinnings for the study: cognitive apprenticeship, authentic learning, and community of learners. A design-based research approach was used to conduct the study and create the e-learning solution. Draft design principles were established from the literature and consultations with practitioners, and incorporated and refined throughout the study as the e-learning solution moved from early sketches, a working “alpha” version,” and finally a field test of the working prototype. At each stage, formative evaluations were conducted with the results used to improve the subsequent iterations of the e-learning course. Interviews and surveys of the learners (participants) and instructors (mentors), learning assignments, diary entries, and researcher observations formed the data that were used and analyzed using semi-quantitative and qualitative techniques. The results were applied to improve subsequent iterations of the course design, including the user interface, learner tasks and activities, and the interactions between the mentors and participants. Additionally, the results supported the refinement and restructuring of the design principles, which was a major outcome of the research. The results of this study showed that an e-learning course could be based on an existing physical course, but in doing so, efforts should be made not to simply mirror the new course to the old, but rather to take maximum advantage of the affordances of each mode. Creating an authentic environment with authentic tasks and activities requires close consultation with practitioners in the field and a degree of suspension of disbelief by the learners which is accomplished by effectively communicating the context (or backstory) and the role(s) that they must take in accomplishing the task. While many e-learning design and development efforts emphasize the technologies to be used, the findings here place a higher emphasis on the importance of relationships that participants and mentors establish and develop as they work virtually together to accomplish authentic tasks. The outcomes of the study include an effective e-learning environment ready for implementation under real world conditions and a set of 13 refined design principles. Implications for practice cohere around the refined design principles that will provide a theoretical and practical foundation for those who develop e-learning solutions in other education and training contexts, and to assist them to incorporate authentic activities in their own e-learning solutions.

[1]  Catherine A. Hansman Context‐Based Adult Learning , 2001 .

[2]  Thomas C. Reeves,et al.  A Guide to Authentic e-Learning , 2009 .

[3]  Jan Herrington,et al.  Authentic conditions for authentic assessment: aligning task and assessment , 2006 .

[4]  Carol H. Weiss Evaluation Research: Methods of Assessing Program Effectiveness , 1972 .

[5]  Jan Herrington,et al.  Considering communities of learners when creating an E-learning course , 2012 .

[6]  David R. Olson,et al.  The Triumph of Hope Over Experience in the Search for “What Works”: A Response to Slavin , 2004 .

[7]  B. L. Smith,et al.  The Challenge of Learning Communities as a Growing National Movement. , 2001 .

[8]  Paul A. Kirschner,et al.  Authentic assessment, student and teacher perceptions: the practical value of the five‐dimensional framework , 2006 .

[9]  Mitchel Resnick,et al.  “Thick” authenticity: new media and authentic learning , 1999 .

[10]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[11]  Carol Jollie,et al.  Web based learning , 2003, BMJ : British Medical Journal.

[12]  A. Kirkwood Learning from media: arguments, analysis, and evidence , 2013 .

[13]  T. Sharot The optimism bias , 2011, Current Biology.

[14]  A. Mackay,et al.  A Dictionary of Scientific Quotations , 2019, A Dictionary of Scientific Quotations.

[15]  Johnnie E.V. Johnson,et al.  Educational Validity of Business Gaming Simulation: A Research Methodology Framework , 2010 .

[16]  S. Dreyfus,et al.  Peripheral Vision , 2005 .

[17]  John Seely Brown,et al.  Book Reviews : The Social Life of Information By John Seely Brown and Paul Duguid. Boston: Harvard Business School Press, 2000. 320 pages , 2000 .

[18]  D. Gaba The future vision of simulation in health care , 2004, Quality and Safety in Health Care.

[19]  Chi-Cheng Chang,et al.  Development of competency-based web learning material and effect evaluation of self-directed learning aptitudes on learning achievements , 2006, Interact. Learn. Environ..

[20]  Stephen M. Alessi,et al.  Fidelity in the design of instructional simulations , 1988 .

[21]  Mary K. Tallent-Runnels,et al.  Teaching Courses Online: A Review of the Research , 2006 .

[22]  S. Kaplan,et al.  On The Quantitative Definition of Risk , 1981 .

[23]  Ümit Kartoğlu,et al.  A case study in experiential learning: Pharmaceutical cold chain management on wheels* , 2010, The Journal of continuing education in the health professions.

[24]  Robyn Benson,et al.  Online Learning and Assessment in Higher Education , 2010 .

[25]  Pm Jenkinson,et al.  Cognitive , 2020, Definitions.

[26]  Paul A. Kirschner,et al.  The sociability of computer-supported collaborative learning environment , 2002, J. Educ. Technol. Soc..

[27]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[28]  Robert Maribe Branch,et al.  Instructional Design: The ADDIE Approach , 2009 .

[29]  Curtis J. Bonk The World is Open: How Web Technology Is Revolutionizing Education , 2009 .

[30]  Jan Herrington,et al.  An instructional design framework for authentic learning environments , 2000 .

[31]  Jan Herrington,et al.  Design-based research and doctoral students: Guidelines for preparing a dissertation proposal , 2007 .

[32]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[33]  M. Carter Visible learning: a synthesis of over 800 meta‐analyses relating to achievement , 2009 .

[34]  Michael W. Allen Designing Successful e-Learning: Forget What You Know About Instructional Design and Do Something Interesting , 2007 .

[35]  Jakob Nielsen,et al.  Eyetracking Web Usability , 2009 .

[36]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[37]  D. Schoen Educating the reflective practitioner , 1987 .

[38]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[39]  M. Smith Field Theory in Social Science: Selected Theoretical Papers. , 1951 .

[40]  Minhong Wang,et al.  A Performance-Oriented Approach to E-Learning in the Workplace , 2010, J. Educ. Technol. Soc..

[41]  F. Sloane Comments on Slavin: Through the Looking Glass: Experiments, Quasi-Experiments, and the Medical Model , 2008 .

[42]  Janos Sebestyen Janosy Simulation and Simulators for Nuclear Power Generation , 2011 .

[43]  Rosemary M. Lehman,et al.  Creating a Sense of Presence in Online Teaching: How to "Be There" for Distance Learners , 2010 .

[44]  Olivier Le Bohec,et al.  Procrastination, participation, and performance in online learning environments , 2011, Comput. Educ..

[45]  Thomas C. Reeves,et al.  Design research: A socially responsible approach to instructional technology research in higher education , 2005, J. Comput. High. Educ..

[46]  D. Schunk Learning Theories: An Educational Perspective , 1991 .

[47]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[48]  John D. Van Horn,et al.  The Cambridge Handbook of Expertise and Expert Performance: A Merging Theory of Expertise and Intelligence , 2006 .

[49]  Barbara S. Chaparro,et al.  Eye Gaze Patterns while Searching vs. Browsing a Website , 2007 .

[50]  Thomas C. Reeves,et al.  A model of authentic activities for online learning , 2006 .

[51]  Louis M. Gomez,et al.  Mutual benefit partnership: A curricular design for authenticity , 2001 .

[52]  S. Thompson Social Learning Theory , 2008 .

[53]  D. Cook,et al.  Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[54]  Randall W. Hill,et al.  Simulation Meets Hollywood: Integrating Graphics, Sound, Story and Character for Immersive Simulation , 2005 .

[55]  W. Clancey Representations of knowing: in defense of cognitive apprenticeship , 1992 .

[56]  A. Bandura Social cognitive theory: an agentic perspective. , 1999, Annual review of psychology.

[57]  K. A. Ericsson,et al.  The making of an expert. , 2007, Harvard business review.

[58]  D. Chavis,et al.  Sense of community: A definition and theory , 1986 .

[59]  Lisbeth Amhag,et al.  Collaborative learning as a collective competence when students use the potential of meaning in asynchronous dialogues , 2009, Comput. Educ..

[60]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[61]  Margaret S. Barrett,et al.  Defining learning communities , 2003 .

[63]  Anabel Quan-Haase Trends in online learning communities , 2005, SIGG.

[64]  Robert E. Slavin,et al.  Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations , 2008 .

[65]  Mitchell J. Nathan,et al.  Expert Blind Spot : When Content Knowledge Eclipses Pedagogical Content Knowledge , 2001 .

[66]  L. P. Saettler A history of instructional technology , 1967 .

[67]  Kevin Kunkler,et al.  The role of medical simulation: an overview , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[68]  Myung Hwa Koh,et al.  Student Perceptions of Groupwork in an Online Course: Benefits and Challenges , 2009 .

[69]  Thomas C. Reeves,et al.  The Meaning of Culture in Online Education: Implications for Teaching, Learning and Desgin , 2007 .

[70]  Jan Herrington,et al.  The application of expert review as a formative evaluation strategy within an educational design research study , 2011 .

[71]  D. Dunn,et al.  Experiential Learning , 2019, High Impact Teaching for Sport and Exercise Psychology Educators.

[72]  D. Leonard,et al.  The Role of Tacit Knowledge in Group Innovation , 1998 .

[73]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[74]  Richard R. Burton,et al.  Skiing as a Model of Instruction , 1984 .

[75]  Thomas C. Reeves,et al.  'Cognitive realism' in online authentic learning environments , 2003 .

[76]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[77]  D. Krathwohl A Revision of Bloom's Taxonomy: An Overview , 2002 .

[78]  M. Polanyi Chapter 7 – The Tacit Dimension , 1997 .

[79]  I. Nonaka,et al.  The Knowledge Creating Company , 2008 .

[80]  Marcia Gentry,et al.  A Time and a Place for Authentic Learning. , 2004 .

[81]  K. Squire,et al.  Design-Based Research: Putting a Stake in the Ground , 2004 .

[82]  Clare MacMahon,et al.  The Cambridge Handbook of Expertise and Expert Performance: Expert Performance in Sport: A Cognitive Perspective , 2006 .

[83]  Jan Herrington,et al.  Using preliminary risk assessment in a formative evaluation , 2013 .

[84]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[85]  A. Pritchard Ways of Learning: Learning Theories and Learning Styles in the Classroom , 2006 .

[86]  Aziz Ghefaili,et al.  Cognitive Apprenticeship, Technology, and the Contextualization of Learning Environments , 2003 .

[87]  J. Lave Cognition in Practice: Outdoors: a social anthropology of cognition in practice , 1988 .

[88]  朴轍柱 Pragmatism의 眞理論 小考 , 1962 .

[89]  Jon Mueller,et al.  The Authentic Assessment Toolbox: Enhancing Student Learning through Online Faculty Development , 2005 .

[90]  Jan Herrington,et al.  Authentic Assessment and Multimedia: how university students respond to a model of authentic assessment , 1998 .

[91]  Peter J. Fadde Instructional design for advanced learners: training recognition skills to hasten expertise , 2009 .

[92]  R. Schiffer,et al.  INTRODUCTION , 1988, Neurology.

[93]  Gary Klein,et al.  The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work , 2004 .

[94]  Georges M. Fadel,et al.  Affordance based design: a relational theory for design , 2009 .

[95]  Sirkka L. Jarvenpaa,et al.  The Use of Information Technology to Enhance Management School Education: A Theoretical View , 1995, MIS Q..

[96]  Grant Wiggins,et al.  Assessing student performance , 1993 .

[97]  Sasha A. Barab,et al.  A co-evolutionary model for supporting the emergence of authenticity , 2000 .

[98]  Marshall McLuhan The Gutenberg Galaxy , 1962 .

[99]  Thomas C. Reeves,et al.  Authentic Tasks Online: A synergy among learner, task, and technology , 2006 .

[100]  R. Slavin Evidence-Based Education Policies: Transforming Educational Practice and Research , 2002 .

[101]  S. Merriam Qualitative Research in Practice , 2008 .

[102]  Feng Wang,et al.  Design-based research and technology-enhanced learning environments , 2005 .

[103]  O. E. Gullander Conscious Competency: The Mark of a Competent Instructor. , 1974 .

[104]  Edward A. Feigenbaum,et al.  The fifth generation - artificial intelligence and Japan's computer challenge to the world , 1991 .

[105]  D. Walker,et al.  Toward productive design studies , 2006 .

[106]  J. Petraglia The real world on a short leash: The (mis) application of constructivism to the design of educational technology , 1998 .

[107]  Sam Ashton Authenticity in adult learning , 2010 .

[108]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[109]  Naomi L. Quenk,et al.  Essentials of Myers-Briggs Type Indicator Assessment , 1999 .

[110]  Wallace W. Tourtellotte,et al.  Interaction , 1988 .

[111]  R. Felder,et al.  Navigating the Bumpy Road to Student-Centered Instruction , 1996 .

[112]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[113]  Michele Biasutti,et al.  The student experience of a collaborative e-learning university module , 2011, Comput. Educ..

[114]  J. Brown,et al.  Bridging epistemologies: The generative dance between organizational knowledge and organizational knowing , 1999, STUDI ORGANIZZATIVI.

[115]  Anna T. Cianciolo,et al.  The Cambridge Handbook of Expertise and Expert Performance: Tacit Knowledge, Practical Intelligence, and Expertise , 2006 .

[116]  Julianne C. Turner,et al.  How Literacy Tasks Influence Children's Motivation for Literacy. , 1995 .

[117]  Graham S. Maxwell,et al.  Contextualising Authentic Assessment , 1999 .

[118]  Susan McKenney,et al.  Educational design research: the value of variety , 2006 .

[119]  M. Patton Qualitative research & evaluation methods , 2002 .

[120]  Caroline Haythornthwaite,et al.  Community Development Among Distance Learners: Temporal and Technological Dimensions , 2006, J. Comput. Mediat. Commun..

[121]  Paul Hildreth,et al.  The duality of knowledge , 2002, Inf. Res..

[122]  J. Taylor,et al.  RECOMMENDATIONS ON THE CONTROL AND MONITORING OF STORAGE AND TRANSPORTATION TEMPERATURES OF MEDICINAL PRODUCTS , 2001 .

[123]  Robert E. Levasseur People Skills: Optimizing Team Development and Performance , 2011, Interfaces.

[124]  James N. Gribble,et al.  Effects Of Health Programs on Child Mortality in Sub-Saharan Africa , 1993 .

[125]  G. Salomon,et al.  Educational Psychology and Technology: A Matter of Reciprocal Relations , 1998, Teachers College Record: The Voice of Scholarship in Education.

[126]  S. Tripp Theories, Traditions, and Situated Learning , 1993 .

[127]  Ümit Kartoğlu,et al.  Structural damages in adsorbed vaccines affected by freezing. , 2013, Biologicals : journal of the International Association of Biological Standardization.

[128]  D. D. Bueno A Crisis in Critical Thinking , 2009 .

[129]  Spike Cramphorn Blink: The Power of Thinking without Thinking / Strangers to Ourselves: Discovering the Adaptive Unconscious , 2006, Journal of Advertising Research.

[130]  Thomas C. Reeves,et al.  Authentic activities and online learning , 2002 .

[131]  Fengfeng Ke,et al.  Web-Based Teaching and Learning across Culture and Age , 2013 .

[132]  Allan Collins,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[133]  Jan Herrington,et al.  Developing expertise in those handling time and temperature sensitive pharmaceutical products: Applying the early phases of a design research methodology , 2011 .

[134]  Robert H. Woods,et al.  Using Non-Subject-Matter-Specific Discussion Boards to Build Connectedness in Online Learning , 2003 .

[135]  Paul A. Kirschner,et al.  Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design , 2007 .

[136]  Neil Charness,et al.  Expertise in chess , 2006 .

[137]  H. Schneider Failure mode and effect analysis : FMEA from theory to execution , 1996 .

[138]  J. Petraglia Reality by Design: The Rhetoric and Technology of Authenticity in Education , 1998 .

[139]  Thomas C. Reeves,et al.  Authentic Learning Environments , 2014 .

[140]  Sharon Decker,et al.  The evolution of simulation and its contribution to competency. , 2008, Journal of continuing education in nursing.

[141]  Education M. Lombardi Approaches That Work: How Authentic Learning Is Transforming Higher , 2007 .

[142]  David R. Thomas,et al.  A General Inductive Approach for Analyzing Qualitative Evaluation Data , 2006 .

[143]  Jos Beishuizen,et al.  Does a community of learners foster self‐regulated learning? , 2008 .

[144]  M. Wallace,et al.  Professional Learning Communities: A Review of the Literature , 2006 .

[145]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[146]  Ronald D. Zellner,et al.  The relative effects of positive interdependence and group processing on student achievement and attitude in online cooperative learning , 2011, Comput. Educ..

[147]  E. Wenger Communities of Practice and Social Learning Systems , 2000 .

[148]  Thomas M. Duffy,et al.  Problem Based Learning: An instructional model and its constructivist framework , 1995 .

[149]  Thomas C. Reeves,et al.  Design research from a technology perspective , 2006 .

[150]  Patrick R. Lowenthal The evolution and influence of social presence theory on online learning , 2010 .

[151]  Kevin W. Eva,et al.  The Cambridge Handbook of Expertise and Expert Performance: Expertise in Medicine and Surgery , 2006 .

[152]  James S Edstam,et al.  Exposure of hepatitis B vaccine to freezing temperatures during transport to rural health centers in Mongolia. , 2004, Preventive medicine.

[153]  J. Lave Teaching, as Learning, in Practice , 1996 .

[154]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[155]  Jan Herrington,et al.  Authentic learning in interactive multimedia environments , 1997 .

[156]  T. Wentling,et al.  Factors associated with transfer of training in workplace e‐learning , 2007 .

[157]  Janette R. Hill,et al.  Overcoming obstacles and creating connections: Community building in Web-based learning environments , 2002, J. Comput. High. Educ..

[158]  John Short,et al.  The social psychology of telecommunications , 1976 .

[159]  L. S. Vygotksy Mind in society: the development of higher psychological processes , 1978 .

[160]  Thomas C. Reeves,et al.  Interactive Learning Systems Evaluation , 2003 .

[161]  K. Bruffee Collaborative Learning: Higher Education, Interdependence, and the Authority of Knowledge , 1995 .

[162]  Gregor Kennedy,et al.  Evaluating e-Learning: Guiding Research and Practice , 2011 .

[163]  Eunjung Oh,et al.  Collaborative group work in an online learning environment , 2011 .

[164]  Brent G. Wilson Thoughts on Theory in Educational Technology. , 1997 .

[165]  R. Glavin,et al.  Low‐ to high‐fidelity simulation – a continuum of medical education? , 2003, Medical education.

[166]  Michael K. Barbour,et al.  The Landscape of K–12 Online Learning , 2012 .

[167]  S. Messick The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[168]  Yacov Y. Haimes,et al.  Total Risk Management , 1991 .

[169]  Thomas C. Reeves,et al.  Immersive learning technologies: Realism and online authentic learning , 2007, J. Comput. High. Educ..

[170]  W. Nehring,et al.  Nursing Simulation: A Review of the Past 40 Years , 2009 .

[171]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[172]  Thomas C. Reeves,et al.  Implementing Authentic Tasks in Web-Based Learning Environments , 2007 .

[173]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[174]  J. Kestle Clinical Trials , 2014, World Journal of Surgery.

[175]  P. Kirschner,et al.  A five-dimensional framework for authentic assessment , 2004 .

[176]  Yacov Y Haimes,et al.  Risk Filtering, Ranking, and Management Framework Using Hierarchical Holographic Modeling , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[177]  M. Scriven Prose and Cons about Goal-Free Evaluation , 1991 .

[178]  G. Wiggins The Futility of Trying to Teach Everything of Importance. , 1989 .

[179]  S. Dreyfus,et al.  A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition , 1980 .

[180]  Richard Chamberlain,et al.  The Design of Online Learning Communities: Critical Issues , 2004 .

[181]  K. Ecclestone,et al.  Learning styles and pedagogy in post-16 learning , 2004 .

[182]  Ernest L. Boyer,et al.  The Basic School A Community for Learning , 1995 .

[183]  F. Maina Authentic learning : perspectives from contemporary educators , 2004 .

[184]  Mark Campbell,et al.  What campus-based students think about the quality and benefits of e-learning , 2005, Br. J. Educ. Technol..

[185]  B. Munjas,et al.  FROM NOVICE TO EXPERT: EXCELLENCE AND POWER IN CLINICAL NURSING PRACTICE , 1985 .

[186]  J. Ioannidis Contradicted and Initially Stronger Effects in Highly Cited Clinical Research , 2005 .

[187]  Julie Dirksen Design for How People Learn , 2011 .

[188]  Susan McKenney,et al.  Conducting Educational Design Research , 2012 .

[189]  Robert B Miller PSYCHOLOGICAL CONSIDERATIONS IN THE DESIGN OF TRAINING EQUIPMENT , 1954 .

[190]  Zahari Taha,et al.  Virtual Teams: A Literature Review , 2009 .

[191]  Claude Ricciardi Rigault,et al.  Collaborative Distance Learning and Computer Conferencing , 1996 .

[192]  M. Schrage Shared Minds: The New Technologies of Collaboration , 1990 .

[193]  Saskia Brand-Gruwel,et al.  The pedagogical use of information and communication technology in education: a Dutch perspective , 2005, Comput. Hum. Behav..

[194]  Thomas C. Reeves,et al.  How do you know they are learning? The importance of alignment in higher education , 2006, Int. J. Learn. Technol..

[195]  Kara Morgan-Short,et al.  Second Language Processing Shows Increased Native-Like Neural Responses after Months of No Exposure , 2012, PloS one.

[196]  G. Wiggins The Case for Authentic Assessment. , 1990 .

[197]  T. Paulus,et al.  Collaboration or Cooperation? Analyzing Small Group Interactions in Educational Environments , 2005 .

[198]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[199]  B. Daley Novice to Expert: An Exploration of How Professionals Learn , 1999 .

[200]  Robert A. Reiser A history of instructional design and technology: Part I: A history of instructional media , 2001 .

[201]  Mark J. W. Lee,et al.  Beyond distance and time constraints: Applying social networking tools and Web 2.0 approaches in distance education , 2010 .

[202]  Mark J. W. Lee,et al.  Social software and participatory learning: Pedagogical choices with technology affordances in the Web 2.0 era , 2007 .

[203]  C. Tu,et al.  The Relationship of Social Presence and Interaction in Online Classes , 2002 .

[204]  Jan Herrington,et al.  Engaging learners in complex, authentic contexts: Instructional design for the web , 2000 .

[205]  J. Hoogmartens,et al.  Book Reviews : Who Expert Committee on Specifications for Pharmaceutical Preparations. Published by World Health Organisation, 1984. Price: Sw. fr. 6. Paperback. Pp 54. ISBN: 924 120704 3 , 1985, World Health Organization technical report series.

[206]  Camille Dickson-Deane,et al.  e-Learning, online learning, and distance learning environments: Are they the same? , 2011, Internet High. Educ..

[207]  David W. Carraher,et al.  Street mathematics and school mathematics , 1993 .

[208]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[209]  Mitchell J. Nathan,et al.  Expert Blind Spot Among Preservice Teachers , 2003 .

[210]  M. Polanyi,et al.  Tacit Knowing: Its Bearing on Some Problems of Philosophy , 1962 .

[211]  Sedef Uzuner,et al.  Questions of Culture in Distance Learning: A Research Review , 2009 .

[212]  Kelley J. Burton,et al.  A framework for determining the authenticity of assessment tasks : applied to an example in law , 2011 .

[213]  Barry L. Lewis,et al.  Determinants of Auditor Expertise , 1990 .

[214]  Thomas C. Reeves,et al.  The reality of virtual schools: A review of the literature , 2009, Comput. Educ..

[215]  Marie-Line Germain,et al.  Expertise: myth or reality of a cross‐national definition? , 2009 .

[216]  G. Heyer [Carl Gustav JUNG]. , 1961, Der Landarzt.

[217]  Jenny Gavriel Cognitive apprenticeship , 2015, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors.

[218]  Thomas C. Reeves,et al.  Patterns of engagement in authentic online learning environments , 2003, ASCILITE.

[219]  Barry Harper,et al.  Designing real life cases to support authentic design activities , 2002 .

[220]  Thomas C. Reeves,et al.  Designing authentic activities in web-based courses , 2004, J. Comput. High. Educ..

[221]  Mark Mahemoff,et al.  Quiet: The power of introverts in a world that can't stop talking [Book Review] , 2013 .