ASSESSMENT TO PROMOTE 21 ST CENTURY LEARNING : THE BENEFITS OF BLINKING

What competencies do kids need to succeed in the 21 century, and how do these skills differ from those reflected in current state standards? What is the best way to assess and support new competencies? This paper extends current thinking about educationally valuable skills and instructional system design by identifying and modeling 21 century skills. The first stage (described in this paper) of our multi-stage research involves: (a) conducting an extensive literature review to identify a set of viable and valuable 21 century skills, and (b) modeling each in terms of constituent sub-skills, at a sufficiently refined grain size so that we can measure and diagnose competency levels. The competencies showcased in this paper include: systems thinking, creativity, collaborative learning, and managing social identities. Subsequent stages of this research will include developing appropriate and engaging assessments to extract data on our relevant 21 century skills from students –individually and in groups – during interaction with immersive learning environments. Findings from the second stage will then inform the third stage which will involve adapting existing (or developing new) learning environments that incorporate problems, assessments, and instructional support in relation to our set of important 21 century skills.

[1]  Jonathan J. Cadiz,et al.  Coordination, overload and team performance: effects of team communication strategies , 1998, CSCW '98.

[2]  R. Sternberg Beyond IQ: A Triarchic Theory of Human Intelligence , 1984 .

[3]  R. Volkema The Influence of Cognitive-based Group Composition on Decision-making Process and Outcome , 1998 .

[4]  Alan M. Lesgold,et al.  What Makes Peer Interaction Effective? Modeling Effective Communication in an Intelligent CSCL , 1999 .

[5]  W. Doise,et al.  Social interaction and the development of cognitive operations , 1975 .

[6]  Michael Stefanone,et al.  Writing for Friends and Family: The Interpersonal Nature of Blogs , 2007, J. Comput. Mediat. Commun..

[7]  J. Wiley Expertise as mental set: The effects of domain knowledge in creative problem solving , 1998, Memory & cognition.

[8]  Carl E. Larson,et al.  Teamwork: What Must Go Right/What Can Go Wrong , 1989 .

[9]  Cliff Lampe,et al.  A familiar face(book): profile elements as signals in an online social network , 2007, CHI.

[10]  C. E. Puente,et al.  The Essence of Chaos , 1995 .

[11]  H. Murray,et al.  Explorations in Personality , 2007 .

[12]  N. Orion,et al.  Development of system thinking skills in the context of earth system education , 2005 .

[13]  John S. Dacey Fundamentals of Creative Thinking , 1988 .

[14]  P. Kirschner,et al.  Social and Cognitive Factors Driving Teamwork in Collaborative Learning Environments , 2006 .

[15]  Michael Lewis,et al.  Designing for Human-Agent Interaction , 1998, AI Mag..

[16]  Danah Boyd,et al.  Social Network Sites: Definition, History, and Scholarship , 2007, J. Comput. Mediat. Commun..

[17]  A. Lenhart,et al.  Teens, privacy and online social networks: How teens manage their online identities and personal information in the age of MySpace , 2007 .

[18]  John F. Patterson,et al.  Identity disclosure and the creation of social capital , 2003, CHI Extended Abstracts.

[19]  Jaekyung Lee Racial and Ethnic Achievement Gap Trends: Reversing the Progress Toward Equity? , 2002 .

[20]  R. Sternberg,et al.  An Investment Theory of Creativity and Its Development , 1991 .

[21]  Ton de Jong,et al.  Effects of within-class ability grouping on social interaction, achievement, and motivation , 2005 .

[22]  Kati Haycock,et al.  Closing the Achievement Gap. , 2001 .

[23]  Vanessa Paz Dennen,et al.  Finding community in the comments: the role of reader and blogger responses in a weblog community of practice , 2008, Int. J. Web Based Communities.

[24]  H. Hollingworth Personality a psychological interpretation. , 1938 .

[25]  A. Furnham,et al.  Creativity, Intelligence, and Personality: A Critical Review of the Scattered Literature , 2006, Genetic, social, and general psychology monographs.

[26]  R. Sternberg Implicit theories of intelligence. creativity, and wisdom , 1985 .

[27]  S. Messick The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[28]  J. Matthews The Mind's Best Work , 1985 .

[29]  Herbert J. Walberg,et al.  Productive human capital: Learning, creativity, and eminence , 1992 .

[30]  Alexandra Rankin Macgill,et al.  Teens, Video Games, and Civics: Teens' Gaming Experiences Are Diverse and Include Significant Social Interaction and Civic Engagement. , 2008 .

[31]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[32]  D. Hocevar,et al.  A Taxonomy and Critique of Measurements Used in the Study of Creativity , 1989 .

[33]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[34]  D. Schwartz,et al.  Toward the development of flexibly adaptive instructional design , 1999 .

[35]  Arthur S. Reber,et al.  Cognition Unawares. (Book Reviews: Implicit Learning and Tacit Knowledge. An Essay on the Cognitive Unconscious.) , 1996 .

[36]  Amy Soller,et al.  Supporting Social Interaction in an Intelligent Collaborative Learning System , 2001 .

[37]  Raquel Recuero,et al.  Information flows and social capital in weblogs: a case study in the brazilian blogosphere , 2008, Hypertext.

[38]  Robert T. Brown Creativity: What are we to measure? , 1989 .

[39]  M. Eysenck,et al.  Personality and Individual Differences: A Natural Science Approach , 1985 .

[40]  R. Slavin Research on Cooperative Learning: Consensus and Controversy. , 1990 .

[41]  Gregory C. Sales,et al.  Cooperative learning in computer-based instruction , 1991 .

[42]  S. Mednick The associative basis of the creative process. , 1962, Psychological review.

[43]  Moshe Barak,et al.  Learning elemental structures and dynamic processes in technological systems: a cognitive framework , 2007 .

[44]  Barbaros Günçer,et al.  Relationship between creativity and nonconformity to school discipline as perceived by teachers of Turkish elementary school children, by controlling for their grade and sex. , 1993 .

[45]  Holger Arndt,et al.  Enhancing System Thinking in Education Using System Dynamics , 2006, Simul..

[46]  R. Mislevy Evidence and inference in educational assessment , 1994 .

[47]  Linda Lohr,et al.  Psychology of learning for instruction , 2005 .

[48]  Erman Yukselturk,et al.  Collaborative Work in Online Learning Environments: Critical Issues, Dynamics, and Challenges , 2008 .

[49]  J. Sterman Learning from evidence in a complex world. , 2006, American journal of public health.

[50]  Gerald W. Bracey Setting the Record Straight: Responses to Misconceptions About Public Education in the U.S. , 2004 .

[51]  J. Lagowski National Science Education Standards , 1995 .

[52]  Arthur J. Cropley,et al.  Creativity and mental health in everyday life. , 1990 .

[53]  Ann L. Brown,et al.  Guided, Cooperative Learning and Individual Knowledge Acquisition , 2018, Knowing, Learning, and Instruction.

[54]  Russell G. Almond,et al.  You Can't Fatten A Hog by Weighing It - Or Can You? Evaluating an Assessment for Learning System Called ACED , 2008, Int. J. Artif. Intell. Educ..

[55]  Valerie J. Shute,et al.  TENSIONS, TRENDS, TOOLS, AND TECHNOLOGIES: TIME FOR AN EDUCATIONAL SEA CHANGE , 2006 .

[56]  P. Costa,et al.  Personality in adulthood , 1990 .

[57]  Tak-Wai Chan,et al.  An Attempt to Design Synchronous Collaborative Learning Environments for Peer Dyads on the World Wide Web , 1999 .

[58]  David F. Salisbury Five Technologies for Educational Change: Systems Thinking, Systems Design, Quality Science, Change Management, Instructional Technology , 1996 .

[59]  J. D. Fletcher,et al.  Training & retraining : a handbook for business, industry, government, and the military , 2000 .

[60]  B. Davies,et al.  Positioning: The Discursive Production of Selves , 1990 .

[61]  Michael D. Mumford,et al.  Process analytic models of creative capacities , 1991 .

[62]  E. Torrance,et al.  The Torrance Tests of Creative Thinking , 2012 .

[63]  P. Mattessich,et al.  Collaboration: What Makes It Work- A Review of Research Literature on Factors Influencing Successful Collaboration , 1992 .

[64]  C. Cramton The Mutual Knowledge Problem and Its Consequences for Dispersed Collaboration , 2001 .

[65]  H. Eysenck Genius: The Natural History of Creativity , 1995 .

[66]  Michael J. Baker,et al.  Promoting reflective interactions in a computer-supported collaborative learning environment , 1997 .

[67]  Robert J. Sternberg,et al.  Successful Intelligence: How Practical and Creative Intelligence Determine Success in Life , 1996 .

[68]  T. Treadwell,et al.  The Social Psychology of Online Collaborative Learning: The Good, the Bad, and the Awkward , 2008 .

[69]  David H. Cropley,et al.  Engineering Creativity: A Systems Concept of Functional Creativity , 2005 .

[70]  R. Almond,et al.  A BRIEF INTRODUCTION TO EVIDENCE-CENTERED DESIGN , 2003 .

[71]  Teresa M. Amabile,et al.  ? + ? = creativity. , 2018, Public health nursing.

[72]  Theodore Panitz,et al.  Collaborative versus Cooperative Learning: A Comparison of the Two Concepts Which Will Help Us Understand the Underlying Nature of Interactive Learning. , 1999 .

[73]  J. Michael Spector,et al.  System Dynamics and Interactive Learning Environments: Lessons Learned and Implications for the Future , 2000 .

[74]  Mark A. Runco,et al.  Creative morality: Intentional and unconventional , 1993 .

[75]  Patricia Wallace The Psychology of the Internet , 1999 .

[76]  R. McCrae Creativity, divergent thinking, and openness to experience. , 1987 .

[77]  R. Sternberg,et al.  The concept of creativity: Prospects and paradigms. , 1998 .

[78]  A. Cropley In Praise of Convergent Thinking , 2006 .

[79]  Richard J. Shavelson,et al.  Self-Concept: Its Multifaceted, Hierarchical Structure , 1985 .

[80]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[81]  D. Jonassen Learning to Solve Problems: An Instructional Design Guide , 2009 .

[82]  K. Brown,et al.  From Teacher-Centered to Learner-Centered Curriculum: Improving Learning in Diverse Classrooms , 2003 .

[83]  D. Simonton Political pathology and societal creativity , 1990 .

[84]  Russell G. Almond,et al.  Graphical Models and Computerized Adaptive Testing , 1998 .

[85]  Ammon Salter,et al.  Sources of ideas for innovation in engineering design , 2003 .

[86]  Jessica Vitak,et al.  Digital footprints: online identity management and search in the age of transparency , 2007 .

[87]  D. Perkins Person plus: A distributed view of thinking and learning , 1994 .

[88]  David W. Johnson,et al.  Cooperation and Competition: Theory and Research , 1989 .

[89]  Robert R. McCrae,et al.  Openness to Experience as a Basic Dimension of Personality , 1993 .

[90]  D. Hocevar,et al.  Measurement of creativity: review and critique. , 1981, Journal of personality assessment.

[91]  Barry Richmond,et al.  Systems thinking: critical thinking skills for the 1990s and beyond , 1993 .

[92]  V. Shute Focus on Formative Feedback , 2007 .

[93]  R. Sternberg A three-facet model of creativity. , 1988 .

[94]  M. Banaji,et al.  Implicit social cognition: attitudes, self-esteem, and stereotypes. , 1995, Psychological review.

[95]  S. Turkle Life on the Screen , 1995 .

[96]  Selma Leitão,et al.  The Potential of Argument in Knowledge Building , 2000, Human Development.

[97]  Ion Georgiou,et al.  Thinking Through Systems Thinking , 2007 .

[98]  W. Lyddon Creativity in Context: Update to "The Social Psychology of Creativity" , 1998 .

[99]  Christopher M. Hoadley,et al.  Anonymity options and professional participation in an online community of practice , 2005, CSCL.

[100]  R. Sternberg The Nature of creativity : contemporary psychological perspectives , 1988 .

[101]  Susannah Fox Privacy Implications of Fast, Mobile Internet Access , 2008 .

[102]  渋江 靖弘,et al.  Science for All Americans , 1990 .

[103]  M. Field Defying the Crowd: Cultivating Creativity in a Culture of Conformity , 1996 .

[104]  Elizabeth G. Cohen,et al.  Designing Groupwork: Strategies for the Heterogeneous Classroom , 1986 .

[105]  THE DEVELOPMENT OF SYSTEMS THINKING SKILLS USING SYSTEM DYNAMICS MODELLING TOOLS , 1999 .

[106]  David H. Jonassen,et al.  Model building for conceptual change , 2005, Interact. Learn. Environ..

[107]  T. Amabile,et al.  The conditions of creativity. , 1988 .

[108]  Teresa M. Amabile,et al.  Motivation and Creativity: Effects of Motivational Orientation on Creative Writers , 1985 .

[109]  L. Shulman,et al.  Modes of thinking in young children , 1965 .

[110]  Gustavo Stubrich The Fifth Discipline: The Art and Practice of the Learning Organization , 1993 .

[111]  J. W. Getzels,et al.  The Creative Vision: A Longitudinal Study of Problem Finding in Art , 1976 .

[112]  Jay W. Forrester,et al.  System dynamics, systems thinking, and soft OR , 1994 .

[113]  Samuel Totten,et al.  Cooperative learning : a guide to research , 1991 .

[114]  Frances J. Milliken,et al.  Searching for Common Threads: Understanding the Multiple Effects of Diversity in Organizational Groups , 1996 .

[115]  Stephanie D. Teasley,et al.  The Construction of Shared Knowledge in Collaborative Problem Solving , 1995 .

[116]  R. Slavin Cooperative Learning: Theory, Research and Practice , 1990 .

[117]  J Swanson,et al.  Business Dynamics—Systems Thinking and Modeling for a Complex World , 2002, J. Oper. Res. Soc..

[118]  Richard A. Guzzo,et al.  Teams in organizations: recent research on performance and effectiveness. , 1996, Annual review of psychology.

[119]  Robert J. Sternberg,et al.  Creating a Vision of Creativity: The First 25 Years , 2006 .

[120]  Paul A. Walker,et al.  The Tourism Futures Simulator: a systems thinking approach , 1998, Environ. Model. Softw..

[121]  A. Gokhale Collaborative Learning Enhances Critical Thinking , 1995 .

[122]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[123]  J. Forrester System Dynamics and K-12 Teachers , 1997 .

[124]  J. P. Guilford,et al.  Intelligence, creativity, and their educational implications , 1968 .

[125]  E. Torrance,et al.  Stimulation, enjoyment, and originality in dyadic creativity. , 1971, Journal of educational psychology.

[126]  David W. Johnson,et al.  AN OVERVIEW OF COOPERATIVE LEARNING , 2002 .

[127]  Dennis O’Connor,et al.  Team Leadership , 2007 .

[128]  C. Handy Trust and the virtual organization , 1999 .

[129]  Dietrich Dörner,et al.  The Logic Of Failure: Recognizing And Avoiding Error In Complex Situations , 1997 .

[130]  T. M. Amabile Social psychology of creativity: A consensual assessment technique. , 1982 .

[131]  James I. Mills,et al.  ON THE APPLICATION OF SYSTEM DYNAMICS TO THE INTEGRATION OF NATIONAL RESEARCH AND K – 12 EDUCATION , 2001 .

[132]  R. Sternberg RETRACTED ARTICLE: The Nature of Creativity , 2006 .

[133]  Raymond Grenier,et al.  Going Virtual: Moving Your Organization Into the 21st Century , 1995 .

[134]  Pieter J. Beers,et al.  Coercing knowledge construction in collaborative learning environments , 2005, CSCL.

[135]  David Gurteen,et al.  Knowledge, Creativity and Innovation , 1998, J. Knowl. Manag..

[136]  R. Weisberg Creativity and knowledge: A challenge to theories. , 1998 .

[137]  Linda S. Steinberg,et al.  Intelligent tutoring and assessment built on an understanding of a technical problem-solving task , 1996 .

[138]  Gregory J. Feist Handbook of Creativity: The Influence of Personality on Artistic and Scientific Creativity , 1998 .

[139]  John M. Dirkx,et al.  Book Review: Building Learning Communities in Cyberspace: Effective Strategies for the Online Classroom , 2003 .

[140]  T. M. Amabile The social psychology of creativity: A componential conceptualization. , 1983 .

[141]  Paul T. Costa,et al.  Evaluating comprehensiveness in personality systems: The California Q‐Set and the five‐factor model , 1986 .

[142]  W. Maugham,et al.  On art and aesthetics , 1966 .