Video-as-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Video-as-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices Roy D. Pea

[1]  D. Schoen.  The Reflective Practitioner , 1983 .

[2]  U. Eco.  The Open Work , 1989 .

[3]  G. Frege.  On Sense and Reference , 1948 .

[4]  Richard Lehrer,et al.  The Design of a Case-Based Hypermedia Teaching Tool , 2000, Int. J. Comput. Math. Learn..

[5]  Bernice A. Stone.  Problems, Pitfalls, and Benefits of Portfolios , 1998 .

[6]  Thomas A. Finholt,et al.  Collaboratories , 2002, Annu. Rev. Inf. Sci. Technol..

[7]  C. Atman,et al.  How people learn. , 1985, Hospital topics.

[8]  R. Pea.  Augmenting the Discourse of Learning with Computer-Based Learning Environments , 1992 .

[9]  Andrew C. Porter,et al.  State Policy Related to Teacher Licensure , 2003 .

[10]  Telecommunications Board,et al.  National Collaboratories: Applying Information Technology for Scientific Research , 1993 .

[11]  Jeremy Roschelle,et al.  VideoNoter: A productivity tool for video data analysis , 1991 .

[12]  Paul Ginsparg,et al.  The impact of open access on biomedical research , 2000, Genome Biology.

[13]  Charles Goodwin,et al.  Seeing in Depth , 1995 .

[14]  Kenneth M. Zeichner,et al.  The teaching portfolio in US teacher education programs: what we know and what we need to know , 2001 .

[15]  J. Bruner.  From communication to language—a psychological perspective , 1975, Cognition.

[16]  C. Trevarthen.  Communication and cooperation in early infancy: a description of primary intersubjectivity , 1979 .

[17]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[18]  E. Cassirer,et al.  The Philosophy of Symbolic Forms , 2021 .

[19]  J. Levin.  Computers, teachers, peers: Science learning partners , 2003 .

[20]  J. Williamson.  Decoding Advertisements: Ideology and Meaning in Advertising , 1978 .

[21]  Steven K. Feiner,et al.  Augmented reality: a new way of seeing. , 2002, Scientific American.

[22]  Roy D. Pea,et al.  A walk on the WILD side How wireless handhelds may change computer-supported collaborative learning , 2002 .

[23]  Michael F. Goodchild,et al.  Geographical information science , 1992, Int. J. Geogr. Inf. Sci..

[24]  R. Stevens,et al.  Talking Mathematics in School: Disciplined Perception: Learning to See in Technoscience , 1998 .

[25]  Wolff-Michael Roth,et al.  Situating Cognition , 2001 .

[26]  Rogers Hall,et al.  Videorecording as Theory , 2000 .

[27]  Wolfgang Effelsberg,et al.  The Diver project: interactive digital video repurposing , 2004, IEEE MultiMedia.

[28]  Michael Mills,et al.  Panoramic overviews for navigating real-world scenes , 1993, MULTIMEDIA '93.

[29]  Virtual Reality: The Revolutionary Technology of Computer-Generated Artificial Worlds - and How It Promises to Transform Society, Howard Rheingold. 1992. Simon & Schuster, New York, NY. 416 pages. $12.00 , 1993 .

[30]  S. Barab,et al.  Designing system dualities: Characterizing an online professional development community , 2004 .

[31]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[32]  Christopher Edwards,et al.  The effects of filtered video on awareness and privacy , 2000, CSCW '00.

[33]  David Crismond,et al.  Approaches to using video cases in teacher professional development , 2003, Proceedings 3rd IEEE International Conference on Advanced Technologies.

[34]  John C. Tang.  Findings from Observational Studies of Collaborative Work , 1991, Int. J. Man Mach. Stud..

[35]  Rebecca S. Anderson,et al.  Portfolio Use in Twenty-Four Teacher Education Programs. , 1998 .

[36]  Hans Hagen,et al.  Scientific Visualization: Overviews, Methodologies, and Techniques , 1997 .

[37]  B. Latour.  Visualization and cognition: thinking with eyes and hands , 1986 .

[38]  Russell Martin,et al.  Picasso's War: The Destruction of Guernica and the Masterpiece That Changed the World , 2002 .

[39]  Karon Weber,et al.  Marquee: a tool for real-time video logging , 1994, CHI '94.

[40]  Paul Dourish,et al.  On "Technomethodology": Foundational Relationships Between Ethnomethodology and System Design , 1998, Hum. Comput. Interact..

[41]  J. Bruner,et al.  The capacity for joint visual attention in the infant , 1975, Nature.

[42]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[43]  G. Olson,et al.  From Laboratories to Collaboratories: A New Organizational Form for Scientific Collaboration , 1997 .

[44]  Suh-Yin Lee,et al.  Video indexing: an approach based on moving object and track , 1993, Electronic Imaging.

[45]  Pau Klein,et al.  San Francisco, California , 2007 .

[46]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[47]  Theresa-Marie Rhyne,et al.  Scientific Visualization , 1997, Encyclopedia of GIS.

[48]  Donald A. Schön.  Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions , 1987 .

[49]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[50]  Don Kimber,et al.  FlyCam: practical panoramic video , 2000, ACM Multimedia.

[51]  TerryBoult.  Personal Panoramic Perception , 2002 .

[52]  S. Nayar.  Omnidirectional Video Camera , 1997 .

[53]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[54]  Gary Marchionini,et al.  Video browsing interfaces for the open video project , 2002, CHI Extended Abstracts.

[55]  Matthew J. Koehler,et al.  Designing Case-Based Hypermedia for Developing Understanding of Children's Mathematical Reasoning , 2002 .

[56]  Pelle Ehn,et al.  Work-oriented design of computer artifacts , 1989 .

[57]  J. Stigler,et al.  The Teaching Gap: Best Ideas from the World's Teachers for Improving Education in the Classroom , 1999 .

[58]  John Shotter,et al.  Seeing Historically: Goethe and Vygotsky’s ‘Enabling Theory-Method’ , 2000 .

[59]  Giulio Jacucci,et al.  Imagining and experiencing in design, the role of performances , 2002, NordiCHI '02.

[60]  Roy D. Pea,et al.  Addressing the Challenges of Inquiry-Based Learning Through Technology and Curriculum Design , 1999 .

[61]  Narendra Ahuja,et al.  Multiview panoramic cameras using mirror pyramids , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  J. Greeno.  THE SITUATIVITY OF KNOWING, LEARNING, AND RESEARCH , 1998 .

[63]  Magdalene Lampert,et al.  Talking Mathematics in School: Studies of Teaching and Learning , 1998 .

[64]  D. Norris.  Report to the National Science Foundation , 1980 .

[65]  Gregory M. Nielson,et al.  Visualizing functions over a sphere , 1990, IEEE Computer Graphics and Applications.

[66]  DeeDee Halleck,et al.  Hand-held visions : the impossible possibilities of community media , 2002 .

[67]  David Hakken.  Work‐Oriented Design of Computer Artifacts , 1989 .

[68]  James D. Hollan,et al.  Beyond being there , 1992, CHI.

[69]  M. Fiala,et al.  provided that the source of such material is fully acknowledged. A Panoramic Video and Acoustic Beamforming Sensor for , 2004 .

[70]  Jean Lave,et al.  Situating learning in communities of practice , 1991, Perspectives on socially shared cognition.

[71]  M. Lecompte.  The Handbook of Qualitative Research in Education , 1993 .

[72]  Ricki Goldman,et al.  Orion™, An Online Digital Video Data Analysis Tool: Changing our Perspectives as an Interpretive Community , 2007 .

[73]  B. S. Manjunath,et al.  Panoramic capturing and recognition of human activity , 2002, Proceedings. International Conference on Image Processing.

[74]  Anders M. Dale,et al.  Towards effective and rewarding data sharing , 2003, Neuroinformatics.

[75]  Stevan Harnad,et al.  Post-Gutenberg Galaxy: The Fourth Revolution in the Means of Production of Knowledge , 1991 .

[76]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[77]  Anna Sfard,et al.  Analyzing tools : perspectives on the role of designed artifacts in mathematics learning : special issue , 2002 .

[78]  Daniel D. Suthers,et al.  Video cases for teacher learning: issues of social and organizational design for use , 2002, CSCL.

[79]  P. G. Schrader,et al.  Using Internet delivered video cases, to support pre-service teachers' understanding of effective early literacy instruction: An exploratory study , 2003 .

[80]  Jay L. Lemke,et al.  Typological and Topological Meaning in Diagnostic Discourse , 2018, Discourse Processes.

[81]  Hyoung-Joo Kim,et al.  VIRON: an annotation-based video information retrieval system , 1996, Proceedings of 20th International Computer Software and Applications Conference: COMPSAC '96.

[82]  B. Asher.  The Professional Vision , 1994 .

[83]  Miriam Gamoran Sherin,et al.  Video Portfolio Assessment: Creating a Framework for Viewing the Functions of Teaching. , 1998 .

[84]  D. Blackketter,et al.  QuickTime: an extensible standard for digital multimedia , 1992, Digest of Papers COMPCON Spring 1992.

[85]  Roy D. Pea,et al.  Prospects for Scientific Visualization as an Educational Technology , 1995 .

[86]  Jon Rigelsford.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[87]  M. Wittrock.  Handbook of research on teaching , 1986 .

[88]  Thomas D. C. Little,et al.  An Annotation Engine for Supporting Video Database Population , 1997, Multimedia Tools and Applications.

[89]  Miriam Gamoran Sherin,et al.  Using Video to Support Teachers' Ability to Interpret Classroom Interactions , 2002 .

[90]  R. Pea,et al.  Seeing What We Build Together: Distributed Multimedia Learning Environments for Transformative Communications , 2004 .

[91]  Sharon J. Derry,et al.  The STEP system for collaborative case-based teacher education: design, evaluation & future directions , 2002, CSCL.

[92]  F Olivero,et al.  Videopaper: bridging research and practice for pre-service and experienced teachers , 2007 .

[93]  Stephen H Koslow,et al.  Sharing primary data: a threat or asset to discovery? , 2002, Nature Reviews Neuroscience.

[94]  Barbara J. Dougherty,et al.  Mathematics Education Across Cultures: Proceedings of the 42nd Meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education , 2020 .

[95]  Ricki Goldman-Segall.  Points of Viewing Children's Thinking: A Digital Ethnographer's Journey , 1997 .

[96]  J. Brophy,et al.  Using Video in Teacher Education , 2003 .

[97]  B. Rogoff.  Apprenticeship in Thinking: Cognitive Development in Social Context , 1990 .

[98]  Karen B. Givvin,et al.  Teaching Mathematics in Seven Countries: Results From the TIMSS 1999 Video Study , 2003 .

[99]  D. Knight.  Ways of seeing , 2015, Nature.

[100]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[101]  R. Birdwhistell.  Kinesics and Context: Essays on Body Motion Communication , 1971 .

[102]  Carne Barnett,et al.  Mathematics teaching cases as a catalyst for informed strategic inquiry , 1998 .

[103]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[104]  Anoop Gupta,et al.  Viewing meeting captured by an omni-directional camera , 2001, CHI.

[105]  Descriptors Algebra,et al.  Group for the Psychology of Mathematics , 2000 .

[106]  B. MacWhinney.  The CHILDES project: tools for analyzing talk , 1992 .

[107]  Geoffrey B. Saxe,et al.  Culture and cognitive development , 1990 .

[108]  Alan H. Schoenfeld,et al.  On Paradigms and Methods: What Do You Do When the Ones You Know Don't Do What You Want Them To? issues in the Analysis of Data in the Form of Videotapes , 1992 .

[109]  B. Rogoff.  The Cultural Nature of Human Development , 2003 .

[110]  S. Derry,et al.  Video Research in the Learning Sciences , 2007 .

[111]  Maureen A. Callanan,et al.  Parents Explain More Often to Boys Than to Girls During Shared Scientific Thinking , 2001, Psychological science.

[112]  J. Goody.  The logic of writing and the organization of society: Ruptures and continuities , 1988 .

[113]  James H. Gray,et al.  Designing for Virtual Communities in the Service of Learning: COMING TO TERMS WITH COMMUNITY , 2004 .

[114]  B. S. Manjunath,et al.  Recording the region of interest from FlyCam panoramic video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[115]  David C. Berliner,et al.  The Development of Expertise in Pedagogy. , 1988 .

[116]  Cathy Collins Block,et al.  Creating powerful thinking in teachers and students : diverse perspectives , 1994 .

[117]  C Neidle,et al.  SignStream: A tool for linguistic and computer vision research on visual-gestural language data , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[118]  Roy D. Pea Stanford,et al.  Learning Science through Collaborative Visualization over the Internet , 2002 .

[119]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[120]  M. Black,et al.  Translations from the philosophical writings of Gottlob Frege , 1953 .

[121]  Ramana Rao,et al.  A focus+context technique based on hyperbolic geometry for visualizing large hierarchies , 1995, CHI '95.

[122]  S. Barab,et al.  Designing and building an on-line community: The struggle to support sociability in the inquiry learning forum , 2001 .

[123]  Willard Van Orman Quine,et al.  Word and Object , 1960 .

[124]  Wendy E. Mackay,et al.  DIVA: exploratory data analysis with multimedia streams , 1998, CHI.

[125]  Cyrus Shahabi,et al.  Yima: A Second-Generation Continuous Media Server , 2002, Computer.

[126]  G. Salomon.  Distributed cognitions : psychological and educational considerations , 1997 .

[127]  Lucy Suchman,et al.  Understanding practice: video as a medium for reflection and design (excerpt) , 1992 .

[128]  Beverly L. Harrison,et al.  Designing video annotation and analysis systems , 1992 .

[129]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[130]  Don Kimber,et al.  Enhancing distance learning with panoramic video , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[131]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[132]  Arie Rip,et al.  Knowledge and society : studies in the sociology of culture past and present : a research annual , 1981 .

[133]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[134]  David R. Olson,et al.  The World on Paper: The Conceptual and Cognitive Implications of Writing and Reading , 1996 .

[135]  Barry J. Fishman,et al.  8. LINKING ON-LINE VIDEO AND CURRICULUM TO LEVERAGE COMMUNITY KNOWLEDGE , 2003 .

[136]  Wolff‐Michael Roth,et al.  The concept map as a tool for the collaborative construction of knowledge: A microanalysis of high school physics students , 1993 .

[137]  Berna Erol,et al.  Portable meeting recorder , 2002, MULTIMEDIA '02.

[138]  P. Grossman.  The Making of a Teacher: Teacher Knowledge and Teacher Education , 1990 .

[139]  David Bargeron,et al.  Asynchronous Collaboration Around Multimedia Applied to On-Demand Education , 2002, J. Manag. Inf. Syst..

[140]  Wolff‐Michael Roth.  Gestures: Their Role in Teaching and Learning , 2001 .

[141]  Alexander H. Waibel,et al.  Multimodal people ID for a multimedia meeting browser , 1999, MULTIMEDIA '99.

[142]  M. King,et al.  Professional development to promote schoolwide inquiry , 2002 .

[143]  James A. Hendler,et al.  The Semantic Web: A new form of Web content that is meaningful to computers will unleash a revolution of new possibilities , 2001 .

[144]  Anoop Gupta,et al.  Distributed meetings: a meeting capture and broadcasting system , 2002, MULTIMEDIA '02.

[145]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[146]  Victoria Hoban,et al.  The Reflective Practitioner , 2013 .

[147]  Abbie Brown,et al.  Design experiments: Theoretical and methodological challenges in creating complex interventions in c , 1992 .

[148]  Roy,et al.  The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning , Education , and Human Activity , 2004 .

[149]  Terry Winograd,et al.  Bringing Design to Software , 1996 .

[150]  Alexander H. Waibel,et al.  Modeling focus of attention for meeting indexing based on multiple cues , 2002, IEEE Trans. Neural Networks.

[151]  H. Edgerton,et al.  Stopping Time: The Photographs of Harold Edgerton , 1987 .

[152]  Andreas Girgensohn,et al.  LiteMinutes: an Internet-based system for multimedia meeting minutes , 2001, WWW '01.

[153]  Bryce Allen,et al.  Information Tasks: Toward a User-Centered Approach to Information Systems , 1996 .

[154]  Joseph D. Novak,et al.  Learning creating and using knowledge: Concept maps as facilitative tools , 1998 .

[155]  Steven Bird,et al.  Models and Tools for Collaborative Annotation , 2002, LREC.

[156]  Roy D. Pea,et al.  New Media Communications Forums for Improving Education Research and Practice , 2004 .

[157]  L. Quéré.  Cognition in Practice , 1996 .

[158]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[159]  Gail A. Herndon.  The chronicle of higher education , 1977 .

[160]  Brigid Barron.  When Smart Groups Fail , 2003 .

[161]  J. Chatwin.  Conversation analysis. , 2004, Complementary therapies in medicine.

[162]  Daniel C. Edelson,et al.  Visualization for learners: a framework for adapting scientists' tools , 1998 .

[163]  Michael Barnett,et al.  Developing an Empirical Account of a Community of Practice: Characterizing the Essential Tensions , 2002 .

[164]  Don Kimber,et al.  FlyAbout: spatially indexed panoramic video , 2001, MULTIMEDIA '01.

[165]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[166]  G. D. Laguna,et al.  Speech, its function and development , 1927 .

[167]  Harold E. Edgerton,et al.  Seeing The Unseen Dr Harold E Edgerton And The Wonders Of Strobe Alley , 1994 .

[168]  R. Gallimore,et al.  Using Video Surveys to Compare Classrooms and Teaching Across Cultures: Examples and Lessons From the TIMSS Video Studies , 2000 .

[169]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[170]  Roy D. Pea,et al.  CILT Workshop on Digital Video Inquiry in Learning and Education , 2002 .

[171]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[172]  Laura A. Dabbish,et al.  A multi-view intelligent editor for digital video libraries , 2001, JCDL '01.

[173]  Michael Twidale,et al.  From Docent to Cyberdocent: Education and Guidancein the Virtual Museum , 1999, Arch. Mus. Informatics.

[174]  William Whittaker,et al.  The Atacama Desert Trek: outcomes , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[175]  L. Resnick.  Learning In School and Out , 2008 .

[176]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[177]  Alexandra Beatty,et al.  The Power of Video Technology in International Comparative Research in Education. , 2001 .

[178]  Franc Solina,et al.  User interface for video observation over the internet , 1998, J. Netw. Comput. Appl..

[179]  一心,et al.  Windows Media Technologies后起之秀 , 2002 .

[180]  Ramana Rao,et al.  The table lens: merging graphical and symbolic representations in an interactive focus + context visualization for tabular information , 1994, CHI '94.

[181]  William D. Taylor,et al.  Orality and literacy: The technologizing of the word , 1984 .

[182]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[183]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[184]  Steven Z. Athanases.  Teachers' Reports of the Effects of Preparing Portfolios of Literacy Instruction , 1994, The Elementary School Journal.

[185]  David Seamon,et al.  Goethe's Way of Science as a Phenomenology of Nature , 2005, Janus Head.

[186]  Geoffrey B. Saxe,et al.  Candy Selling and Math Learning , 1988 .

[187]  B. S. Manjunath,et al.  Panoramic video capturing and compressed domain virtual camera control , 2001, MULTIMEDIA '01.

[188]  Terry Wood,et al.  Beyond Classical Pedagogy : Teaching Elementary School Mathematics , 2001 .

[189]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[190]  Myke Gluck,et al.  Visual Explanations: Images and Quantities, Evidence and Narrative , 1997, Inf. Process. Manag..

[191]  Steve Benford,et al.  Fragmented interaction: establishing mutual orientation in virtual environments , 1998, CSCW '98.

[192]  B. Rogoff,et al.  Everyday Cognition: Development in Social Context , 1999 .

[193]  H. Mehan.  Structuring School Structure , 1978 .

[194]  Brigid Barron.  Achieving Coordination in Collaborative Problem-Solving Groups , 2000 .

[195]  C. Metz.  Film Language: A Semiotics of the Cinema , 1974 .

[196]  Larry S. Yaeger,et al.  Visualization of natural phenomena , 1993 .

[197]  Piet Kommers,et al.  Concept Mapping , 1997, Springer Texts in Education.

[198]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[199]  Jon Snyder,et al.  The Inherent Tensions in the Multiple Uses of Portfolios in Teacher Education. , 1998 .

[200]  Deborah Loewenberg Ball,et al.  Teaching, Multimedia, and Mathematics: Investigations of Real Practice , 2000 .

[201]  Reed Stevens,et al.  Using a digital video annotation tool to teach dance composition , 2003 .