MAVEN-SA: Model-Based Automated Visualization for Enhanced Situation Awareness

Abstract : Report developed under a Phase I Small Business Technology Transfer Research (STTR) program contract for topic A04-T002. The research reported here explored methods for training battlefield visualization through human-computer visualization. The objective was to determine whether an adaptive visualization system that strongly leverages current findings in cognitive and perceptual psychology and in situation awareness could be designed that would improve Army schoolhouse training. The research approach had three focal points. First, we reviewed the extant literature on perceptual and cognitive visualization and mixed-initiative interaction as related to military situation awareness and decision making. Second, we developed a company level Military Operations in Urban Terrain (MOUT) scenario to inform our inquiry. Third, we developed a limited capability visualization prototype to test core approach concepts. The work conducted during Phase I lays the foundation for a Phase II plan to develop a usable schoolhouse tool for training battlespace visualization and to test the utility of this tool in an experimental setting.

[1]  Herbert A. Simon,et al.  Radical constructivism and cognitive psychology , 1998 .

[2]  Drew McDermott,et al.  Issues in the Development of Human-Computer Mixed Initiative Planning , 1994 .

[3]  Daniel S. Weld.  An Introduction to Least Commitment Planning , 1994, AI Mag..

[4]  Bernice E. Rogowitz,et al.  A rule-based tool for assisting colormap selection , 1995, Proceedings Visualization '95.

[5]  Yael Kali,et al.  Design principles for educational software , 2002, CSCL.

[6]  Erica Melis,et al.  Adaptable Mixed-Initiative Proof Planning for Educational Interaction , 2004, Electron. Notes Theor. Comput. Sci..

[7]  B. Wilson.  Constructivist Learning Environments: Case Studies in Instructional Design , 1995 .

[8]  Joseph Krajcik,et al.  Issues and approaches for developing lerner-centered technology , 2003, Adv. Comput..

[9]  M. Posner.  Foundations of cognitive science , 1989 .

[10]  Alan Bundy,et al.  Constructing Induction Rules for Deductive Synthesis Proofs , 2006, CLASE.

[11]  B. Gorayska,et al.  Cognitive Technology: In Search of a Humane Interface , 1995 .

[12]  James L. McClelland,et al.  Reflections on Cognition and Parallel Distributed Processing , 1987 .

[13]  P. Johnson-Laird.  Mental models , 1989 .

[14]  Merideth Leigh Gattis,et al.  Spatial schemas and abstract thought , 2001 .

[15]  Ralph Chatham,et al.  Training for Future Conflicts , 2003 .

[16]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[17]  Paul S. Goodman,et al.  Technology Enhanced Learning: Opportunities For Change , 2001 .

[18]  Mica R. Endsley,et al.  Using Goal Directed Task Analysis with Army Brigade Officer Teams , 2002 .

[19]  Michael R. Macedonia,et al.  Power from the Edge , 2005, Computer.

[20]  P. C. Honebein,et al.  Seven goals for the design of constructivist learning environments , 1996 .

[21]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[22]  Franklin L. Moses,et al.  Six Myths About Digital Skills Training , 2001 .

[23]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[24]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[25]  Sun-Joo Shin.  The Iconic Logic of Peirce's Graphs , 2002 .

[26]  Peter C.-H. Cheng.  Interactive Law Encoding Diagrams for learning and instruction , 1999 .

[27]  Joseph Krajcik,et al.  Constructing Extended Inquiry Projects: Curriculum Materials for Science Education Reform , 2000 .

[28]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[29]  Mica R. Endsley,et al.  A Survey of Situation Awareness Requirements in Air-to-Air Combat Fighters , 1993 .

[30]  D. Perkins,et al.  Partners in Cognition: Extending Human Intelligence with Intelligent Technologies , 1991 .

[31]  Mark Guzdial,et al.  Software-Realized Scaffolding to Facilitate Programming for Science Learning , 1994, Interact. Learn. Environ..

[32]  Jaime R Carbonell,et al.  Mixed-initiative man-computer instructional dialogues , 1970 .

[33]  Barbara Tversky,et al.  Spatial schemas in depictions , 1999 .

[34]  Russell W. Glenn,et al.  Street Smart: Intelligence Preparation of the Battlefield for Urban Operations , 2002 .

[35]  Robert St. Amant,et al.  ViA: a perceptual visualization assistant , 2000, Applied Imaging Pattern Recognition.

[36]  N. Hari Narayanan,et al.  Visual language theory: towards a human computer interaction perspective , 1998 .

[37]  Mark Guzdial,et al.  Learner-centered design: the challenge for HCI in the 21st century , 1994, INTR.

[38]  B. Bloom.  The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[39]  Joe Marks,et al.  "Man-Computer Symbiosis" Revisited: Achieving Natural Communication and Collaboration with Computers , 2004, IEICE Trans. Inf. Syst..

[40]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[41]  S. Papert.  The children's machine: rethinking school in the age of the computer , 1993 .

[42]  David S Alberts,et al.  Network Centric Warfare: Developing and Leveraging Information Superiority , 1999 .

[43]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[44]  J. Piaget.  The construction of reality in the child , 1954 .

[45]  Gautam Biswas,et al.  A rule network for efficient implementation of a mixed-initiative reasoning scheme , 1989, CSC '89.

[46]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[47]  Mia Stern,et al.  Applications of AI in education , 1996, CROS.

[48]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[49]  Marcia C. Linn,et al.  Internet Environments for Science Education , 2004 .

[50]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[51]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[52]  K. VanLehn.  Problem solving and cognitive skill acquisition , 1989 .

[53]  James F. Allen,et al.  A Task-Based Evaluation of the TRAINS-95 Dialogue System , 1996, ECAI Workshop on Dialogue Processing in Spoken Language Systems.

[54]  B F SKINNER,et al.  Teaching machines; from the experimental study of learning come devices which arrange optimal conditions for self instruction. , 1958, Science.

[55]  Bernd Meyer,et al.  Visual Language Theory , 2012, Springer New York.

[56]  Joseph Krajcik,et al.  A Scaffolding Design Framework for Software to Support Science Inquiry , 2004, The Journal of the Learning Sciences.

[57]  Roy D. Pea,et al.  The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning, Education, and Human Activity , 2004, The Journal of the Learning Sciences.

[58]  Carl W. Lickteig.  Applying Digital Training Technologies to Shape User Representations , 2000 .

[59]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[60]  Lawrence J. Rosenblum,et al.  Scientific visualization : advances and challenges , 1994 .

[61]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[62]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[63]  Irene Mavrommati,et al.  Design principles , 2001 .

[64]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[65]  Laura D. Strater,et al.  Measures of Platoon Leader Situation Awareness in Virtual Decision-Making Exercises , 2001 .

[66]  John R. Anderson.  The Architecture of Cognition , 1983 .

[67]  Robert L. Harris,et al.  Information Graphics: A Comprehensive Illustrated Reference , 1996 .

[68]  Eric K. Ringger,et al.  The Design and Implementation of the TRAINS-96 System: A Prototype Mixed-Initiative Planning Assistant , 1996 .