Evaluating the Benefits of the Immersive Space to Think

Sensemaking with large multimedia dataset is a cognitively intensive task that requires analysts to understand the underlying stories that the dataset tells. Often, analysts use tools in order to offload cognition as well as convey their new understanding of the dataset; however, existing tools are limited by their underlying technologies. We have proposed a novel virtual reality tool to support sensemaking called the Immersive Space to Think (IST). IST can aid the process of analyzing multimedia data, but it remains unproven whether IST improves sensemaking performance over a traditional desktop setting. In a study performed over six weeks, one participant used both IST and traditional methods of sensemaking with a dataset of 100 text documents of transcribed survey responses from World War 2 soldiers to perform historical analysis. The participant was asked guided questions that produced three essays with their understanding of the data. After conducting a blind evaluation of the participant’s interpretation of the data, a team of three experts in historical analysis concluded that the essays written with IST displayed a better understanding of the dataset. Furthermore, the participant gave positive feedback on IST, and also suggested possible improvements.

[1]  David Hicks,et al.  The SCIM-C Strategy: Expert Historians, Historical Inquiry, and Multimedia. , 2004 .

[2]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[3]  Anthony C. Robinson,et al.  Supporting synthesis in geovisualization , 2011, Int. J. Geogr. Inf. Sci..

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  Chris North,et al.  Immersive Analytics: Theory and Research Agenda , 2019, Front. Robot. AI.

[6]  A. Pye,et al.  Organizing to counter terrorism: Sensemaking amidst dynamic complexity , 2013 .

[7]  Bruce H. Thomas,et al.  ImAxes: Immersive Axes as Embodied Affordances for Interactive Multivariate Data Visualisation , 2017, UIST.

[8]  Chris North,et al.  CrowdIA: Solving Mysteries with Crowdsourced Sensemaking , 2018, Proc. ACM Hum. Comput. Interact..

[9]  Tamara Sumner,et al.  Self-Directed Learning and the Sensemaking Paradox , 2011, Hum. Comput. Interact..

[10]  Matthias Klapperstück,et al.  Immersive Analytics , 2015, 2015 Big Data Visual Analytics (BDVA).

[11]  Celestine A. Ntuen,et al.  Designing an Information Visualization Tool for Sensemaking , 2010, Int. J. Hum. Comput. Interact..

[12]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[13]  Gang Hua,et al.  Multimedia Big Data Computing , 2015, IEEE Multim..

[14]  Tia C. Madkins,et al.  Connecting the dots: Secondary science teacher candidates’ uptake of the core practice of facilitating sensemaking discussions from teacher education experiences , 2019, Teaching and teacher education.

[15]  Ee-Peng Lim,et al.  Event-Driven Document Selection for Terrorism Information Extraction , 2005, ISI.

[16]  John T. Stasko,et al.  Jigsaw: Supporting Investigative Analysis through Interactive Visualization , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[17]  Karsten Klein,et al.  Design Considerations for Immersive Analytics of Bird Movements Obtained by Miniaturised GPS Sensors , 2017, VCBM.