Neuro-imaging Support for the Use of Audio to Represent Geospatial Location in Cartographic Design

[1]  Alan M. MacEachren,et al.  Constructing knowledge from multivariate spatiotemporal data: integrating geographical visualization with knowledge discovery in database methods , 1999, Int. J. Geogr. Inf. Sci..

[2]  Michal Young,et al.  The MGIS: a minimal geographic information system accessible to users who are blind , 2013, SIGSPATIAL/GIS.

[3]  Jodi Forlizzi,et al.  TIMELINESSound in computing: a short history , 2009, INTR.

[4]  A. MacEachren,et al.  Some Truth With Maps: A Primer on Symbolization and Design , 2011 .

[5]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[6]  Reginald G. Golledge,et al.  Matching Geospatial Concepts with Geographic Educational Needs , 2008 .

[7]  F. Donders.  On the speed of mental processes. , 1969, Acta psychologica.

[8]  Daniel R. Montello,et al.  The Perception and Cognition of Environmental Distance: Direct Sources of Information , 1997, COSIT.

[9]  Jean-Loïc Le Carrou,et al.  Categorization of seismic sources by auditory display: A blind test , 2016, Int. J. Hum. Comput. Stud..

[10]  Adriaan Moelker,et al.  Acoustic noise concerns in functional magnetic resonance imaging , 2003, Human brain mapping.

[11]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[12]  James L. Alty,et al.  The rising pitch metaphor: an empirical study , 2005, Int. J. Hum. Comput. Stud..

[13]  Amy Lobben,et al.  The Map Effect , 2014 .

[14]  C. Guariglia,et al.  Neuropsychology of Environmental Navigation in Humans: Review and Meta-Analysis of fMRI Studies in Healthy Participants , 2014, Neuropsychology Review.

[15]  Daniel R. Montello,et al.  Cognitive Map-Design Research in the Twentieth Century: Theoretical and Empirical Approaches , 2002 .

[16]  Andrew J. Oxenham,et al.  Rhythm judgments reveal a frequency asymmetry in the perception and neural coding of sound synchrony , 2017, Proceedings of the National Academy of Sciences.

[17]  Stina Ojala,et al.  Tactile Maps - Safety and Usability , 2016 .

[18]  B. Walker,et al.  Mental scanning of sonifications reveals flexible encoding of nonspeech sounds and a universal per-item scanning cost. , 2011, Acta psychologica.

[19]  Michael Wood,et al.  Human Factors in Cartographic Communication , 1972 .

[20]  Steen Moeller,et al.  Evaluation of 2D multiband EPI imaging for high-resolution, whole-brain, task-based fMRI studies at 3T: Sensitivity and slice leakage artifacts , 2016, NeuroImage.

[21]  A. Robinson.  Elements of Cartography , 1953 .

[22]  Gary H. McClelland,et al.  Data analysis: A model comparison approach (2nd ed.). , 2009 .

[23]  Jonathan N. Middleton,et al.  The sound of migration: exploring data sonification as a means of interpreting multivariate salmon movement datasets , 2018, Heliyon.

[24]  Sophie K. Scott,et al.  Auditory neuroimaging with fMRI and PET , 2014, Hearing Research.

[25]  Deborah A. Hall,et al.  fMRI of the auditory cortex , 2006 .

[26]  Essa Yacoub,et al.  Less noise, more activation: Multiband acquisition schemes for auditory functional MRI , 2015, Magnetic resonance in medicine.

[27]  N. Kanwisher.  Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[28]  Doris-Eva Bamiou,et al.  The insula (Island of Reil) and its role in auditory processing Literature review , 2003, Brain Research Reviews.

[29]  James M. Keller,et al.  A human geospatial predictive analytics framework with application to finding medically underserved areas , 2014, 2014 IEEE Symposium on Computational Intelligence in Big Data (CIBD).

[30]  Helen Couclelis,et al.  People Manipulate Objects (but Cultivate Fields): Beyond the Raster-Vector Debate in GIS , 1992, Spatio-Temporal Reasoning.

[31]  Jin Chen,et al.  A Visualization System for Space-Time and Multivariate Patterns (VIS-STAMP) , 2006, IEEE Transactions on Visualization and Computer Graphics.

[32]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[33]  Polona Vilar,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th edition) , 2010, J. Assoc. Inf. Sci. Technol..

[34]  Applying a creative cognition approach to exploratory cartography tool development , 2012 .

[35]  M. D’Esposito,et al.  Experimental Design for Brain fMRI , 2000 .

[36]  Janni Nielsen,et al.  Getting access to what goes on in people's heads?: reflections on the think-aloud technique , 2002, NordiCHI '02.

[37]  F. Shellock,et al.  MR procedures: biologic effects, safety, and patient care. , 2004, Radiology.

[38]  Tilman Dingler,et al.  Learnabiltiy of Sound Cues for Environmental Features: Auditory Icons, Earcons, Spearcons, and Speech , 2008 .

[39]  I. Pollack,et al.  The Information of Elementary Multidimensional Auditory Displays , 1954 .

[40]  Waldo R. Tobler,et al.  Automation and Cartography , 1959 .

[41]  Daniel R. Montello,et al.  Functions and applications of spatial cognition. , 2013 .

[42]  Philip J. Gersmehl,et al.  Spatial Thinking by Young Children: Neurologic Evidence for Early Development and “Educability” , 2007 .

[43]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[44]  F G Shellock,et al.  Auditory noise associated with MR procedures: a review. , 2000, Journal of magnetic resonance imaging : JMRI.

[45]  J. O’Keefe,et al.  Space in the brain: how the hippocampal formation supports spatial cognition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  Randy L. Buckner,et al.  Mixed blocked/event-related designs separate transient and sustained activity in fMRI , 2003, NeuroImage.

[47]  Fabio De Felice,et al.  A haptic/acoustic application to allow blind the access to spatial information , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[48]  Bruce N. Walker,et al.  Universal Design of Auditory Graphs: A Comparison of Sonification Mappings for Visually Impaired and Sighted Listeners , 2010, TACC.

[49]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[50]  Donna Peuquet,et al.  Making Space for Time: Issues in Space-Time Data Representation , 1999, Proceedings. Tenth International Workshop on Database and Expert Systems Applications. DEXA 99.

[51]  G. Schlaug,et al.  Absolute Pitch and Planum Temporale , 2001, NeuroImage.

[52]  Donna J. Peuquet,et al.  A Conceptual Framework and Comparison of Spatial Data Models , 1984 .

[53]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[54]  Christos Constantinidis,et al.  A Neural Circuit Basis for Spatial Working Memory , 2004, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[55]  Edward S. Yeung,et al.  Pattern recognition by audio representation of multivariate analytical data , 1980 .

[56]  Thomas J. Baerwald,et al.  Prospects for Geography as an Interdisciplinary Discipline , 2010 .

[57]  C. Gaucherel,et al.  How climate, migration ability and habitat fragmentation affect the projected future distribution of European beech , 2015, Global change biology.

[58]  Scott St. George,et al.  Making Climate Data Sing: Using Music-like Sonifications to Convey a Key Climate Record , 2017 .

[59]  Bärbel Maus,et al.  Optimal Design for Functional Magnetic Resonance Imaging Experiments: Methodology, Challenges, and Future Perspectives , 2013 .

[60]  Mark Jenkinson,et al.  Fast, automated, N‐dimensional phase‐unwrapping algorithm , 2003, Magnetic resonance in medicine.

[61]  Keith J. Worsley,et al.  Statistical analysis of activation images , 2001 .

[62]  N. Gale,et al.  Exploring the anchor-point hypothesis of spatial cognition , 1987 .

[63]  Alexandra Supper,et al.  Sound Information: Sonification in the Age of Complex Data and Digital Audio , 2015 .

[64]  R Bowtell,et al.  Analytic approach to the design of transverse gradient coils with co‐axial return paths , 1999, Magnetic resonance in medicine.

[65]  Matthew T. Rice,et al.  Design Considerations for Haptic and Auditory Map Interfaces , 2005 .

[66]  G. Barker,et al.  Study design in fMRI: Basic principles , 2006, Brain and Cognition.

[67]  D A Sumikawa.  GUIDELINES FOR THE INTEGRATION OF AUDIO CUES INTO COMPUTER USER INTERFACES , 1985 .

[68]  Amy Lobben.  Classification and Application of Cartographic Animation , 2003 .

[69]  Ben Shneiderman,et al.  Listening to Maps: User Evaluation of Interactive Sonifications of Geo-Referenced Data (2004) , 2005 .

[70]  Murray Campbell,et al.  The Musician's Guide to Acoustics , 1990 .

[71]  Stephen Brewster,et al.  Nonspeech auditory output , 2002 .

[72]  Stefan Thesen,et al.  Scanning for the scanner: FMRI of audition by read-out omissions from echo-planar imaging , 2007, NeuroImage.

[73]  James L. Alty,et al.  Exploring the use of structured musical stimuli to communicate simple diagrams: the role of context , 2005, Int. J. Hum. Comput. Stud..

[74]  Anthony E. Richardson,et al.  Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning , 2006 .

[75]  Sile O'Modhrain,et al.  Recognition of Audified Data in Untrained Listeners , 2012 .

[76]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[77]  M. Wood,et al.  Visual Perception and Map Design , 1968 .

[78]  Brian J. L. Berry,et al.  APPROACHES TO REGIONAL ANALYSIS: A SYNTHESIS , 1964 .

[79]  A. Koláčcný.  Cartographic Information – A Fundamental Concept And Term In Modern Cartography , 1977 .

[80]  Judy M. Olson.  AUTOCORRELATION AND VISUAL MAP COMPLEXITY , 1975 .

[81]  C. Drake,et al.  Tempo sensitivity in auditory sequences: Evidence for a multiple-look model , 1993, Perception & psychophysics.

[82]  Sylvie Droit-Volet,et al.  SMA Selectively Codes the Active Accumulation of Temporal, Not Spatial, Magnitude , 2015, Journal of Cognitive Neuroscience.

[83]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[84]  Megen Brittell,et al.  Seeking a Reference Frame for Cartographic Sonification , 2018, Proceedings of the 24th International Conference on Auditory Display - ICAD 2018.

[85]  Nora Newcombe,et al.  Methods for the Study of Spatial Cognition , 2013 .

[86]  Constantine Stephanidis,et al.  Developing dual user interfaces for integrating blind and sighted users: the HOMER UIMS , 1995, CHI '95.

[87]  Dwight J. Kravitz,et al.  A Retinotopic Basis for the Division of High-Level Scene Processing between Lateral and Ventral Human Occipitotemporal Cortex , 2015, The Journal of Neuroscience.

[88]  Glenn Brauen,et al.  Interactive Audiovisual Design for Cartography , 2014 .

[89]  Jean-Pierre Fiset,et al.  How can we map stories? A cybercartographic application for narrative cartography , 2014 .

[90]  Timothy D. Griffiths,et al.  Orthogonal representation of sound dimensions in the primate midbrain , 2011, Nature Neuroscience.

[91]  R. A. Bryson,et al.  A METHOD FOR DESCRIBING QUANTITATIVELY THE CORRESPONDENCE OF GEOGRAPHICAL DISTRIBUTIONS1 , 1957 .

[92]  Stephen Brewster,et al.  Sonification of Astronomical Data , 2011, Proceedings of the International Astronomical Union.

[93]  Alan M. MacEachren,et al.  Map Complexity: Comparison and Measurement , 1982 .

[94]  Visda Goudarzi,et al.  Exploration of sonification design process through an interdisciplinary workshop , 2016, Audio Mostly Conference.

[95]  Raymond W. Kulhavy,et al.  How Cognitive Maps are Learned and Remembered , 1996 .

[96]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[97]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[98]  Kai-Florian Richter,et al.  Cognitive Aspects: How People Perceive, Memorize, Think and Talk About Landmarks , 2014 .

[99]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[100]  R. Golledge.  The Nature of Geographic Knowledge , 2002 .

[101]  Bruce N. Walker,et al.  Auditory Interfaces and Sonification , 2009, The Universal Access Handbook.

[102]  A. P. French.  How far away is the horizon , 1982 .

[103]  R. Buxton,et al.  Detection Power, Estimation Efficiency, and Predictability in Event-Related fMRI , 2001, NeuroImage.

[104]  Stephen M. Smith,et al.  General multilevel linear modeling for group analysis in FMRI , 2003, NeuroImage.

[105]  John Krygier,et al.  Sound and Geographic Visualization , 1994 .

[106]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[107]  W. Turnbull,et al.  Pitch discrimination as a function of tonal duration , 1944 .

[108]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[109]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[110]  M. Proulx,et al.  Visual experience facilitates allocentric spatial representation , 2013, Behavioural Brain Research.

[111]  Bruce N. Walker,et al.  ENCODING AND REPRESENTATION OF INFORMATION IN AUDITORY GRAPHS: DESCRIPTIVE REPORTS OF LISTENER STRATEGIES FOR UNDERSTANDING DATA , 2008 .

[112]  The Isometric Map as a Technique of Social Research , 1938, American Journal of Sociology.

[113]  D. Larkman,et al.  Use of multicoil arrays for separation of signal from multiple slices simultaneously excited , 2001, Journal of magnetic resonance imaging : JMRI.

[114]  P. Fisher.  Hearing the Reliability In Classified Remotely Sensed Images , 1994 .

[115]  Sara Irina Fabrikant,et al.  Exploring maps by sounds: using parameter mapping sonification to make digital elevation models audible , 2018, Int. J. Geogr. Inf. Sci..

[116]  Anjali Krishnan,et al.  Cluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations , 2014, NeuroImage.

[117]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[118]  Gregory G. Brown,et al.  A technique for the deidentification of structural brain MR images , 2007, Human brain mapping.

[119]  Amy Lobben,et al.  Inclusive Cartographic Design: Overcoming Ocular-Centric Cartographies , 2015 .

[120]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[121]  Jonathan Westley Peirce,et al.  Neuroinformatics Original Research Article Generating Stimuli for Neuroscience Using Psychopy , 2022 .

[122]  Thomas Porcello,et al.  Soundscapes: Toward a sounded anthropology , 2010 .

[123]  Qing Guo,et al.  A systematic review of the reporting of sample size calculations and corresponding data components in observational functional magnetic resonance imaging studies , 2014, NeuroImage.

[124]  Daniel R. Montello,et al.  Behavioral Methods for Spatial Cognition Research , 2016 .

[125]  Ursula Dresdner,et al.  Music Cognition And Computerized Sound An Introduction To Psychoacoustics , 2016 .

[126]  Satrajit S. Ghosh,et al.  Optimized Design and Analysis of Sparse-Sampling fMRI Experiments , 2013, Front. Neurosci..

[127]  Elizabeth D. Mynatt,et al.  Mapping GUIs to auditory interfaces , 1992, UIST '92.

[128]  Alan M. MacEachren,et al.  How Maps Work - Representation, Visualization, and Design , 1995 .

[129]  F. J. Langdon,et al.  The Child's Conception of Space , 1967 .

[130]  A. Supper.  Sublime frequencies:  The construction of sublime listening experiences in the sonification of scientific data , 2014, Social studies of science.

[131]  Ingrid S. Johnsrude,et al.  Interleaved silent steady state (ISSS) imaging: A new sparse imaging method applied to auditory fMRI , 2006, NeuroImage.

[132]  Andrew U. Frank,et al.  Using Hierarchical Spatial Data Structures for Hierarchical Spatial Reasoning , 1997, COSIT.

[133]  Alan M. MacEachren,et al.  The Role of Complexity and Symbolization Method in Thematic Map Effectiveness , 1982 .

[134]  G. Glover.  Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[135]  M. F. Fuller,et al.  Practical Nonparametric Statistics; Nonparametric Statistical Inference , 1973 .

[136]  R. Carson,et al.  Valuing shifts in the distribution of visibility in national parks and wilderness areas in the United States. , 2016, Journal of environmental management.

[137]  Mike Rinck.  Spatial situation models , 2005 .

[138]  Judy M. Olson,et al.  fMRI and Human Subjects Research in Cartography , 2009, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[139]  Wa Mackaness,et al.  Cartography thematic map design, 5th edition. , 2000 .

[140]  Dave R M Langers,et al.  Interactions between hemodynamic responses to scanner acoustic noise and auditory stimuli in functional magnetic resonance imaging , 2005, Magnetic resonance in medicine.

[141]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[142]  J. Morrison.  Changing Philosophical-Technical Aspects of Thematic Cartography , 1974 .

[143]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[144]  Stephen Brewster,et al.  Experimentally Derived Guidelines for the Creation of Earcons , 2001 .

[145]  Satrajit S. Ghosh,et al.  The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments , 2016, Scientific Data.

[146]  Judy M. Olson,et al.  USING fMRI IN CARTOGRAPHIC RESEARCH , 2007 .

[147]  R. Bowtell,et al.  “sparse” temporal sampling in auditory fMRI , 1999, Human brain mapping.

[148]  Mark S. Cohen,et al.  Echo planar imaging before and after fMRI: A personal history , 2012, NeuroImage.

[149]  Elizabeth Harris,et al.  The Look of Maps: An Examination of Cartographic Design , 1987 .

[150]  Daniel J. Levitin,et al.  Memory for musical attributes , 1999 .

[151]  Robert L. Alexander,et al.  Sonification of Ace Level 2 Solar Wind Data , 2010 .

[152]  P. Thorndyke,et al.  Individual differences in procedures for knowledge acquisition from maps , 1980, Cognitive Psychology.