When Are Two Visual Cognition Systems Better Than One?

Visual decision-making involving pairs of individuals tasked with determining the location of an object is a cognitive process combining independent systems together. Although it has been observed that combined systems can improve each of the individual systems, it remains a challenging problem to determine why and how this will occur. In this paper, we use Combinatorial Fusion Analysis (CFA) as a methodology through which we can effectively combine the decisions of two independent visual cognition systems. An experiment with 20 trials is performed in which participants are tasked with determining an object location, and stating the uncertainty factor for their decision. Our results demonstrate that the combination of two visual cognition systems using CFA can match or improve the performance of each individual system only if the pair of systems perform relatively well and are cognitively diverse.

[1]  M. Ernst.  Learning to integrate arbitrary signals from vision and touch. , 2007, Journal of vision.

[2]  D. Frank Hsu,et al.  Comparing Rank and Score Combination Methods for Data Fusion in Information Retrieval , 2005, Information Retrieval.

[3]  Paul B. Kantor,et al.  Predicting the effectiveness of Naïve data fusion on the basis of system characteristics , 2000 .

[4]  Shiro Usui,et al.  Brain and Health Informatics , 2013, Lecture Notes in Computer Science.

[5]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[6]  S. Gepshtein,et al.  The combination of vision and touch depends on spatial proximity. , 2005, Journal of vision.

[7]  Jeffrey M. Bradshaw,et al.  Brain Informatics , 2011 .

[8]  Christina Schweikert,et al.  Combining multiple ChIP-seq peak detection systems using combinatorial fusion , 2012, BMC Genomics.

[9]  Benjamin J. Southwell,et al.  Human Object Recognition Using Colour and Depth Information from an RGB-D Kinect Sensor , 2013 .

[10]  M. Morrone,et al.  Touch disambiguates rivalrous perception at early stages of visual analysis , 2010, Current Biology.

[11]  Xing Zhang,et al.  A skeleton pruning algorithm based on information fusion , 2013, Pattern Recognit. Lett..

[12]  D. Frank Hsu,et al.  Combining Two Visual Cognition Systems Using Confidence Radius and Combinatorial Fusion , 2013, Brain and Health Informatics.

[13]  Chuan Yi Tang,et al.  Feature Selection and Combination Criteria for Improving Accuracy in Protein Structure Prediction , 2007, IEEE Transactions on NanoBioscience.

[14]  Damian M. Lyons,et al.  Combining multiple scoring systems for target tracking using rank-score characteristics , 2009, Inf. Fusion.

[15]  Marc O. Ernst.  Decisions Made Better , 2010, Science.

[16]  D. Frank Hsu,et al.  Comparative Study of Joint Decision-Making on Two Visual Cognition Systems Using Combinatorial Fusion , 2012, AMT.

[17]  D. Frank Hsu,et al.  Joint decision making in visual cognition using Combinatorial Fusion Analysis , 2011, IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11).

[18]  D. Frank Hsu,et al.  Sensor Feature Selection and Combination for Stress Identification Using Combinatorial Fusion , 2013 .

[19]  D. Frank Hsu,et al.  Rank-Score Characteristics (RSC) Function and Cognitive Diversity , 2010, Brain Informatics.

[20]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[21]  D. Frank Hsu,et al.  Fusion of two visual perception systems utilizing cognitive diversity , 2013, 2013 IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing.

[22]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[23]  D. Frank Hsu,et al.  Combining multiple visual cognition systems for joint decision-making using combinatorial fusion , 2012, 2012 IEEE 11th International Conference on Cognitive Informatics and Cognitive Computing.

[24]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[25]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[26]  Asher Koriat,et al.  When Are Two Heads Better than One and Why? , 2012, Science.

[27]  D. Frank Hsu,et al.  Consensus Scoring Criteria for Improving Enrichment in Virtual Screening , 2005, J. Chem. Inf. Model..