Estimation of Person-Specific Visual Attention via Selection of Similar Persons

This paper presents a method for estimation of person-specific visual attention based on estimated similar persons' visual attention. For improving the estimation performance of person-specific visual attention, the proposed method uses the dataset including the large number of images and corresponding gaze data of many persons not including the target person and trains an estimation model based on deep learning. By using the estimated visual attention of similar persons for the target image, the proposed method estimates the visual attention of the target person with the small amount of gaze data. Experimental results show that the proposed method is effective for estimation of person-specific visual attention.

[1]  Shenghua Gao,et al.  Personalized Saliency and Its Prediction , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[4]  Shabab Bazrafkan,et al.  Eye Gaze for Consumer Electronics: Controlling and commanding intelligent systems. , 2015, IEEE Consumer Electronics Magazine.

[5]  Qi Zhao,et al.  SALICON: Saliency in Context , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Miki Haseyama,et al.  Estimation of User-Specific Visual Attention Based on Gaze Information of Similar Users , 2019, 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE).

[7]  Miki Haseyama,et al.  User-Specific Visual Attention Estimation Based on Visual Similarity and Spatial Information in Images , 2019, 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW).

[8]  Miki Haseyama,et al.  User-centric Visual Attention Estimation Based on Relationship between Image and Eye Gaze Data , 2018, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE).

[9]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[10]  Frédo Durand,et al.  What Do Different Evaluation Metrics Tell Us About Saliency Models? , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Noel E. O'Connor,et al.  SalGAN: Visual Saliency Prediction with Generative Adversarial Networks , 2017, ArXiv.