Touch Gesture and Pupil Reaction on Mobile Terminal to Find Occurrences of Interested Items in Web Browsing

Mobile users usually browse web pages on mobile terminals. Many new interesting items occur when the user browses web pages. However, since former methods use the history of past searches to identify users' interests in order to recommend services based on them, it is difficult to estimate pinpoint and new interests for the users. This paper proposes a method to estimate the hidden interesting items in pinpoint, by the user's touch operations and pupil reactions. A part of a web page which user looks at is regarded as their interested items when both touch operations and pupil reactions make a response related to their interested items. The methods can deal with users' interests, because touch operations and pupil reactions show their current interests. Moreover, using both touch operations and pupil reactions improves the precision of the estimation, because they can reduce each noise. Users are able to enjoy the services provided according to their estimated pinpoint and current interests after the estimation of the interested items. When we estimate interested items with the proposed method, we calculated the precision, the recall and the F-measure for every subject. The mean of the precision, the recall and the F-measure are 0.850, 0.534, and 0.603, respectively. In addition, we discuss how to improve the proposed method from the aspects of touch gestures and pupil reactions.

[1]  Ravi Kumar,et al.  Recommendation Systems , 2001 .

[2]  E. Hess.  ATTITUDE AND PUPIL SIZE. , 1965, Scientific American.

[3]  Yo-Sub Han,et al.  A Smart Movie Recommendation System , 2011, HCI.

[4]  Michael J. Pazzani,et al.  User Modeling for Adaptive News Access , 2000, User Modeling and User-Adapted Interaction.

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Raymond K. Wong,et al.  Online role mining for context-aware mobile service recommendation , 2013, Personal and Ubiquitous Computing.

[7]  Enhong Chen,et al.  Mining Mobile User Preferences for Personalized Context-Aware Recommendation , 2014, ACM Trans. Intell. Syst. Technol..

[8]  Umberto Straccia,et al.  Combining Fuzzy Logic and Semantic Web to Enable Situation-Awareness in Service Recommendation , 2010, DEXA.

[9]  Michael J. Pazzani,et al.  Learning and Revising User Profiles: The Identification of Interesting Web Sites , 1997, Machine Learning.

[10]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[11]  Hiromitsu Shimakawa,et al.  Specific Touch Gesture on Mobile Devices to Find Attractive Phrases in News Browsing , 2014, 2014 IEEE 38th Annual Computer Software and Applications Conference.

[12]  Hans-Peter Kriegel,et al.  Ieee Transactions on Knowledge and Data Engineering Probabilistic Memory-based Collaborative Filtering , 2022 .

[13]  Dan Witzner Hansen,et al.  Eye tracking in the wild , 2005, Comput. Vis. Image Underst..