App usage prediction for dual display device via two-phase sequence modeling

Abstract There have been many recent studies dealing with issues regarding app usage prediction. A number of smartphone manufacturers have recently released flexible dual display devices for multitasking purposes. In spite of many studies achieving higher levels of prediction accuracy, owing to certain practical limitations, they have not been effectively applied to real dual display devices. First, they trained their prediction model using only existing data collected from a single display device. Thus, they are unable to reflect the multitasking usage of dual display devices in their model prediction. In addition, previous studies have mostly been based on a Markov assumption, which needs to calculate the transition probability for all pairs of apps, which is difficult to calculate for newly installed apps. To address these limitations, we initially trained our prediction model using data collected from a single display during the first phase, and re-trained the prediction model using data collected from the prototype of a dual display device, which we developed along with LG Electronics, during the second phase. In addition, we applied an app prediction user interface to the prototype. Next, we applied a stacked long–short term memory architecture, a type of sequential deep learning architecture, to train the prediction model without calculating the transition probability. The experiment results show that our proposed method achieves an effective app usage prediction for dual display devices in a qualitative way, and outperforms all other approaches in quantitative experiments with top-3 and top-5 level accuracies. The reason for the higher performance of the proposed method is that it captures the real usage of a dual display and reflects multitasking use in its app usage prediction. In addition, we also verified the effects of a few variables such as the location, time, and two-phase training.

[1]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[2]  Gang Pan,et al.  Prophet: what app you wish to use next , 2013, UbiComp.

[3]  Hong Cao,et al.  Mining smartphone data for app usage prediction and recommendations: A survey , 2017, Pervasive Mob. Comput..

[4]  Zhaohui Wu,et al.  Discovering different kinds of smartphone users through their application usage behaviors , 2016, UbiComp.

[5]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[6]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[7]  Saeed Moghaddam,et al.  MobileMiner: mining your frequent patterns on your phone , 2014, UbiComp.

[8]  Kuo-Wei Hsu Efficiently and Effectively Mining Time-Constrained Sequential Patterns of Smartphone Application Usage , 2017, Mob. Inf. Syst..

[9]  Hilde A. M. Voorveld,et al.  Insight into everyday media use with multiple screens , 2017 .

[10]  Jilei Tian,et al.  Towards Personalized Context-Aware Recommendation by Mining Context Logs through Topic Models , 2012, PAKDD.

[11]  Alastair R. Beresford,et al.  Device Analyzer: Understanding Smartphone Usage , 2013, MobiQuitous.

[12]  Xiangang Li,et al.  Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Jie Liu,et al.  Fast app launching for mobile devices using predictive user context , 2012, MobiSys '12.

[14]  Dongyan Zhao,et al.  Transition-Based Discourse Parsing with Multilayer Stack Long Short Term Memory , 2016, NLPCC/ICCPOL.

[15]  Philip S. Yu,et al.  On the Feature Discovery for App Usage Prediction in Smartphones , 2013, 2013 IEEE 13th International Conference on Data Mining.

[16]  Xiaoxiao Ma,et al.  Predicting mobile application usage using contextual information , 2012, UbiComp.

[17]  Yi-Wei Lin,et al.  Mining mobile application sequential patterns for usage prediction , 2014, 2014 IEEE International Conference on Granular Computing (GrC).

[18]  Yang Wang,et al.  AppRush: Using Dynamic Shortcuts to Facilitate Application Launching on Mobile Devices , 2013, ANT/SEIT.

[19]  Ricardo Baeza-Yates,et al.  Predicting The Next App That You Are Going To Use , 2015, WSDM.

[20]  Lin Zhang,et al.  Exploiting User Context and Network Information for Mobile Application Usage Prediction , 2015, HOTPOST '15.

[21]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Jin-Hyuk Hong,et al.  Understanding and prediction of mobile application usage for smart phones , 2012, UbiComp.

[23]  Dong-Hee Shin,et al.  How the second screens change the way people interact and learn: the effects of second screen use on information processing , 2016, Interact. Learn. Environ..

[24]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[25]  Fathi M. Salem,et al.  Simplified minimal gated unit variations for recurrent neural networks , 2017, 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS).

[26]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[27]  Daniel Gatica-Perez,et al.  Where and what: Using smartphones to predict next locations and applications in daily life , 2014, Pervasive Mob. Comput..

[28]  Nagarajan Natarajan,et al.  Which app will you use next?: collaborative filtering with interactional context , 2013, RecSys.

[29]  Nicholas Jing Yuan,et al.  A contextual collaborative approach for app usage forecasting , 2016, UbiComp.

[30]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[31]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[32]  Xiaoming Liu,et al.  On Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).