Smoothed Graphic User Interaction on Smartphones With Motion Prediction

The smoothness of human-smartphone interaction directly influences users experience and affects their purchase decisions. A commonly used method to improve user interaction of smartphones is to optimize the CPU scheduler. However, optimizing the CPU scheduler requires a modification of operating system. In addition, the improvement of the smoothness of human-smartphone interaction may be limited because the display subsystem is not optimized. Therefore, in this paper, we design a motion prediction queuing system, named MPQS, to improve the smoothness of human-smartphone interaction. For this, we use the information of vector, speed, movement, provided by the queuing mechanism of Android, to predict the movement of user-smartphone interaction. Based on the prediction, we then utilize available execution time between frames to perform image processing. We conducted a set of experiments on beagleboard-xM to evaluate the performance of MPQS. Our experiment results show that the proposed method can reduce the number of jank by up to 21.75%.

[1]  Marisol García-Valls,et al.  A library for developing real-time and embedded applications in C , 2015, J. Syst. Archit..

[2]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[3]  Robert B. Miller,et al.  Response time in man-computer conversational transactions , 1899, AFIPS Fall Joint Computing Conference.

[4]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[5]  Barton P. Miller,et al.  A comparison of interactivity in the Linux 2.6 scheduler and an MLFQ scheduler , 2007, Softw. Pract. Exp..

[6]  Marisol García-Valls,et al.  Resource management policies for real-time Java remote invocations , 2014, J. Parallel Distributed Comput..

[7]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[8]  Feng Guo,et al.  Research of graphics acceleration based on embedded system , 2012, 2012 International Conference on Audio, Language and Image Processing.

[9]  C.S. Wong,et al.  Fairness and interactive performance of O(1) and CFS Linux kernel schedulers , 2008, 2008 International Symposium on Information Technology.

[10]  Andy J. Wellings,et al.  Architecting Time-Critical Big-Data Systems , 2016, IEEE Transactions on Big Data.

[11]  Marisol García-Valls,et al.  Comparative analysis of two different middleware approaches for reconfiguration of distributed real-time systems , 2014, J. Syst. Archit..

[12]  Guoliang Xing,et al.  Reducing Smartphone Application Delay through Read/Write Isolation , 2015, MobiSys.

[13]  Jian-Jia Chen,et al.  Energy-Efficient Scheduling in Nonpreemptive Systems With Real-Time Constraints , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[15]  Peng Li,et al.  Fairness and Interactivity of Three CPU Schedulers in Linux , 2009, 2009 15th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications.

[16]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[17]  Xi Wang,et al.  Optimal Priority-Free Conditionally-Preemptive Real-Time Scheduling of Periodic Tasks Based on DES Supervisory Control , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Seongsoo Hong,et al.  Improving Interactivity via VT-CFS and Framework-Assisted Task Characterization for Linux/Android Smartphones , 2012, 2012 IEEE International Conference on Embedded and Real-Time Computing Systems and Applications.