The end user in computer architecture and systems research

The ultimate goal of a computer design is to satisfy the end user. However, the design and optimization of computer architectures have largely left the user out of the loop. In this dissertation, I make the case that with modern computer architectures it is becoming increasingly important to take the end user into account. I then propose three specific aspects of the end user that should be explored when incorporating the end user into loop; (1) user perception, (2) user state, and (3) user activity. First, I show that that computer architects should study the end user’s perception of performance relative to actual hardware performance. User studies show that for satisfaction across different users. This variation represents opportunity for optimizing computer architectures subject to individual user satisfaction. Second, I make the case for measuring user state via empathic input devices, input devices providing a computer with information about user state. I demonstrate that three example empathic input devices (eye tracking, a galvanic skin response sensor, and force sensors) can be useful for understanding changes in user satisfaction for driving power optimizations. Third, I show that computer architects should begin studying the activity of the end user as an important part of the workload. I study real user activity on Android G1 mobile phones and to show that it can be important in characterizing power consumption, and developing new power optimizations. Overall, this work points towards a new approach to computer architecture and systems research that incorporates the end user into the loop. The findings show that if we place the end user into the design and optimization process, we can significantly improve the effciency of current computer architectures and systems, while maintaining or even improving individual user satisfaction at the same time.

[1]  Brian P. Bailey,et al.  Towards an index of opportunity: understanding changes in mental workload during task execution , 2004, CHI.

[2]  Dakshi Agrawal,et al.  Inferring client response time at the web server , 2002, SIGMETRICS '02.

[3]  Peter A. Dinda,et al.  Experiences with Client-based Speculative Remote Display , 2008, USENIX Annual Technical Conference.

[4]  Peter A. Dinda,et al.  EmNet: Satisfying The Individual User Through Empathic Home Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[5]  Peter A. Dinda,et al.  PICSEL: measuring user-perceived performance to control dynamic frequency scaling , 2008, ASPLOS.

[6]  Gokhan Memik,et al.  Into the wild: Studying real user activity patterns to guide power optimizations for mobile architectures , 2009, 2009 42nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[7]  Peter A. Dinda,et al.  Measuring and understanding user comfort with resource borrowing , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[8]  Sunny Consolvo,et al.  Designing for persuasion: mobile services for health behavior change , 2009, Persuasive '09.

[9]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[10]  Mingsong Bi,et al.  IADVS: On-demand performance for interactive applications , 2010, HPCA - 16 2010 The Sixteenth International Symposium on High-Performance Computer Architecture.

[11]  David Garlan,et al.  Giving Users the Steering Wheel for Guiding Resource-Adaptive Systems , 2005 .

[12]  Bishop Brock,et al.  Dynamic Power Management for Embedded Systems , 2003 .

[13]  Venkatesh Pallipadi,et al.  The Ondemand Governor Past, Present, and Future , 2010 .

[14]  Mincheol Whang The Emotional Computer Adaptive to Human Emotion , 2008 .

[15]  Carla Schlatter Ellis,et al.  Energy estimation tools for the Palm , 2000, MSWIM '00.

[16]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[17]  Peter A. Dinda,et al.  Characterizing and Modeling User Activity on Smartphones , 2010 .

[18]  Niraj K. Jha,et al.  High-level software energy macro-modeling , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).

[19]  Margaret Martonosi,et al.  A dynamic compilation framework for controlling microprocessor energy and performance , 2005, 38th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'05).

[20]  Lizy Kurian John,et al.  Run-time modeling and estimation of operating system power consumption , 2003, SIGMETRICS '03.

[21]  Brian D. Davison,et al.  Predicting Sequences of User Actions , 1998 .

[22]  Jason Flinn,et al.  Self-Tuning Wireless Network Power Management , 2003, MobiCom '03.

[23]  John Lee,et al.  Eye movements and pupil dilation during event perception , 2006, ETRA.

[24]  D. Simons,et al.  Change Blindness in the Absence of a Visual Disruption , 2000, Perception.

[25]  Carson Jonathan Reynolds,et al.  The sensing and measurement of frustration with computers , 2001 .

[26]  Lizy Kurian John,et al.  Runtime identification of microprocessor energy saving opportunities , 2005, ISLPED '05. Proceedings of the 2005 International Symposium on Low Power Electronics and Design, 2005..

[27]  Bruce Jacob,et al.  The performance and energy consumption of three embedded real-time operating systems , 2001, CASES '01.

[28]  Lionel Lacassagne,et al.  Low power image processing: analog versus digital comparison , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[29]  Peter A. Dinda,et al.  Learning and Leveraging the Relationship between Architecture-Level Measurements and Individual User Satisfaction , 2008, 2008 International Symposium on Computer Architecture.

[30]  Pietro Cortelli,et al.  Sympathetic skin response: basic mechanisms and clinical applications. , 2003, Clinical autonomic research : official journal of the Clinical Autonomic Research Society.

[31]  Massoud Pedram,et al.  Dynamic voltage and frequency scaling based on workload decomposition , 2004, Proceedings of the 2004 International Symposium on Low Power Electronics and Design (IEEE Cat. No.04TH8758).

[32]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[33]  Thomas Martinetz,et al.  Remote Eye Tracking: State of the Art and Directions for Future Development , 2006 .

[34]  Cynthia Breazeal,et al.  Stoop to Conquer: Posture and Affect Interact to Influence Computer Users' Persistence , 2007, ACII.

[35]  Alan Jay Smith,et al.  Using user interface event information in dynamic voltage scaling algorithms , 2002, 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003. MASCOTS 2003..

[36]  Liam Murphy,et al.  User perception of adapting video quality , 2006, Int. J. Hum. Comput. Stud..

[37]  Jack J. Dongarra,et al.  A Portable Programming Interface for Performance Evaluation on Modern Processors , 2000, Int. J. High Perform. Comput. Appl..

[38]  Yong Wang,et al.  Content-adaptive utility-based video adaptation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[39]  Luis von Ahn Games with a Purpose , 2006, Computer.

[40]  Niraj K. Jha,et al.  An energy-aware framework for coordinated dynamic software management in mobile computers , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[41]  John Langford,et al.  CAPTCHA: Using Hard AI Problems for Security , 2003, EUROCRYPT.

[42]  Hiroshi Nakamura,et al.  An intra-task dvfs technique based on statistical analysis of hardware events , 2007, CF '07.

[43]  Vibhore Vardhan,et al.  Power Consumption Breakdown on a Modern Laptop , 2004, PACS.

[44]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[45]  Chandra Krintz,et al.  A run-time, feedback-based energy estimation model For embedded devices , 2006, Proceedings of the 4th International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS '06).

[46]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[47]  Wei-Chung Hsu,et al.  Design and Implementation of a Lightweight Dynamic Optimization System , 2004, J. Instr. Level Parallelism.

[48]  R. D. Valentine,et al.  The Intel Pentium M processor: Microarchitecture and performance , 2003 .

[49]  Frank Bellosa,et al.  The benefits of event: driven energy accounting in power-sensitive systems , 2000, ACM SIGOPS European Workshop.

[50]  Mahmut T. Kandemir,et al.  vEC: virtual energy counters , 2001, PASTE '01.

[51]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[52]  Maria Virvou,et al.  Towards Improving Visual-Facial Emotion Recognition through Use of Complementary Keyboard-Stroke Pattern Information , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[53]  Thomas P. Moran,et al.  User-tailorable systems: pressing the issues with buttons , 1990, CHI '90.

[54]  A. Ax The Physiological Differentiation between Fear and Anger in Humans , 1953, Psychosomatic medicine.

[55]  Krisztián Flautner,et al.  Vertigo: Automatic Performance-Setting for Linux , 2002, OSDI.

[56]  Aleksandar Kuzmanovic,et al.  Network Monitoring is People: Understanding End-user Perception of Network Problems , 2010 .

[57]  Peter A. Dinda,et al.  User-Driven Frequency Scaling , 2006, IEEE Computer Architecture Letters.

[58]  Margaret Martonosi,et al.  Run-time power estimation in high performance microprocessors , 2001, ISLPED '01.

[59]  Deborah Estrin,et al.  Diversity in smartphone usage , 2010, MobiSys '10.

[60]  Peter A. Dinda,et al.  Display power management policies in practice , 2010, ICAC '10.

[61]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[62]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[63]  Liam Murphy,et al.  User-perceived quality-aware adaptive delivery of MPEG-4 content , 2003, NOSSDAV '03.

[64]  Peter A. Dinda,et al.  Sonar-based measurement of user presence and attention , 2009, UbiComp.

[65]  Niraj K. Jha,et al.  Power analysis of embedded operating systems , 2000, Proceedings 37th Design Automation Conference.

[66]  Michael Stumm,et al.  Online performance analysis by statistical sampling of microprocessor performance counters , 2005, ICS '05.

[67]  Peter A. Dinda,et al.  Towards Scheduling Virtual Machines Based On Direct User Input , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[68]  Peter A. Dinda,et al.  User- and process-driven dynamic voltage and frequency scaling , 2009, 2009 IEEE International Symposium on Performance Analysis of Systems and Software.

[69]  Carson Reynolds,et al.  The HandWave Bluetooth Skin Conductance Sensor , 2005, ACII.

[70]  Zheng Wang,et al.  Using latency to evaluate interactive system performance , 1996, OSDI '96.

[71]  Margo I. Seltzer,et al.  Improving interactive performance using TIPME , 2000, SIGMETRICS '00.

[72]  David W. McDonald,et al.  Theory-driven design strategies for technologies that support behavior change in everyday life , 2009, CHI.

[73]  Richard L. Hazlett,et al.  Measuring emotional valence to understand the user's experience of software , 2007, Int. J. Hum. Comput. Stud..

[74]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[75]  Peter A. Dinda,et al.  Power to the people: Leveraging human physiological traits to control microprocessor frequency , 2008, 2008 41st IEEE/ACM International Symposium on Microarchitecture.

[76]  Lance M. Berc,et al.  Continuous profiling: where have all the cycles gone? , 1997, ACM Trans. Comput. Syst..

[77]  Suresh Singh,et al.  Applying models of user activity for dynamic power management in wireless devices , 2008, Mobile HCI.

[78]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[79]  Alea Chandler Teeters,et al.  Use of a wearable camera system in conversation : toward a companion tool for social-emotional learning in autism , 2007 .

[80]  David Blaauw,et al.  Razor: A Low-Power Pipeline Based on Circuit-Level Timing Speculation , 2003, MICRO.

[81]  Dragan Maksimovic,et al.  Closed-loop adaptive voltage scaling controller for standard-cell ASICs , 2002, ISLPED '02.

[82]  Peter A. Dinda,et al.  The user in experimental computer systems research , 2007, ExpCS '07.

[83]  Peter A. Dinda,et al.  Characterizing and modeling user activity on smartphones: summary , 2010, SIGMETRICS '10.

[84]  M. Toyokura Waveform and habituation of sympathetic skin response. , 1998, Electroencephalography and clinical neurophysiology.

[85]  Alex Pentland,et al.  Social serendipity: mobilizing social software , 2005, IEEE Pervasive Computing.

[86]  Mahmut T. Kandemir,et al.  Using complete machine simulation for software power estimation: the SoftWatt approach , 2002, Proceedings Eighth International Symposium on High Performance Computer Architecture.

[87]  Aggelos K. Katsaggelos,et al.  Maximizing user utility in video streaming applications , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[88]  David W. McDonald,et al.  Goal-setting considerations for persuasive technologies that encourage physical activity , 2009, Persuasive '09.

[89]  Gilberto Contreras,et al.  Power prediction for Intel XScale processors using performance monitoring unit events , 2005 .

[90]  Parthasarathy Ranganathan,et al.  Energy-aware user interfaces: an evaluation of user acceptance , 2004, CHI.

[91]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[92]  Parthasarathy Ranganathan,et al.  Investigating the Relationship Between Battery Life and User Acceptance of Dynamic, Energy-Aware Interfaces on Handhelds , 2004, Mobile HCI.

[93]  Rami G. Melhem,et al.  Minimizing expected energy in real-time embedded systems , 2005, EMSOFT.

[94]  Margaret Martonosi,et al.  Wattch: a framework for architectural-level power analysis and optimizations , 2000, Proceedings of 27th International Symposium on Computer Architecture (IEEE Cat. No.RS00201).

[95]  Peter A. Dinda,et al.  Putting the User in Direct Control of CPU Scheduling , 2006 .

[96]  Vasily G. Moshnyaga,et al.  Reducing Energy Consumption of Computer Display by Camera-Based User Monitoring , 2005, PATMOS.