Power to the people: Leveraging human physiological traits to control microprocessor frequency

Any architectural optimization aims at satisfying the end user. However, modern architectures execute with little to no knowledge about the individual user. If architectures could determine whether their users are satisfied, they could provide higher efficiency; improved reliability, reduced power consumption, increased security, and a better user experience. A major reason for this limitation is their input devices. Specifically, the traditional input devices (e.g., the mouse and keyboard) provide limited information about the user. In this paper, we make a case for the addition of new biometric input devices for providing the computer information about the userpsilas physiological traits. We explore three biometric devices as potential sensors: an eye tracker, a galvanic skin response (GSR) sensor, and force sensors. We first present two user studies that explore the link between the sensor readings and user satisfaction when the performance of the processor is varied as a video game is being played. In the first study, we drastically drop the processor clock frequency at a set point in the game. In the second study, we set the clock frequency to randomly-selected levels during game play. Both studies show that there are significant changes in human physiological traits as performance decreases. More importantly, we show that physiological changes correlate strongly to the satisfaction levels reported by the users. Based upon these observations, we construct a Physiological Traits-based Power-management (PTP) system that can be applied to existing dynamic voltage and frequency scaling (DVFS) schemes. We apply PTP to a typical CPU-utilization-based adaptive DVFS policy and evaluate our scheme using a third user study. An aggressive version of our PTP scheme reduces the total system power consumption of a laptop by up to 33.3% for an application averaged across users (18.1% averaged across three applications), while a conservative version reduces the total system power consumption by up to 25.6% across users (11.4% averaged across three applications).

[1]  Peter A. Dinda,et al.  User-Driven Frequency Scaling , 2006, IEEE Computer Architecture Letters.

[2]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[3]  Niraj K. Jha,et al.  An energy-aware framework for coordinated dynamic software management in mobile computers , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[4]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[5]  R. VetrugnoMD,et al.  Sympathetic skin response , 2003 .

[6]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[7]  M. Toyokura.  Waveform and habituation of sympathetic skin response. , 1998, Electroencephalography and clinical neurophysiology.

[8]  Peter A. Dinda,et al.  PICSEL: measuring user-perceived performance to control dynamic frequency scaling , 2008, ASPLOS.

[9]  Maria Virvou,et al.  Towards Improving Visual-Facial Emotion Recognition through Use of Complementary Keyboard-Stroke Pattern Information , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[10]  A. Ax.  The Physiological Differentiation between Fear and Anger in Humans , 1953, Psychosomatic medicine.

[11]  Krisztián Flautner,et al.  Vertigo: Automatic Performance-Setting for Linux , 2002, OSDI.

[12]  John Lee,et al.  Eye movements and pupil dilation during event perception , 2006, ETRA.

[13]  Pietro Cortelli,et al.  Sympathetic skin response: basic mechanisms and clinical applications. , 2003, Clinical autonomic research : official journal of the Clinical Autonomic Research Society.

[14]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[15]  Thomas Martinetz,et al.  Remote Eye Tracking: State of the Art and Directions for Future Development , 2006 .

[16]  Barry Fowler,et al.  A 640×512 CMOS Image Sensor with Ultra Wide Dynamic Range Floating-Point Pixel-Level ADC , 1999 .

[17]  Mincheol Whang.  The Emotional Computer Adaptive to Human Emotion , 2008 .

[18]  Margaret Martonosi,et al.  A dynamic compilation framework for controlling microprocessor energy and performance , 2005, 38th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'05).

[19]  Peter A. Dinda,et al.  Towards Scheduling Virtual Machines Based On Direct User Input , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[20]  Zheng Wang,et al.  Using latency to evaluate interactive system performance , 1996, OSDI '96.

[21]  Brian P. Bailey,et al.  Towards an index of opportunity: understanding changes in mental workload during task execution , 2004, CHI.

[22]  Vasily G. Moshnyaga,et al.  Reducing Energy Consumption of Computer Display by Camera-Based User Monitoring , 2005, PATMOS.

[23]  A. El Gamal,et al.  A 640/spl times/512 CMOS image sensor with ultra wide dynamic range floating-point pixel-level ADC , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[24]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[25]  Peter A. Dinda,et al.  Measuring and understanding user comfort with resource borrowing , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[26]  Carson Reynolds,et al.  The HandWave Bluetooth Skin Conductance Sensor , 2005, ACII.

[27]  Alea Chandler Teeters,et al.  Use of a wearable camera system in conversation : toward a companion tool for social-emotional learning in autism , 2007 .

[28]  David Blaauw,et al.  Razor: A Low-Power Pipeline Based on Circuit-Level Timing Speculation , 2003, MICRO.

[29]  R. D. Valentine,et al.  The Intel Pentium M processor: Microarchitecture and performance , 2003 .

[30]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[31]  Bishop Brock,et al.  Dynamic Power Management for Embedded Systems , 2003 .

[32]  Venkatesh Pallipadi,et al.  The Ondemand Governor Past, Present, and Future , 2010 .

[33]  B. Brock,et al.  Dynamic power management for embedded systems [SOC design] , 2003, IEEE International [Systems-on-Chip] SOC Conference, 2003. Proceedings..

[34]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[35]  Carson Jonathan Reynolds,et al.  The sensing and measurement of frustration with computers , 2001 .

[36]  Alan Jay Smith,et al.  Using user interface event information in dynamic voltage scaling algorithms , 2002, 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003. MASCOTS 2003..

[37]  Lionel Lacassagne,et al.  Low power image processing: analog versus digital comparison , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[38]  Peter A. Dinda,et al.  Learning and Leveraging the Relationship between Architecture-Level Measurements and Individual User Satisfaction , 2008, 2008 International Symposium on Computer Architecture.

[39]  Cynthia Breazeal,et al.  Stoop to Conquer: Posture and Affect Interact to Influence Computer Users' Persistence , 2007, ACII.

[40]  Richard L. Hazlett,et al.  Measuring emotional valence to understand the user's experience of software , 2007, Int. J. Hum. Comput. Stud..

[41]  Dragan Maksimovic,et al.  Closed-loop adaptive voltage scaling controller for standard-cell ASICs , 2002, ISLPED '02.