Privacy implications of accelerometer data: a review of possible inferences

Accelerometers are sensors for measuring acceleration forces. They can be found embedded in many types of mobile devices, including tablet PCs, smartphones, and smartwatches. Some common uses of built-in accelerometers are automatic image stabilization, device orientation detection, and shake detection. In contrast to sensors like microphones and cameras, accelerometers are widely regarded as not privacy-intrusive. This sentiment is reflected in protection policies of current mobile operating systems, where third-party apps can access accelerometer data without requiring security permission. It has been shown in experiments, however, that seemingly innocuous sensors can be used as a side channel to infer highly sensitive information about people in their vicinity. Drawing from existing literature, we found that accelerometer data alone may be sufficient to obtain information about a device holder's location, activities, health condition, body features, gender, age, personality traits, and emotional state. Acceleration signals can even be used to uniquely identify a person based on biometric movement patterns and to reconstruct sequences of text entered into a device, including passwords. In the light of these possible inferences, we suggest that accelerometers should urgently be re-evaluated in terms of their privacy implications, along with corresponding adjustments to sensor protection mechanisms.

[1]  Marko Katana,et al.  Physical Activity and Depressive Mood in the Daily Life of Older Adults , 2017 .

[2]  Zhi Xu,et al.  SemaDroid: A Privacy-Aware Sensor Management Framework for Smartphones , 2015, CODASPY.

[3]  Catherine B. Chan,et al.  Cross-sectional relationship of pedometer-determined ambulatory activity to indicators of health. , 2003, Obesity research.

[4]  Hiro-Fumi Yanai,et al.  Estimating Carrier's Height by Accelerometer Signals of a Smartphone , 2016, HCI.

[5]  Gary M. Weiss,et al.  Actitracker: A Smartphone-Based Activity Recognition System for Improving Health and Well-Being , 2016, 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[6]  S.Y. Lee,et al.  Accelerometer's position free human activity recognition using a hierarchical recognition model , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[7]  H. H. Merrifield Female gait patterns in shoes with different heel heights. , 1971, Ergonomics.

[8]  Venet Osmani,et al.  Automatic Sensing of Speech Activity and Correlation with Mood Changes , 2013 .

[9]  Stephen S. Intille,et al.  Automated detection of puffing and smoking with wrist accelerometers , 2014, PervasiveHealth.

[10]  Y. Bhagat,et al.  Clinical validation of a wrist actigraphy mobile health device for sleep efficiency analysis , 2014, 2014 IEEE Healthcare Innovation Conference (HIC).

[11]  Gary M. Weiss,et al.  Cell phone-based biometric identification , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[12]  Christoph Busch,et al.  Authentication of Smartphone Users Based on the Way They Walk Using k-NN Algorithm , 2012, 2012 Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[13]  Zhi Xu,et al.  TapLogger: inferring user inputs on smartphone touchscreens using on-board motion sensors , 2012, WISEC '12.

[15]  Emin Anarim,et al.  Age group detection using smartphone motion sensors , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[16]  A. Pesonen,et al.  The Validity of a New Consumer-Targeted Wrist Device in Sleep Measurement: An Overnight Comparison Against Polysomnography in Children and Adolescents. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[17]  Dong Xuan,et al.  Mobile phone based drunk driving detection , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[18]  Jun Han,et al.  ACComplice: Location inference using accelerometers on smartphones , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[19]  C. Tudor-Locke,et al.  Accelerometer-determined peak cadence and weight status in children from São Caetano do Sul, Brazil. , 2017, Ciencia & saude coletiva.

[20]  G. G. Alvarez,et al.  The impact of daily sleep duration on health: a review of the literature. , 2004, Progress in cardiovascular nursing.

[21]  Emre Ertin,et al.  puffMarker: a multi-sensor approach for pinpointing the timing of first lapse in smoking cessation , 2015, UbiComp.

[22]  R. Fitzpatrick,et al.  Age-related differences in walking stability. , 2003, Age and ageing.

[23]  Gary M. Weiss,et al.  Identifying user traits by mining smart phone accelerometer data , 2011, SensorKDD '11.

[24]  Tim Dallas,et al.  Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer , 2014, IEEE Transactions on Biomedical Engineering.

[25]  Parth H. Pathak,et al.  AccelWord: Energy Efficient Hotword Detection through Accelerometer , 2015, MobiSys.

[26]  Hao Chen,et al.  TouchLogger: Inferring Keystrokes on Touch Screen from Smartphone Motion , 2011, HotSec.

[27]  Emmanuel Agu,et al.  Smartphone Inference of Alcohol Consumption Levels from Gait , 2015, 2015 International Conference on Healthcare Informatics.

[28]  T. Baranowski,et al.  Adolescent patterns of physical activity differences by gender, day, and time of day. , 2005, American journal of preventive medicine.

[29]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[30]  Beatrix Vereijken,et al.  Physical activity monitoring by use of accelerometer-based body-worn sensors in older adults: a systematic literature review of current knowledge and applications. , 2012, Maturitas.

[31]  Yu-Ping Wang,et al.  Sensor Guardian: prevent privacy inference on Android sensors , 2017, EURASIP J. Inf. Secur..

[32]  I. Janssen,et al.  Estimating sleep efficiency in 10‐ to‐ 13‐year‐olds using a waist‐worn accelerometer , 2018, Sleep health.

[33]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[34]  Reza Shokri,et al.  Evaluating the Privacy Risk of Location-Based Services , 2011, Financial Cryptography.

[35]  Kamin Whitehouse,et al.  Doorjamb: unobtrusive room-level tracking of people in homes using doorway sensors , 2012, SenSys '12.

[36]  Hassan A. Karimi,et al.  An Artificial Neural Network for Movement Pattern Analysis to Estimate Blood Alcohol Content Level , 2017, Sensors.

[37]  Jim Tørresen,et al.  Smartphone accelerometer data used for detecting human emotions , 2016, 2016 3rd International Conference on Systems and Informatics (ICSAI).

[38]  R. Dishman,et al.  Personality And Physical Activity: A Systematic Review And Meta-analysis , 2014 .

[39]  Jer-Vui Lee,et al.  Smart Elderly Home Monitoring System with an Android Phone , 2013 .

[40]  Hassan A. Karimi,et al.  An Artificial Neural Network for Gait Analysis to Estimate Blood Alcohol Content Level , 2017, ArXiv.

[41]  O. Kwon,et al.  Gender differences in three dimensional gait analysis data from 98 healthy Korean adults. , 2004, Clinical biomechanics.

[42]  A. Terracciano,et al.  Personality and Actigraphy-Measured Physical Activity in Older Adults , 2017, Psychology and aging.

[43]  Andrea Mannini,et al.  Activity recognition using a single accelerometer placed at the wrist or ankle. , 2013, Medicine and science in sports and exercise.

[44]  Friedrich Foerster,et al.  Detection of posture and motion by accelerometry : a validation study in ambulatory monitoring , 1999 .

[45]  Tingshao Zhu,et al.  Emotion recognition based on customized smart bracelet with built-in accelerometer , 2016, PeerJ.

[46]  Predrag V. Klasnja,et al.  Exploring Privacy Concerns about Personal Sensing , 2009, Pervasive.

[47]  Mark J. Buller,et al.  Estimating load carriage from a body-worn accelerometer , 2015, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[48]  Philippe Golle,et al.  On the Anonymity of Home/Work Location Pairs , 2009, Pervasive.

[49]  Gwenn Englebienne,et al.  Mining for motivation: using a single wearable accelerometer to detect people's interests , 2012, IMMPD '12.

[50]  Scott E Crouter,et al.  Validity of 10 electronic pedometers for measuring steps, distance, and energy cost. , 2003, Medicine and science in sports and exercise.

[51]  Michael Catt,et al.  A Novel, Open Access Method to Assess Sleep Duration Using a Wrist-Worn Accelerometer , 2015, PloS one.

[52]  Jun Han,et al.  ACCessory: password inference using accelerometers on smartphones , 2012, HotMobile '12.

[53]  Jingyu Hua,et al.  We Can Track You if You Take the Metro: Tracking Metro Riders Using Accelerometers on Smartphones , 2015, IEEE Transactions on Information Forensics and Security.

[54]  E. Evans,et al.  Personality Correlates of Physical Activity in College Women. , 2015, Medicine and science in sports and exercise.

[55]  J S Arora,et al.  Accelerographic analysis of several types of walking. , 1971, American Journal of Physical Medicine.

[56]  Hongnian Yu,et al.  Activity classification using a single wrist-worn accelerometer , 2011, 2011 5th International Conference on Software, Knowledge Information, Industrial Management and Applications (SKIMA) Proceedings.

[57]  Vivek Kanhangad,et al.  Investigating gender recognition in smartphones using accelerometer and gyroscope sensor readings , 2016, 2016 International Conference on Computational Techniques in Information and Communication Technologies (ICCTICT).

[58]  Wolfgang Schlicht,et al.  Be active and become happy: an ecological momentary assessment of physical activity and mood. , 2010, Journal of sport & exercise psychology.

[59]  Sebastian Risi,et al.  Deep-Spying: Spying using Smartwatch and Deep Learning , 2015, ArXiv.

[60]  Rajesh Kumar,et al.  Context-Aware Active Authentication Using Smartphone Accelerometer Measurements , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[61]  D. Warburton,et al.  Health benefits of physical activity: the evidence , 2006, Canadian Medical Association Journal.

[62]  Gabi Nakibly,et al.  Mobile Device Identification via Sensor Fingerprinting , 2014, ArXiv.

[63]  Adam J. Aviv,et al.  Practicality of accelerometer side channels on smartphones , 2012, ACSAC '12.

[64]  Francisco B. Ortega,et al.  Accelerometer Data Collection and Processing Criteria to Assess Physical Activity and Other Outcomes: A Systematic Review and Practical Considerations , 2017, Sports Medicine.

[65]  Urs Hengartner,et al.  Two Novel Defenses against Motion-Based Keystroke Inference Attacks , 2014, ArXiv.

[66]  Nikita Borisov,et al.  Tracking Mobile Web Users Through Motion Sensors: Attacks and Defenses , 2016, NDSS.

[67]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[68]  Sheng Liu,et al.  A physiological sound sensing system using accelerometer based on flip-chip piezoelectric technology and asymmetrically gapped cantilever , 2015, 2015 IEEE 65th Electronic Components and Technology Conference (ECTC).

[69]  Sen Zhang,et al.  Detection of Activities by Wireless Sensors for Daily Life Surveillance: Eating and Drinking , 2009, Sensors.

[70]  He Wang,et al.  MoLe: Motion Leaks through Smartwatch Sensors , 2015, MobiCom.

[71]  Vincenzo Pasquale Giofrè,et al.  Driving Behavior and Traffic Safety: An Acceleration-Based Safety Evaluation Procedure for Smartphones , 2014 .

[72]  Pushpendra Singh,et al.  Using mobile phone sensors to detect driving behavior , 2013, ACM DEV '13.

[73]  Sonia Ancoli-Israel,et al.  Daily Patterns of Accelerometer Activity Predict Changes in Sleep, Cognition, and Mortality in Older Men , 2018, The journals of gerontology. Series A, Biological sciences and medical sciences.

[74]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[75]  Oscar Mayora-Ibarra,et al.  Automatic Stress Detection in Working Environments From Smartphones’ Accelerometer Data: A First Step , 2015, IEEE Journal of Biomedical and Health Informatics.

[76]  Wenyuan Xu,et al.  AccelPrint: Imperfections of Accelerometers Make Smartphones Trackable , 2014, NDSS.

[77]  Ashwin Ashok,et al.  Whose move is it anyway? Authenticating smart wearable devices using unique head movement patterns , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[78]  Emmanuel,et al.  Using machine learning for real-time activity recognition and estimation of energy expenditure , 2008 .