AROMA

Human activity recognition (HAR) is a promising research issue in ubiquitous and wearable computing. However, there are some problems existing in traditional methods: 1) They treat HAR as a single label classification task, and ignore the information from other related tasks, which is helpful for the original task. 2) They need to predesign features artificially, which are heuristic and not tightly related to HAR task. To address these problems, we propose AROMA (human activity recognition using deep multi-task learning). Human activities can be divided into simple and complex activities. They are closely linked. Simple and complex activity recognitions are two related tasks in AROMA. For simple activity recognition task, AROMA utilizes a convolutional neural network (CNN) to extract deep features, which are task dependent and non-handcrafted. For complex activity recognition task, AROMA applies a long short-term memory (LSTM) network to learn the temporal context of activity data. In addition, there is a shared structure between the two tasks, and the object functions of these two tasks are optimized jointly. We evaluate AROMA on two public datasets, and the experimental results show that AROMA is able to yield a competitive performance in both simple and complex activity recognitions.

[1]  Thomas Plötz,et al.  Ensembles of Deep LSTM Learners for Activity Recognition using Wearables , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  Daniel Roggen,et al.  Deep convolutional feature transfer across mobile activity recognition domains, sensor modalities and locations , 2016, SEMWEB.

[3]  Takuya Maekawa,et al.  Toward practical factory activity recognition: unsupervised understanding of repetitive assembly work in a factory , 2016, UbiComp.

[4]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[5]  Ming Liu,et al.  Sensor-based human activity recognition system with a multilayered model using time series shapelets , 2015, Knowl. Based Syst..

[6]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[7]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[8]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[9]  Hongnian Yu,et al.  Elderly activities recognition and classification for applications in assisted living , 2013, Expert Syst. Appl..

[10]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[11]  Bernt Schiele,et al.  Daily Routine Recognition through Activity Spotting , 2009, LoCA.

[12]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[13]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Scott E. Hudson,et al.  Techniques for addressing fundamental privacy and disruption tradeoffs in awareness support systems , 1996, CSCW '96.

[15]  Konrad Tollmar,et al.  Supporting social awareness @ work design and experience , 1996, CSCW '96.

[16]  Hiroshi Ishii,et al.  Transparent layered user interfaces: an evaluation of a display design to enhance focused and divided attention , 1995, CHI '95.

[17]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[18]  William W. Gaver The affordances of media spaces for collaboration , 1992, CSCW '92.

[19]  Ronald E. Rice,et al.  Evaluating video as a technology for informal communication , 1992, CHI.

[20]  Paul Dourish,et al.  Portholes: supporting awareness in a distributed work group , 1992, CHI.

[21]  Marilyn Tremaine,et al.  Experiences in the use of a media space , 1991, CHI.

[22]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[23]  Carl Gutwin,et al.  Using Disortion-Oriented Displays to Support Workspace Awareness , 1996, BCS HCI.

[24]  Scott E. Hudson,et al.  Low disturbance audio for awareness and privacy in media space applications , 1995, MULTIMEDIA '95.

[25]  Sara A. Bly,et al.  Media spaces: bringing people together in a video, audio, and computing environment , 1993, CACM.