Can You See It?

Today's smartphones and wearable devices come equipped with an array of inertial sensors, along with IMU-based Human Activity Recognition models to monitor everyday activities. However, such models rely on large amounts of annotated training data, which require considerable time and effort for collection. One has to recruit human subjects, define clear protocols for the subjects to follow, and manually annotate the collected data, along with the administrative work that goes into organizing such a recording.

[1]  G. Abowd,et al.  IMUTube , 2020 .

[2]  Cholmin Kang,et al.  Towards Machine Learning with Zero Real-World Data , 2019, WearSys@MobiSys.

[3]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[4]  Dario Pavllo,et al.  3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Gregory D. Abowd,et al.  IMUTube: Automatic extraction of virtual on-body accelerometry from video for human activity recognition , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[6]  Peter Andras,et al.  On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution , 2013, ISWC '13.

[7]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sozo Inoue,et al.  A Multi-Sensor Setting Activity Recognition Simulation Tool , 2018, UbiComp/ISWC Adjunct.

[9]  D. K. Arvind,et al.  IMUSim: A simulation environment for inertial sensing algorithm design and evaluation , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[10]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[11]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).