3D teleimmersive activity classification based on application-system metadata

Being able to detect and recognize human activities is essential for 3D collaborative applications for efficient quality of service provisioning and device management. A broad range of research has been devoted to analyze media data to identify human activity, which requires the knowledge of data format, application-specific coding technique and computationally expensive image analysis. In this paper, we propose a human activity detection technique based on application generated metadata and related system metadata. Our approach does not depend on specific data format or coding technique. We evaluate our algorithm with different cyber-physical setups, and show that we can achieve very high accuracy (above 97%) by using a good learning model.

[1]  Ruzena Bajcsy,et al.  Teleimmersive 3D collaborative environment for cyberarchaeology , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  Andrew T. Campbell,et al.  Community-Guided Learning: Exploiting Mobile Sensor Users to Model Human Behavior , 2010, AAAI.

[3]  David Chu,et al.  Demo: Sword fight with smartphones , 2011, SenSys.

[4]  Ruzena Bajcsy,et al.  Classification and Analysis of 3 D Tele-immersive Activities , 2012 .

[5]  Kristen Grauman,et al.  Efficient activity detection with max-subgraph search , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ruzena Bajcsy,et al.  Classification and Analysis of 3D Teleimmersive Activities , 2013, IEEE MultiMedia.

[7]  Dan Roth,et al.  Learning Based Java for Rapid Development of NLP Systems , 2010, LREC.

[8]  Bart Selman,et al.  Human Activity Detection from RGBD Images , 2011, Plan, Activity, and Intent Recognition.

[9]  Wei Niu,et al.  Human activity detection and recognition for video surveillance , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[10]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[11]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[12]  Henry Fuchs,et al.  Real-time volumetric 3D capture of room-sized scenes for telepresence , 2012, 2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[13]  Klara Nahrstedt,et al.  Prioritized evolutionary optimization in open session management for 3D tele-immersion , 2013, MMSys.