Personalized Ubiquitous Data Collection and Intervention as Interactive Multimedia Documents

The Experience Sampling Method (ESM) has been proposed as a method for collecting data about people's experiences in their everyday and natural environments. ESM-based systems offer limited authoring for interactive documents designed to collect text-based responses offered as answers to text-based questions, and integrated with the non-intrusive data collection from sensors. From a document engineering perspective, ESM brings new requirements with respect to the authoring of non-trivial interaction and navigation workflow, in particular when multiple media and collaborative tasks are concerned. Tackling existing challenges, we modeled the Experience Sampling and Programmed Intervention Method (ESPIM) by combining ESM, individualized teaching procedures and ubiquitous computing toward producing interactive personalized multimedia documents applied in data collection.

[1]  Harald Kosch,et al.  Interactive non-linear video: definition and XML structure , 2012, DocEng '12.

[2]  M. Csíkszentmihályi,et al.  The ecology of adolescent activity and experience , 1977, Journal of youth and adolescence.

[3]  Anind K. Dey,et al.  Lifelogging memory appliance for people with episodic memory impairment , 2008, UbiComp.

[4]  Yue-Sun Kuo,et al.  An XML interaction service for workflow applications , 2006, DocEng '06.

[5]  Gaetano Borriello,et al.  Open data kit 2.0: expanding and refining information services for developing regions , 2013, HotMobile '13.

[6]  Sam Epstein,et al.  The first book of teaching machines , 1961 .

[7]  Bob Evans,et al.  Using Experience Sampling Methodology to Collect Deep Data About Your Users , 2015, CHI Extended Abstracts.

[8]  Deborah Estrin,et al.  Ohmage , 2015, ACM Trans. Intell. Syst. Technol..

[9]  Thierry Nodenot,et al.  A framework with tools for designing web-based geographic applications , 2011, DocEng '11.

[10]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[11]  Angelo Signore,et al.  Mapping and sharing agro-biodiversity using Open Data Kit and Google Fusion Tables , 2016, Comput. Electron. Agric..

[12]  Cameron L. McCormack,et al.  Authoring adaptive diagrams , 2008, ACM Symposium on Document Engineering.

[13]  Deborah Estrin,et al.  Center of excellence for mobile sensor data-to-knowledge (MD2K) , 2015, J. Am. Medical Informatics Assoc..

[14]  M. Petruzzi,et al.  WhatsApp: a telemedicine platform for facilitating remote oral medicine consultation and improving clinical examinations. , 2016, Oral surgery, oral medicine, oral pathology and oral radiology.

[15]  Maria da Graça Campos Pimentel,et al.  ESPIM: An Ubiquitous Data Collection and Programmed Intervention System using ESM and Mobile Devices , 2016, WebMedia.

[16]  Pablo César,et al.  Multimedia Document Structure for Distributed Theatre , 2015, DocEng.

[17]  M. Petruzzi,et al.  Response to: WhatsApp: a telemedicine platform for facilitating remote oral medicine consultation and improving clinical examinations. , 2016, Oral surgery, oral medicine, oral pathology and oral radiology.

[18]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.