Walking and health: an enactive affective system

ABSTRACT This essay presents a transdisciplinary project whose objective is to create a sensorised insole built with latex (Hevea brasiliensis) to measure physiological variations of the human body, as well as to graphically represent affective reciprocal exchanges of the human behaviour with the environment. The purpose is to improve our enactive system through the use of various physiological sensors (e.g. pressure, galvanic skin response and temperature sensors), which can be processed and visualised by revealing the affective exchanges of the body while walking in the city, pinned on a map as data visualisation. Inspired by the enaction theories, the output of sensors and devices application that models the perception as a laboratory phenomenon, as proposed by Dr Ted Krueger, the investigation directed by Dr Domingues is conceived for the expanded sensorium and for the reengineering of life. The artwork is inserted in the domain of aesthetic investigation of art as experiences related to topics on art and technoscience for innovation in health. The created prototype was tested in the city at different locations and the results demonstrated its use as a kind of personal assistant for vital signals by configuring an enactive system added of affective qualities which possibilities to reveal the ‘pathos’, or the affective narratives experienced in the emergent reciprocity with the city. The insole biomaterial, created by Dr Suelia Rodrigues (BioEngeLab), has been successfully used to measure the foot pressure and to serve as a health assistant, especially for people with diabetes. The signal-processing approaches, explored in Biomedical engineering by Dr Cristiano Miosso, were empowered by data visualisation approaches developed by Dr Ricardo Torres (University of Campinas). Finally, we consider this prototype a creative technology for mhealth, which is a disruptive innovation, by providing other forms of existence.

[1]  Jennifer Healey,et al.  Recording Affect in the Field: Towards Methods and Metrics for Improving Ground Truth Labels , 2011, ACII.

[2]  Joseph A. Paradiso,et al.  Expressive footwear for computer-augmented dance performance , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[3]  Rosalind W. Picard Affective computing: (526112012-054) , 1997 .

[4]  Tapio Takala,et al.  Enactive cinema paves way for understanding complex real-time social interaction in neuroimaging experiments , 2012, Front. Hum. Neurosci..

[5]  Ted Krueger,et al.  Design and prosthetic perception , 2007, Kybernetes.

[6]  A. Boulton,et al.  The global burden of diabetic foot disease , 2005, The Lancet.

[7]  Adson Ferreira da Rocha,et al.  Biocybrid systems and the re-engineering of life , 2011, Electronic Imaging.

[8]  R. Rosenfeld,et al.  Ethics , 2008 .

[9]  Steve Kelling,et al.  BirdVis: Visualizing and Understanding Bird Populations , 2011, IEEE Transactions on Visualization and Computer Graphics.

[10]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[11]  W. Davis The Ecological Approach to Visual Perception , 2012 .

[12]  Maja Pantic,et al.  Affect-Sensitive Multi-Modal Monitoring in Ubiquitous Computing: Advances and Challenges , 2001, ICEIS.

[13]  Yadira Albornoz,et al.  The effects of group improvisational music therapy on depression in adolescents and adults with substance abuse: a randomized controlled trial** , 2011 .

[14]  Kevin Lynch,et al.  The Image of the City , 1960 .

[15]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[16]  A. Veves,et al.  The risk of foot ulceration in diabetic patients with high foot pressure: a prospective study , 1992, Diabetologia.

[17]  Lea Fleischer,et al.  The Senses Considered As Perceptual Systems , 2016 .

[18]  M Lord,et al.  Plantar pressures are elevated in the neuroischemic and the neuropathic diabetic foot. , 1999, Diabetes care.

[19]  Jurandy Almeida,et al.  Phenological visual rhythms: Compact representations for fine-grained plant species identification , 2016, Pattern Recognit. Lett..

[20]  Tapio Takala,et al.  Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces , 2011, Leonardo.

[21]  E. Couchot La technologie dans l'art : de la photographie à la réalité virtuelle , 1998 .

[22]  E. Hall The hidden dimension: an anthropologist examines man's use of space in public and private , 1969 .

[23]  S. Martin,et al.  A system for visualizing time varying oceanographic 3D data , 2004, Oceans '04 MTS/IEEE Techno-Ocean '04 (IEEE Cat. No.04CH37600).

[24]  B. Massumi Parables for the Virtual: Movement, Affect, Sensation , 2002 .

[25]  C. Aguiton,et al.  Living Maps New data , new uses , new problems , 2009 .

[26]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[27]  Jung Wook Park,et al.  Estimation of Indoor Physical Activity Level Based on Footstep Vibration Signal Measured by MEMS Accelerometer for Personal Health Care Under Smart Home Environments , 2009 .

[28]  Joseph A. Paradiso,et al.  Gait Analysis Using a Shoe-Integrated Wireless Sensor System , 2008, IEEE Transactions on Information Technology in Biomedicine.

[29]  Michael S. Horn,et al.  Visualizing Biodiversity with Voronoi Treemaps , 2009, 2009 Sixth International Symposium on Voronoi Diagrams.

[30]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[31]  L. Poissant Arts et sciences:: Les biotechnologies et le bioart , 2012 .

[32]  Robert E. Morley,et al.  In-shoe multisensory data acquisition system , 2001, IEEE Transactions on Biomedical Engineering.

[33]  A. Boulton,et al.  The diabetic foot: grand overview, epidemiology and pathogenesis , 2008, Diabetes/metabolism research and reviews.

[34]  Alex Pentland,et al.  Looking at People: Sensing for Ubiquitous and Wearable Computing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  H. Maturana,et al.  The Tree of Knowledge: The Biological Roots of Human Understanding , 2007 .

[36]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[37]  Ming-Zher Poh,et al.  Wearable sensors: Opportunities and challenges for low-cost health care , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[38]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[39]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[40]  Pia Tikka Enactive Cinema: Simulatorium Eisensteinense , 2008 .

[41]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[42]  M. J. Muêller,et al.  Monitoring in-shoe plantar pressures, temperature, and humidity: reliability and validity of measures from a portable device. , 2001, Archives of physical medicine and rehabilitation.

[43]  Marina Zimmermann,et al.  Teste de biocompatibilidade e resistncia de membranas de ltex em ces , 2007 .

[44]  A. de Lange,et al.  Elevated plantar pressures in neuropathic diabetic patients with claw/hammer toe deformity. , 2005, Journal of biomechanics.

[45]  Alex Pentland,et al.  Sensible Organizations: Technology and Methodology for Automatically Measuring Organizational Behavior , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Charles Perin,et al.  SoccerStories: A Kick-off for Visual Soccer Analysis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[47]  Vijay Viswanathan,et al.  Effectiveness of different types of footwear insoles for the diabetic neuropathic foot: a follow-up study. , 2004, Diabetes care.

[48]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[49]  R. M. Schafer,et al.  The tuning of the world , 1977 .

[50]  Ramesh Raskar,et al.  Embodiments, visualizations, and immersion with enactive affective systems , 2014, Electronic Imaging.

[51]  Joao L. A. Carvalho,et al.  Insole with pressure control and tissue neoformation induction systems for diabetic foot , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.