Affective analytics of demonstration sites

Abstract Multiple-criteria decision-making (MCDM) typically assumes that crowds make completely rational decisions. In MCDM, a crowd as a whole, or its individual members, generally make decisions free from any influence of valence, arousal, emotional state or environment. In contrast, various theories dealing with crowd psychology (Gustave Le Bon, Freudian, Deindividuation, Convergence, Emergent norm, Social identity) analyze, in one form or another, the emotions of the crowd. According to above theories, crowd is influenced by a range of behavioral factors, such as physical, social, psychological, culture, norms, and emotions. It can be argued that the emotional state, valence and arousal of crowds affect their decision making to a considerable degree and multiple criteria crowd behavior modeling must, therefore, consider this impact as well. In this light, the integration of crowd simulation and biometric methods, behavioral operations research and emotions in decision making has taken a prominent place as it leads to a better understanding of crowd emotions and crowd decision making. In this context, the authors developed the Affective Analytics of Demonstration Sites (ANDES) that added to this body of research in four ways. The crowd analysis and simulations conducted with ANDES used a neuro decision matrix. The matrix contains a detailed description of demonstration sites (public spaces) in question and the emotions, valence, arousal and physiological parameters of people present there. With ANDES’s Remote Sensor Network, emotional (emotions, valence, arousal) and physiological (average crowd facial temperature, crowd composition by gender and age group, etc.) parameters of people present at demonstration sites can be mapped. ANDES can assist experts in more effective implementations of public spaces planning and a participation process by attendees by collecting and examining various layers of data on the emotional and physiological parameters of visitors based on a visitors-centric public spaces planning approach. ANDES can determine the public space and real estate values.

[1]  E. Salazar-López,et al.  The mental and subjective skin: Emotion, empathy, feelings and thermography , 2015, Consciousness and Cognition.

[2]  M. Hui,et al.  Perceived Control and the Effects of Crowding and Consumer Choice on the Service Experience , 1991 .

[3]  Hamid Reza Arkian,et al.  MIST: Fog-based data analytics scheme with cost-efficient resource provisioning for IoT crowdsensing applications , 2017, J. Netw. Comput. Appl..

[4]  E. Zavadskas,et al.  The conceptual model of construction and real estate negotiation , 2009 .

[5]  Thomas Neubauer,et al.  A methodology for the pseudonymization of medical data , 2011, Int. J. Medical Informatics.

[6]  B. Streich Stadtplanung in der Wissensgesellschaft : ein Handbuch , 2005 .

[7]  B. Rowe,et al.  Ambient air pollution and depressive symptoms , 2014 .

[8]  Yung-Ming Li,et al.  A social route recommender mechanism for store shopping support , 2017, Decis. Support Syst..

[9]  C. Gehin,et al.  Infrared Imaging Analysis for Thermal Comfort Assessment , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Silvio Savarese,et al.  The Group and Crowd Analysis Interdisciplinary Challenge , 2017, Group and Crowd Behavior for Computer Vision.

[11]  J. Ciment,et al.  Social Issues in America: An Encyclopedia , 2006 .

[12]  J. Forgas Mood and judgment: the affect infusion model (AIM). , 1995, Psychological bulletin.

[13]  Edmundas Kazimieras Zavadskas,et al.  Decision support system for innovation with a special emphasis on pollution , 2007 .

[14]  Maria Roussou,et al.  Design and Evaluation of a Real-World Virtual Environment for Architecture and Urban Planning , 2007, PRESENCE: Teleoperators and Virtual Environments.

[15]  Susan Powell Mantel,et al.  Perceived Retail Crowding and Shopping Satisfaction: What Modifies This Relationship? , 2000 .

[16]  Norman I. Badler,et al.  Modeling Crowd and Trained Leader Behavior during Building Evacuation , 2006, IEEE Computer Graphics and Applications.

[17]  S. Mor,et al.  Assessment of noise pollution in and around a sensitive zone in North India and its non-auditory impacts. , 2016, The Science of the total environment.

[18]  I. Pavlidis,et al.  Thermal image analysis for polygraph testing. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[19]  Muhammad Reza Pourshahabi,et al.  A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection , 2014 .

[20]  Jean-Luc Dugelay,et al.  Towards crowd density-aware video surveillance applications , 2015, Inf. Fusion.

[21]  Luc Van Gool,et al.  Empiric design evaluation in urban planning , 2011 .

[22]  Edmundas Kazimieras Zavadskas,et al.  Method and system for Multi-Attribute Market Value Assessment in analysis of construction and retrofit projects , 2011, Expert Syst. Appl..

[23]  Karthik Vasudevan,et al.  Concurrent consideration of evacuation safety and productivity in manufacturing facility planning using multi-paradigm simulations , 2011, Comput. Ind. Eng..

[24]  I. Blešić,et al.  Visitors' motives for attending a hybrid event: a case study of agricultural fair. , 2015 .

[25]  Edmundas Kazimieras Zavadskas,et al.  The selection of effective retrofit scenarios for panel houses in urban neighborhoods based on expected energy savings and increase in market value: The Vilnius case , 2008 .

[26]  Vikas Agrawal,et al.  An agent-based simulation system for concert venue crowd evacuation modeling in the presence of a fire disaster , 2014, Expert Syst. Appl..

[27]  Anita Zehrer,et al.  The impact of perceived crowding on customer satisfaction , 2016 .

[28]  Zixue Cheng,et al.  Spatial Big Data Analytics for Cellular Communication Systems , 2017 .

[29]  Hadi Ghaderi,et al.  Sustainable third-party reverse logistics provider evaluation and selection using fuzzy SWARA and developed fuzzy COPRAS in the presence of risk criteria , 2018, Appl. Soft Comput..

[30]  L. Gibelli,et al.  Behavioral crowds: Modeling and Monte Carlo simulations toward validation , 2016 .

[31]  Chee Seng Chan,et al.  Crowd behavior analysis: A review where physics meets biology , 2015, Neurocomputing.

[32]  Gintautas Dzemyda,et al.  Multidimensional Data Visualization: Methods and Applications , 2012 .

[33]  C. Watanabe,et al.  Ambient air pollution and suicide in Tokyo, 2001-2011. , 2016, Journal of affective disorders.

[34]  A. Merla,et al.  Thermal Signatures of Emotional Arousal: A Functional Infrared Imaging Study , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  Siuming Lo,et al.  Randomness in the evacuation route selection of large-scale crowds under emergencies , 2015 .

[36]  Dirk Helbing,et al.  Specification of the Social Force Pedestrian Model by Evolutionary Adjustment to Video Tracking Data , 2007, Adv. Complex Syst..

[37]  Alessio Del Bue,et al.  Human behavior analysis in video surveillance: A Social Signal Processing perspective , 2013, Neurocomputing.

[38]  Arturas Kaklauskas Biometric and Intelligent Decision Making Support , 2015, Intelligent Systems Reference Library.

[39]  Edmundas Kazimieras Zavadskas,et al.  Evaluating the life cycle of a building: A multivariant and multiple criteria approach , 2008 .

[40]  Nirajan Shiwakoti,et al.  Enhancing the panic escape of crowd through architectural design , 2013 .

[41]  Sridha Sridharan,et al.  Automatic surveillance in transportation hubs: No longer just about catching the bad guy , 2015, Expert Syst. Appl..

[42]  Bernd Resch,et al.  Urban Emotions – Tools of Integrating People’s Perception into Urban Planning , 2015 .

[43]  Paul L. Rosin,et al.  A particle model of crowd behavior: Exploring the relationship between alcohol, crowd dynamics and violence , 2008 .

[44]  Hani S. Mahmassani,et al.  A hybrid simulation-assignment modeling framework for crowd dynamics in large-scale pedestrian facilities , 2016 .

[45]  Jie Li,et al.  On current crowd management practices and the need for increased situation awareness, prediction, and intervention , 2017 .

[46]  Dirk Helbing,et al.  Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods , 2011, Networks Heterog. Media.

[47]  Xianhua Wu,et al.  Effect of air pollution on the stock yield of heavy pollution enterprises in China's key control cities , 2018 .

[48]  B. Yogameena,et al.  Computer vision based crowd disaster avoidance system: A survey , 2017 .

[49]  N. Shoval,et al.  Mobility Research in the Age of the Smartphone , 2016 .

[50]  Wei Wang,et al.  A study of pedestrian group behaviors in crowd evacuation based on an extended floor field cellular automaton model , 2017 .

[51]  Human crowding and personal control: an integration of the research. , 1979 .

[52]  Ioannis T. Pavlidis,et al.  StressCam: non-contact measurement of users' emotional states through thermal imaging , 2005, CHI Extended Abstracts.

[53]  Maneesha Vinodini Ramesh,et al.  Context aware ad hoc network for mitigation of crowd disasters , 2014, Ad Hoc Networks.

[54]  P. Khalsa Biomechanics of musculoskeletal pain: dynamics of the neuromatrix. , 2004, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[55]  G. Moseley A pain neuromatrix approach to patients with chronic pain. , 2003, Manual therapy.

[56]  Ramon Spaaij,et al.  Sports crowd violence: An interdisciplinary synthesis , 2014 .

[57]  Vittorio Gallese,et al.  The Autonomic Signature of Guilt in Children: A Thermal Infrared Imaging Study , 2013, PloS one.

[58]  Sevgin Eroğlu,et al.  The interaction of retail density and music tempo: Effects on shopper responses , 2005 .

[59]  M. Shamim Hossain,et al.  Cloud-assisted secure video transmission and sharing framework for smart cities , 2017, Future Gener. Comput. Syst..

[60]  Haruyasu Yamada,et al.  Altered structural connectivity of pain-related brain network in burning mouth syndrome—investigation by graph analysis of probabilistic tractography , 2017, Neuroradiology.

[61]  Bernd Resch,et al.  Crowdsourcing Physiological Conditions and Subjective Emotions by Coupling Technical and Human Mobile Sensors , 2015 .

[62]  Noam Shoval,et al.  The shoemaker's son always goes barefoot: Implementations of GPS and other tracking technologies for geographic research , 2014 .

[63]  Hideto Ide,et al.  Study of Stress Analysis Using Facial Skin Temperature , 1998, J. Robotics Mechatronics.

[64]  Hairong Dong,et al.  Modeling and simulation of pedestrian dynamical behavior based on a fuzzy logic approach , 2016, Inf. Sci..

[65]  Yoshihisa Fujiwara,et al.  Using facial skin temperature to objectively evaluate sensations , 1997 .

[66]  Masashi Yasuda,et al.  Development of a skin temperature measuring system for non-contact stress evaluation , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[67]  Steve Miller,et al.  How to Get the Most Out of Trade Shows , 1989 .

[68]  Amit Birenboim,et al.  New approaches to the study of tourist experiences in time and space , 2016 .

[69]  Romualdas Bausys,et al.  Sustainable market valuation of buildings by the single-valued neutrosophic MAMVA method , 2017, Appl. Soft Comput..

[70]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[71]  Gintautas Dzemyda,et al.  Visualization of a set of parameters characterized by their correlation matrix , 2001 .

[72]  Shu Tao,et al.  A review of air pollution impact on subjective well-being: Survey versus visual psychophysics , 2018 .

[73]  Lale Akarun,et al.  Modeling annotator behaviors for crowd labeling , 2015, Neurocomputing.

[74]  Arturas Kaklauskas,et al.  Degree of Project Utility and Investment Value Assessments , 2016, Int. J. Comput. Commun. Control.

[75]  I. Pavlidis,et al.  Thermal imaging for anxiety detection , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).

[76]  P. Conzo,et al.  The Cultural Foundations of Happiness , 2017 .

[77]  Hong Liu,et al.  Extended route choice model based on available evacuation route set and its application in crowd evacuation simulation , 2017, Simul. Model. Pract. Theory.

[78]  Ladislav Lenc,et al.  Face Recognition under Real-world Conditions , 2013, ICAART.

[79]  Joakim Rydell,et al.  Estimation of crowd behavior using sensor networks and sensor fusion , 2009, 2009 12th International Conference on Information Fusion.

[80]  R. Melzack Pain and the neuromatrix in the brain. , 2001, Journal of dental education.

[81]  Gopal Das,et al.  Consumer emotions: Determinants and outcomes in a shopping mall , 2017 .

[82]  Stelios C. A. Thomopoulos,et al.  An agent-based crowd behaviour model for real time crowd behaviour simulation , 2014, Pattern Recognit. Lett..

[83]  G. Evans,et al.  The interaction of stressful life events and chronic strains on community mental health , 1987, American journal of community psychology.

[84]  N. Malys,et al.  Comparative analysis of MCDM methods for the assessment of sustainable housing affordability , 2016 .

[85]  Dinesh Manocha,et al.  Directing Crowd Simulations Using Navigation Fields , 2011, IEEE Transactions on Visualization and Computer Graphics.

[86]  Tim M. den Uyl,et al.  Automated facial coding: validation of basic emotions and FACS AUs in FaceReader , 2014 .

[87]  Jing Wang,et al.  Spatio-temporal texture modelling for real-time crowd anomaly detection , 2016, Comput. Vis. Image Underst..

[88]  Cacm Staff,et al.  A conversation with David E. Shaw , 2009 .

[89]  K. Smallbone,et al.  An assessment of sustainable housing affordability using a multiple criteria decision making method , 2013 .

[90]  A Lundberg,et al.  Psychiatric Aspects of Air Pollution , 1996, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[91]  N. Shoval,et al.  Tracking technologies and urban analysis: Adding the emotional dimension , 2018 .

[92]  Majid Sarvi,et al.  Pedestrian crowd tactical-level decision making during emergency evacuations , 2016 .

[93]  Kristian Hegner Reinau,et al.  High-Resolution Measurement and Analysis of Visitor Experiences in Time and Space: The Case of Aalborg Zoo in Denmark , 2015 .

[94]  Sheldon Cohen Behavior, Health, and Environmental Stress , 1986 .

[95]  Bernd Resch,et al.  Urban Emotions and Cycling Experience – Enriching Traffic Planning for Cyclists with Human Sensor Data , 2016 .

[96]  Rakesh Garg,et al.  Optimal selection of E-learning websites using multiattribute decision-making approaches , 2017 .

[97]  Xiaoqiang Lu,et al.  Learning deep event models for crowd anomaly detection , 2017, Neurocomputing.

[98]  Jason M. Harley,et al.  A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system , 2014, Comput. Hum. Behav..

[99]  Ris S. C. Lee,et al.  Minimisation of the risk of trampling in a crowd , 2007, Math. Comput. Simul..

[100]  Miguel Angel Ferrer-Ballester,et al.  Biometric System Verification Close to "Real World" Conditions , 2009, COST 2101/2102 Conference.

[101]  J. Zyl,et al.  Introduction to the Physics and Techniques of Remote Sensing , 2006 .

[102]  Edmundas Kazimieras Zavadskas,et al.  A neuro-advertising property video recommendation system , 2017, Technological Forecasting and Social Change.

[103]  J. Gramann Toward a behavioral theory of crowding in outdoor recreation: An evaluation and synthesis of research , 1982 .

[104]  Haidi Ibrahim,et al.  Recent survey on crowd density estimation and counting for visual surveillance , 2015, Eng. Appl. Artif. Intell..

[105]  Arun Kumar Sangaiah,et al.  An intelligent decision computing paradigm for crowd monitoring in the smart city , 2017, J. Parallel Distributed Comput..

[106]  Joakim Rydell,et al.  Crowd behavior analysis under cameras network fusion using probabilistic methods , 2010, 2010 13th International Conference on Information Fusion.

[107]  Manuela Tancogne-Dejean,et al.  Fire risk perception and building evacuation by vulnerable persons: Points of view of laypersons, fire victims and experts , 2016 .

[108]  Ioannis Pavlidis,et al.  The face of fear , 2001 .

[109]  Shimon Y. Nof,et al.  Sustainability decision support system based on collaborative control theory , 2012, Annu. Rev. Control..

[110]  Yingling Fan,et al.  Commute happiness in Xi’an, China: Effects of commute mode, duration, and frequency , 2018 .

[111]  Marcos Faúndez-Zanuy,et al.  Biometric Face Recognition with Different Training and Testing Databases , 2007, COST 2102 Workshop.

[112]  K. Trout The neuromatrix theory of pain: implications for selected nonpharmacologic methods of pain relief for labor. , 2004, Journal of midwifery & women's health.

[113]  Massimo Pizzol,et al.  Contingent valuation of health and mood impacts of PM2.5 in Beijing, China. , 2018, The Science of the total environment.

[114]  Wentong Cai,et al.  Crowd modeling and simulation technologies , 2010, TOMC.

[115]  Michael A. McCollough,et al.  Service Encounter Emotional Value , 2001 .

[116]  D. Halperin Environmental noise and sleep disturbances: A threat to health? , 2014, Sleep science.

[117]  Ken Eason,et al.  Factors influencing experience in crowds - The participant perspective. , 2017, Applied ergonomics.

[118]  Thomas Blaschke,et al.  Ubiquitous Geo-Sensing for Context-Aware Analysis: Exploring Relationships between Environmental and Human Dynamics , 2012, Sensors.