Socio-inspired ICT

Modern ICT (Information and Communication Technology) has developed a vision where the “computer” is no longer associated with the concept of a single device or a network of devices, but rather the entirety of situated services originating in a digital world, which are perceived through the physical world. It is observed that services with explicit user input and output are becoming to be replaced by a computing landscape sensing the physical world via a huge variety of sensors, and controlling it via a plethora of actuators. The nature and appearance of computing devices is changing to be hidden in the fabric of everyday life, invisibly networked, and omnipresent, with applications greatly being based on the notions of context and knowledge. Interaction with such globe spanning, modern ICT systems will presumably be more implicit, at the periphery of human attention, rather than explicit, i.e. at the focus of human attention. Socio-inspired ICT assumes that future, globe scale ICT systems should be viewed as social systems. Such a view challenges research to identify and formalize the principles of interaction and adaptation in social systems, so as to be able to ground future ICT systems on those principles. This position paper therefore is concerned with the intersection of social behaviour and modern ICT, creating or recreating social conventions and social contexts through the use of pervasive, globe-spanning, omnipresent and participative ICT. a e-mail: ferscha@pervasive.jku.at 402 The European Physical Journal Special Topics 1 The rise of aware ICT Modern ICT, building on the ever progressing miniaturization of technology (processing, storage, communication) as well as at the ever growing globe spanning networks, has postulated to invisibly integrate technology into everyday objects like tools, appliances, objects of everyday use, and environments like offices, homes and cars in such a way, that these objects turn into “smart things” or “smart environments”. Built with networked embedded systems technology, such “smart” things and environments have become increasingly interconnected, diverse and heterogeneous, and together with IP networking technology have created a whole new generation of ICT as we see it today (e.g. the “Internet-of-Things”, “Smart Buildings, Cars, Cities”, “Smart Grids”, even the “Smart Planet”). Only networking and communication capabilities, however, cannot make things and environments appear “smart”, unless coping with the challenge of an operative, and semantically meaningful interplay among each other. One approach to address the challenge of “smart” ICT has been to design and implement systems able to manage themselves in a more or less autonomous way, with little or no human interaction. While self-management stands for the ability of single smart thing to describe itself, to select and use adequate sensors to capture information describing its context, self-organizing stands for the ability of a group of possibly heterogeneous peers to establish a spontaneous network based on interest, purpose or goal, and to negotiating and fulfilling a group goal. Self-management relates to an individual smart thing, and concerns adaptation to changing individual goals and conditions at runtime, while self-organization relates to whole ensembles of smart things, and concerns adaptation in order to meet group goals. A prerequisite for self-management, even more so for self-organization is the ability to autonomously perceive, recognize, and even anticipate phenomena and their consequences, i.e. being “aware”. Early signs “aware ICT” have been observed by contributions from Pervasive and Ubiquitous Computing over the past two decades, starting with systems being aware about the physical situation they are operated in (“context aware ICT”)[134], and later on with systems being aware about the user and his activities (“activity aware ICT”) [120,132] (see Fig. 1). More recent trends tend to make ICT aware about social (“socially aware ICT”) [96,118], emotional (“emotion aware ICT”) [9] and even cognitive aspects (e.g., “attention aware ICT”) [47]. We look at this evolution in more detail. 1.1 From context aware ICT to socio-technical fabric Quoting from Weiser’s (1991) vision “The most profound technologies are those that disappear. They weave themselves into the fabric of every day life, until they are indistinguishable from it” [151] conveys the most common understanding of the origins of a computer science research branch today known as Pervasive and Ubiquitous Computing (PUC). Weiser’s seminal vision was pathbreaking, and still represents the corner stone for what might be referred to as a first generation of research, aiming towards embedded, hidden, invisible, but networked ICT systems. This first generation definitely gained from the technological progress momentum (miniaturization of electronics, gate packaging), and was driven by the upcoming availability of technology to connect literally everything to everything (Connectedness, Late Nineties), like wireless communication standards and the exponentially growing internet. Networks of systems emerged, forming communication clouds of miniaturized, cheap, fast, powerful, wirelessly connected, “always on” systems, enabled by the massive availability of miniaturized computing, storage, communication, and embedded systems technologies. Special purpose computing and information appliances, ready to spontaneously Participatory Science and Computing for Our Complex World 403 Fig. 1. The Evolution of Aware ICT Systems. communicate with one another, sensor-actuator systems to invert the roles of interaction from human to machine (implicit interaction), and organism like capabilities (self-configuration, self-healing, self-optimizing, self-protecting) characterize this generation. The second generation PUC research inherited from the then upcoming sensor based recognition systems, as well as knowledge representation and processing technologies (Awareness, around the turn of the century), where research issues like e.g. context and situation awareness, self-awareness, future-awareness or resourceawareness reshaped the understanding of pervasive computing. Autonomy and adaptation in this generation was reframed to be based on knowledge, extracted from low level sensor data captured in a particular situation or over long periods of time (The respective “epoch” of research on “context aware” systems was stimulated by Schillit, Adams and Want [134], and fertilized by the PhD work of Anind Dey [31], redefining the term “context” as: “. . . any information that can be used to characterize the situation of an entity. An entity is a person, place, or object that is considered relevant to the interaction between a user and an application, including the user and application themselves.”). One result out of this course of research are autonomic systems [72], and later autonomic elements, able to capture context, to build up, represent and carry knowledge, to self-describe, -manage, and –organize with respect to the environment, and to exhibit behaviour grounded on “knowledge based” monitoring, analysing, planning and executing were proposed, shaping ecologies of ICT systems, built from collective autonomic elements interacting in spontaneous spatial/temporal contexts, based on proximity, priority, privileges, capabilities, interests, offerings, environmental conditions, etc. Finally, a third generation of PUC is approaching, building upon connectedness and awareness, and attempting to exploit the (ontological) semantics of systems, services and interactions (i.e. giving meaning to situations and actions). Such systems are often referred to as highly complex, orchestrated, cooperative and coordinated “Ensembles of Digital Artefacts” (FP7 FET). An essential aspect of such an ensemble is its spontaneous configuration towards a complex system, i.e. a “... dynamic network of many agents (which may represent cells, species, individuals, nations) acting in parallel, constantly acting and reacting to what the other agents are doing where the control tends to be highly dispersed and decentralized, and if there is to be any coherent behavior in the system, it has to arise from competition and cooperation 404 The European Physical Journal Special Topics among the agents, so that the overall behavior of the system is the result of a huge number of decisions made every moment by many individual agents” [19]. Ensembles of digital artefacts as compounds of huge numbers of possibly heterogeneous entities constitute a future generation of systems to which we refer as SocioTechnical Fabric [49], weaving social and technological phenomena into the ‘fabric of technology-rich societies’. Indications of evidence for such large scale, complex, technology rich societal settings are facts like 10 – 10 “things” or “goods” being traded in (electronic) markets today, 10 personal computer nodes and 10 mobile phones on the internet, 10 cars or 10 digital cameras with sophisticated embedded electronics – even for internet access on the go, etc. Today’s megacities approach sizes of 10 citizens. Already today some 10 users are registered on Facebook, 10 videos have been uploaded to YouTube, like 10 music titles haven been labeled on last.fm, etc. Next generation research directions are thus going away from single user, or small user group as addressed in the first two generations, heading more towards complex socio-technical systems, i.e. large scale to very large scale deployments of PUC and the respective concerns on a societal level. 1.2 Key future ICT research challenges identified by the scientific community To better understand the trends and impacts of future ICT systems, as well as the research challenges posed by them, we have conducted a large scale solicitation initiative to pave future generation ICT research roadmaps The voices raised by active researchers in the field can be c

[1]  D. Gática-Pérez,et al.  Towards rich mobile phone datasets: Lausanne data collection campaign , 2010 .

[2]  Dieter Fox,et al.  Large-Scale Localization from Wireless Signal Strength , 2005, AAAI.

[3]  Nathan Eagle,et al.  Parameterizing the Dynamics of Slums , 2010, AAAI Spring Symposium: Artificial Intelligence for Development.

[4]  Shiva. Abdi Farzaneh Pour User Identification Roadmap towards 2020 : A study of personal identification challenges for ubiquitous computing world , 2008 .

[5]  Alois Ferscha,et al.  Goal Oriented Opportunistic Recognition of High-Level Composed Activities Using Dynamically Configured Hidden Markov Models , 2012, ANT/MobiWIS.

[6]  Mika Ylianttila,et al.  Pervasive Social Computing: augmenting five facets of human intelligence , 2012, J. Ambient Intell. Humaniz. Comput..

[7]  Emiliano Miluzzo,et al.  CenceMe - Injecting Sensing Presence into Social Networking Applications , 2007, EuroSSC.

[8]  Alois Ferscha,et al.  Locomotion@location: when the rubber hits the road , 2012, ICAC '12.

[9]  Paul Lukowicz,et al.  Sensing muscle activities with body-worn sensors , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[10]  R. Gregory The intelligent eye , 1970 .

[11]  Daniel Gatica-Perez,et al.  Discovering human places of interest from multimodal mobile phone data , 2010, MUM.

[12]  Dieter Fox,et al.  Location-Based Activity Recognition , 2005, KI.

[13]  Alois Ferscha,et al.  20 Years Past Weiser: What's Next? , 2012, IEEE Pervasive Comput..

[14]  Dirk Helbing,et al.  Participatory Science and Computing for Our Complex World , 2012 .

[15]  D. Broadbent Perception and communication , 1958 .

[16]  Alois Ferscha,et al.  Socio-Technical Network Analysis from Wearable Interactions , 2012, 2012 16th International Symposium on Wearable Computers.

[17]  Katayoun Farrahi,et al.  Sensing the 'Health State' of our Society , 2011 .

[18]  T. Jebara,et al.  CitySenseTM : multiscale space time clustering of GPS points and trajectories , 2009 .

[19]  Alois Ferscha,et al.  Pervasive Web Access via Public Communication Walls , 2002, Pervasive.

[20]  Dirk Helbing,et al.  Self-control of traffic lights and vehicle flows in urban road networks , 2008, 0802.0403.

[21]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[22]  Sunny Consolvo,et al.  Learning and Recognizing the Places We Go , 2005, UbiComp.

[23]  Gerhard Tröster,et al.  Decentralized Detection of Group Formations from Wearable Acceleration Sensors , 2009, 2009 International Conference on Computational Science and Engineering.

[24]  Alois Ferscha,et al.  LifeBelt: Silent Directional Guidance for Crowd Evacuation , 2009, 2009 International Symposium on Wearable Computers.

[25]  Franco Zambonelli,et al.  Pervasive social context: Taxonomy and survey , 2013, TIST.

[26]  Alois Ferscha,et al.  Heart on the road: HRV analysis for monitoring a driver's affective state , 2009, AutomotiveUI.

[27]  Alois Ferscha,et al.  Real-Time Transfer and Evaluation of Activity Recognition Capabilities in an Opportunistic System , 2011 .

[28]  Daniel Gatica-Perez,et al.  By their apps you shall understand them: mining large-scale patterns of mobile phone usage , 2010, MUM.

[29]  D. Kahneman Attention and Effort , 1973 .

[30]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[31]  Scott E. Page,et al.  Agent-Based Models , 2014, Encyclopedia of GIS.

[32]  Luís A. Castro,et al.  Seamless Interaction Among Heterogeneous Devices in Support for Co-located Collaboration , 2006, CRIWG.

[33]  Alessandro Soro,et al.  Multitouch Sensing for Collaborative Interactive Walls , 2008, HCIS.

[34]  Ondrej Krejcar Using of Ubiquitous Computing principles to develop a mobile user adaptive system framework , 2010, 9th RoEduNet IEEE International Conference.

[35]  Alois Ferscha,et al.  Dynamic Adaptation of Opportunistic Sensor Configurations for Continuous and Accurate Activity Recognition , 2012 .

[36]  Guang-Zhong Yang,et al.  Wearable and ambient sensor fusion for the characterisation of human motion , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  John Bragin Social Self-Organization: Agent-Based Simulations and Experiments to Study Emergent Social Behavior (Understanding Complex Systems) by Dirk Helbing (ed.) , 2013, J. Artif. Soc. Soc. Simul..

[38]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[39]  Gerhard Tröster,et al.  Wearable EOG goggles: eye-based interaction in everyday environments , 2009, CHI Extended Abstracts.

[40]  Gernot Bahle,et al.  Can magnetic field sensors replace gyroscopes in wearable sensing applications? , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[41]  N. Luhmann Familiarity, Confidence, Trust: Problems and Alternatives , 2000 .

[42]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[43]  Kwee-Bo Sim,et al.  Human adaptive system model development merged with context and emotion information , 2004, 30th Annual Conference of IEEE Industrial Electronics Society, 2004. IECON 2004.

[44]  R. Matthews,et al.  A Wearable Physiological Sensor Suite for Unobtrusive Monitoring of Physiological and Cognitive State , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Gerhard Tröster,et al.  A wearable, ambient sound-based approach for infrastructureless fuzzy proximity estimation , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[46]  Tian Lan,et al.  Cognitive State Estimation Based on EEG for Augmented Cognition , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[47]  François Courtemanche,et al.  Physiological Measures, Eye Tracking and Task Analysis to Track User Reactions in User Generated Content , 2010 .

[48]  Sherif Akoush,et al.  Movement Prediction Using Bayesian Learning for Neural Networks , 2007, 2007 Second International Conference on Systems and Networks Communications (ICSNC 2007).

[49]  Richard Lindley Lying: Moral Choice in Public and Private Life , 1980 .

[50]  N. Luhmann,et al.  Trust: Making and Breaking Cooperative Relations , 1990 .

[51]  Eyal de Lara,et al.  Accurate GSM Indoor Localization , 2005, UbiComp.

[52]  Alex Pentland,et al.  Sensing and modeling human networks using the sociometer , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[53]  Henry A. Kautz,et al.  Inferring High-Level Behavior from Low-Level Sensors , 2003, UbiComp.

[54]  Alois Ferscha,et al.  Supporting Implicit Human-to-Vehicle Interaction: Driver Identification from Sitting Postures , 2008 .

[55]  Alex Pentland Socially Aware Computation and Communication , 2005, Computer.

[56]  Eric Horvitz,et al.  Predestination: Inferring Destinations from Partial Trajectories , 2006, UbiComp.

[57]  Mohan Kumar,et al.  Pervasive Computing: Enabling Technologies and Challenges , 2006, Handbook of Nature-Inspired and Innovative Computing.

[58]  Harry Bouwman,et al.  Analysis of users and non-users of smartphone applications , 2010, Telematics Informatics.

[59]  Nathan Eagle,et al.  Machine perception and learning of complex social systems , 2005 .

[60]  Jan Treur On Human Aspects in Ambient Intelligence , 2007, AmI Workshops.

[61]  Clemens Holzmann,et al.  DarSens: a framework for distributed activity recognition from body-worn sensors , 2010, BODYNETS.

[62]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[63]  Diane L. Damos,et al.  Residual Attention as a Predictor of Pilot Performance , 1978 .

[64]  Antonio Krüger,et al.  ReflectiveSigns: Digital Signs That Adapt to Audience Attention , 2009, Pervasive.

[65]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[66]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[67]  Alex Pentland,et al.  VibeFones: Socially Aware Mobile Phones , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[68]  Alex Pentland,et al.  Pervasive Sensing to Model Political Opinions in Face-to-Face Networks , 2011, Pervasive.

[69]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.