Semantic, Cognitive, and Perceptual Computing: Advances toward Computing for Human Experience

The World Wide Web continues to evolve and serve as the infrastructure for carrying massive amounts of multimodal and multisensory observations. These observations capture various situations pertinent to people's needs and interests along with all their idiosyncrasies. To support human-centered computing that empower people in making better and timely decisions, we look towards computation that is inspired by human perception and cognition. Toward this goal, we discuss computing paradigms of semantic computing, cognitive computing, and an emerging aspect of computing, which we call perceptual computing. In our view, these offer a continuum to make the most out of vast, growing, and diverse data pertinent to human needs and interests. We propose details of perceptual computing characterized by interpretation and exploration operations comparable to the interleaving of bottom and top brain processing. This article consists of two parts. First we describe semantic computing, cognitive computing, and perceptual computing to lay out distinctions while acknowledging their complementary capabilities. We then provide a conceptual overview of the newest of these three paradigms--perceptual computing. For further insights, we focus on an application scenario of asthma management converting massive, heterogeneous and multimodal (big) data into actionable information or smart data.

[1]  Alfred Korzybski,et al.  Science and sanity : an introduction to non-aristotelian systems and general semantics / Alfred Korzybski , 1942 .

[2]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[3]  D. C. Englebart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[4]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[5]  R. Gregory,et al.  Knowledge in perception and illusion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[7]  William Gobson,et al.  Multimedia: From Wagner to Virtual Reality , 2001 .

[8]  Ramesh C. Jain Experiential computing , 2003, CACM.

[9]  Amit P. Sheth,et al.  Computing for human experience: Semantics-empowered sensors, services, and social computing on the ubiquitous Web , 2010, IEEE Internet Computing.

[10]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[11]  Oscar Corcho,et al.  Semantic Sensor Network XG Final Report , 2011 .

[12]  Amit P. Sheth,et al.  Semantics Scales Up: Beyond Search in Web 3.0 , 2011, IEEE Internet Comput..

[13]  Amit P. Sheth,et al.  Semantic Perception: Converting Sensory Observations to Abstractions , 2012, IEEE Internet Computing.

[14]  Amit P. Sheth,et al.  The SSN ontology of the W3C semantic sensor network incubator group , 2012, J. Web Semant..

[15]  Amit P. Sheth,et al.  An Efficient Bit Vector Approach to Semantics-Based Machine Perception in Resource-Constrained Devices , 2012, SEMWEB.

[16]  Stephen Michael Kosslyn,et al.  Top Brain, Bottom Brain: Surprising Insights into How You Think , 2013 .

[17]  Cory Andrew Henson,et al.  A Semantics-based Approach to Machine Perception , 2013 .

[18]  Amit P. Sheth,et al.  Physical-Cyber-Social Computing: An Early 21st Century Approach , 2013, IEEE Intelligent Systems.

[19]  Peter J. Haas,et al.  Automated hypothesis generation based on mining scientific literature , 2014, KDD.