An Introduction to the 3rd Workshop on Egocentric (First-Person) Vision

Egocentric vision provides a unique perspective of the visual world that is inherently human-centric. Since egocentric cameras are mounted on the user (typically on the user's head), they are naturally primed to gather visual information from our everyday interactions, and can even act on that information in real-time (e.g. for a vision aid). We believe that this human-centric characteristic of egocentric vision can have a large impact on the way we approach central computer vision tasks such as visual detection, recognition, prediction, and socio-behavioral analysis. By taking advantage of the first-person point-of-view paradigm, there have been recent advances in areas such as personalized video summarization, understanding concepts of social saliency, activity analysis with inside-out cameras (a camera to capture eye gaze and an outward-looking camera), recognizing human interactions and modeling focus of attention. However, in many ways people are only beginning to understand the full potential (and limitations) of the first-person paradigm. In the 3rd workshop on Egocentric (First-Person) Vision, we bring together researchers to discuss emerging topics such as: Personalization of visual analysis; Socio-behavioral modeling; Understanding group dynamics and interactions; Egocentric video as big data; First-person vision for robotics; and Egographical User Interfaces (EUIs).

[1]  Katina Michael,et al.  Sousveillance and Point of View Technologies in Law Enforcement: An Overview , 2012 .

[2]  Yoichi Sato,et al.  Coupling eye-motion and ego-motion features for first-person activity recognition , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Takeo Kanade,et al.  Illumination-free gaze estimation method for first-person vision wearable device , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Steve Mann Smart clothing: The wearable computer and wearcam , 2005, Personal Technologies.

[5]  Yasuo Kuniyoshi,et al.  AI Goggles: Real-time Description and Retrieval in the Real World with Online Learning , 2009, 2009 Canadian Conference on Computer and Robot Vision.

[6]  Walterio W. Mayol-Cuevas,et al.  High level activity recognition using low resolution wearable vision , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Kristen Grauman,et al.  Story-Driven Summarization for Egocentric Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jeffrey S. Shell,et al.  Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects , 2008 .

[9]  W. W. Mayol,et al.  On the Positioning of Wearable Optical Devices , 2001 .

[10]  Kiyoharu Aizawa,et al.  Summarizing wearable video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[11]  Ann Cavoukian,et al.  Privacy by Design and the Promise of SmartData , 2013 .

[12]  William J. Miller,et al.  Sousveillance, Media and Strategic Political Communication, by Vian Bakir , 2011 .

[13]  Luc Van Gool,et al.  AWEAR 2.0 system: Omni-directional audio-visual data acquisition and processing , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Steve Mann,et al.  Veillance flux, vixels, veillons: An information-bearing extramissive formulation of sensing, to measure surveillance and sousveillance , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[15]  Steve Mann,et al.  "Sousveillance": inverse surveillance in multimedia imaging , 2004, MULTIMEDIA '04.

[16]  Takeo Kanade,et al.  Image matching in large scale indoor environment , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Jason Nolan,et al.  Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments. , 2002 .

[18]  Deva Ramanan,et al.  Detecting activities of daily living in first-person camera views , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Cheng Li,et al.  Pixel-Level Hand Detection in Ego-centric Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  D. Lyon Surveillance Studies: An Overview , 2007 .

[21]  Diane Pedrotty Bryant,et al.  Assistive Technology for People with Disabilities , 2002 .

[22]  Yuichi Ohta,et al.  Image Retrieval of First-Person Vision for Pedestrian Navigation in Urban Area , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Ian D. Reid,et al.  Learning texton models for real-time scene context , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Yaser Sheikh,et al.  3D Social Saliency from Head-mounted Cameras , 2012, NIPS.

[25]  Alireza Fathi Learning descriptive models of objects and activities from egocentric video , 2013 .

[26]  Shmuel Peleg,et al.  Temporal Segmentation of Egocentric Videos , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  M. Beetz,et al.  3D Hand and Object Tracking for Inside Out Activity Analysis , 2009 .

[28]  Takahiro Okabe,et al.  Attention Prediction in Egocentric Video Using Motion and Visual Saliency , 2011, PSIVT.

[29]  Martial Hebert,et al.  Temporal segmentation and activity classification from first-person sensing , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[30]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[31]  David W. Murray,et al.  On the Choice and Placement of Wearable Vision Sensors , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Jadwiga Indulska,et al.  A survey of context modelling and reasoning techniques , 2010, Pervasive Mob. Comput..

[33]  Cheng Li,et al.  Model Recommendation with Virtual Probes for Egocentric Hand Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[34]  Aude Billard,et al.  WearCam: A head mounted wireless camera for monitoring gaze attention and for the diagnosis of developmental disorders in young children , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[35]  Yaser Sheikh,et al.  Motion capture from body-mounted cameras , 2011, SIGGRAPH 2011.

[36]  Mingui Sun,et al.  A wearable electronic system for objective dietary assessment. , 2010, Journal of the American Dietetic Association.

[37]  Hideki Koike,et al.  Human-centric panoramic imaging stitching , 2012, AH '12.

[38]  Steve Mann,et al.  The inevitability of the transition from a surveillance-society to a veillance-society: Moral and economic grounding for sousveillance , 2013, 2013 IEEE International Symposium on Technology and Society (ISTAS): Social Implications of Wearable Computing and Augmediated Reality in Everyday Life.

[39]  Takahiro Okabe,et al.  Can Saliency Map Models Predict Human Egocentric Visual Attention? , 2010, ACCV Workshops.

[40]  Steve Mann,et al.  Toposculpting: Computational lightpainting and wearable computational photography for abakographic user interfaces , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[41]  Peter Schaar,et al.  Privacy by Design , 2010 .

[42]  Matthai Philipose,et al.  Egocentric recognition of handled objects: Benchmark and analysis , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[43]  Vian Bakir Sousveillance, Media and Strategic Political Communication: Iraq, USA, UK , 2010 .

[44]  Alejandro Rituerto,et al.  Line image signature for scene understanding with a wearable vision system , 2013, SenseCam '13.

[45]  Stephen Wilson The Body Electric: An Anatomy of the New Bionic Senses (review) , 2003 .

[46]  Steve Mann,et al.  'WearCam' (The wearable camera): personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[47]  James M. Rehg,et al.  Social interactions: A first-person perspective , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Benjamin Greschbach,et al.  The devil is in the metadata — New privacy challenges in Decentralised Online Social Networks , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[49]  Ali Farhadi,et al.  Understanding egocentric activities , 2011, 2011 International Conference on Computer Vision.

[50]  G. O'loughlin,et al.  Using a wearable camera to increase the accuracy of dietary analysis. , 2013, American journal of preventive medicine.

[51]  Katsuhiko Sakaue,et al.  The Hand Mouse: GMM hand-color classification and mean shift tracking , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[52]  Alejandro Betancourt,et al.  A Sequential Classifier for Hand Detection in the Framework of Egocentric Vision , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[53]  Takeo Kanade,et al.  First-Person Vision , 2012, Proceedings of the IEEE.

[54]  Larry H. Matthies,et al.  First-Person Activity Recognition: What Are They Doing to Me? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  James M. Rehg,et al.  Learning to Predict Gaze in Egocentric Video , 2013, 2013 IEEE International Conference on Computer Vision.

[56]  Steve Mann,et al.  Wearable Tetherless Computer-Mediated Reality: WearCam as a wearable face-recognizer, and other applications for the disabled , 1996 .

[57]  James M. Rehg,et al.  Learning to recognize objects in egocentric activities , 2011, CVPR 2011.

[58]  David W. Murray,et al.  Wearable hand activity recognition for event summarization , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[59]  Steve Mann,et al.  Wearable Computing: A First Step Toward Personal Imaging , 1997, Computer.

[60]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[62]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[63]  Alex Pentland,et al.  Visual contextual awareness in wearable computing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[64]  Takeo Kanade,et al.  Unwrapping the eye for visible-spectrum gaze tracking on wearable devices , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[65]  Mathias Kölsch,et al.  Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[66]  Maria Kutar,et al.  A Day in the Digital Life: A Preliminary Sousveillance Study , 2011 .

[67]  Steve Mann,et al.  Humanistic computing: "WearComp" as a new framework and application for intelligent signal processing , 1998, Proc. IEEE.

[68]  Yong Jae Lee,et al.  Discovering important people and objects for egocentric video summarization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[69]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[70]  Katina Michael,et al.  Security workshop brings 'sousveillance' under the microscope , 2012 .

[71]  Katina Michael,et al.  Social Implications of Technology: The Past, the Present, and the Future , 2012, Proceedings of the IEEE.

[72]  James M. Rehg,et al.  Detecting eye contact using wearable eye-tracking glasses , 2012, UbiComp.

[73]  James M. Rehg,et al.  Learning to Recognize Daily Actions Using Gaze , 2012, ECCV.

[74]  Steve Mann,et al.  An historical account of the 'WearComp' and 'WearCam' inventions developed for applications in 'personal imaging' , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[75]  Takahiro Okabe,et al.  Fast unsupervised ego-action learning for first-person sports videos , 2011, CVPR 2011.