Gamification as a Key Enabling Technology for Image Sensing and Content Tagging

The advent of mobile phone with a multi-megapixel camera and autouploaders has democratised photography. Taking pictures and acquiring annotations is no longer an expensive task as it used to be. Yet performing these tasks in a systematically way is still very cumbersome for most users. In this paper, we outline two game mechanics that can be exploited for the purpose of large-scale image sensing and content annotation. Our first mechanic allows for better control over when, how and where people should acquire images. The problem with existent image providers is that their services usually do not cover the entire area of interest, are inaccurate or very expensive. Our second mechanism aims at making the annotation of crowd-sourcing images more engaging. It leverage on large end-user communities to annotate images while avoiding the pitfall of using annotations that are meaningful only to domain experts. Annotations that are not relevant to users’ interests cannot be directly leveraged to enable search and discovery. A drawback of using crowdsourced annotations is that they have low agreement rates. Our approach aims at a finding a balanced agreement rate between pre-established annotations and those defined by users.

[1]  Pedro Santos,et al.  C-space: Fostering new creative paradigms based on recording and sharing “casual” videos through the internet , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[2]  Zoran Popovic,et al.  PhotoCity: training experts at large-scale image acquisition through a competitive game , 2011, CHI.

[3]  Jean-Pierre Jessel,et al.  Origins of Serious Games , 2011, Serious Games and Edutainment Applications.

[4]  Matthew Chalmers,et al.  EyeSpy: supporting navigation through play , 2009, CHI.

[5]  Manuel Blum,et al.  Improving Image Search with PHETCH , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[7]  Raffaele De Amicis,et al.  Digital Earth in a User-Centric Perspective , 2014, 2014 Fifth International Conference on Computing for Geospatial Research and Application.

[8]  Manuel Blum,et al.  Peekaboom: a game for locating objects in images , 2006, CHI.

[9]  Yutaka Arakawa,et al.  Gamification-based incentive mechanism for participatory sensing , 2014, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS).

[10]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[11]  Guido C. H. E. de Croon,et al.  Crowdsourcing as a methodology to obtain large and varied robotic data sets , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.