A crowdsourcing based mobile image translation and knowledge sharing service

Travelers in countries that use an unfamiliar script cannot use pocket translators or online translation services to understand menus, maps, signs and other important information, because they are unable to write the text they see. Solutions based on optical character recognition provide very limited performance in real-world situations and for complex scripts such as Chinese and Japanese. In this paper, we propose an alternative image translation solution based on crowdsourcing. A large number of human workers on mobile terminals are used to carry out the tasks of image recognition, translation and quality assurance. Compared to purely technical solutions, this human computation approach is also able to account for context and non-textual cues, and provide higher level information to the end-user. In this paper, we describe a preliminary user study to create a model of end-user requirements.

[1]  Alexander Hars,et al.  Working for free? Motivations of participating in open source projects , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[2]  Mark W. Newman,et al.  The challenges of user-centered design and evaluation for infrastructure , 2003, CHI '03.

[3]  J. Tirole,et al.  Intrinsic and Extrinsic Motivation , 2003 .

[4]  Masashi Koga,et al.  Camera-based Kanji OCR for mobile-phones: practical issues , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[5]  Georgia Koutrika,et al.  Questioning Yahoo! Answers , 2007 .

[6]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[7]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[8]  Hiromichi Fujisawa,et al.  Forty years of research in character and document recognition - an industrial perspective , 2008, Pattern Recognit..

[9]  Jan Marco Leimeister,et al.  Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition , 2009, J. Manag. Inf. Syst..

[10]  Chris Callison-Burch,et al.  Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon’s Mechanical Turk , 2009, EMNLP.

[11]  Vikas Sindhwani,et al.  Data Quality from Crowdsourcing: A Study of Annotation Selection Criteria , 2009, HLT-NAACL 2009.

[12]  Nathan Eagle,et al.  txteagle: Mobile Crowdsourcing , 2009, HCI.

[13]  Gert R. G. Lanckriet,et al.  User-centered design of a social game to tag music , 2009, HCOMP '09.

[14]  Brian A Vander Schee.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2009 .

[15]  Hiroaki Kimura,et al.  Using individual, social and economic persuasion techniques to reduce CO2 emissions in a family setting , 2009, Persuasive '09.

[16]  Takahiro Hara,et al.  A game based approach to assign geographical relevance to web images , 2009, WWW '09.

[17]  Jaime G. Carbonell,et al.  Active Learning and Crowd-Sourcing for Machine Translation , 2010, LREC.

[18]  Carman Neustaedter,et al.  Sharing conversation and sharing life: video conferencing in the home , 2010, CHI.

[19]  Jimmy J. Lin,et al.  CrowdFlow : Integrating Machine Learning with Mechanical Turk for Speed-Cost-Quality Flexibility , 2010 .

[20]  Damon Horowitz,et al.  The anatomy of a large-scale social search engine , 2010, WWW '10.

[21]  Panagiotis G. Ipeirotis,et al.  Quality management on Amazon Mechanical Turk , 2010, HCOMP '10.

[22]  Meredith Ringel Morris,et al.  What do people ask their social networks, and why?: a survey study of status message q&a behavior , 2010, CHI.

[23]  T. Brown,et al.  Change by Design , 2011 .

[24]  ไพบูลย์ จงผิตะ,et al.  Change by Design : How Design Thinking Transforms Organizations and Inspires Innovation , 2012 .