Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images

In this article, we present a novel application domain for human computation, specifically for crowdsourcing, which can help in understanding particle-tracking problems. Through an interdisciplinary inquiry, we built a crowdsourcing system designed to detect tracer particles in industrial tomographic images, and applied it to the problem of bulk solid flow in silos. As images from silo-sensing systems cannot be adequately analyzed using the currently available computational methods, human intelligence is required. However, limited availability of experts, as well as their high cost, motivates employing additional nonexperts. We report on the results of a study that assesses the task completion time and accuracy of employing nonexpert workers to process large datasets of images in order to generate data for bulk flow research. We prove the feasibility of this approach by comparing results from a user study with data generated from a computational algorithm. The study shows that the crowd is more scalable and more economical than an automatic solution. The system can help analyze and understand the physics of flow phenomena to better inform the future design of silos, and is generalized enough to be applicable to other domains.

[1]  Erik Meijering,et al.  Methods for cell and particle tracking. , 2012, Methods in enzymology.

[2]  Erkki Oja,et al.  Randomized hough transform (rht) : Basic mech-anisms, algorithms, and computational complexities , 1993 .

[3]  Alessandro Corsini,et al.  Innovative Techniques for the Detection and Characterization of the Kinematics of Slow-Moving Landslides , 2014 .

[4]  Louis-Philippe Morency,et al.  Toward crowdsourcing micro-level behavior annotations: the challenges of interface, training, and generalization , 2014, IUI.

[5]  Carsten Eickhoff.  Crowd-powered experts: helping surgeons interpret breast cancer images , 2014, GamifIR '14.

[6]  Hai Yang,et al.  ACM Transactions on Intelligent Systems and Technology - Special Section on Urban Computing , 2014 .

[7]  Z. Popovic,et al.  Increased Diels-Alderase activity through backbone remodeling guided by Foldit players , 2012, Nature Biotechnology.

[8]  Saeed Albaraki,et al.  How does internal angle of hoppers affect granular flow? Experimental studies using Digital Particle Image Velocimetry , 2014 .

[9]  Walter S. Lasecki,et al.  Real-time captioning by groups of non-experts , 2012, UIST.

[10]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[11]  Jonathan Seville,et al.  Storage and discharge of particulate bulk solids , 1997 .

[12]  Josef Kittler,et al.  A Comparative Study of Hough Transform Methods for Circle Finding , 1989, Alvey Vision Conference.

[13]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[14]  Kuo-Liang Chung,et al.  An Efficient Randomized Algorithm for Detecting Circles , 2001, Comput. Vis. Image Underst..

[15]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[16]  Bidyut Baran Chaudhuri,et al.  A survey of Hough Transform , 2015, Pattern Recognit..

[17]  Raúl Enrique Sánchez-Yáñez,et al.  Circle detection on images using genetic algorithms , 2006, Pattern Recognit. Lett..

[18]  ZhaoShengdong,et al.  Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images , 2016 .

[19]  Dominik Sankowski,et al.  ECT Image Analysis Methods for Shear Zone Measurements during Silo Discharging Process , 2012 .

[20]  Katharina Morik,et al.  Heterogeneous Stream Processing and Crowdsourcing for Urban Traffic Management , 2014, EDBT.

[21]  Jin Y. Ooi,et al.  An improved PTV technique to evaluate the velocity field of non-spherical particles , 2010 .

[22]  Philip J. Withers,et al.  Influence of wall roughness and packing density on stagnant zone formation during funnel flow discharge from a silo: An X-ray imaging study , 2013 .

[23]  Darren J. Kerbyson,et al.  Size invariant circle detection , 1999, Image Vis. Comput..

[24]  Victor A. F. Lamme,et al.  Detailed Sensory Memory, Sloppy Working Memory , 2010, Front. Psychology.

[25]  Michael S. Bernstein,et al.  Human-Computer Interaction and Collective Intelligence , 2014 .

[26]  Hao Lü,et al.  Analysis of social gameplay macros in the Foldit cookbook , 2011, FDG.

[27]  D. Schulze.  Powders and Bulk Solids: Behavior, Characterization, Storage and Flow , 2021 .

[28]  Caren B. Cooper,et al.  Data validation in citizen science: a case study from Project FeederWatch , 2012 .

[29]  Krzysztof Grudzień,et al.  Detection of tracer particles in tomography images for analysis of gravitational flow in silo , 2013 .

[30]  Frank Fuchs-Kittowski,et al.  Crowdsourcing in Early Warning Systems , 2014 .

[31]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[32]  Michael S. Bernstein,et al.  Soylent: a word processor with a crowd inside , 2010, UIST.

[33]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.