What is a Question? Crowdsourcing Tweet Categorization
暂无分享,去创建一个
One major way in which Amazon Mechanical Turk has been used is in the human labeling (or coding) of data, such as the relevance of search results or quality of Wikipedia articles. Recently, we used Amazon Mechanical Turk for classifying or labeling Twitter updates as questions or not. We present the design of our study and the steps that we took to address the challenges we faced in using Mechanical Turk for this labeling task. We also present our findings and some lessons learnt about the utility and effectiveness of using micro-task markets for conducting large-scale studies involving human-intelligence tasks.
[1] Aniket Kittur,et al. Crowdsourcing user studies with Mechanical Turk , 2008, CHI.
[2] Jeffrey Heer,et al. Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.
[3] Meredith Ringel Morris,et al. What do people ask their social networks, and why?: a survey study of status message q&a behavior , 2010, CHI.
[4] Susan C. Herring,et al. Beyond Microblogging: Conversation and Collaboration via Twitter , 2009, 2009 42nd Hawaii International Conference on System Sciences.