Moving Disambiguation of Regulations from the Cathedral to the Bazaar

Regulatory compliance is critical to the existence, continuity, and credibility of businesses. Regulations, however, are ridden with ambiguities that make their comprehension a challenge that seems surmountable only by experts. Experts’ involvement in understanding regulatory requirements for every software development project is expensive and not scalable. Having software engineers perform disambiguation of such requirements would be a great value addition. We present our design of a 3-step crowdsourcing workflow that aims to convert the task of disambiguation into a series of micro-tasks to be performed by a crowd of software engineers. We demonstrate that the outcome of this workflow is at par with the expert-enabled disambiguation at 4.5 times

[1]  Jaime G. Carbonell,et al.  Collaborative workflow for crowdsourcing translation , 2012, CSCW.

[2]  Matthew Reid,et al.  Quality control mechanisms for crowdsourcing: peer review, arbitration, & expertise at familysearch indexing , 2013, CSCW '13.

[3]  Riley Davis.  Health Insurance Portability and Accountability Act , 2011 .

[4]  André van der Hoek,et al.  A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design , 2015, 2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering.

[5]  Annie I. Antón,et al.  Identifying and classifying ambiguity for regulatory requirements , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[6]  Aaron K. Massey,et al.  A Strategy for Addressing Ambiguity in Regulatory Requirements , 2015 .

[7]  A. Meyer.  The Health Insurance Portability and Accountability Act. , 1997, Tennessee medicine : journal of the Tennessee Medical Association.

[8]  Todd Lingren,et al.  Web 2.0-Based Crowdsourcing for High-Quality Gold Standard Development in Clinical Natural Language Processing , 2013, Journal of medical Internet research.

[9]  Toru Ishida,et al.  Understanding Crowdsourcing Workflow: Modeling and Optimizing Iterative and Parallel Processes , 2016, HCOMP.

[10]  André van der Hoek,et al.  Toward microtask crowdsourcing software design work , 2016, CSI-SE@ICSE.

[11]  André van der Hoek,et al.  Crowdsourcing in Software Engineering: Models, Motivations, and Challenges , 2016, IEEE Software.

[12]  Jisup Hong,et al.  How Good is the Crowd at "real" WSD? , 2011, Linguistic Annotation Workshop.

[13]  Wai-Tat Fu,et al.  Enhancing reliability using peer consistency evaluation in human computation , 2013, CSCW '13.

[14]  Annie I. Antón,et al.  Towards Regulatory Compliance: Extracting Rights and Obligations to Align Requirements with Regulations , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[15]  André van der Hoek,et al.  Exploring Microtask Crowdsourcing as a Means of Fault Localization , 2016, ArXiv.