Recognition of Paper-Based Conceptual Models Captured Under Uncontrolled Conditions

Today, modeling and subsequent digital model representations are essential constituents in collaborative endeavors on organizational change. Once created, models need to be digitized for shared stakeholder understanding and further processing. Whenever paper serves as carrier medium, it is likely to disrupt further processing, elicitation, and modeling. While digital environments support transformation processes in collaborative modeling from its very beginning, the necessary technical infrastructure still might hamper situated capturing of models. Hence, this contribution aims to reduce the need for sophisticated technical components by enabling stakeholders to capture their paper-based models in a situation-sensitive way. We present a system that enables capturing paper-based models with mundane technical means by end users under uncontrolled conditions. We describe the components developed for recognition of these models and embed it in a mixed-modality workflow supported by a tabletop interfacing a web platform for further processing. As our empirical evidence demonstrates, this approach enables both situated and error-tolerant capturing of hand-drawn conceptual models by individual users. Moreover, it can be integrated with more sophisticated IT-based modeling tools for further digital processing.

[1]  Marta Indulska,et al.  How do practitioners use conceptual modeling in practice? , 2006, Data Knowl. Eng..

[2]  George S. Avrunin,et al.  Rigorously Defining and Analyzing Medical Processes: An Experience Report , 2008, MoDELS.

[3]  Morten Fjeld,et al.  Tabletops: Interactive Horizontal Displays for Ubiquitous Computing , 2012, Computer.

[4]  Joseph M. Firestone,et al.  Doing Knowledge Management , 2005 .

[5]  Michele Nappi,et al.  Robust Face Recognition for Uncontrolled Pose and Illumination Changes , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Gwendolyn L. Kolfschoten,et al.  Collaborative Enterprise Modeling , 2009, PRET.

[7]  Stefan Oppl,et al.  Facilitating Knowledge Transfer in IANES - A Transactive Memory Approach , 2013 .

[8]  Toomas Timpka,et al.  Ubiquitous computing to support co-located clinical teams: Using the semiotics of physical objects in system design , 2007, Int. J. Medical Informatics.

[9]  Thomas Reichherzer,et al.  Collaborative knowledge capture in ontologies , 2005, K-CAP '05.

[10]  Eva Hornecker,et al.  Graspable Interfaces as Tool for Cooperative Modelling , 2001 .

[11]  Hartmut Neven,et al.  PhotoOCR: Reading Text in Uncontrolled Conditions , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Rui S. Moreira,et al.  LoCoBoard: Low-Cost Interactive Whiteboard Using Computer Vision Algorithms , 2013 .

[13]  Khalid Saeed,et al.  K3M: A universal algorithm for image skeletonization and a review of thinning techniques , 2010, Int. J. Appl. Math. Comput. Sci..

[14]  Luciano da Fontoura Costa,et al.  2D Euclidean distance transform algorithms: A comparative survey , 2008, CSUR.

[15]  Stefan Oppl,et al.  Articulation of subject-oriented business process models , 2015, S-BPM ONE.

[16]  Harry Wechsler,et al.  Face Recognition Methods for Uncontrolled Settings , 2014 .

[17]  Hongan Wang,et al.  Understanding, Manipulating and Searching Hand-Drawn Concept Maps , 2011, TIST.

[18]  Edmund Y. Lam,et al.  Automatic White Balancing in Digital Photography , 2018, Single-Sensor Imaging.

[19]  Christian Stary,et al.  Non-disruptive knowledge and business processing in knowledge life cycles - aligning value network analysis to process management , 2014, J. Knowl. Manag..

[20]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[21]  Alberto Del Bimbo,et al.  INTERACTIVE CONCEPT MAPPING THROUGH GESTURE RECOGNITION ON A TABLETOP , 2012 .

[22]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[23]  S. Furlinger,et al.  Interactive annotations in Web-based learning systems , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[24]  Levent Burak Kara,et al.  Hierarchical parsing and recognition of hand-sketched diagrams , 2004, UIST '04.

[25]  G. P. Mullery,et al.  CORE - a method for controlled requirement specification , 1979, ICSE 1979.

[26]  Andreas Auinger,et al.  Interactive Annotations in Webbased Learning Systems , 2013 .

[27]  Flávia Maria Santoro,et al.  CEPE: Cooperative Editor for Processes Elicitation , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[28]  Martin Vogel,et al.  Scribbler - Drawing Models in a Creative and Collaborative Environment: from Hand-Drawn Sketches to Domain Specific Models , 2014, AUIC.

[29]  Jan Mendling,et al.  An Exploratory Study of IT-Enabled Collaborative Process Modeling , 2010, Business Process Management Workshops.

[30]  Randall Davis,et al.  Tahuti: a geometrical sketch recognition system for UML class diagrams , 2006, SIGGRAPH Courses.

[31]  Thomas Herrmann,et al.  Combining Collaborative Modeling with Collaborative Creativity for Process Design , 2014, COOP.

[32]  Philip J. Farrugia,et al.  A language for representing and extracting 3D geometry semantics from paper-based sketches , 2014, J. Vis. Lang. Comput..

[33]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[34]  Edmund Y. Lam,et al.  Automatic White Balancing in Digital Photography , 2008 .

[35]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[36]  Norbert Seyff,et al.  Sketching and notation creation with FlexiSketch Team: Evaluating a new means for collaborative requirements elicitation , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[37]  Patrick Jermann,et al.  An empirical evaluation of touch and tangible interfaces for tabletop displays , 2010, TEI '10.

[38]  Stefan Oppl,et al.  Facilitating shared understanding of work situations using a tangible tabletop interface , 2014, Behav. Inf. Technol..

[39]  Jing Wang,et al.  The study of liquid surface waves with a smartphone camera and an image recognition algorithm , 2015 .

[40]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[41]  Stefan Oppl,et al.  Business Processes to Touch: Engaging Domain Experts in Process Modelling , 2015, BPM.

[42]  Alessandro Adamo,et al.  Face Recognition in Uncontrolled Conditions Using Sparse Representation and Local Features , 2013, ICIAP.

[43]  Aurélie Lemaitre,et al.  Interactive interpretation of structured documents: Application to the recognition of handwritten architectural plans , 2015, Pattern Recognit..

[44]  David G. Ullman,et al.  The design capture system : capturing back-of-the-envelope sketches , 1990 .

[45]  Nicholas Negroponte,et al.  Recent advances in sketch recognition , 1973, AFIPS National Computer Conference.

[46]  Thomas Rothschädl,et al.  Towards a Subject-Oriented Evolutionary Business Information System , 2014, 2014 IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations.

[47]  Hong Gao,et al.  A Review of Studies on Collaborative Concept Mapping: What Have We Learned About the Technique and What Is Next? , 2007 .

[48]  Ben Jonson,et al.  Design ideation: the conceptual sketch in the digital age , 2005 .

[49]  Pierre Dillenbourg,et al.  Interactive tabletops in education , 2011, Int. J. Comput. Support. Collab. Learn..

[50]  Judy Kay,et al.  Collaborative concept mapping at the tabletop , 2010, ITS '10.

[51]  André van der Hoek,et al.  Supporting informal design with interactive whiteboards , 2014, CHI.

[52]  Stefan Oppl,et al.  Tabletop concept mapping , 2009, TEI.

[53]  Peter Rittgen,et al.  Collaborative Modeling - A Design Science Approach , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[54]  Norbert Seyff,et al.  Semi-automatic generation of metamodels from model sketches , 2013, 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[55]  Peter Rittgen Collaborative modeling of business processes: a comparative case study , 2009, SAC '09.

[56]  Petrus A.M. Kommers,et al.  Concept Mapping as a Medium of Shared Cognition in Computer-Supported Collaborative Problem Solving , 2002 .

[57]  Flávia Maria Santoro,et al.  A context-based model for Knowledge Management embodied in work processes , 2009, Inf. Sci..

[58]  J. Novak Concept mapping to facilitate teaching and learning , 1995 .

[59]  Pierre Dillenbourg,et al.  Paper-based concept map: the effects of tabletop on an expressive collaborative learning task , 2009, BCS HCI.

[60]  Beryl Plimmer,et al.  Combining Sketching and Traditional Diagram Editing Tools , 2015, ACM Trans. Intell. Syst. Technol..

[61]  Markus König,et al.  Natural markers for augmented reality-based indoor navigation and facility maintenance , 2014 .

[62]  Stefan Oppl,et al.  Stakeholder-Driven Collaborative Modeling of Subject-Oriented Business Processes , 2012, S-BPM ONE.

[63]  Eva Hornecker,et al.  A Design Theme for Tangible Interaction: Embodied Facilitation , 2005, ECSCW.

[64]  Kenneth D. Forbus,et al.  Sketching for knowledge capture: a progress report , 2002, IUI '02.