A voice-based annotation system for collaborative computer-aided design

In this paper, we describe a voice-based interaction mechanism to annotate 3D models directly from a computer-aided design (CAD) modeling environment. The audio signal is captured and automatically transcribed to a textual 3D note, which is attached to the geometry and made available to other product information and business processes across the enterprise via a product data management system. Our approach provides a more natural and intuitive method to capture design and engineering knowledge that is particularly effective when large amounts of information need to be communicated. We discuss the rationale of the software architecture and the value of this modality for capturing knowledge in a collaborative engineering context. Finally, we examine the results of an experiment to validate our proposal. Our results show that 3D annotations are an effective mechanism to communicate design knowledge, which suggests the need for further developments in the areas of multimodal interaction methods and interfaces for CAD and collaborative tools.

[1]  Manuel Contero,et al.  Management of Visual Clutter in Annotated 3D CAD Models: A Comparative Study , 2014, HCI.

[2]  Qin Yi Ma,et al.  Development of CAD Model Annotation System Based on Design Intent , 2017 .

[3]  Robert E. Kraut,et al.  Expressive richness: a comparison of speech and text as media for revision , 1991, CHI.

[4]  Manuel Contero,et al.  Revisiting the design intent concept in the context of mechanical CAD education , 2018 .

[5]  Alain Bernard,et al.  The evolution, challenges, and future of knowledge representation in product design systems , 2013, Comput. Aided Des..

[6]  Bige Tunçer,et al.  Speech analysis for conceptual CAD modeling using multi-modal interfaces: An investigation into Architects’ and Engineers’ speech preferences , 2019, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[7]  Zhao Gang,et al.  Data Mining and Recommendation of Engineering Note Items in MBD Dataset , 2019, ICCAE 2019.

[8]  Lian Ding,et al.  Markup in Engineering Design: A Discourse , 2010, Future Internet.

[9]  André van der Hoek,et al.  Collecting design knowledge through voice notes , 2019, CHASE@ICSE.

[10]  Thomas P. Moran,et al.  Questions, Options, and Criteria: Elements of Design Space Analysis , 1991, Hum. Comput. Interact..

[11]  Manuel Contero,et al.  Approach for developing coordinated rubrics to convey quality criteria in MCAD training , 2015, Comput. Aided Des..

[12]  Yolande E. Chan,et al.  Knowledge loss and retention: the paradoxical role of IT , 2016 .

[13]  Yuan Cheng,et al.  On the role of generating textual description for design intent communication in feature-based 3D collaborative design , 2019, Adv. Eng. Informatics.

[14]  Manuel Contero,et al.  Assessment of Parametric Assembly Models Based on CAD Quality Dimensions , 2018, Computer-Aided Design and Applications.

[15]  I. M. Barrio-Cantalejo,et al.  Validación de la Escala INFLESZ para evaluar la legibilidad de los textos dirigidos a pacientes , 2008 .

[16]  Manuel Contero,et al.  From Voice to Knowledge: A Proposal for a Voice Annotation System to Support Collaborative Engineering Design Processes , 2020, HICSS.

[17]  Raymond McCall.  PHI : A Conceptual Foundation For Design Hypermedia , 1990 .

[18]  Maarten Sierhuis,et al.  Facilitated hypertext for collective sensemaking: 15 years on from gIBIS , 2001, Hypertext.

[19]  Mats Näsström,et al.  A Proposed Method to Preserve Knowledge and Information by Use of Knowledge Enabled Engineering , 2007 .

[20]  Euthimios Panagos,et al.  Making Voice Knowledge Pervasive , 2002, IEEE Pervasive Comput..

[21]  Jason Yon,et al.  Model-based information navigation for engineering documents , 2020, Comput. Ind..

[22]  Manuel Contero,et al.  Speak with the annotator: Promoting interaction in a knowledge-based CAD environment built on the extended annotation concept , 2014, Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[23]  Indira Thouvenin,et al.  Supporting design with 3D-annotations in a collaborative virtual environment , 2009 .

[24]  Paul G. Maropoulos,et al.  A knowledge capturing and sharing framework for improving the testing processes in global product development using storytelling and video sharing , 2018 .

[25]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[26]  Ying Liu,et al.  A New Design Rationale Representation Model for Rationale Mining , 2010, J. Comput. Inf. Sci. Eng..

[27]  Manuel Contero,et al.  On the integration of model-based feature information in Product Lifecycle Management systems , 2017, Int. J. Inf. Manag..

[28]  Claudia Eckert,et al.  Supporting communication between product designers and engineering designers in the design process of branded products: a comparison of three approaches , 2014 .

[29]  Elmar Jürgens,et al.  Quality analysis of source code comments , 2013, 2013 21st International Conference on Program Comprehension (ICPC).

[30]  Rob H. Bracewell,et al.  DRed and Design Folders: A Way of Capturing, Storing and Passing On Knowledge Generated During Design Projects , 2004, DAC 2004.

[31]  Mats Näsström,et al.  Efficient Design Module Capture and Representation for Product Family Reuse , 2017, J. Comput. Inf. Sci. Eng..

[32]  Manuel Contero,et al.  Extended 3D annotations as a new mechanism to explicitly communicate geometric design intent and increase CAD model reusability , 2014, Comput. Aided Des..

[33]  Ram D. Sriram,et al.  The Role of Knowledge in Next-generation Product Development Systems , 2001, J. Comput. Inf. Sci. Eng..