Semantic-based information retrieval in support of concept design

This research is motivated by the realisation that semantic technology can be used to develop computational tools in support of designers’ creativity by focusing on the inspirational stage of design. The paper describes a semantic-based image retrieval tool developed for the needs of concept cars designers from two renowned European companies. It is created to help them find and interpret sources of inspiration. The core innovation of the tool is its ability to provide a degree of diversity, ambiguity and uncertainty in the information gathering and idea generation process. The tool is based on the assumption that there is a semantic link between the images in a web page and the text around them. Furthermore, it uses the idea that the more frequently a term occurs in a document and the fewer documents it occurs in, the more representative this term is of that document. The new contribution is linking the most meaningful words in a document with ontological concepts, and then finding the most powerful set of concepts representing that document and consequently the images in it. This is based on the observation that monosemic words (with a single meaning) are more domain-oriented than polysemic ones (that have multiple meanings), and provide a greater amount of domain information. The tool tags images by first processing all significant words in the text around them, extracting all keywords and key phrases in it, ranking them according to their significance, and linking them to ontological concepts. It generates a set of concept numbers for each text, which is then used to retrieve information in a process called semantic expansion, where a keyword query is also processed semantically. The proposed approach is illustrated with examples using the tool developed for the needs of Stile Bertone and Fiat, Italy, two of the industrial partners in the TRENDS project sponsored by the European Community.

[1]  Amaresh Chakrabarti,et al.  Understanding the Knowledge Needs of Designers During Design Process in Industry , 2008, J. Comput. Inf. Sci. Eng..

[2]  L.J. Leifer,et al.  Engineering design thinking, teaching, and learning , 2005, IEEE Engineering Management Review.

[3]  Óscar Corcho,et al.  Ontology based document annotation: trends and open research problems , 2006, Int. J. Metadata Semant. Ontologies.

[4]  Vijayan Sugumaran,et al.  Improving web-query processing through semantic knowledge , 2008, Data Knowl. Eng..

[5]  Jonathon S. Hare,et al.  Facing the reality of semantic image retrieval , 2007, J. Documentation.

[6]  Carole Bouchard,et al.  Ontology-Based Concept Indexing of Images , 2009, KES.

[7]  Pamela I. Ansburg,et al.  Creative and analytic thinkers differ in their use of attentional resources , 2003 .

[8]  Claudia Eckert,et al.  Intelligent support for communication in design teams: garment shape specifications in the knitwear industry , 2000 .

[9]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[10]  Deana McDonagh,et al.  Signs, symbols, and subjectivity: An alternative view of the visual , 2005 .

[11]  Stephen J. McKenna,et al.  Merging technology and users: Applying image browsing to the fashion industry for design inspiration , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[12]  Aidong Zhang,et al.  Extracting semantic concepts from images: a decisive feature pattern mining approach , 2006, Multimedia Systems.

[13]  Min Song,et al.  Integration of association rules and ontologies for semantic query expansion , 2007, Data Knowl. Eng..

[14]  Rossitza Setchi,et al.  Semantic-based representation of content using concept indexing , 2007 .

[15]  Rossitza Setchi,et al.  Concept indexing using ontology and supervised machine learning , 2007 .

[16]  J. Blake,et al.  Creating the Gene Ontology Resource : Design and Implementation The Gene Ontology Consortium 2 , 2001 .

[17]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  R. Sternberg RETRACTED ARTICLE: The Nature of Creativity , 2006 .

[19]  Claudia Eckert,et al.  Sources of inspiration: a language of design , 2000 .

[20]  Nigel Ford,et al.  Information retrieval and creativity: towards support for the original thinker , 1999, J. Documentation.

[21]  Mathias Benedek,et al.  Creativity meets neuroscience: experimental tasks for the neuroscientific study of creative thinking. , 2007, Methods.

[22]  Teng-Wen Chang,et al.  A distributed linking system for supporting idea association during the conceptual design stage , 2006 .

[23]  Paola Mello,et al.  A Knowledge-Based System for Fashion Trend Forecasting , 2008, IEA/AIE.

[24]  Morita Junya,et al.  A Study on Design Creative Process Focused on Concept Combination Types in Comparison With Linguistic Interpretation Process , 2007 .

[25]  Carole Bouchard,et al.  Building a domain ontology for designers: Towards a Kansei-based ontology , 2007 .

[26]  Gerard Salton,et al.  Improving Retrieval Performance by Relevance Feedback , 1997 .

[27]  Nuno Seco,et al.  The importance of retrieval in creative design analogies , 2006, Knowl. Based Syst..

[28]  Wei-Ying Ma,et al.  A probabilistic semantic model for image annotation and multi-modal image retrieval , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[29]  Adrian Popescu,et al.  Ontology driven content based image retrieval , 2007, CIVR '07.

[30]  Steffen Staab,et al.  Semantic Multimedia , 2008, Reasoning Web.

[31]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[32]  D. McDonagh,et al.  Visual product evaluation: exploring users' emotional relationships with products. , 2002, Applied ergonomics.

[33]  Marin Ferecatu,et al.  Semantic interactive image retrieval combining visual and conceptual content description , 2007, Multimedia Systems.

[34]  Masafumi Hagiwara,et al.  An image retrieval system by impression words and specific object names - IRIS , 2002, Neurocomputing.

[35]  Maryanne M. Gobble,et al.  Design Thinking , 2010, The Palgrave Encyclopedia of the Possible.

[36]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[37]  Carlo Strapparava,et al.  Unsupervised and supervised exploitation of semantic domains in lexical disambiguation , 2004, Comput. Speech Lang..

[38]  Steve J. Westerman,et al.  Creative Industrial Design and Computer-Based Image Retrieval: The Role of Aesthetics and Affect , 2007, ACII.

[39]  Eva Navas,et al.  Cultural Heritage and the Semantic Web , 2004, ESWS.

[40]  Ramanathan V. Guha,et al.  A case for automated large-scale semantic annotation , 2003, J. Web Semant..

[41]  Michael Tovey,et al.  Styling and design: intuition and analysis in industrial design☆ , 1997 .

[42]  Michael Specht,et al.  Ontology based text indexing and querying for the semantic web , 2006, Knowl. Based Syst..

[43]  Chun-Hsien Chen,et al.  Human-centric product conceptualization using a design space framework , 2009, Adv. Eng. Informatics.

[44]  Chih-Fong Tsai,et al.  A review of image retrieval methods for digital cultural heritage resources , 2007, Online Inf. Rev..

[45]  Susan T. Dumais,et al.  Discovery is never by chance: designing for (un)serendipity , 2009, C&C '09.

[46]  Robert Newman,et al.  Sketching, concept development and automotive design , 2003 .