Requirements Elicitation Towards a Search Engine for Semantic Multimedia Content

We investigate user requirements regarding the interface design for a semantic multimedia search and retrieval based on a prototypical implementation of a search engine for multimedia content on the web. Thus, unlike existing image search engines and video search engines, we are interested in true multimedia content combining different media assets into multimedia documents like PowerPoint presentations and Flash files. In a user study with 20 participants, we conducted a formative evaluation based on the think-aloud method and semi-structured interviews in order to obtain requirements to a future web search engine for multimedia content. The interviews are complemented by a paper-and-pencil questionnaire to obtain quantitative information and present mockups demonstrating the user interface of a future multimedia search and retrieval engine.

[1]  Yi-Ping Phoebe Chen,et al.  A scalable and extensible segment-event-object-based sports video retrieval system , 2008, TOMCCAP.

[2]  M. D. Myers,et al.  Qualitative Research in Business & Management , 2008 .

[3]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[4]  Y. Trope,et al.  Construal-level theory of psychological distance. , 2010, Psychological review.

[5]  Marti A. Hearst.  Search User Interfaces , 2009 .

[6]  Emanuele Della Valle,et al.  Squiggle: a Semantic Search Engine for Indexing and Retrieval of Multimedia Content , 2006, SEMPS.

[7]  Luca Chiarandini,et al.  Search behaviour on photo sharing platforms , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Yueting Zhuang,et al.  Content-based Retrieval of Flash TM Movies : Research Issues , Generic Framework , and Future Directions * , 2004 .

[9]  Amel Behaz,et al.  Conception and Use of Ontologies for Indexing and Searching by Semantic Contents of Video Courses , 2012, ArXiv.

[10]  Yueting Zhuang,et al.  Content-based retrieval of Flash™ movies: research issues, generic framework, and future directions , 2007, Multimedia Tools and Applications.

[11]  John Adcock,et al.  Interactive Multimedia Search: Systems for Exploration and Collaboration , 2008 .

[12]  Feng-Yang Kuo,et al.  To share or not to share: a critical research perspective on knowledge management systems , 2012, Eur. J. Inf. Syst..

[13]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[14]  Hsin-Min Wang,et al.  Colorizing tags in tag cloud: a novel query-by-tag music search system , 2011, ACM Multimedia.

[15]  Günther Gediga,et al.  IsoMetrics: An usability inventory supporting summative and formative evaluation of software systems , 1999, HCI.

[16]  Mathias Lux,et al.  An Exploratory Study on the Explicitness of User Intentions in Digital Photo Retrieval , 2009 .

[17]  Peter Morville,et al.  Search Patterns - Design for Discovery , 2010 .

[18]  Wei-Ying Ma,et al.  Multimedia information retrieval: what is it, and why isn't anyone using it? , 2005, MIR '05.