Mining and Visualizing Multimedia Dataset on Mobile Devices in a Topic-oriented Manner

With significant enhancement of telecom bandwidth along with mobile devices getting cheaper and cheaper, consuming multimedia video clips "on the move" is no longer a hype. A great amount of telecom operators are now porting traditional TV service to PDA, cell phone and other mobile devices. However, a tailored solution to help mobile device user consuming multimedia items is yet available. In this paper, we propose a novel solution to organize multimedia dataset in a topic-oriented manner and visualize it into a graphic-rich map format. The main benefit is that mobile user can quickly locate the interesting topics intuitively to request the streaming of intended clips only. The topic-oriented navigation can further help users mining related multimedia data by using the automatically-constructed relationships between topics. A web-based multimedia data retrieval application has been implemented for PDA to demonstrate the feasibility and robustness of the proposed solution. Five sample video clips from four different domains (sports, news, talkshow and advertisement) have been included in the application.

[1]  Lars Marius Garshol.  Living with Topic Maps and RDF , 2003 .

[2]  Yi-Ping Phoebe Chen,et al.  Content-based video indexing for sports applications using integrated multi-modal approach , 2005, MULTIMEDIA '05.

[3]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[4]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[5]  HermanIvan,et al.  Graph Visualization and Navigation in Information Visualization , 2000 .

[6]  Lynn Wilcox,et al.  MiniMedia surfer: browsing video segments on small displays , 2004, CHI EA '04.

[7]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[8]  Steve Pepper.  Topic Maps , 2004 .

[9]  A KeimDaniel.  Information Visualization and Visual Data Mining , 2002 .

[10]  Dian Tjondronegoro.  PhD Thesis: "Content-based Video Indexing for Sports Applications using Multi-modal approach" , 2005 .

[11]  John R. Smith,et al.  Video summarization and personalization for pervasive mobile devices , 2001, IS&T/SPIE Electronic Imaging.

[12]  Hanqing Lu,et al.  Providing on-demand sports video to mobile devices , 2005, MULTIMEDIA '05.

[13]  Wei-Ying Ma,et al.  An indexing and browsing system for home video , 2000, 2000 10th European Signal Processing Conference.

[14]  B. Karstens,et al.  Visualization of Complex Structures on Mobile Handhelds , 2003 .