Content transcoding middleware for pervasive geospatial intelligence access

We describe a novel content transcoding middleware for accessing military geospatial intelligence information in real-time. Intelligence information, including maps and location, category and properties of object targets, is adapted for various pervasive devices such as laptop, personal digital assistant (PDA), cellular phone, etc. The middleware is deployed as proxies on the Web using the IBM Websphere Transcoding Publisher (WTP) platform, which facilitates the middleware management. We developed several Java-based plug-ins and Extensible Stylesheet Language (XSL) stylesheets for content transcoding. A prototype has been established and real experiments have demonstrated the effectiveness of this novel middleware.

[1]  Ching-Yung Lin,et al.  Semantic multimedia authentication with model vector signature , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[2]  John R. Smith,et al.  Adapting Multimedia Internet Content for Universal Access , 1999, IEEE Trans. Multim..

[3]  John R. Smith,et al.  Video personalization and summarization system , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[4]  Ching-Yung Lin.  Public Watermarking Surviving General Scaling and Cropping: An Application for Print-and-Scan Process , 2000 .

[5]  Ching-Yung Lin,et al.  Sleep condition inferencing using simple multimodality sensors , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[6]  John R. Smith,et al.  A multi-modal system for the retrieval of semantic video events , 2004, Comput. Vis. Image Underst..

[7]  Ching-Yung Lin,et al.  Developing smart video semantic sensors , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[8]  Shih-Fu Chang,et al.  News video story segmentation using fusion of multi-level multi-modal features in TRECVID 2003 , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  John R. Smith,et al.  Integrating Features, Models, and Semantics for TREC Video Retrieval , 2001, TREC.

[10]  Ching-Yung Lin,et al.  Personalized video summary using visual semantic annotations and automatic speech transcriptions , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[11]  Shih-Fu Chang,et al.  Using self-authentication and recovery images for error concealment in wireless environments , 2001, SPIE ITCom.

[12]  John R. Smith,et al.  Universal MPEG content access using compressed-domain system stream editing techniques , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[13]  John R. Smith,et al.  Interactive search fusion methods for video database retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  John R. Smith,et al.  Learning semantic multimedia representations from a small set of examples , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[15]  John R. Smith,et al.  Universal Tuner: A Video Streaming System for CPU/Power-Constrained Mobile Devices , 2001 .

[16]  C.-H. Lin,et al.  An Image Authenticator Surviving DCT-based Variable Quantization Table Compression , 1997 .

[17]  Chien-Cheng Tseng,et al.  A parallel decoding algorithm for IFS codes without transient behavior , 1996, IEEE Trans. Image Process..

[18]  Shih-Fu Chang,et al.  Generating Robust Digital Signature for Image/Video Authentication , 1998 .

[19]  John R. Smith,et al.  Multimodal video search techniques: late fusion of speech-based retrieval and visual content-based retrieval , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  John R. Smith,et al.  A framework for moderate vocabulary semantic visual concept detection , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[21]  Ching-Yung Lin,et al.  Autonomous visual model building based on image crawling through internet search engines , 2004, MIR '04.

[22]  John R. Smith,et al.  Improved text overlay detection in videos using a fusion-based classifier , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[23]  Shih-Fu Chang,et al.  Accurate overlay text extraction for digital video analysis , 2003, International Conference on Information Technology: Research and Education, 2003. Proceedings. ITRE2003..

[24]  John R. Smith,et al.  A statistical modeling approach to content based video retrieval , 2002, Object recognition supported by user interaction for service robots.

[25]  Ching-Yung Lin,et al.  Video Collaborative Annotation Forum: Establishing Ground-Truth Labels on Large Multimedia Datasets , 2003, TRECVID.

[26]  John R. Smith,et al.  User-trainable video annotation using multimodal cues , 2003, SIGIR '03.

[27]  Ching-Yung Lin,et al.  Multimodality Sensors for Sleep Quality Monitoring and Logging , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[28]  Morris Sloman,et al.  Map adaptation for users of mobile systems , 2001, WWW '01.

[29]  Shih-Fu Chang,et al.  Distortion Modeling and Invariant Extraction for Digital Image Print-and-Scan Process , 2000 .

[30]  John R. Smith,et al.  Normalized classifier fusion for semantic visual concept detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Min Wu,et al.  Rotation-, scale-, and translation-resilient public watermarking for images , 2000, Electronic Imaging.

[32]  Shih-Fu Chang,et al.  Discovery and fusion of salient multimodal features toward news story segmentation , 2003, IS&T/SPIE Electronic Imaging.

[33]  Allan Kuchinsky,et al.  Framework for adaptive content delivery in heterogeneous network environments , 1999, Electronic Imaging.

[34]  Shih-Fu Chang,et al.  A robust image authentication method distinguishing JPEG compression from malicious manipulation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[35]  Ching-Yung Lin,et al.  Personalized recommendation driven by information flow , 2006, SIGIR.

[36]  Ching-Yung Lin.  Watermarking and Digital Signature Techniques for Multimedia Authentication and Copyright Protection , 2000 .

[37]  Haim H. Permuter,et al.  IBM Research TREC 2002 Video Retrieval System , 2002, TREC.

[38]  Wenjun Zeng,et al.  Multimedia Security Technologies for Digital Rights Management , 2006 .

[39]  K. Roberts,et al.  Thesis , 2002 .

[40]  Ching-Yung Lin,et al.  Cross-Modality Automatic Face Model Training from Large Video Databases , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[41]  John R. Smith,et al.  Video texture indexing using spatio-temporal wavelets , 2002, Proceedings. International Conference on Image Processing.

[42]  Shih-Fu Chang,et al.  Discovering meaningful multimedia patterns with audio-visual concepts and associated text , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[43]  John R. Smith,et al.  Validity-weighted model vector-based retrieval of video , 2003, IS&T/SPIE Electronic Imaging.

[44]  John R. Smith,et al.  Video summarization and personalization for pervasive mobile devices , 2001, IS&T/SPIE Electronic Imaging.

[45]  John R. Smith,et al.  Modeling semantic concepts to support query by keywords in video , 2002, Proceedings. International Conference on Image Processing.

[46]  Deepa Kundur,et al.  Security and Digital Rights Management for Mobile Content , 2005 .

[47]  C.-Y. Lin,et al.  A Distributed Multimodality Sensor System for Home-Used Sleep Condition Inference and Monitoring , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[48]  Chien-Chang Chen,et al.  Robust image authentication method surviving JPEG lossy compression , 1997, Electronic Imaging.

[49]  Chien-Cheng Tseng,et al.  Two-dimensional LMS adaptive linear phase filters , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[50]  John R. Smith,et al.  Semantic Indexing of Multimedia Content Using Visual, Audio, and Text Cues , 2003, EURASIP J. Adv. Signal Process..

[51]  John R. Smith,et al.  Using MPEG-7 and MPEG-21 for personalizing video , 2004, IEEE MultiMedia.

[52]  John R. Smith,et al.  Sezione III. Il contesto extraeuropeo : Capitolo 8. Multisource Video Clustering using Semantic Model Vectors , 2004 .

[53]  John R. Smith,et al.  Video personalization system for Usage environment , 2002 .

[54]  Shih-Fu Chang,et al.  Issues and solutions for authenticating MPEG video , 1999, Electronic Imaging.

[55]  John R. Smith,et al.  VideoAnnEx: IBM MPEG-7 Annotation Tool for Multimedia Indexing and Concept Learning , 2003 .

[56]  Gang Wu,et al.  Imperfect learning for autonomous concept modeling , 2005, IS&T/SPIE Electronic Imaging.

[57]  Ajay Divakaran,et al.  Providing multimedia services to a diverse set of consumer devices , 2001, ICCE. International Conference on Consumer Electronics (IEEE Cat. No.01CH37182).

[58]  Shih-Fu Chang,et al.  SARI: self-authentication-and-recovery image watermarking system , 2001, MULTIMEDIA '01.

[59]  John R. Smith,et al.  Video personalization and summarization system for usage environment , 2004, J. Vis. Commun. Image Represent..

[60]  Shih-Fu Chang,et al.  A crypto signature scheme for image authentication over wireless channel , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[61]  Shih-Fu Chang,et al.  Watermarking capacity of digital images based on domain-specific masking effects , 2001, Proceedings International Conference on Information Technology: Coding and Computing.

[62]  Shih-Fu Chang,et al.  Semantic video clustering across sources using bipartite spectral clustering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[63]  Shih-Fu Chang,et al.  Zero-error information hiding capacity of digital images , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[64]  Ching-yung Lin.  Information Flow Prediction by Modeling Dynamic Probabilistic Social Network , 2006 .

[65]  John R. Smith,et al.  Multi-granular detection of regional semantic concepts , 2004, ICME.