Image representations for access and similarity-based organization of web information

Although digital and visual technologies are beginning to converge, most digital systems continue to use text to access and organize information. Textual organizations, such as indexes and conceptual hierarchies, are effective for well-structured information, but seem less effective for vast and poorly-structured sources like the World Wide Web, where information exists in a wide range of formats, styles, and combinations. Images provide a complementary way to represent information that may be better suited for helping people use large poorly-structured information sources. Images are perceived quickly, even when reduced in size. Animation, scaling, and layout techniques can therefore help people access masses of visual information with minimal cognitive overhead. Because images play a special role in the function of human memory, hypermedia systems that use images as links to information may be less susceptible to the classic hypertext problems of spatial disorientation and cognitive overhead. Mandala is a platform for studying the utility of images for accessing and organizing web information. Mandala lets people view hundreds of thumbnails of web page images. Selecting any thumbnail signals a web browser to display the associated page. Other systems that use images to represent information focus on server-side applications, because images can take a long time to retrieve over the web. Mandala focuses on client-side applications and minimizes retrieval delays by obtaining images from a proxy server cache. Given a collage of images, people have an intrinsic ability to identify groups of related images quickly. Mandala is designed to make it easy for people to share their visually-identified groups with the system by dragging and dropping thumbnails between windows. Mandala also groups different types of images automatically, computes layouts for groups, and stores groups as imagemaps. With these capabilities, Mandala is, at once, a repository for visual site indexes, a visual history facility, a visual bookmark facility, and a cache visualization application. In addition to helping people access and organize information, Mandala's visualizations can increase cache hit-rates and provide shared access to relevant resources, while revealing the dynamic access patterns of a community.

[1]  Hans Pfeiffenberger,et al.  Web Cataloguing through Cache Exploitation and Steps Toward Consistency Maintenance , 1995, Comput. Networks ISDN Syst..

[2]  Donald Neal,et al.  The Harvest Object Cache in New Zealand , 1996, Comput. Networks.

[3]  Stephen T. Kerr Wayfinding in an electronic database: The relative importance of navigational cues vs. mental models , 1990, Inf. Process. Manag..

[4]  David A. Forsyth,et al.  Identifying nude pictures , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[5]  Patrick Chan The Java Developers Almanac , 1998 .

[6]  B. C. Walsh,et al.  Online text retrieval via browsing , 1988, Inf. Process. Manag..

[7]  Randall H. Trigg,et al.  Notecards in a nutshell , 1986, CHI '87.

[8]  Imagery in children's learning: A symposium. , 1970 .

[9]  Peter Selfridge,et al.  Cospace: combining Web browsing and dynamically generated, 3D, multiuser environments , 1999, INTL.

[10]  Oren Etzioni,et al.  Multi-Service Search and Comparison Using the MetaCrawler , 1995 .

[11]  George Mallen,et al.  Back to the Cave - Cultural Perspectives on Virtual Reality , 1993, Virtual Reality Systems.

[12]  Ari Luotonen Web Proxy Servers , 1997 .

[13]  Christopher De Hamel,et al.  A History of Illuminated Manuscripts , 1986 .

[14]  Richard Mander,et al.  A “pile” metaphor for supporting casual organization of information , 1992, CHI.

[15]  Nelson,et al.  Literary machines : the report on, and of, project Xanadu concerning word processing, electronic publishing, hypertext, thinkertoys, tomorrow's intellectual revolution, and certain other topics including knowledge, education and freedom , 1981 .

[16]  Gerard Salton,et al.  Dynamic information and library processing , 1975 .

[17]  Tom Lanning,et al.  Rapid-fire image previews for information navigation , 1998, AVI '98.

[18]  Jonathan Helfman,et al.  Dotplot Patterns: A Literal Look at Pattern Languages , 1996, Theory Pract. Object Syst..

[19]  Andruid Kerne,et al.  CollageMachine: temporality and indeterminacy in media browsing via interface ecology , 1997, CHI Extended Abstracts.

[20]  Ari Luotonen,et al.  World-Wide Web Proxies , 1994, Comput. Networks ISDN Syst..

[21]  Douglas C. Engelbart,et al.  A conceptual framework for the augmentation of man's intellect , 1988 .

[22]  Tim Berners-Lee RFC 1866 Hypertext Markup Language-2.0 , 1995 .

[23]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[24]  Clement H. C. Leung,et al.  Characteristics and Architectural Components of Visual Information Systems , 1996, VISUAL.

[25]  Henry Lieberman,et al.  Autonomous interface agents , 1997, CHI.

[26]  Susan T. Dumais,et al.  The vocabulary problem in human-system communication , 1987, CACM.

[27]  Israel Ben-Shaul,et al.  Automatically Organizing Bookmarks per Contents , 1996, Comput. Networks.

[28]  Jakob Nielsen,et al.  Evaluating the thinking-aloud technique for use by computer scientists , 1993 .

[29]  James E. Pitkow,et al.  Yet Robust Caching Algorithm Based on Dynamic Access Patterns , 1994, WWW Spring 1994.

[30]  Jakob Nielsen,et al.  The art of navigating through hypertext , 1990, CACM.

[31]  B. Pinkerton,et al.  Finding What People Want : Experiences with the WebCrawler , 1994, WWW Spring 1994.

[32]  Ted Nelson,et al.  A new home for the mind , 1982 .

[33]  Peter Dömel,et al.  WebMap: A Graphical Hypertext Navigation Tool , 1995, Comput. Networks ISDN Syst..

[34]  Steven Glassman,et al.  A Caching Relay for the World Wide Web , 1994, Comput. Networks ISDN Syst..

[35]  Paul P. Maglio,et al.  Intermediaries: New Places for Producing and Manipulating Web Content , 1998, Comput. Networks.

[36]  Carolyn L. Foss,et al.  Tools for reading and browsing hypertext , 1989, Inf. Process. Manag..

[37]  Neil C. Rowe,et al.  Finding Photograph Captions Multimodally on the World Wide Web , 1997 .

[38]  Robert Taylor,et al.  Disney's Aladdin: first steps toward storytelling in virtual reality , 1996, SIGGRAPH.

[39]  D. S. Johnson,et al.  On Packing Two-Dimensional Bins , 1982 .

[40]  W. Köhler Gestalt Psychology: An Introduction to New Concepts in Modern Psychology , 1970 .

[41]  Munindar P. Singh,et al.  Agents on the Web: Mobile Agents , 1997, IEEE Internet Comput..

[42]  Luca Cardelli,et al.  Abstractions for Mobile Computation , 1999, Secure Internet Programming.

[43]  James D. Hollan,et al.  Pad++: A Zoomable Graphical Sketchpad For Exploring Alternate Interface Physics , 1996, J. Vis. Lang. Comput..

[44]  David Flanagan,et al.  Java in a Nutshell , 1996 .

[45]  Robert T. Braden,et al.  Requirements for Internet Hosts - Application and Support , 1989, RFC.

[46]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.1 , 1997, RFC.

[47]  Jeffrey Mogul Forcing HTTP/1.1 proxies to revalidate responses , 1997 .

[48]  Jim Miller,et al.  Application-Specific Proxy Servers as HTTP Stream Transducers , 1996, World Wide Web journal.

[49]  Larry Stead,et al.  Group Asynchronous Browsing on the World Wide Web , 1995, World Wide Web J..

[50]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[51]  Ken Turkowski,et al.  Filters for common resampling tasks , 1990 .

[52]  Marc H. Brown,et al.  DeckScape: An Experimental Web Browser , 1995, Comput. Networks ISDN Syst..

[53]  R. Haber,et al.  Perception and memory for pictures: Single-trial learning of 2500 visual stimuli , 1970 .

[54]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[55]  Edward A. Fox,et al.  Caching Proxies: Limitations and Potentials , 1995, WWW.

[56]  James D. Hollan,et al.  Graphical multiscale Web histories: a study of padprints , 1998, HYPERTEXT '98.

[57]  George G. Robertson,et al.  The WebBook and the Web Forager: an information workspace for the World-Wide Web , 1996, CHI.

[58]  M. Lindauer,et al.  A Psychology of Picture Perception: Images and Information , 1974 .

[59]  Fred Douglis,et al.  WebGUIDE: Querying and Navigating Changes in Web Repositories , 1996, Comput. Networks.

[60]  Ramana Rao,et al.  Silk from a sow's ear: extracting usable structures from the Web , 1996, CHI.

[61]  Peter J. Brown Do We Need Maps to Navigate Round Hypertext Documents? , 1988, Electron. Publ..

[62]  Sougata Mukherjea,et al.  Visualizing the World-Wide Web with the Navigational View Builder , 1995, Comput. Networks ISDN Syst..

[63]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[64]  G. Bower Analysis of a mnemonic device , 1970 .

[65]  C. Jung,et al.  Man and His Symbols , 1964 .