Human-centered interaction with documents

In this paper, we discuss a new user interface, a complementary environment for the work with personal document archives, i.e. for document filing and retrieval. We introduce our implementation of a spatial medium for document interaction, explorative search and active navigation, which exploits and further stimulates the human strengths of visual information processing. Our system achieves a high degree of immersion of the user, so that he/she forgets the artificiality of his/her environment. This is done by means of a tripartite ensemble of allowing users to interact naturally with gestures and postures (as an option gestures and postures can be individually taught to the system by users), exploiting 3D technology, and supporting the user to maintain structures he/she discovers, as well as provide computer calculated semantic structures. Our ongoing evaluation shows that even non-expert users can efficiently work with the information in a document collection, and have fun.

[1]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[2]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1997, SEMWEB.

[3]  Kirsti Grobel,et al.  Real-time hand-arm motion analysis using a single video camera , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[5]  Tom Forester.  Office of the Future , 1985 .

[6]  James L. Crowley,et al.  Finger Tracking as an Input Device for Augmented Reality , 1995 .

[7]  Marc M. Sebrechts,et al.  Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces , 1999, SIGIR '99.

[8]  Vladimir Pavlovic,et al.  Hand Gesture Modeling, Analysis, and Synthesis , 1995 .

[9]  Uwe Krohn.  Visualization for retrieval of scientific and technical information , 1996 .

[10]  Michael S. Brown,et al.  Projected Imagery in Your "Office of the Future" , 2000, IEEE Computer Graphics and Applications.

[11]  Chung-Lin Huang,et al.  Model-based articulated hand motion tracking for gesture recognition , 1998, Image Vis. Comput..

[12]  Colin Ware,et al.  Evaluating stereo and motion cues for visualizing information nets in three dimensions , 1996, TOGS.

[13]  David A. Carr,et al.  An empirical study of task support in 3D information visualizations , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).

[14]  David S. Ebert,et al.  Interactive volumetric information visualization for document corpus management , 1997, International Journal on Digital Libraries.

[15]  Mark Green,et al.  The Information Cube: Using Transparency in 3D Information Visualization , 1993 .

[16]  George G. Robertson,et al.  The WebBook and the Web Forager: an information workspace for the World-Wide Web , 1996, CHI.

[17]  Jarke J. van Wijk,et al.  Beamtrees: compact visualization of large hierarchies , 2002, Inf. Vis..

[18]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[19]  Mary Czerwinski,et al.  The Task Gallery: a 3D window manager , 2000, CHI.

[20]  Anders Sandberg,et al.  Gesture Recognition using Neural Networks , 1997 .

[21]  Tomoichi Takahashi,et al.  Hand gesture coding based on experiments using a hand gesture interface device , 1991, SGCH.

[22]  Hideki Hashimoto,et al.  Building topological maps by looking at people: an example of cooperation between intelligent spaces and robots , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.