Design and evaluation of awareness mechanisms in CiteSeer

Awareness has been extensively studied in human computer interaction (HCI) and computer supported cooperative work (CSCW). The success of many collaborative systems hinges on effectively supporting awareness of different collaborators, their actions, and the process of creating shared work products. As digital libraries are increasingly becoming more than just repositories for information search and retrieval - essentially fostering collaboration among its community of users - awareness remains an unexplored research area in this domain. We are investigating awareness mechanisms in CiteSeer, a scholarly digital library for the computer and information science domain. CiteSeer users can be notified of new publication events (e.g., publication of a paper that cites one of their papers) using feeds as notification systems. We present three cumulative user studies - requirements elicitation, prototype evaluation, and naturalistic study - in the context of supporting CiteSeer feeds. Our results indicate that users prefer feeds that place target items in query-relevant contexts, and that preferred context varies with type of publication event. We found that users integrated feeds as part of their broader, everyday activities and used them as planning tools to collaborate with others.

[1]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[2]  George Buchanan,et al.  A generic alerting service for digital libraries , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[3]  W A Wulf,et al.  The collaboratory opportunity. , 1993, Science.

[4]  Brian P. Bailey,et al.  A method, system, and tools for intelligent interruption management , 2005, TAMODIA '05.

[5]  John M. Carroll,et al.  Supporting distributed scientific collaboration: Implications for designing the CiteSeer collaboratory , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[6]  Ralph Westfall,et al.  Technical opinion: Hello, world considered harmful , 2001, CACM.

[7]  George Buchanan,et al.  HDLalert – a healthcare DL alerting system: from user needs to implementation , 2006, Health Informatics J..

[8]  Mary Beth Rosson,et al.  Classroom BRIDGE: using collaborative public and desktop timelines to support activity awareness , 2003, UIST '03.

[9]  Fred Martin,et al.  Toy projects considered harmful , 2006, CACM.

[10]  Ann Blandford,et al.  Organizational communication and awareness: a novel solution for health informatics , 2005, Health Informatics J..

[11]  Christine L. Borgman,et al.  What can Studies of e-Learning Teach us about Collaboration in e-Research? Some Findings from Digital Library Studies , 2005, Computer Supported Cooperative Work (CSCW).

[12]  Andrew Dillon,et al.  Technologies of Information: HCI and the digital library , 2002 .

[13]  C. Lee Giles,et al.  Scholarly publishing in the Internet age: a citation analysis of computer science literature , 2001, Inf. Process. Manag..

[14]  Sandra Payette,et al.  What is a Digital Library Anymore, Anyway? Beyond Search and Access in the NSDL , 2005, D Lib Mag..

[15]  Ann Blandford,et al.  Digital libraries in the context of users' broader activities , 2006 .

[16]  Ian H. Witten,et al.  Greenstone: a comprehensive open-source digital library software system , 2000, DL '00.

[17]  Carl Gutwin,et al.  Workspace awareness for groupware , 1996, CHI Conference Companion.

[18]  Christine L. Borgman,et al.  What are Digital Libraries? Competing Visions , 1999, Inf. Process. Manag..

[19]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[20]  Chenglie Hu.  Dataless objects considered harmful , 2005, CACM.

[21]  Sara Kiesler.  Culture of the Internet , 1997 .

[22]  David M. Nichols,et al.  Talking in the library: implications for the design of digital libraries , 1997, DL '97.

[23]  Umberto Straccia,et al.  A personalized collaborative Digital Library environment: a model and an application , 2005, Inf. Process. Manag..

[24]  Donna Harman,et al.  Information Processing and Management , 2022 .

[25]  C. Lee Giles,et al.  CiteSeer: an automatic citation indexing system , 1998, DL '98.

[26]  B. Wellman.  Networks in the Global Village , 1998 .

[27]  Madhu C. Reddy,et al.  Temporality in Medical Work: Time also Matters , 2006, Computer Supported Cooperative Work (CSCW).

[28]  C. Lee Giles,et al.  Who gets acknowledged: Measuring scientific contributions through automatic acknowledgment indexing , 2004, Proc. Natl. Acad. Sci. USA.

[29]  Ketan K. Mane,et al.  ScienceSifter: facilitating activity awareness in collaborative research groups through focused information feeds , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[30]  Preben Hansen,et al.  Collaborative Information Retrieval in an information-intensive domain , 2005, Inf. Process. Manag..

[31]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[32]  Laurie E. Damianos,et al.  MiTAP: a case study of integrated knowledge discovery tools , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[33]  Mary Beth Rosson,et al.  When news is more than what makes headlines , 2005, CROS.

[34]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[35]  Kjeld Schmidt,et al.  The Problem with `Awareness': Introductory Remarks on `Awareness in CSCW' , 2002, Computer Supported Cooperative Work (CSCW).

[36]  JärvelinKalervo,et al.  Collaborative Information Retrieval in an information-intensive domain , 2005 .

[37]  Ann Blandford,et al.  Organisational Communication And Awareness: A Novel Solution , 2005 .

[38]  D. Scott McCrickard,et al.  Attuning notification design to user goals and attention costs , 2003, Commun. ACM.

[39]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[40]  Mary Beth Rosson,et al.  Awareness and teamwork in computer-supported collaborations , 2006, Interact. Comput..

[41]  Anoop Gupta,et al.  Designing and deploying an information awareness interface , 2002, CSCW '02.

[42]  Nancy A. Vanhouse,et al.  Digital Library Use: Social Practice in Design and Evaluation , 2003 .

[43]  Darren Gergle,et al.  On the "localness" of user-generated content , 2010, CSCW '10.

[44]  Fred G. Martin,et al.  Computing in context: integrating an embedded computing project into a course on ethical and societal issues , 2006, SIGCSE '06.