Reflections on the Research Methods Used in an Investigation of Cross-modal Collaborative Information Seeking

Evaluating collaborative information seeking can be challenging, often more than individual information seeking. This can be attributed to the complexity of the interaction as the study involves a number of users using the systems. While this is particularly important, but rather hard when the users employ different modalities accessing the systems. In this paper, we describe a semi-structured combination of qualitative and quantitative methods used to investigate visually impaired and sighted web users' collaborative information seeking behavior. We critically reflect on the benefits and limitations of the methods used, and discuss practical considerations in application of such methods in a cross-modal setting.

[1]  Jennifer Mankoff,et al.  Is your web page accessible?: a comparative study of methods for assessing web page accessibility for the blind , 2005, CHI.

[2]  Chirag Shah,et al.  Evaluating collaborative information seeking – synthesis, suggestions, and structure , 2014, J. Inf. Sci..

[3]  Kitch Barnicle,et al.  Usability testing with screen reading technology in a Windows environment , 2000, CUU '00.

[4]  Anastasios Tombros,et al.  Cross-modal collaborative information seeking (CCIS): an exploratory study , 2013, BCS HCI.

[5]  Meredith Ringel Morris,et al.  CoSearch: a system for co-located collaborative web search , 2008, CHI.

[6]  Tony Stockman,et al.  Participatory Design with Blind Users: A Scenario-Based Approach , 2013, INTERACT.

[7]  Hannele Hyppönen.  Handbook on inclusive design of telematics applications , 2000 .

[8]  Ann Blandford,et al.  Semi-structured qualitative studies , 2013 .

[9]  Susanne Bødker,et al.  Scenarios in user-centred design-setting the stage for reflection and action , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[10]  Helen Petrie,et al.  The relationship between accessibility and usability of websites , 2007, CHI.

[11]  John M. Carroll,et al.  Making Use: Scenario-Based Design of Human-Computer Interactions , 2000 .

[12]  Edward G. Sargis,et al.  Social psychological research and the Internet : the promise and peril of a new methodological frontier , 2005 .

[13]  Eric Horvitz,et al.  SearchTogether: an interface for collaborative web search , 2007, UIST.

[14]  Giorgio Brajnik,et al.  Web Accessibility Testing: When the Method Is the Culprit , 2006, ICCHP.

[15]  Roberto I. González-Ibáñez,et al.  Let's search together, but not too close! An analysis of communication and performance in collaborative information seeking , 2013, Inf. Process. Manag..

[16]  J. Olson,et al.  Abstract , 1929, Veterinary Record.

[17]  Chirag Shah,et al.  Awareness in collaborative information seeking , 2010, J. Assoc. Inf. Sci. Technol..

[18]  Angela Petit,et al.  Observing the User Experience: A Practitioner's Guide to User Research (Second Edition) [book review] , 2013, IEEE Trans. Prof. Commun..

[19]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[20]  Dena Al-Thani,et al.  Understanding and supporting cross-modal collaborative information seeking , 2016 .

[21]  Judit Bar-Ilan.  Collaborative Information Behavior: User Engagement and Communication Sharing , 2011 .

[22]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[23]  Andrew Sears,et al.  Heuristic Walkthroughs: Finding the Problems Without the Noise , 1997, Int. J. Hum. Comput. Interact..

[24]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[25]  Peter Gregor,et al.  User-Sensitive Inclusive Design , 2011, Universal Access in the Information Society.

[26]  Oussama Metatla,et al.  Designing for Collaborative Cross-modal Interaction , 2011 .

[27]  C W Clegg,et al.  Towards a practical method of user interface evaluation. , 1989, Applied ergonomics.

[28]  Anastasios Tombros,et al.  Exploring the stages of information seeking in a cross-modal context , 2016 .