Is there a need for biomedical CBIR systems in clinical practice? Outcomes from a usability study

Articles in the literature routinely describe advances in Content Based Image Retrieval (CBIR) and its potential for improving clinical practice, biomedical research and education. Several systems have been developed to address particular needs, however, surprisingly few are found to be in routine practical use. Our collaboration with the National Cancer Institute (NCI) has identified a need to develop tools to annotate and search a collection of over 100,000 cervigrams and related, anonymized patient data. One such tool developed for a projected need for retrieving similar patient images is the prototype CBIR system, called CervigramFinder, which retrieves images based on the visual similarity of particular regions on the cervix. In this article we report the outcomes from a usability study conducted at a primary meeting of practicing experts. We used the study to not only evaluate the system for software errors and ease of use, but also to explore its "user readiness", and to identify obstacles that hamper practical use of such systems, in general. Overall, the participants in the study found the technology interesting and bearing great potential; however, several challenges need to be addressed before the technology can be adopted.

[1]  Mark Schiffman,et al.  ASCUS-LSIL Triage Study , 2000, Acta Cytologica.

[2]  Sameer Antani,et al.  Digital Tools for Collecting Data from Cervigrams for Research and Training in Colposcopy , 2006, Journal of lower genital tract disease.

[3]  Thomas Martin Deserno,et al.  Ontology of Gaps in Content-Based Image Retrieval , 2009, Journal of Digital Imaging.

[4]  Sameer Antani,et al.  Web-accessible cervigram automatic segmentation tool , 2010, Medical Imaging.

[5]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[6]  L. Rodney Long,et al.  Bridging the Gap: Enabling CBIR in Medical Applications , 2008, 2008 21st IEEE International Symposium on Computer-Based Medical Systems.

[7]  L. Mango,et al.  Design and methods of a population-based natural history study of cervical neoplasia in a rural province of Costa Rica: the Guanacaste Project. , 1997, Revista panamericana de salud publica = Pan American journal of public health.

[8]  L. Rodney Long,et al.  A system for searching uterine cervix images by visual attributes , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[9]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[10]  John W. Sellows,et al.  Colposcopy and treatment of cervical intraepithelial neoplasia : a beginners' manual . Sellors, R. Sankaranarayanan , 2003 .

[11]  Daniel P. Lopresti,et al.  Balancing the Role of Priors in Multi-Observer Segmentation Evaluation , 2009, J. Signal Process. Syst..

[12]  Sameer Antani,et al.  A web-accessible content-based cervicographic image retrieval system , 2008, SPIE Medical Imaging.