Papers101: Supporting the Discovery Process in the Literature Review Workflow for Novice Researchers

A literature review is a critical task in performing research. However, even browsing an academic database and choosing must-read items can be daunting for novice researchers. In this paper, we introduce Papers101, an interactive system that supports novice researchers’ discovery of papers relevant to their research topics. Prior to system design, we performed a formative study to investigate what difficul-ties novice researchers often face and how experienced researchers address them. We found that novice researchers have difficulty in identifying appropriate search terms, choosing which papers to read first, and ensuring whether they have examined enough candidates. In this work, we identified key requirements for the system dedicated to novices: prioritizing search results, unifying the contexts of multiple search results, and refining and validating the search queries. Accordingly, Papers101 provides an opinionated perspective on selecting important metadata among papers. It also visualizes how the priority among papers is developed along with the users’ knowledge discovery process. Finally, we demonstrate the potential usefulness of our system with the case study on the metadata collection of papers in visualization and HCI community.

[1]  Tobias Isenberg,et al.  Vispubdata.org: A Metadata Collection About IEEE Visualization (VIS) Publications , 2017, IEEE Transactions on Visualization and Computer Graphics.

[2]  Lexing Xie,et al.  Influence Flowers of Academic Entities , 2019, 2019 IEEE Conference on Visual Analytics Science and Technology (VAST).

[3]  Yunan Chen,et al.  Mapping and Taking Stock of the Personal Informatics Literature , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[4]  Xi Chen,et al.  VIStory: interactive storyboard for exploring visual information in scientific publications , 2019, Journal of Visualization.

[5]  Niklas Elmqvist,et al.  Keshif: Rapid and Expressive Tabular Data Exploration for Novices , 2018, IEEE Transactions on Visualization and Computer Graphics.

[6]  Paolo Cignoni,et al.  ReviewerNet: A visualization platform for the selection of academic reviewers , 2020, Comput. Graph..

[7]  Juwon Hong,et al.  A Conference Paper Exploring System Based on Citing Motivation and Topic , 2020, 2020 IEEE Pacific Visualization Symposium (PacificVis).

[8]  Maria Cristina Ferreira de Oliveira,et al.  TRIVIR: A Visualization System to Support Document Retrieval with High Recall , 2019, DocEng.

[9]  Kwan-Liu Ma,et al.  BiblioViz: a system for visualizing bibliography information , 2006, APVIS.

[10]  Daniel J. Wigdor,et al.  Understanding and Supporting Academic Literature Review Workflows with LitSense , 2020, AVI.

[11]  Tamara Munzner,et al.  PaperQuest: A Visualization Tool to Support Literature Review , 2016, CHI Extended Abstracts.

[12]  Tobias Isenberg,et al.  Visualization as Seen through its Research Paper Keywords , 2014, IEEE Transactions on Visualization and Computer Graphics.

[13]  Ali Sunyaev,et al.  Design Principles for Systematic Search Systems: A Holistic Synthesis of a Rigorous Multi-cycle Design Science Research Journey , 2018, Business & Information Systems Engineering.

[14]  Xiaolong Zhang,et al.  CiteSense: supporting sensemaking of research literature , 2008, CHI.

[15]  David Sankoff,et al.  Literature Visualization and Similarity Measurement Based on Citation Relations , 2015, 2015 19th International Conference on Information Visualisation.

[16]  Charles Perin,et al.  Investigating the Direct Manipulation of Ranking Tables for Time Navigation , 2015, CHI.

[17]  Kyungwon Lee,et al.  Citation Network Visualization of Reference Papers Based on Influence Groups , 2018, 2018 IEEE 8th Symposium on Large Data Analysis and Visualization (LDAV).

[18]  Qi Han,et al.  CiteRivers: Visual Analytics of Citation Patterns , 2016, IEEE Transactions on Visualization and Computer Graphics.

[19]  Takayuki Itoh,et al.  A Visualization of Research Papers Based on the Topics and Citation Network , 2015, 2015 19th International Conference on Information Visualisation.

[20]  Jia-Kai Chou,et al.  PaperVis: Literature Review Made Easy , 2011, Comput. Graph. Forum.

[21]  Hanspeter Pfister,et al.  LineUp: Visual Analysis of Multi-Attribute Rankings , 2013, IEEE Transactions on Visualization and Computer Graphics.

[22]  Alex Endert,et al.  Podium: Ranking Data Using Mixed-Initiative Visual Analytics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[23]  B. Caffo,et al.  eAppendix 1 : Lasagna plots : A saucy alternative to spaghetti plots , 2010 .