Kevin Roitero

发表

Can The Crowd Identify Misinformation Objectively?: The Effects of Judgment Scale and Assessor's Background

Stefano Mizzaro, Gianluca Demartini, Kevin Roitero, 2020, SIGIR.

Effectiveness evaluation without human relevance judgments: A systematic analysis of existing methods and of their combinations

Stefano Mizzaro, Giuseppe Serra, Kevin Roitero, 2020, Inf. Process. Manag..

Underlying cause of death identification from death certificates using reverse coding to text and a NLP based deep learning approach

Vincenzo Della Mea, Kevin Roitero, Mihai Horia Popescu, 2020 .

CHEERS: CHeap & Engineered Evaluation of Retrieval Systems

Kevin Roitero, 2018, SIGIR.

All Those Wasted Hours: On Task Abandonment in Crowdsourcing

Lei Han, Eddy Maddalena, Gianluca Demartini, 2019, WSDM.

Reproduce and Improve

Stefano Mizzaro, Kevin Roitero, Michael Soprano, 2018, ACM J. Data Inf. Qual..

The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?

Gianluca Demartini, Vincenzo Della Mea, Kevin Roitero, 2020, CIKM.

Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments

Stefano Mizzaro, Giuseppe Serra, Marco Passon, 2018, ACM J. Data Inf. Qual..

The Impact of Task Abandonment in Crowdsourcing

Eddy Maddalena, Gianluca Demartini, Ujwal Gadiraju, 2019, IEEE Transactions on Knowledge and Data Engineering.

On Transforming Relevance Scales

Eddy Maddalena, Stefano Mizzaro, Gianluca Demartini, 2019, CIKM.

Leveraging Behavioral Heterogeneity Across Markets for Cross-Market Training of Recommender Systems

Mounia Lalmas, Rishabh Mehrotra, Kevin Roitero, 2020, WWW.

Improving the Efficiency of Retrieval Effectiveness Evaluation: Finding a Few Good Topics with Clustering?

Stefano Mizzaro, Kevin Roitero, 2016, IIR.

Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing

Eddy Maddalena, Stefano Mizzaro, Gianluca Demartini, 2017, HCOMP.

IRevalOO: An Object Oriented Framework for Retrieval Evaluation

Eddy Maddalena, Stefano Mizzaro, Kevin Roitero, 2018, SIGIR.

How Many Truth Levels? Six? One Hundred? Even More? Validating Truthfulness of Statements via Crowdsourcing

Stefano Mizzaro, Gianluca Demartini, Damiano Spina, 2018, CIKM Workshops.

Fewer topics? A million topics? Both?! On topics subsets in test collections

J. Shane Culpepper, Mark Sanderson, Falk Scholer, 2020, Inf. Retr. J..

Cheap IR evaluation pdf

Kevin Roitero, Kevin Roitero, 2020, SIGIR Forum.

HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysis

Stefano Mizzaro, Kevin Roitero, Michael Soprano, 2019, BIRNDL@SIGIR.

On Fine-Grained Relevance Scales

Eddy Maddalena, Stefano Mizzaro, Gianluca Demartini, 2018, SIGIR.

Economic Evaluation of Recommender Systems: A Proposal

Stefano Mizzaro, Giuseppe Serra, Kevin Roitero, 2017, IIR.

Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models

Stefano Mizzaro, Kevin Roitero, Michael Soprano, 2019, IIR.

Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin

Josiane Mothe, Stefano Mizzaro, Kevin Roitero, 2018, SIGIR.

Detection of HER2 from Haematoxylin-Eosin Slides Through a Cascade of Deep Learning Classifiers via Multi-Instance Learning

Vincenzo Della Mea, Kevin Roitero, António Polónia, 2020, J. Imaging.

Twitter goes to the Doctor: Detecting Medical Tweets using Machine Learning and BERT

Stefano Mizzaro, Giuseppe Serra, Vincenzo Della Mea, 2020, SIIRH@ECIR.

Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias

Stefano Mizzaro, Gianluca Demartini, Kevin Roitero, 2020, ECIR.

On Topic Difficulty in IR Evaluation: The Effect of Systems, Corpora, and System Components

J. Shane Culpepper, Oren Kurland, Stefano Mizzaro, 2019, SIGIR.

Do Easy Topics Predict Effectiveness Better Than Difficult Topics?

Eddy Maddalena, Stefano Mizzaro, Kevin Roitero, 2017, ECIR.

Considering Assessor Agreement in IR Evaluation

Eddy Maddalena, Stefano Mizzaro, Gianluca Demartini, 2017, ICTIR.

Towards Stochastic Simulations of Relevance Profiles

Stefano Mizzaro, Julián Urbano, Kevin Roitero, 2019, CIKM.

Effectiveness Evaluation with a Subset of Topics: A Practical Approach

Stefano Mizzaro, Kevin Roitero, Michael Soprano, 2018, SIGIR.

Crowd Worker Strategies in Relevance Judgment Tasks

Eddy Maddalena, Gianluca Demartini, Ujwal Gadiraju, 2020, WSDM.

On the effect of relevance scales in crowdsourcing relevance assessments for Information Retrieval evaluation

Falk Scholer, Eddy Maddalena, Stefano Mizzaro, 2021, Inf. Process. Manag..

Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19

Stefano Mizzaro, Gianluca Demartini, Giuseppe Serra, 2021, Personal and Ubiquitous Computing.

Managing Bias in Human-Annotated Data: Moving Beyond Bias Removal pdf

Stefano Mizzaro, Gianluca Demartini, Kevin Roitero, 2021, ArXiv.

A Software Simulator for Optimizing Ambulance Location and Response Time: A Preliminary Report

Stefano Mizzaro, Vincenzo Della Mea, Francesca Valent, 2021, 2021 IEEE International Conference on Digital Health (ICDH).

The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scale

Stefano Mizzaro, Gianluca Demartini, Davide Ceolin, 2021, Inf. Process. Manag..

E-BART: Jointly Predicting and Explaining Truthfulness

Gianluca Demartini, Kevin Roitero, Michael Soprano, 2021, TTO.

Human-in-the-Loop Systems for Truthfulness: A Study of Human and Machine Confidence

Stefano Mizzaro, Gianluca Demartini, Kevin Roitero, 2021, TTO.

DiLBERT: Cheap Embeddings for Disease Related Medical NLP

Vincenzo Della Mea, Kevin Roitero, Beatrice Portelli, 2021, IEEE Access.

Automatic Assignment of ICD-10 Codes to Diagnostic Texts using Transformers Based Techniques

Vincenzo Della Mea, Kevin Roitero, Mihai Horia Popescu, 2021, 2021 IEEE 9th International Conference on Healthcare Informatics (ICHI).