Publications

by Cabitza, Federico, Campagner, Andrea, Ferrari, Davide, Di Resta, Chiara, Ceriotti, Daniele, Sabetta, Eleonora, Colombini, Alessandra, De Vecchi, Elena, Banfi, Giuseppe, Locatelli, Massimo, Carobene, Anna,

Clinical Chemistry and Laboratory Medicine 59

Published in 2021 (Cited by: 93)

Three-Way Decision for Handling Uncertainty in Machine Learning: A Narrative Review

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12179 LNAI

Published in 2020 (Cited by: 36)

H-Accuracy, an alternative metric to assess classification models in medicine

by Campagner, Andrea, Sconfienza, Luca, Cabitza, Federico,

Studies in Health Technology and Informatics 270

Published in 2020 (Cited by: 6)

Credal Learning: Weakly Supervised Learning from Credal Sets

by Campagner, Andrea,

Frontiers in Artificial Intelligence and Applications 372

Published in 2023 (Cited by: 0)

Assessment of Fast-Track Pathway in Hip and Knee Replacement Surgery by Propensity Score Matching on Patient-Reported Outcomes

by Campagner, Andrea, Milella, Frida, Guida, Stefania, Bernareggi, Susan, Banfi, Giuseppe, Cabitza, Federico,

Diagnostics 13

Published in 2023 (Cited by: 0)

A Formal Learning Theory for Three-Way Clustering

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12322 LNAI

Published in 2020 (Cited by: 2)

Uncertainty representation in dynamical systems using rough set theory

by Campagner, Andrea, Ciucci, Davide, Dorigatti, Valentina,

Theoretical Computer Science 908

Published in 2022 (Cited by: 3)

The importance of being external. methodological insights for the external validation of machine learning models in medicine

by Cabitza, Federico, Campagner, Andrea, Soares, Felipe, García de Guadiana-Romualdo, Luis, Challa, Feyissa, Sulejmani, Adela, Seghezzi, Michela, Carobene, Anna,

Computer Methods and Programs in Biomedicine 208

Published in 2021 (Cited by: 52)

External validation of Machine Learning models for COVID-19 detection based on Complete Blood Count

by Campagner, Andrea, Carobene, Anna, Cabitza, Federico,

Health Information Science and Systems 9

Published in 2021 (Cited by: 12)

Evaluation of uncertainty quantification methods in multi-label classification: A case study with automatic diagnosis of electrocardiogram

by Barandas, Marília, Famiglini, Lorenzo, Campagner, Andrea, Folgado, Duarte, Simão, Raquel, Cabitza, Federico, Gamboa, Hugo,

Information Fusion 101

Published in 2024 (Cited by: 0)

Approximate Reaction Systems Based on Rough Set Theory

by Campagner, Andrea, Ciucci, Davide, Dorigatti, Valentina,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12179 LNAI

Published in 2020 (Cited by: 1)

Feature Reduction in Superset Learning Using Rough Sets and Evidence Theory

by Campagner, Andrea, Ciucci, Davide, Hüllermeier, Eyke,

Communications in Computer and Information Science 1237 CCIS

Published in 2020 (Cited by: 3)

Let Me Think! Investigating the Effect of Explanations Feeding Doubts About the AI Advice

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo, Natali, Chiara, Caccavella, Valerio, Gallazzi, Enrico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Published in 2023 (Cited by: 0)

Exploring medical data classification with three-way decision trees

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

HEALTHINF 2019 - 12th International Conference on Health Informatics, Proceedings; Part of 12th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2019

Published in 2019 (Cited by: 7)

Preface

by Holzinger, Andreas, Kieseberg, Peter, Cabitza, Federico, Campagner, Andrea, Weippl, Edgar, Tjoa, A. Min,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Published in 2023 (Cited by: 0)

Belief functions and rough sets: Survey and new insights

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

International Journal of Approximate Reasoning 143

Published in 2022 (Cited by: 30)

Introducing new measures of inter- And intra-rater agreement to assess the reliability of medical ground truth

by Campagner, Andrea, Cabitza, Federico,

Studies in Health Technology and Informatics 270

Published in 2020 (Cited by: 0)

Color Shadows 2: Assessing the Impact of XAI on Diagnostic Decision-Making

by Natali, Chiara, Famiglini, Lorenzo, Campagner, Andrea, La Maida, Giovanni Andrea, Gallazzi, Enrico, Cabitza, Federico,

Communications in Computer and Information Science 1901 CCIS

Published in 2023 (Cited by: 0)

The need to separate the wheat from the chaff in medical informatics: Introducing a comprehensive checklist for the (self)-assessment of medical AI studies

by Cabitza, Federico, Campagner, Andrea,

International Journal of Medical Informatics 153

Published in 2021 (Cited by: 94)

Three–Way Classification: Ambiguity and Abstention in Machine Learning

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11499 LNAI

Published in 2019 (Cited by: 10)

Studying human-AI collaboration protocols: the case of the Kasparov’s law in radiological double reading

by Cabitza, Federico, Campagner, Andrea, Sconfienza, Luca Maria,

Health Information Science and Systems 9

Published in 2021 (Cited by: 10)

Scikit-Weak: A Python Library for Weakly Supervised Machine Learning

by Campagner, Andrea, Lienen, Julian, Hüllermeier, Eyke, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13633 LNAI

Published in 2022 (Cited by: 1)

Ordinal labels in machine learning: A user-centered approach to improve data validity in medical settings

by Seveso, Andrea, Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

BMC Medical Informatics and Decision Making 20

Published in 2020 (Cited by: 3)

Demo: Decision Support System Quality Assessment Tool

by Cabitza, Federico, Campagner, Andrea, Natali, Chiara,

ACM International Conference Proceeding Series

Published in 2023 (Cited by: 0)

Learnability in 'Learning from Fuzzy Labels'

by Campagner, Andrea,

IEEE International Conference on Fuzzy Systems 2021-July

Published in 2021 (Cited by: 4)

A distributional framework for evaluation, comparison and uncertainty quantification in soft clustering

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

International Journal of Approximate Reasoning 162

Published in 2023 (Cited by: 0)

A Distributional Approach for Soft Clustering Comparison and Evaluation

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13506 LNAI

Published in 2022 (Cited by: 1)

The Impact of Gender and Personality in Human-AI Teaming: The Case of Collaborative Question Answering

by Milella, Frida, Natali, Chiara, Scantamburlo, Teresa, Campagner, Andrea, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14143 LNCS

Published in 2023 (Cited by: 0)

To Err is (only) Human. Reflections on How to Move from Accuracy to Trust for Medical AI

by Cabitza, Federico, Campagner, Andrea, Datteri, Edoardo,

Lecture Notes in Information Systems and Organisation 51 LNISO

Published in 2021 (Cited by: 1)

Prediction of ICU admission for COVID-19 patients: A machine learning approach based on complete blood count data

by Famiglini, Lorenzo, Bini, Giorgio, Carobene, Anna, Campagner, Andrea, Cabitza, Federico,

Proceedings - IEEE Symposium on Computer-Based Medical Systems 2021-June

Published in 2021 (Cited by: 15)

Identification of SARS-CoV-2 positivity using machine learning methods on blood count data: External validation of state-of-the-art models.; [Identificazione di positività al SARS-CoV-2 attraverso metodi di Machine Learning sui dati dell'esame emocromocitometrico: Validazione esterna di modelli allo stato dell'arte]

by Carobene, Anna, Campagner, Andrea, Sulejmani, Adela, Leoni, Valerio, Seghezzi, Michela, Buoro, Sabrina, Cabitza, Federico,

Biochimica Clinica 45

Published in 2021 (Cited by: 5)

The three-way-in and three-way-out framework to treat and exploit ambiguity in data

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

International Journal of Approximate Reasoning 119

Published in 2020 (Cited by: 31)

Machine Learning based on laboratory medicine test results in diagnosis and prognosis for COVID-19 patients: A systematic review.; [Tecniche di apprendimento automatico basato sui risultati di esami di medicina di laboratorio nella diagnosi e prognosi per i pazienti COVID-19: Una revisione sistematica]

by Carobene, Anna, Sabetta, Eleonora, Monteverde, Elena, Locatelli, Massimo, Banfi, Giuseppe, Di Resta, Chiara, Guerranti, Roberto, Vidali, Matteo, Campagner, Andrea, Cabitza, Federico,

Biochimica Clinica 45

Published in 2021 (Cited by: 5)

Decisions are not all equal—Introducing a utility metric based on case-wise raters’ perceptions

by Campagner, Andrea, Sternini, Federico, Cabitza, Federico,

Computer Methods and Programs in Biomedicine 221

Published in 2022 (Cited by: 3)

Re-calibrating Machine Learning Models Using Confidence Interval Bounds

by Campagner, Andrea, Famiglini, Lorenzo, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13408 LNAI

Published in 2022 (Cited by: 1)

Three-way and semi-supervised decision tree learning based on orthopartitions

by Campagner, Andrea, Ciucci, Davide,

Communications in Computer and Information Science 854

Published in 2018 (Cited by: 11)

Feature Selection and Disambiguation in Learning from Fuzzy Labels Using Rough Sets

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12872 LNAI

Published in 2021 (Cited by: 1)

Aggregation operators on shadowed sets

by Boffa, Stefania, Campagner, Andrea, Ciucci, Davide, Yao, Yiyu,

Information Sciences 595

Published in 2022 (Cited by: 3)

Programmed Inefficiencies in DSS-Supported Human Decision Making

by Cabitza, Federico, Campagner, Andrea, Ciucci, Davide, Seveso, Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11676 LNAI

Published in 2019 (Cited by: 4)

Rough-set Based Genetic Algorithms for Weakly Supervised Feature Selection

by Campagner, Andrea, Ciucci, Davide,

Communications in Computer and Information Science 1602 CCIS

Published in 2022 (Cited by: 6)

The multicenter European Biological Variation Study (EuBIVAS): a new glance provided by the Principal Component Analysis (PCA), a machine learning unsupervised algorithms, based on the basic metabolic panel linked measurands

by Carobene, Anna, Campagner, Andrea, Uccheddu, Christian, Banfi, Giuseppe, Vidali, Matteo, Cabitza, Federico,

Clinical Chemistry and Laboratory Medicine 60

Published in 2022 (Cited by: 9)

The elephant in the machine: Proposing a new metric of data reliability and its application to a medical case to assess classification reliability

by Cabitza, Federico, Campagner, Andrea, Albano, Domenico, Aliprandi, Alberto, Bruno, Alberto, Chianca, Vito, Corazza, Angelo, Pietto, Francesco Di, Gambino, Angelo, Gitto, Salvatore, Messina, Carmelo, Orlandi, Davide, Pedone, Luigi, Zappia, Marcello, Sconfienza, Luca Maria,

Applied Sciences (Switzerland) 10

Published in 2020 (Cited by: 19)

Ground truthing from multi-rater labeling with three-way decision and possibility theory

by Campagner, Andrea, Ciucci, Davide, Svensson, Carl-Magnus, Figge, Marc Thilo, Cabitza, Federico,

Information Sciences 545

Published in 2021 (Cited by: 36)

Towards a Rigorous Calibration Assessment Framework: Advancements in Metrics, Methods, and Use

by Famiglini, Lorenzo, Campagner, Andrea, Cabitza, Federico,

Frontiers in Artificial Intelligence and Applications 372

Published in 2023 (Cited by: 0)

AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-making

by Cabitza, Federico, Campagner, Andrea, Angius, Riccardo, Natali, Chiara, Reverberi, Carlo,

Conference on Human Factors in Computing Systems - Proceedings

Published in 2023 (Cited by: 5)

The Tower of Babel in Explainable Artificial Intelligence (XAI)

by Schneeberger, David, Röttger, Richard, Cabitza, Federico, Campagner, Andrea, Plass, Markus, Müller, Heimo, Holzinger, Andreas,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Published in 2023 (Cited by: 0)

Orthopartitions in Knowledge Representation and Machine Learning

by Ciucci, Davide, Boffa, Stefania, Campagner, Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13633 LNAI

Published in 2022 (Cited by: 1)

Measuring uncertainty in orthopairs

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10369 LNAI

Published in 2017 (Cited by: 6)

A robust and parsimonious machine learning method to predict ICU admission of COVID-19 patients

by Famiglini, Lorenzo, Campagner, Andrea, Carobene, Anna, Cabitza, Federico,

Medical and Biological Engineering and Computing

Published in 2022 (Cited by: 14)

Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis

by Cabitza, Federico, Campagner, Andrea, Ronzio, Luca, Cameli, Matteo, Mandoli, Giulia Elena, Pastore, Maria Concetta, Sconfienza, Luca Maria, Folgado, Duarte, Barandas, Marília, Gamboa, Hugo,

Artificial Intelligence in Medicine 138

Published in 2023 (Cited by: 8)

Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting

by Cabitza, Federico, Campagner, Andrea, Natali, Chiara, Parimbelli, Enea, Ronzio, Luca, Cameli, Matteo,

Machine Learning and Knowledge Extraction 5

Published in 2023 (Cited by: 1)

Entropy-based shadowed set approximation of intuitionistic fuzzy sets

by Campagner, Andrea, Dorigatti, Valentina, Ciucci, Davide,

International Journal of Intelligent Systems 35

Published in 2020 (Cited by: 18)

As if sand were stone. New concepts and metrics to probe the ground on which to build trustable AI

by Cabitza, Federico, Campagner, Andrea, Sconfienza, Luca Maria,

BMC Medical Informatics and Decision Making 20

Published in 2020 (Cited by: 27)

All you need is higher accuracy? On the quest for minimum acceptable accuracy for medical artificial intelligence

by Cabitza, Federico, Campagner, Andrea, Zotti, Francesco Del, Ravizza, Alice, Sternini, Federico,

Proceedings of the 12th IADIS International Conference e-Health 2020, EH 2020 - Part of the 14th Multi Conference on Computer Science and Information Systems, MCCSIS 2020

Published in 2020 (Cited by: 6)

The unbearable (technical) unreliability of automated facial emotion recognition

by Cabitza, Federico, Campagner, Andrea, Mattioli, Martina,

Big Data and Society 9

Published in 2022 (Cited by: 6)

Quod erat demonstrandum? - Towards a typology of the concept of explanation for the design of explainable AI

by Cabitza, Federico, Campagner, Andrea, Malgieri, Gianclaudio, Natali, Chiara, Schneeberger, David, Stoeger, Karl, Holzinger, Andreas,

Expert Systems with Applications 213

Published in 2023 (Cited by: 25)

The need to move away from agential-AI: Empirical investigations, useful concepts and open issues

by Cabitza, Federico, Campagner, Andrea, Simone, Carla,

International Journal of Human Computer Studies 155

Published in 2021 (Cited by: 15)

Rough set-based feature selection for weakly labeled data

by Campagner, Andrea, Ciucci, Davide, Hüllermeier, Eyke,

International Journal of Approximate Reasoning 136

Published in 2021 (Cited by: 18)

Evidence of significant difference in key covid-19 biomarkers during the italian lockdown strategy. A retrospective study on patients admitted to a hospital emergency department in northern italy

by Carobene, Anna, Ferrari, Davide, Campagner, Andrea, Cabitza, Federico, Sabetta, Eleonora, Ceriotti, Daniele, Di Resta, Chiara, Locatelli, Massimo,

Acta Biomedica 91

Published in 2020 (Cited by: 2)

Color Shadows (Part I): Exploratory Usability Evaluation of Activation Maps in Radiological Machine Learning

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo, Gallazzi, Enrico, La Maida, Giovanni Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13480 LNCS

Published in 2022 (Cited by: 4)

Weighted Utility: A Utility Metric Based on the Case-Wise Raters’ Perceptions

by Campagner, Andrea, Conte, Enrico, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12844 LNCS

Published in 2021 (Cited by: 0)

Three-way Learnability: A Learning Theoretic Perspective on Three-way Decision

by Campagner, Andrea, Ciucci, Davide,

Proceedings of the 17th Conference on Computer Science and Intelligence Systems, FedCSIS 2022

Published in 2022 (Cited by: 1)

Ensemble learning, social choice and collective intelligence: An experimental comparison of aggregation techniques

by Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12256 LNAI

Published in 2020 (Cited by: 2)

Orthopartitions and soft clustering: Soft mutual information measures for clustering validation

by Campagner, Andrea, Ciucci, Davide,

Knowledge-Based Systems 180

Published in 2019 (Cited by: 27)

Global Interpretable Calibration Index, a New Metric to Estimate Machine Learning Models’ Calibration

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13480 LNCS

Published in 2022 (Cited by: 2)

A general framework for evaluating and comparing soft clusterings

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

Information Sciences 623

Published in 2023 (Cited by: 5)

Back to the Feature: A Neural-Symbolic Perspective on Explainable AI

by Campagner, Andrea, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12279 LNCS

Published in 2020 (Cited by: 2)

Aggregation models in ensemble learning: A large-scale comparison

by Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

Information Fusion 90

Published in 2023 (Cited by: 8)

Learning from fuzzy labels: Theoretical issues and algorithmic solutions

by Campagner, Andrea,

International Journal of Approximate Reasoning

Published in 2023 (Cited by: 2)