Three-way decision in machine learning tasks: a systematic review

by Campagner, Andrea, Milella, Frida, Ciucci, Davide, Cabitza, Federico,

Artificial Intelligence Review 57

Partially-defined equivalence relations: Relationship with orthopartitions and connection to rough sets

by Boffa, Stefania, Campagner, Andrea, Ciucci, Davide,

Information Sciences 657

Towards Better Ways to Assess Predictive Computing in Medicine: On Reliability, Robustness, and Utility

by Cabitza, Federico, Campagner, Andrea,

Big Data Analysis and Artificial Intelligence for Medical Sciences

Evaluation of uncertainty quantification methods in multi-label classification: A case study with automatic diagnosis of electrocardiogram

by Barandas, Marília, Famiglini, Lorenzo, Campagner, Andrea, Folgado, Duarte, Simão, Raquel, Cabitza, Federico, Gamboa, Hugo,

Information Fusion 101

Second opinion machine learning for fast-track pathway assignment in hip and knee replacement surgery: the use of patient-reported outcome measures

by Campagner, Andrea, Milella, Frida, Banfi, Giuseppe, Cabitza, Federico,

BMC Medical Informatics and Decision Making 24

Evidence-based XAI: An empirical approach to design more effective and explainable decision support systems

by Famiglini, Lorenzo, Campagner, Andrea, Barandas, Marilia, La Maida, Giovanni Andrea, Gallazzi, Enrico, Cabitza, Federico,

Computers in Biology and Medicine 170

Ensemble Predictors: Possibilistic Combination of Conformal Predictors for Multivariate Time Series Classification

by Campagner, Andrea, Barandas, Marilia, Folgado, Duarte, Gamboa, Hugo, Cabitza, Federico,

IEEE Transactions on Pattern Analysis and Machine Intelligence

Dissimilar Similarities: Comparing Human and Statistical Similarity Evaluation in Medical AI

by Cabitza, Federico, Famiglini, Lorenzo, Campagner, Andrea, Sconfienza, Luca Maria, Fusco, Stefano, Caccavella, Valerio, Gallazzi, Enrico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14986 LNAI

Explanations Considered Harmful: The Impact of Misleading Explanations on Accuracy in Hybrid Human-AI Decision Making

by Cabitza, Federico, Fregosi, Caterina, Campagner, Andrea, Natali, Chiara,

Communications in Computer and Information Science 2156 CCIS

Never tell me the odds: Investigating pro-hoc explanations in medical decision making

by Cabitza, Federico, Natali, Chiara, Famiglini, Lorenzo, Campagner, Andrea, Caccavella, Valerio, Gallazzi, Enrico,

Artificial Intelligence in Medicine 150

Learning from fuzzy labels: Theoretical issues and algorithmic solutions

by Campagner, Andrea,

International Journal of Approximate Reasoning 171

Everything is varied: The surprising impact of instantial variation on ML reliability

by Campagner, Andrea, Famiglini, Lorenzo, Carobene, Anna, Cabitza, Federico,

Applied Soft Computing 146

Toward a Perspectivist Turn in Ground Truthing for Predictive Computing

by Cabitza, Federico, Campagner, Andrea, Basile, Valerio,

Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023 37

Controllable AI - An Alternative to Trustworthiness in Complex AI Systems?

by Kieseberg, Peter, Weippl, Edgar, Tjoa, A. Min, Cabitza, Federico, Campagner, Andrea, Holzinger, Andreas,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Biomarkers for Mixed Dementia: a hard bone to bite? Preliminary analyses and promising results for a debated topic

by Campagner, Andrea, Famiglini, Lorenzo, Arosio, Beatrice, Rossi, Paolo, Annoni, Giorgio, Cabitza, Federico,

CEUR Workshop Proceedings 3623

Preface

by Campagner, Andrea, Lenz, Oliver Urs, Xia, Shuyin, Ślęzak, Dominik, Wąs, Jarosław, Yao, Jing Tao,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14481 LNAI

Credal Learning: Weakly Supervised Learning from Credal Sets

by Campagner, Andrea,

Frontiers in Artificial Intelligence and Applications 372

Assessment of Fast-Track Pathway in Hip and Knee Replacement Surgery by Propensity Score Matching on Patient-Reported Outcomes

by Campagner, Andrea, Milella, Frida, Guida, Stefania, Bernareggi, Susan, Banfi, Giuseppe, Cabitza, Federico,

Diagnostics 13

Aggregation Operators on Shadowed Sets Deriving from Conditional Events and Consensus Operators

by Boffa, Stefania, Campagner, Andrea, Ciucci, Davide, Yao, Yiyu,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14481 LNAI

Let Me Think! Investigating the Effect of Explanations Feeding Doubts About the AI Advice

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo, Natali, Chiara, Caccavella, Valerio, Gallazzi, Enrico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Preface

by Holzinger, Andreas, Kieseberg, Peter, Cabitza, Federico, Campagner, Andrea, Weippl, Edgar, Tjoa, A. Min,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Color Shadows 2: Assessing the Impact of XAI on Diagnostic Decision-Making

by Natali, Chiara, Famiglini, Lorenzo, Campagner, Andrea, La Maida, Giovanni Andrea, Gallazzi, Enrico, Cabitza, Federico,

Communications in Computer and Information Science 1901 CCIS

Demo: Decision Support System Quality Assessment Tool

by Cabitza, Federico, Campagner, Andrea, Natali, Chiara,

ACM International Conference Proceeding Series

A distributional framework for evaluation, comparison and uncertainty quantification in soft clustering

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

International Journal of Approximate Reasoning 162

The Impact of Gender and Personality in Human-AI Teaming: The Case of Collaborative Question Answering

by Milella, Frida, Natali, Chiara, Scantamburlo, Teresa, Campagner, Andrea, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14143 LNCS

Towards a Rigorous Calibration Assessment Framework: Advancements in Metrics, Methods, and Use

by Famiglini, Lorenzo, Campagner, Andrea, Cabitza, Federico,

Frontiers in Artificial Intelligence and Applications 372

AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-making

by Cabitza, Federico, Campagner, Andrea, Angius, Riccardo, Natali, Chiara, Reverberi, Carlo,

Conference on Human Factors in Computing Systems - Proceedings

The Tower of Babel in Explainable Artificial Intelligence (XAI)

by Schneeberger, David, Röttger, Richard, Cabitza, Federico, Campagner, Andrea, Plass, Markus, Müller, Heimo, Holzinger, Andreas,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 14065 LNCS

Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis

by Cabitza, Federico, Campagner, Andrea, Ronzio, Luca, Cameli, Matteo, Mandoli, Giulia Elena, Pastore, Maria Concetta, Sconfienza, Luca Maria, Folgado, Duarte, Barandas, Marília, Gamboa, Hugo,

Artificial Intelligence in Medicine 138

Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting

by Cabitza, Federico, Campagner, Andrea, Natali, Chiara, Parimbelli, Enea, Ronzio, Luca, Cameli, Matteo,

Machine Learning and Knowledge Extraction 5

Quod erat demonstrandum? - Towards a typology of the concept of explanation for the design of explainable AI

by Cabitza, Federico, Campagner, Andrea, Malgieri, Gianclaudio, Natali, Chiara, Schneeberger, David, Stoeger, Karl, Holzinger, Andreas,

Expert Systems with Applications 213

A general framework for evaluating and comparing soft clusterings

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

Information Sciences 623

Aggregation models in ensemble learning: A large-scale comparison

by Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

Information Fusion 90

A Confidence Interval-Based Method for Classifier Re-Calibration

by Campagner, Andrea, Famiglini, Lorenzo, Cabitza, Federico,

Studies in Health Technology and Informatics 294

Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition

by Bento, Nuno, Rebelo, Joana, Barandas, Marília, Carreiro, André V., Campagner, Andrea, Cabitza, Federico, Gamboa, Hugo,

Sensors 22

Uncertainty representation in dynamical systems using rough set theory

by Campagner, Andrea, Ciucci, Davide, Dorigatti, Valentina,

Theoretical Computer Science 908

Belief functions and rough sets: Survey and new insights

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

International Journal of Approximate Reasoning 143

Comparative Assessment of Two Data Visualizations to Communicate Medical Test Results Online

by Cabitza, Federico, Campagner, Andrea, Conte, Enrico,

Proceedings of the International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications 3

Scikit-Weak: A Python Library for Weakly Supervised Machine Learning

by Campagner, Andrea, Lienen, Julian, Hüllermeier, Eyke, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13633 LNAI

A Distributional Approach for Soft Clustering Comparison and Evaluation

by Campagner, Andrea, Ciucci, Davide, Denœux, Thierry,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13506 LNAI

Decisions are not all equal—Introducing a utility metric based on case-wise raters’ perceptions

by Campagner, Andrea, Sternini, Federico, Cabitza, Federico,

Computer Methods and Programs in Biomedicine 221

Re-calibrating Machine Learning Models Using Confidence Interval Bounds

by Campagner, Andrea, Famiglini, Lorenzo, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13408 LNAI

Aggregation operators on shadowed sets

by Boffa, Stefania, Campagner, Andrea, Ciucci, Davide, Yao, Yiyu,

Information Sciences 595

Rough-set Based Genetic Algorithms for Weakly Supervised Feature Selection

by Campagner, Andrea, Ciucci, Davide,

Communications in Computer and Information Science 1602 CCIS

The multicenter European Biological Variation Study (EuBIVAS): a new glance provided by the Principal Component Analysis (PCA), a machine learning unsupervised algorithms, based on the basic metabolic panel linked measurands

by Carobene, Anna, Campagner, Andrea, Uccheddu, Christian, Banfi, Giuseppe, Vidali, Matteo, Cabitza, Federico,

Clinical Chemistry and Laboratory Medicine 60

Orthopartitions in Knowledge Representation and Machine Learning

by Ciucci, Davide, Boffa, Stefania, Campagner, Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13633 LNAI

A robust and parsimonious machine learning method to predict ICU admission of COVID-19 patients

by Famiglini, Lorenzo, Campagner, Andrea, Carobene, Anna, Cabitza, Federico,

Medical and Biological Engineering and Computing

The unbearable (technical) unreliability of automated facial emotion recognition

by Cabitza, Federico, Campagner, Andrea, Mattioli, Martina,

Big Data and Society 9

Color Shadows (Part I): Exploratory Usability Evaluation of Activation Maps in Radiological Machine Learning

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo, Gallazzi, Enrico, La Maida, Giovanni Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13480 LNCS

Three-way Learnability: A Learning Theoretic Perspective on Three-way Decision

by Campagner, Andrea, Ciucci, Davide,

Proceedings of the 17th Conference on Computer Science and Intelligence Systems, FedCSIS 2022

Global Interpretable Calibration Index, a New Metric to Estimate Machine Learning Models’ Calibration

by Cabitza, Federico, Campagner, Andrea, Famiglini, Lorenzo,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13480 LNCS

Interpretable heartbeat classification using local model-agnostic explanations on ECGs

by Neves, Inês, Folgado, Duarte, Santos, Sara, Barandas, Marília, Campagner, Andrea, Ronzio, Luca, Cabitza, Federico, Gamboa, Hugo,

Computers in Biology and Medicine 133

Unity is intelligence: a collective intelligence experiment on ecg reading to improve diagnostic performance in cardiology

by Ronzio, Luca, Campagner, Andrea, Cabitza, Federico, Gensini, Gian Franco,

Journal of Intelligence 9

Three-way decision and conformal prediction: Isomorphisms, differences and theoretical properties of cautious learning approaches

by Campagner, Andrea, Cabitza, Federico, Berjano, Pedro, Ciucci, Davide,

Information Sciences 579

Assessing the impact of medical AI: A survey of physicians' perceptions

by Cabitza, Federico, Campagner, Andrea, Cavosi, Valentina,

ACM International Conference Proceeding Series

Development, evaluation, and validation of machine learning models for COVID-19 detection based on routine blood tests

by Cabitza, Federico, Campagner, Andrea, Ferrari, Davide, Di Resta, Chiara, Ceriotti, Daniele, Sabetta, Eleonora, Colombini, Alessandra, De Vecchi, Elena, Banfi, Giuseppe, Locatelli, Massimo, Carobene, Anna,

Clinical Chemistry and Laboratory Medicine 59

The importance of being external. methodological insights for the external validation of machine learning models in medicine

by Cabitza, Federico, Campagner, Andrea, Soares, Felipe, García de Guadiana-Romualdo, Luis, Challa, Feyissa, Sulejmani, Adela, Seghezzi, Michela, Carobene, Anna,

Computer Methods and Programs in Biomedicine 208

External validation of Machine Learning models for COVID-19 detection based on Complete Blood Count

by Campagner, Andrea, Carobene, Anna, Cabitza, Federico,

Health Information Science and Systems 9

Studying human-AI collaboration protocols: the case of the Kasparov’s law in radiological double reading

by Cabitza, Federico, Campagner, Andrea, Sconfienza, Luca Maria,

Health Information Science and Systems 9

Learnability in 'Learning from Fuzzy Labels'

by Campagner, Andrea,

IEEE International Conference on Fuzzy Systems 2021-July

To Err is (only) Human. Reflections on How to Move from Accuracy to Trust for Medical AI

by Cabitza, Federico, Campagner, Andrea, Datteri, Edoardo,

Lecture Notes in Information Systems and Organisation 51 LNISO

Prediction of ICU admission for COVID-19 patients: A machine learning approach based on complete blood count data

by Famiglini, Lorenzo, Bini, Giorgio, Carobene, Anna, Campagner, Andrea, Cabitza, Federico,

Proceedings - IEEE Symposium on Computer-Based Medical Systems 2021-June

Machine Learning based on laboratory medicine test results in diagnosis and prognosis for COVID-19 patients: A systematic review.; [Tecniche di apprendimento automatico basato sui risultati di esami di medicina di laboratorio nella diagnosi e prognosi per i pazienti COVID-19: Una revisione sistematica]

by Carobene, Anna, Sabetta, Eleonora, Monteverde, Elena, Locatelli, Massimo, Banfi, Giuseppe, Di Resta, Chiara, Guerranti, Roberto, Vidali, Matteo, Campagner, Andrea, Cabitza, Federico,

Biochimica Clinica 45

Feature Selection and Disambiguation in Learning from Fuzzy Labels Using Rough Sets

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12872 LNAI

Ground truthing from multi-rater labeling with three-way decision and possibility theory

by Campagner, Andrea, Ciucci, Davide, Svensson, Carl-Magnus, Figge, Marc Thilo, Cabitza, Federico,

Information Sciences 545

The need to move away from agential-AI: Empirical investigations, useful concepts and open issues

by Cabitza, Federico, Campagner, Andrea, Simone, Carla,

International Journal of Human Computer Studies 155

Rough set-based feature selection for weakly labeled data

by Campagner, Andrea, Ciucci, Davide, Hüllermeier, Eyke,

International Journal of Approximate Reasoning 136

Weighted Utility: A Utility Metric Based on the Case-Wise Raters’ Perceptions

by Campagner, Andrea, Conte, Enrico, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12844 LNCS

Detection of COVID-19 Infection from Routine Blood Exams with Machine Learning: A Feasibility Study

by Brinati, Davide, Campagner, Andrea, Ferrari, Davide, Locatelli, Massimo, Banfi, Giuseppe, Cabitza, Federico,

Journal of Medical Systems 44

Assessment and prediction of spine surgery invasiveness with machine learning techniques

by Campagner, Andrea, Berjano, Pedro, Lamartina, Claudio, Langella, Francesco, Lombardi, Giovanni, Cabitza, Federico,

Computers in Biology and Medicine 121

Three-Way Decision for Handling Uncertainty in Machine Learning: A Narrative Review

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12179 LNAI

H-Accuracy, an alternative metric to assess classification models in medicine

by Campagner, Andrea, Sconfienza, Luca, Cabitza, Federico,

Studies in Health Technology and Informatics 270

A Formal Learning Theory for Three-Way Clustering

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12322 LNAI

Approximate Reaction Systems Based on Rough Set Theory

by Campagner, Andrea, Ciucci, Davide, Dorigatti, Valentina,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12179 LNAI

Feature Reduction in Superset Learning Using Rough Sets and Evidence Theory

by Campagner, Andrea, Ciucci, Davide, Hüllermeier, Eyke,

Communications in Computer and Information Science 1237 CCIS

Introducing new measures of inter- And intra-rater agreement to assess the reliability of medical ground truth

by Campagner, Andrea, Cabitza, Federico,

Studies in Health Technology and Informatics 270

Ordinal labels in machine learning: A user-centered approach to improve data validity in medical settings

by Seveso, Andrea, Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

BMC Medical Informatics and Decision Making 20

The three-way-in and three-way-out framework to treat and exploit ambiguity in data

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

International Journal of Approximate Reasoning 119

The elephant in the machine: Proposing a new metric of data reliability and its application to a medical case to assess classification reliability

by Cabitza, Federico, Campagner, Andrea, Albano, Domenico, Aliprandi, Alberto, Bruno, Alberto, Chianca, Vito, Corazza, Angelo, Pietto, Francesco Di, Gambino, Angelo, Gitto, Salvatore, Messina, Carmelo, Orlandi, Davide, Pedone, Luigi, Zappia, Marcello, Sconfienza, Luca Maria,

Applied Sciences (Switzerland) 10

Entropy-based shadowed set approximation of intuitionistic fuzzy sets

by Campagner, Andrea, Dorigatti, Valentina, Ciucci, Davide,

International Journal of Intelligent Systems 35

As if sand were stone. New concepts and metrics to probe the ground on which to build trustable AI

by Cabitza, Federico, Campagner, Andrea, Sconfienza, Luca Maria,

BMC Medical Informatics and Decision Making 20

All you need is higher accuracy? On the quest for minimum acceptable accuracy for medical artificial intelligence

by Cabitza, Federico, Campagner, Andrea, Zotti, Francesco Del, Ravizza, Alice, Sternini, Federico,

Proceedings of the 12th IADIS International Conference e-Health 2020, EH 2020 - Part of the 14th Multi Conference on Computer Science and Information Systems, MCCSIS 2020

Evidence of significant difference in key covid-19 biomarkers during the italian lockdown strategy. A retrospective study on patients admitted to a hospital emergency department in northern italy

by Carobene, Anna, Ferrari, Davide, Campagner, Andrea, Cabitza, Federico, Sabetta, Eleonora, Ceriotti, Daniele, Di Resta, Chiara, Locatelli, Massimo,

Acta Biomedica 91

Ensemble learning, social choice and collective intelligence: An experimental comparison of aggregation techniques

by Campagner, Andrea, Ciucci, Davide, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12256 LNAI

Back to the Feature: A Neural-Symbolic Perspective on Explainable AI

by Campagner, Andrea, Cabitza, Federico,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12279 LNCS

New Frontiers in Explainable AI: Understanding the GI to Interpret the GO

by Cabitza, Federico, Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11713 LNCS

Exploring medical data classification with three-way decision trees

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

HEALTHINF 2019 - 12th International Conference on Health Informatics, Proceedings; Part of 12th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2019

Three–Way Classification: Ambiguity and Abstention in Machine Learning

by Campagner, Andrea, Cabitza, Federico, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11499 LNAI

Programmed Inefficiencies in DSS-Supported Human Decision Making

by Cabitza, Federico, Campagner, Andrea, Ciucci, Davide, Seveso, Andrea,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11676 LNAI

Orthopartitions and soft clustering: Soft mutual information measures for clustering validation

by Campagner, Andrea, Ciucci, Davide,

Knowledge-Based Systems 180

Three-way and semi-supervised decision tree learning based on orthopartitions

by Campagner, Andrea, Ciucci, Davide,

Communications in Computer and Information Science 854

Measuring uncertainty in orthopairs

by Campagner, Andrea, Ciucci, Davide,

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10369 LNAI