Multi-class classification algorithms have become an important tool for the analysis of neuroimaging data. Classification errors contain potentially important information that often goes unreported. It is therefore desirable to quantitatively compare patterns of errors between different experimental conditions. Here we present a Bayesian test that is based on comparing evidence in favor of two competing hypotheses, one stating dependence and one stating independence of two given error patterns. We derive analytical solutions for the likelihoods of both hypotheses. We compare the results from our new test with two other methods of comparing error patterns using data from an fMRI experiment and we substantiate reasons for adopting our proposal and for future work.

A Bayesian Test for Comparing Classifier Errors

Olivetti, Emanuele;
2015

Abstract

Multi-class classification algorithms have become an important tool for the analysis of neuroimaging data. Classification errors contain potentially important information that often goes unreported. It is therefore desirable to quantitatively compare patterns of errors between different experimental conditions. Here we present a Bayesian test that is based on comparing evidence in favor of two competing hypotheses, one stating dependence and one stating independence of two given error patterns. We derive analytical solutions for the likelihoods of both hypotheses. We compare the results from our new test with two other methods of comparing error patterns using data from an fMRI experiment and we substantiate reasons for adopting our proposal and for future work.
978-1-4673-7145-2
File in questo prodotto:
File Dimensione Formato  
olivetti_test_errors.pdf

solo utenti autorizzati

Tipologia: Documento in Pre-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 274.7 kB
Formato Adobe PDF
274.7 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11582/314149
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact