We present TranscRater, an open-source tool for automatic speech recognition (ASR) quality estimation (QE). The tool allows users to perform ASR evaluation bypassing the need of reference transcripts and confidence information, which is common to current assessment protocols. TranscRater includes: i) methods to extract a variety of quality indicators from signal,transcription) pairs and ii) machine learning algorithms which make possible to build ASR QE models exploiting the extracted features. Confirming the positive results of previous evaluations, new experiments with TranscRater indicate its effectiveness both in WER prediction and transcription ranking tasks.

TranscRater: a Tool for Automatic Speech Recognition Quality Estimation

Jalalvand, Shahab;Negri, Matteo;Turchi, Marco;José, G. C. de Souza;Falavigna, Giuseppe Daniele;Qwaider, Mohammed R H
2016

Abstract

We present TranscRater, an open-source tool for automatic speech recognition (ASR) quality estimation (QE). The tool allows users to perform ASR evaluation bypassing the need of reference transcripts and confidence information, which is common to current assessment protocols. TranscRater includes: i) methods to extract a variety of quality indicators from signal,transcription) pairs and ii) machine learning algorithms which make possible to build ASR QE models exploiting the extracted features. Confirming the positive results of previous evaluations, new experiments with TranscRater indicate its effectiveness both in WER prediction and transcription ranking tasks.
978-1-945626-03-6
File in questo prodotto:
File Dimensione Formato  
P16-4008.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: Creative commons
Dimensione 118.56 kB
Formato Adobe PDF
118.56 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/307254
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact