In spite of the advances accomplished throughout the last decades by a number of research teams, Automatic Speech Recognition (ASR) is still a challenging and difficult task. In particular, recognition systems based on hidden Markov models (HMMs) are effective under many circumstances, but do suffer from some major limitations that limit applicability of ASR technology in real-world environments. Attempts were made to overcome these limitations with the adoption of Artificial Neural Networks (ANN) as an alternative paradigm for ASR, but ANN were unsuccessful in dealing with long time-sequences of speech signals. Between the end of the Eighties and the beginning or the Nineties, some researchers began exploring a new research area, by combining HMMs and ANNs within a single, hybrid architecture. The goal in hybrid systems for ASR is to take advantage from the properties of both HMMs and ANNs, improving flexibility, hardware implementability and recognition performance. A variety of different architectures and novel training algorithms have been proposed in literature. This paper reviews a number of significant hybrid models for ASR. Early attempts to emulate HMMs by ANNs are briefly described. Them we focus on ANNs to estimate posterior probabilities of the states of an HMM and on 'global' optimization, where a single, overall training criterion is defined over the HMM and the ANNs, Connectionist Vector Quantization for discrete HMMs, and other more recent approaches are also reviewed, It is pointed out that, in addition to their theoretical interest, hybrid systems have been allowing for tangible improvements in recognition performance over the standard HMMs in difficult and significant benchmark tasks

A Survey of Hibrid ANN/HMM Models for Automatic Speech Recognition

Trentin, Edmondo;Gori, Marco
1998-01-01

Abstract

In spite of the advances accomplished throughout the last decades by a number of research teams, Automatic Speech Recognition (ASR) is still a challenging and difficult task. In particular, recognition systems based on hidden Markov models (HMMs) are effective under many circumstances, but do suffer from some major limitations that limit applicability of ASR technology in real-world environments. Attempts were made to overcome these limitations with the adoption of Artificial Neural Networks (ANN) as an alternative paradigm for ASR, but ANN were unsuccessful in dealing with long time-sequences of speech signals. Between the end of the Eighties and the beginning or the Nineties, some researchers began exploring a new research area, by combining HMMs and ANNs within a single, hybrid architecture. The goal in hybrid systems for ASR is to take advantage from the properties of both HMMs and ANNs, improving flexibility, hardware implementability and recognition performance. A variety of different architectures and novel training algorithms have been proposed in literature. This paper reviews a number of significant hybrid models for ASR. Early attempts to emulate HMMs by ANNs are briefly described. Them we focus on ANNs to estimate posterior probabilities of the states of an HMM and on 'global' optimization, where a single, overall training criterion is defined over the HMM and the ANNs, Connectionist Vector Quantization for discrete HMMs, and other more recent approaches are also reviewed, It is pointed out that, in addition to their theoretical interest, hybrid systems have been allowing for tangible improvements in recognition performance over the standard HMMs in difficult and significant benchmark tasks
1998
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/1511
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact