A Survey of Hibrid ANN/HMM Models for Automatic Speech Recognition

In spite of the advances accomplished throughout the last decades by a number of research teams, Automatic Speech Recognition (ASR) is still a challenging and difficult task. In particular, recognition systems based on hidden Markov models (HMMs) are effective under many circumstances, but do suffer from some major limitations that limit applicability of ASR technology in real-world environments. Attempts were made to overcome these limitations with the adoption of Artificial Neural Networks (ANN) as an alternative paradigm for ASR, but ANN were unsuccessful in dealing with long time-sequences of speech signals. Between the end of the Eighties and the beginning or the Nineties, some researchers began exploring a new research area, by combining HMMs and ANNs within a single, hybrid architecture. The goal in hybrid systems for ASR is to take advantage from the properties of both HMMs and ANNs, improving flexibility, hardware implementability and recognition performance. A variety of different architectures and novel training algorithms have been proposed in literature. This paper reviews a number of significant hybrid models for ASR. Early attempts to emulate HMMs by ANNs are briefly described. Them we focus on ANNs to estimate posterior probabilities of the states of an HMM and on 'global' optimization, where a single, overall training criterion is defined over the HMM and the ANNs, Connectionist Vector Quantization for discrete HMMs, and other more recent approaches are also reviewed, It is pointed out that, in addition to their theoretical interest, hybrid systems have been allowing for tangible improvements in recognition performance over the standard HMMs in difficult and significant benchmark tasks