A Trust Region Based Optimization for Maximum Mutual Information Estimation of HMMs in Speech Recognition

Zhi-Jie Yan, Cong Liu, Yu Hu, and Hui Jiang

Abstract

In this paper, we present a new optimization method for MMIE based discriminative training of HMMs in speech recognition. In our method, the MMIE training of Gaussian mixture HMMs is formulated as a so-called trust region problem, where a quadratic objective function is minimized under a spherical constraint, so that an efficient global optimization method for the trust region problem can be used to solve the MMIE training problem of HMMs. Experimental results on the WSJ0 Nov’92 evaluation task demonstrate that the trust region based optimization significantly outperforms the conventional EBW method in terms of optimization convergence behavior as well as speech recognition performance. It has been observed that the trust region method achieves up to 23.3% relative recognition error reduction over a well-trained MLE system while the EBW method gives only 13.3% relative error reduction.

Details

Publication typeInproceedings
Published inIEEE International Conference on Acoustics, Speech and Signal Processing, 2009, ICASSP 2009
URLhttp://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4960444&isnumber=4959496
Pages3757-3760
SeriesICASSP 2009
PublisherIEEE
> Publications > A Trust Region Based Optimization for Maximum Mutual Information Estimation of HMMs in Speech Recognition