Acoustic Space Dimensionality Selection and Combination using the Maximum Entropy Principle

Yasser H. Abdel-Haleem, Steve Renals, Neil D. Lawrence
International Conference on Acoustics, Speech and Signal Processing, 2004.

Abstract

In this paper we propose a discriminative approach to acoustic space dimensionality selection based on maximum entropy modelling. We form a set of constraints by composing the acoustic space with the space of phone classes, and use a continuous feature formulation of maximum entropy modelling to select an optimal feature set. The suggested approach has two steps: (1) the selection of the best acoustic space that efficiently and economically represents the acoustic data and its variability; (2) the combination of selected acoustic features in the maximum entropy framework to estimate the posterior probabilities over the phonetic labels given the acoustic input. Specific contributions of this paper include a parameter estimation algorithm (generalized improved iterative scaling) that enables the use of negative features, the parameterization of constraint functions using Gaussian mixture models, and experimental results using the TIMIT database.

Cite this Paper

BibTeX
@InProceedings{AbdelHaleem:acoustic04, title = {Acoustic Space Dimensionality Selection and Combination using the Maximum Entropy Principle}, author = {Abdel-Haleem, Yasser H. and Renals, Steve and Lawrence, Neil D.}, booktitle = {International Conference on Acoustics, Speech and Signal Processing}, year = {2004}, pdf = {https://lawrennd.github.io/publications/files/icassp04.pdf}, url = {http://inverseprobability.com/publications/abdelhaleem-acoustic04.html}, abstract = {In this paper we propose a discriminative approach to acoustic space dimensionality selection based on maximum entropy modelling. We form a set of constraints by composing the acoustic space with the space of phone classes, and use a continuous feature formulation of maximum entropy modelling to select an optimal feature set. The suggested approach has two steps: (1) the selection of the best acoustic space that efficiently and economically represents the acoustic data and its variability; (2) the combination of selected acoustic features in the maximum entropy framework to estimate the posterior probabilities over the phonetic labels given the acoustic input. Specific contributions of this paper include a parameter estimation algorithm (generalized improved iterative scaling) that enables the use of negative features, the parameterization of constraint functions using Gaussian mixture models, and experimental results using the TIMIT database.} }
Endnote
%0 Conference Paper %T Acoustic Space Dimensionality Selection and Combination using the Maximum Entropy Principle %A Yasser H. Abdel-Haleem %A Steve Renals %A Neil D. Lawrence %B International Conference on Acoustics, Speech and Signal Processing %D 2004 %F AbdelHaleem:acoustic04 %U http://inverseprobability.com/publications/abdelhaleem-acoustic04.html %X In this paper we propose a discriminative approach to acoustic space dimensionality selection based on maximum entropy modelling. We form a set of constraints by composing the acoustic space with the space of phone classes, and use a continuous feature formulation of maximum entropy modelling to select an optimal feature set. The suggested approach has two steps: (1) the selection of the best acoustic space that efficiently and economically represents the acoustic data and its variability; (2) the combination of selected acoustic features in the maximum entropy framework to estimate the posterior probabilities over the phonetic labels given the acoustic input. Specific contributions of this paper include a parameter estimation algorithm (generalized improved iterative scaling) that enables the use of negative features, the parameterization of constraint functions using Gaussian mixture models, and experimental results using the TIMIT database.
RIS
TY - CPAPER TI - Acoustic Space Dimensionality Selection and Combination using the Maximum Entropy Principle AU - Yasser H. Abdel-Haleem AU - Steve Renals AU - Neil D. Lawrence BT - International Conference on Acoustics, Speech and Signal Processing DA - 2004/01/01 ID - AbdelHaleem:acoustic04 L1 - https://lawrennd.github.io/publications/files/icassp04.pdf UR - http://inverseprobability.com/publications/abdelhaleem-acoustic04.html AB - In this paper we propose a discriminative approach to acoustic space dimensionality selection based on maximum entropy modelling. We form a set of constraints by composing the acoustic space with the space of phone classes, and use a continuous feature formulation of maximum entropy modelling to select an optimal feature set. The suggested approach has two steps: (1) the selection of the best acoustic space that efficiently and economically represents the acoustic data and its variability; (2) the combination of selected acoustic features in the maximum entropy framework to estimate the posterior probabilities over the phonetic labels given the acoustic input. Specific contributions of this paper include a parameter estimation algorithm (generalized improved iterative scaling) that enables the use of negative features, the parameterization of constraint functions using Gaussian mixture models, and experimental results using the TIMIT database. ER -
APA
Abdel-Haleem, Y.H., Renals, S. & Lawrence, N.D.. (2004). Acoustic Space Dimensionality Selection and Combination using the Maximum Entropy Principle. International Conference on Acoustics, Speech and Signal Processing Available from http://inverseprobability.com/publications/abdelhaleem-acoustic04.html.

Related Material