2019
Investigation of Sampling Techniques for Maximum Entropy Language Modeling Training
ICASSP 2019accepted
Maximum entropy language models (MaxEnt LMs) are log-linear models which are able to incorporate various hand-crafted features and non-linguistic information. Standard MaxEnt LMs are computationally heavy for tasks with a large vocabulary size due to the expensive normalization computation in the de…