1 |
Toward a unified approach to statistical language modeling for Chinese
|
|
|
|
In: http://research.microsoft.com/~jfgao/paper/icassp00.pdf (2002)
|
|
Abstract:
This paper presents a unified approach to Chinese statistical language modeling (SLM). Applying SLM techniques like trigrams to Chinese is challenging because (1) there is no standard definition of words in Chinese, (2) word boundaries are not marked by spaces, and (3) there is a dearth of training data. Our unified approach automatically and consistently gathers a highquality training data set from the web, creates a high-quality lexicon, and segments the training data using this lexicon, all using a maximum likelihood principle, which is consistent with the trigram training. We show that each of the methods leads to improvements over standard SLM, and that the combined method yields the best pinyin conversion result reported. 1.
|
|
URL: http://research.microsoft.com/~jfgao/paper/icassp00.pdf http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.67.6799
|
|
BASE
|
|
Hide details
|
|
2 |
Toward a Unified Approach to Statistical Language Modeling for Chinese
|
|
|
|
In: http://www.research.microsoft.com/~joshuago/talip01.pdf (2002)
|
|
BASE
|
|
Show details
|
|
3 |
Toward a unified approach to statistical language modeling for Chinese
|
|
|
|
In: http://research.microsoft.com/~jfgao/paper/cslm.taplip01.pdf (2001)
|
|
BASE
|
|
Show details
|
|
4 |
Recent progress in robust vocabulary-independent speech recognition
|
|
|
|
In: http://acl.ldc.upenn.edu/H/H91/H91-1050.pdf (1991)
|
|
BASE
|
|
Show details
|
|
5 |
Automatic new word acquisition: Spelling from acoustics
|
|
|
|
In: http://acl.ldc.upenn.edu/H/H89/H89-2036.pdf (1989)
|
|
BASE
|
|
Show details
|
|
6 |
Discriminative Training on language model
|
|
|
|
In: http://www.microsoft.com/china/research/group/./downloads/g-nlps/NLPSP/n11.pdf
|
|
BASE
|
|
Show details
|
|
7 |
Toward a Unified Approach to Statistical Language Modeling for Chinese
|
|
|
|
In: http://research.microsoft.com/~jfgao/paper/talip01.pdf
|
|
BASE
|
|
Show details
|
|
|
|