3 |
Tagging French Without Lexical Probabilities - Combining Linguistic Knowledge And Statistical Learning
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Tagging French Without Lexical Probabilities - Combining Linguistic Knowledge And Statistical Learning ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning ...
|
|
|
|
Abstract:
This paper explores morpho-syntactic ambiguities for French to develop a strategy for part-of-speech disambiguation that a) reflects the complexity of French as an inflected language, b) optimizes the estimation of probabilities, c) allows the user flexibility in choosing a tagset. The problem in extracting lexical probabilities from a limited training corpus is that the statistical model may not necessarily represent the use of a particular word in a particular context. In a highly morphologically inflected language, this argument is particularly serious since a word can be tagged with a large number of parts of speech. Due to the lack of sufficient training data, we argue against estimating lexical probabilities to disambiguate parts of speech in unrestricted texts. Instead, we use the strength of contextual probabilities along with a feature we call ``genotype'', a set of tags associated with a word. Using this knowledge, we have built a part-of-speech tagger that combines linguistic and statistical ... : uses ypsfig ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/cmp-lg/9710002 https://dx.doi.org/10.48550/arxiv.cmp-lg/9710002
|
|
BASE
|
|
Hide details
|
|
|
|