1 |
Lucene for n-grams using the ClueWeb Collection
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
2 |
IRRA at TREC 2009: Index Term Weighting based on Divergence From Independence Model
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
3 |
POSTECH at TREC 2009 Blog Track: Top Stories Identification
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
4 |
Experiments on Related Entity Finding Track at TREC 2009
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
5 |
Comparing Evaluation Metrics for Sentence Boundary Detection
|
|
|
|
In: DTIC (2007)
|
|
Abstract:
In recent NIST evaluations on sentence boundary detection, a single error metric was used to describe performance. Additional metrics, however, are available for such tasks, in which a word stream is partitioned into subunits. This paper compares alternative evaluation metrics including the NIST error rate, classification error rate per word boundary, precision and recall, ROC curves, DET curves, precision-recall curves, and area under the curves and discusses advantages and disadvantages of each. Unlike many studies in machine learning, we use real data for a real task. We find benefit from using curves in addition to a single metric. Furthermore, we find that data skew has an impact on metrics, and that differences among different system outputs are more visible in precision-recall curves. Results are expected to help us better understand evaluation metrics that should be generalizable to similar language processing tasks. ; Presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (32nd) held in Honolulu, Hawaii on 15-20 April 2007. Published in the Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (32nd), 2007. The original document contains color images.
|
|
Keyword:
*COMPUTATIONAL LINGUISTICS; *EVALUATION METRICS; *LANGUAGE PROCESSING; *SENTENCE BOUNDARY DETECTION; *SPEECH RECOGNITION; *TEST AND EVALUATION; Equipment and Methods; ERRORS; LEARNING MACHINES; Linguistics; MACHINE LEARNING; NATURAL LANGUAGE; PRECISION; RECALL; ROC CURVES; ROC(RECEIVER OPERATING CHARACTERISTIC); SYMPOSIA; Test Facilities; Voice Communications
|
|
URL: http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA463058 http://www.dtic.mil/docs/citations/ADA463058
|
|
BASE
|
|
Hide details
|
|
6 |
The Effect of Bilingual Term List Size on Dictionary-Based Cross-Language Information Retrieval
|
|
|
|
In: DTIC (2006)
|
|
BASE
|
|
Show details
|
|
7 |
Cross-Document Coreference on a Large Scale Corpus
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
8 |
Stochastic Language Generation in a Dialogue System: Toward a Domain Independent Generator
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
9 |
Spoken Dialogue for Simulation Control and Conversational Tutoring
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
10 |
Generic Sentence Fusion is an Ill-Defined Summarization Task
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
11 |
Development and Evaluation of a Korean Treebank and its Application to NLP
|
|
|
|
In: DTIC (2002)
|
|
BASE
|
|
Show details
|
|
12 |
Automated Tutoring Dialogues for Training in Shipboard Damage Control
|
|
|
|
In: DTIC (2001)
|
|
BASE
|
|
Show details
|
|
14 |
Augmented Role Filling Capabilities for Semantic Interpretation of Spoken Language
|
|
|
|
In: DTIC (1991)
|
|
BASE
|
|
Show details
|
|
15 |
Adaptive Natural Language Processing
|
|
|
|
In: DTIC AND NTIS (1991)
|
|
BASE
|
|
Show details
|
|
16 |
Coordinating Text and Graphics in Explanation Generation
|
|
|
|
In: DTIC (1989)
|
|
BASE
|
|
Show details
|
|
17 |
Natural Language for Problem Solving Systems
|
|
|
|
In: DTIC AND NTIS (1989)
|
|
BASE
|
|
Show details
|
|
18 |
A Contrast Between Computer and Human Language Understanding
|
|
|
|
In: DTIC AND NTIS (1988)
|
|
BASE
|
|
Show details
|
|
19 |
Operational Test and Evaluation of the Meter Engineering Development Model.
|
|
|
|
In: DTIC AND NTIS (1982)
|
|
BASE
|
|
Show details
|
|
|
|