| 1 |
Relevance Feedback based on Constrained Clustering: FDU at TREC 09
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
A Journey in Entity Related Retrieval for TREC 2009
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Lucene for n-grams using the ClueWeb Collection
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
BIT at TREC 2009 Faceted Blog Distillation Task
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
IRRA at TREC 2009: Index Term Weighting based on Divergence From Independence Model
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
POSTECH at TREC 2009 Blog Track: Top Stories Identification
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
PRIS at 2009 Relevance Feedback track: Experiments in Language Model for Relevance Feedback
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Experiments on Related Entity Finding Track at TREC 2009
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Facet Classification of Blogs: Know-Center at the TREC 2009 Blog Distillation Task
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Comparing Evaluation Metrics for Sentence Boundary Detection
|
|
|
|
In: DTIC (2007)
|
|
Abstract:
In recent NIST evaluations on sentence boundary detection, a single error metric was used to describe performance. Additional metrics, however, are available for such tasks, in which a word stream is partitioned into subunits. This paper compares alternative evaluation metrics including the NIST error rate, classification error rate per word boundary, precision and recall, ROC curves, DET curves, precision-recall curves, and area under the curves and discusses advantages and disadvantages of each. Unlike many studies in machine learning, we use real data for a real task. We find benefit from using curves in addition to a single metric. Furthermore, we find that data skew has an impact on metrics, and that differences among different system outputs are more visible in precision-recall curves. Results are expected to help us better understand evaluation metrics that should be generalizable to similar language processing tasks. ; Presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (32nd) held in Honolulu, Hawaii on 15-20 April 2007. Published in the Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (32nd), 2007. The original document contains color images.
|
|
Keyword:
*COMPUTATIONAL LINGUISTICS; *EVALUATION METRICS; *LANGUAGE PROCESSING; *SENTENCE BOUNDARY DETECTION; *SPEECH RECOGNITION; *TEST AND EVALUATION; Equipment and Methods; ERRORS; LEARNING MACHINES; Linguistics; MACHINE LEARNING; NATURAL LANGUAGE; PRECISION; RECALL; ROC CURVES; ROC(RECEIVER OPERATING CHARACTERISTIC); SYMPOSIA; Test Facilities; Voice Communications
|
|
URL: http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA463058
http://www.dtic.mil/docs/citations/ADA463058
|
|
BASE
|
|
Hide details
|
|
|
| 12 |
Measuring Translation Quality by Testing English Speakers with a New Defense Language Proficiency Test for Arabic
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Measuring Human Readability of Machine Generated Text: Three Case Studies in Speech Recognition and Machine Translation
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Uses of the Diagnostic Rhyme Test (English Version) for Predicting the Effects of Communicators' Linguistic Backgrounds on Voice Communications in English: An Exploratory Study
|
|
|
|
In: DTIC (2000)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
The Bible, Truth, and Multilingual OCR Evaluation
|
|
|
|
In: DTIC (1998)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Tipster Shogun System (Joint GE-CMU): MUC-4 Test Results and Analysis
|
|
|
|
In: DTIC (1992)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
GE-CMU: Description of the Tipster/Shogun System as Used for MUC-4
|
|
|
|
In: DTIC (1992)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Overview of the Fourth Message Understanding Evaluation and Conference
|
|
|
|
In: DTIC AND NTIS (1992)
|
|
BASE
|
|
Show details
|
|
|
|
|
