| 1 |
Relevance Feedback based on Constrained Clustering: FDU at TREC 09
|
|
|
|
In: DTIC (2009)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Efficacy in Automated Language Translators
|
|
|
|
In: DTIC (2006)
|
|
Abstract:
This paper suggests an improved measure for evaluating the usefulness of automated machine language translators. With the Global War on Terror (GWOT), the Army has increasing interest and need for accurate language translation more than ever. Today, there are approximately 20,000 linguists with language training in either the Active Duty or Reserve components of the U.S. Army. Coalition operations and U.S. presence in Iraq, Kuwait, and other areas in the Middle East require Arabic translation. Unfortunately, the Army has never been able to maintain the number of linguists it needs, particularly in the hard-to-fill, low-density languages. Previous evaluations of machine translations usually rely on word error rate. Machine translation systems should be rated not in terms of their word error rate but in terms of human comprehension and usefulness, which is some function of word translation, syntax translation, and semantic interpretation. This study introduces a new method of evaluating human comprehension in the context of machine translation using a language translation program known as the Forward Area Language Converter (FALCon). A study was conducted where participants received seven translated articles in a random order. For each of the seven articles, the participants received a set of corresponding comprehension questions. The goal of the questions was to gear the reader toward intelligence gathering and to see if he could grasp main concepts and details. The results of this study suggest that word error rate is not an effective measure of the usefulness of a machine language translator. Comprehension tests perform better at evaluating a human's understanding of a translated document. This study further indicates strengths and weaknesses in each translator. ; See also ADM002075. Presented at the Army Science Conference (25th) held in Orlando, FL on 27-30 November 2006.
|
|
Keyword:
*COMPREHENSION; *MACHINE TRANSLATION; *SYNTAX; COMPARISON; COMPONENT REPORTS; FALCON(FORWARD AREA LANGUAGE CONVERTER); Linguistics; SYMPOSIA; TEST AND EVALUATION; TRANSLATIONS
|
|
URL: http://www.dtic.mil/docs/citations/ADA481410
http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA481410
|
|
BASE
|
|
Hide details
|
|
|
| 3 |
Evaluation of Speech Synthesis Systems using the Speech Reception Threshold Methodology
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Conversational Telephone Speech Corpus Collection for the NIST Speaker Recognition Evaluation 2004
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Speech Intelligibility of Native and Non-Native Speech
|
|
|
|
In: DTIC (2000)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Acoustic-Phonetic Modeling of Non-Native Speech for Language Identification
|
|
|
|
In: DTIC (2000)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
The Bible, Truth, and Multilingual OCR Evaluation
|
|
|
|
In: DTIC (1998)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Tipster Shogun System (Joint GE-CMU): MUC-4 Test Results and Analysis
|
|
|
|
In: DTIC (1992)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
GE-CMU: Description of the Tipster/Shogun System as Used for MUC-4
|
|
|
|
In: DTIC (1992)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Overview of the Fourth Message Understanding Evaluation and Conference
|
|
|
|
In: DTIC AND NTIS (1992)
|
|
BASE
|
|
Show details
|
|
|
|
|
