| 1 |
Exploring Social Meaning in Online Bilingual Text through Social Network Analysis
|
|
|
|
In: DTIC (2015)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Method to Select Technical Terms for Glossaries in Support of Joint Task Force Operations
|
|
|
|
In: DTIC (2012)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Differential Effect of Correct Name Translation on Human and Automated Judgments of Translation Acceptability: A Pilot Study
|
|
|
|
In: DTIC (2008)
|
|
Abstract:
This study proffers two important findings: (1) automated machine translation (MT) evaluation is insensitive to the cognitive gravitas of proper names, contributing to its weak modeling of human judgments of higher quality MT output, and (2) there is a "new" methodology that produces superior measurement of translation acceptability. Twenty Arabic sentences, each with average name density of 3.7 names in 22 words, were translated into English with a research-grade MT system, to produce a 20-output-sentence Control Stimulus Set. Manual correction of 25% of the name translations resulted in an Enhanced Stimulus Set. A Magnitude Estimation (ME) methodology task had each of two teams of five subjects judge Control and Enhanced Sets against human reference translations. As is customary in ME studies, subjects made direct numerical estimations of the magnitude of the stimuli, in this case the degree to which sentences in the Sets conveyed the meaning in the reference sentences. Average estimates for Control and Enhanced Sets were 4.57 and 6.16, respectively, a 34.8% difference. Automated evaluation with the Metric for Evaluation of Translation with Explicit word ORdering (METEOR) produced scores of .446 and .546, a 22% difference. ME detected a differential effect, a finding which suggests that weighting proper name rendering in automated evaluation systems may improve correlations with human judgments on higher quality output.
|
|
Keyword:
*COMPREHENSION; *HUMANS; *MACHINE TRANSLATION; *MAGNITUDE ESTIMATION; *METRICS; *NAME TRANSLATION; ARABIC LANGUAGE; AUTOMATED EVALUATION; ESTIMATES; FOREIGN LANGUAGES; HUMAN UNDERSTANDING; JUDGEMENT(PSYCHOLOGY); Linguistics; MACHINE TRANSLATION EVALUATION; PROPER NAMES; STIMULI
|
|
URL: http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA488000
http://www.dtic.mil/docs/citations/ADA488000
|
|
BASE
|
|
Hide details
|
|
|
| 4 |
Inter-Rater Agreement Measures and the Refinement of Metrics in the PLATO MT Evaluation Paradigm
|
|
|
|
In: DTIC (2005)
|
|
BASE
|
|
Show details
|
|
|
|
|
