PDF(Pubmed)
Abstract：
One of the most difficult challenges that military personnel face when operating in foreign countries is clear and successful communication with the local population. To address this issue, the Defense Advanced Research Projects Agency (DARPA) is funding academic institutions and industrial organizations through the Spoken Language Communication and Translation System for Tactical Use (TRANSTAC) program to develop practical machine translation systems. The goal of the TRANSTAC program is to demonstrate capabilities to rapidly develop and field free-form, two-way, speech-to-speech translation systems that enable speakers of different languages to communicate with one another in real-world tactical situations without an interpreter. Evaluations of these technologies are a significant part of the program and DARPA has asked the National Institute of Standards and Technology (NIST) to lead this effort. This article presents the experimental design of the TRANSTAC evaluations and the metrics, both quantitative and qualitative, that were used to comprehensively assess the systems\' performance.
摘要：
军事人员在外国行动时面临的最困难挑战之一是与当地居民进行清晰和成功的沟通。为了解决这个问题，国防高级研究计划局（DARPA）正在通过战术用口语交流和翻译系统（TRANSTAC）计划资助学术机构和工业组织，以开发实用的机器翻译系统。TRANSTAC计划的目标是展示快速开发和现场自由形式的能力，双向,语音到语音翻译系统，使不同语言的人能够在现实世界的战术情况下相互交流，而无需口译员。对这些技术的评估是该计划的重要组成部分，DARPA已要求国家标准与技术研究所（NIST）领导这项工作。本文介绍了TRANSTAC评估的实验设计和度量标准，定量和定性，用于全面评估系统性能。
