Text

Exploring Discriminative Word-Level Domain Contexts for Multi-Domain Neural Machine Translation

Owing to its practical significance, multi-domain Neural Machine Translation (NMT) has attracted much attention recently. Recent studies mainly focus on constructing a unified NMT model with mixed-domain training corpora to switch translation between different domains. In these models, the words in the same sentence are not well distinguished, while intuitively, they are related to the sentence domain to varying degrees and thus should exert different effects on the multi-domain NMT model. In this article, we are committed to distinguishing and exploiting different word-level domain contexts for multi-domain NMT. For this purpose, we adopt multi-task learning to jointly model NMT and monolingual attention-based domain classification tasks, improving the NMT model in two ways: 1) One domain classifier and one adversarial domain classifier are introduced to conduct domain classifications of input sentences. During this process, two generated gating vectors are used to produce domain-specific and domain-shared annotations for decoder; 2) We equip decoder with an attentional domain classifier. Then, the derived attentional weights are utilized to refine the model training via word-level cost weighting, so that the impacts of target words can be discriminated by their relevance to sentence domain. Experimental results on several multi-domain translations demonstrate the effectiveness of our model.

Ketersediaan

Informasi Detail

Judul Seri

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE; Vol.43 No.5 May 2021

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 1530 - 1545

Bahasa

English

ISBN/ISSN

-

Klasifikasi

-

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

ADVERSARIAL TRAINING
MULTI-DOMAIN NEURAL MACHINE TRANSLATION
WORD-LEVEL CONTEXT

Info Detail Spesifik

DOI: 10.1109/TPAMI.2019.2954406

Pernyataan Tanggungjawab

Jinsong Su, Jiali Zeng, Jun Xie, Huating Wen, Yongjing Yin, Yang Liu

Versi lain/terkait

Lampiran Berkas

Komentar