BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation

9 September 2021

Papers citing "BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation"

35 / 35 papers shown

Title
Evaluation of pretrained language models on music understanding Yannis Vasilakis Rachel M. Bittner Johan Pauwels 20 1 0 17 Sep 2024
Improving code-mixed hate detection by native sample mixing: A case study for Hindi-English code-mixed scenario Debajyoti Mazumder Aakash Kumar Jasabanta Patro 23 0 0 31 May 2024
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation Jingxuan Wei Linzhuang Sun Yichong Leng Xu Tan Bihui Yu Ruifeng Guo 48 3 0 23 Apr 2024
Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings Isabelle Mohr Markus Krimmel Saba Sturua Mohammad Kalim Akram Andreas Koukounas ... Susana Guzman Bo Wang Maximilian Werk Nan Wang Han Xiao 35 15 0 26 Feb 2024
Unraveling Key Factors of Knowledge Distillation Jingxuan Wei Linzhuang Sun Xu Tan Bihui Yu Ruifeng Guo 22 0 0 14 Dec 2023
Efficiently Adapting Pretrained Language Models To New Languages Zoltan Csaki Pian Pawakapan Urmish Thakker Qiantong Xu CLL 29 17 0 09 Nov 2023
Integrating Pre-trained Language Model into Neural Machine Translation Soon-Jae Hwang Chang-Sung Jeong 16 0 0 30 Oct 2023
Enhanced Simultaneous Machine Translation with Word-level Policies Kang Kim Hankyu Cho 46 3 0 25 Oct 2023
A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models Haoran Xu Young Jin Kim Amr Sharaf Hany Awadalla 41 57 0 20 Sep 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 31 9 0 29 Aug 2023
Towards Accurate Translation via Semantically Appropriate Application of Lexical Constraints Yujin Baek Ko-tik Lee Dayeon Ki Hyoung-Gyu Lee Cheonbok Park Jaegul Choo 16 4 0 21 Jun 2023
EM-Network: Oracle Guided Self-distillation for Sequence Learning J. Yoon Sunghwan Ahn Hyeon Seung Lee Minchan Kim Seokhwan Kim N. Kim VLM 25 2 0 14 Jun 2023
Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction Manuel Mager Rajat Bhatnagar Graham Neubig Ngoc Thang Vu Katharina Kann 28 10 0 11 Jun 2023
Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC Shensian Syu Jun Xie Hung-yi Lee 30 0 0 10 Jun 2023
SING: A Plug-and-Play DNN Learning Technique Adrien Courtois Damien Scieur Jean-Michel Morel Pablo Arias Thomas Eboli 28 0 0 25 May 2023
Scalable Educational Question Generation with Pre-trained Language Models Sahan Bulathwela Hamze Muse Emine Yilmaz AI4Ed ELM 13 23 0 13 May 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model Yisheng Xiao Ruiyang Xu Lijun Wu Juntao Li Tao Qin Yan-Tie Liu M. Zhang 22 9 0 13 Mar 2023
Tailoring Language Generation Models under Total Variation Distance Haozhe Ji Pei Ke Zhipeng Hu Rongsheng Zhang Minlie Huang 28 18 0 26 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification W. Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 32 4 0 16 Feb 2023
Language-Aware Multilingual Machine Translation with Self-Supervised Learning Haoran Xu Jean Maillard Vedanuj Goswami LRM 32 3 0 10 Feb 2023
PAMI: partition input and aggregate outputs for model interpretation Wei Shi Wentao Zhang Weishi Zheng Ruixuan Wang FAtt 24 3 0 07 Feb 2023
Better Datastore, Better Translation: Generating Datastores from Pre-Trained Models for Nearest Neural Machine Translation Jiahuan Li Shanbo Cheng Zewei Sun Mingxuan Wang Shujian Huang 47 2 0 17 Dec 2022
Pre-Training With Scientific Text Improves Educational Question Generation Hamze Muse Sahan Bulathwela Emine Yilmaz AI4Ed 16 8 0 07 Dec 2022
A Major Obstacle for NLP Research: Let's Talk about Time Allocation! Katharina Kann Shiran Dudy Arya D. McCarthy 22 1 0 30 Nov 2022
Benchmarking Evaluation Metrics for Code-Switching Automatic Speech Recognition Injy Hamed A. Hussein Oumnia Chellah Shammur A. Chowdhury Hamdy Mubarak Sunayana Sitaram Nizar Habash Ahmed M. Ali 17 6 0 22 Nov 2022
Improving Radiology Summarization with Radiograph and Anatomy Prompts Jinpeng Hu Zhihong Chen Yang Liu Xiang Wan Tsung-Hui Chang MedIm 26 8 0 15 Oct 2022
Neural Approaches to Multilingual Information Retrieval Dawn J Lawrie Eugene Yang Douglas W. Oard J. Mayfield 15 22 0 03 Sep 2022
Forming Trees with Treeformers Nilay Patel Jeffrey Flanigan AI4CE 21 3 0 14 Jul 2022
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation Pengzhi Gao Zhongjun He Hua-Hong Wu Haifeng Wang 28 13 0 06 Jun 2022
CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation Nishant Kambhatla Logan Born Anoop Sarkar 13 16 0 01 Apr 2022
RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolution Z. Geng Luming Liang Tianyu Ding Ilya Zharkov 23 68 0 27 Mar 2022
To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph Sufeng Duan Hai Zhao MILM 22 0 0 16 Jan 2021
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 215 1,207 0 12 Jun 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 239 31,257 0 16 Jan 2013