Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillation

7 December 2021

Papers citing "Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillation"

33 / 33 papers shown

Title
Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models Xiao Cui Mo Zhu Yulei Qin Liang Xie Wengang Zhou Haoyang Li 170 8 0 19 Dec 2024
Contrastive Learning for Neural Topic Model Thong Nguyen Anh Tuan Luu 86 60 0 25 Oct 2021
Enriching and Controlling Global Semantics for Text Summarization Thong Nguyen Anh Tuan Luu Truc Lu Tho Quan 48 35 0 22 Sep 2021
Improving Unsupervised Question Answering via Summarization-Informed Question Generation Chenyang Lyu Lifeng Shang Yvette Graham Jennifer Foster Xin Jiang Qun Liu 66 44 0 16 Sep 2021
Improved Text Classification via Contrastive Adversarial Training Lin Pan Chung-Wei Hang Avirup Sil Saloni Potdar AAML 61 91 0 21 Jul 2021
Cross-Lingual Abstractive Summarization with Limited Parallel Resources Yu Bai Yang Gao Heyan Huang 89 52 0 28 May 2021
Selective Knowledge Distillation for Neural Machine Translation Fusheng Wang Jianhao Yan Fandong Meng Jie Zhou 64 62 0 27 May 2021
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation Xiao Pan Mingxuan Wang Liwei Wu Lei Li 92 206 0 20 May 2021
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training Kuan-Hao Huang Wasi Uddin Ahmad Nanyun Peng Kai-Wei Chang AAML 125 34 0 17 Apr 2021
Data Distillation for Text Classification Chak Tou Leong Wenjie Li DD 155 30 0 17 Apr 2021
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing Kun Wu Lijie Wang Zhenghua Li Ao Zhang Xinyan Xiao Hua Wu Min Zhang Haifeng Wang 55 35 0 03 Mar 2021
VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation Fuli Luo Wei Wang Jiahao Liu Yijia Liu Bin Bi Songfang Huang Fei Huang Luo Si 99 52 0 30 Oct 2020
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization Faisal Ladhak Esin Durmus Claire Cardie Kathleen McKeown CVBM 67 202 0 07 Oct 2020
Interactive Knowledge Distillation Shipeng Fu Zhen Li Jun Xu Ming-Ming Cheng Gwanggil Jeon Xiaomin Yang 58 6 0 03 Jul 2020
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation Haipeng Sun Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita Tiejun Zhao AIMat 59 47 0 21 Apr 2020
Knowledge distillation via adaptive instance normalization Jing Yang Brais Martínez Adrian Bulat Georgios Tzimiropoulos 57 24 0 09 Mar 2020
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Jingqing Zhang Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 3DGS 299 2,056 0 18 Dec 2019
Speeding up Word Mover's Distance and its variants via properties of distances between embeddings Matheus Werner E. Laber 52 14 0 01 Dec 2019
Sinkhorn Divergences for Unbalanced Optimal Transport Thibault Séjourné Jean Feydy Franccois-Xavier Vialard A. Trouvé Gabriel Peyré OT 87 74 0 28 Oct 2019
Capturing Greater Context for Question Generation Anh Tuan Luu Darsh J. Shah Regina Barzilay RALM 57 70 0 22 Oct 2019
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System Ze Yang Linjun Shou Ming Gong Wutao Lin Daxin Jiang 62 94 0 18 Oct 2019
NCLS: Neural Cross-Lingual Summarization Junnan Zhu Qian Wang Yining Wang Yu Zhou Jiajun Zhang Shaonan Wang Chengqing Zong 62 134 0 31 Aug 2019
Multilingual Neural Machine Translation with Knowledge Distillation Xu Tan Yi Ren Di He Tao Qin Zhou Zhao Tie-Yan Liu 98 250 0 27 Feb 2019
Improving Sequence-to-Sequence Learning via Optimal Transport Liqun Chen Yizhe Zhang Ruiyi Zhang Chenyang Tao Zhe Gan Haichao Zhang Bai Li Dinghan Shen Changyou Chen Lawrence Carin OT 68 94 0 18 Jan 2019
What do Language Representations Really Represent? Johannes Bjerva Robert Östling M. H. Veiga Jörg Tiedemann Isabelle Augenstein 77 59 0 09 Jan 2019
Knowledge Distillation with Feature Maps for Image Classification Wei-Chun Chen Chia-Che Chang Chien-Yu Lu Che-Rung Lee 61 36 0 03 Dec 2018
Interpolating between Optimal Transport and MMD using Sinkhorn Divergences Jean Feydy Thibault Séjourné François-Xavier Vialard S. Amari A. Trouvé Gabriel Peyré OT 70 532 0 18 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,324 0 11 Oct 2018
Gromov-Wasserstein Alignment of Word Embedding Spaces David Alvarez-Melis Tommi Jaakkola OT 56 328 0 31 Aug 2018
Attention-Guided Answer Distillation for Machine Reading Comprehension Minghao Hu Yuxing Peng Furu Wei Zhen Huang Dongsheng Li Nan Yang M. Zhou FaML 77 75 0 23 Aug 2018
Optimal Transport for Domain Adaptation Nicolas Courty Rémi Flamary D. Tuia A. Rakotomamonjy OT OOD 157 1,125 0 02 Jul 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 367 19,745 0 09 Mar 2015
Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi OT 222 4,294 0 04 Jun 2013