Monotonic Multihead Attention

26 September 2019

Papers citing "Monotonic Multihead Attention"

50 / 97 papers shown

Title
Spatial Speech Translation: Translating Across Space With Binaural Hearables Tuochao Chen Qirui Wang Runlin He Shyam Gollakota 31 0 0 25 Apr 2025
SimulS2S-LLM: Unlocking Simultaneous Inference of Speech LLMs for Speech-to-Speech Translation Keqi Deng Wenxi Chen Xie Chen P. Woodland 48 0 0 22 Apr 2025
Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation Zeeshan Ahmed Frank Seide Zhe Liu Rastislav Rabatin J. Kolár Niko Moritz Ruiming Xie Simone Merello Christian Fuegen OffRL 29 0 0 28 Mar 2025
Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation Shoutao Guo Shaolei Zhang Zhengrui Ma Yang Feng 43 0 0 03 Jan 2025
Anticipating Future with Large Language Model for Simultaneous Machine Translation Siqi Ouyang Oleksii Hrinchuk Zhehuai Chen Vitaly Lavrukhin Jagadeesh Balam Lei Li Boris Ginsburg 48 0 0 29 Oct 2024
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation Rui Zhao Jinyu Li Ruchao Fan Matt Post 41 1 0 07 Oct 2024
PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation Libo Zhao Jing Li Ziqian Zeng 24 1 0 05 Oct 2024
LLaMA-Omni: Seamless Speech Interaction with Large Language Models Qingkai Fang Shoutao Guo Yan Zhou Zhengrui Ma Shaolei Zhang Yang Feng AuLLM 33 32 0 10 Sep 2024
Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters Abderrahmane Issam Yusuf Can Semerci Jan Scholtes Gerasimos Spanakis 44 0 0 18 Jul 2024
On the Hallucination in Simultaneous Machine Translation M. Zhong Kehai Chen Zhengshan Xue Lemao Liu Mingming Yang Min Zhang HILM LRM 44 0 0 11 Jun 2024
A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Any Translation Zhengrui Ma Qingkai Fang Shaolei Zhang Shoutao Guo Yang Feng Min Zhang 53 10 0 11 Jun 2024
Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models Shoutao Guo Shaolei Zhang Zhengrui Ma Min Zhang Yang Feng LLMAG 38 1 0 11 Jun 2024
Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation Keqi Deng Philip C. Woodland 43 4 0 06 Jun 2024
Decoder-only Streaming Transformer for Simultaneous Translation Shoutao Guo Shaolei Zhang Yang Feng 39 4 0 06 Jun 2024
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning Shaolei Zhang Qingkai Fang Shoutao Guo Zhengrui Ma Min Zhang Yang Feng 36 5 0 05 Jun 2024
Self-Modifying State Modeling for Simultaneous Machine Translation Donglei Yu Xiaomian Kang Yuchen Liu Yu Zhou Chengqing Zong LRM 43 5 0 04 Jun 2024
SiLLM: Large Language Models for Simultaneous Machine Translation Shoutao Guo Shaolei Zhang Zhengrui Ma Min Zhang Yang Feng LRM 46 9 0 20 Feb 2024
TransLLaMa: LLM-based Simultaneous Translation System Roman Koshkin Katsuhito Sudoh Satoshi Nakamura 29 21 0 07 Feb 2024
Streaming Sequence Transduction through Dynamic Compression Weiting Tan Yunmo Chen Tongfei Chen Guanghui Qin Haoran Xu Heidi C. Zhang Benjamin Van Durme Philipp Koehn 24 2 0 02 Feb 2024
R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translation Jiaxin Guo Zhanglin Wu Zongyao Li Hengchao Shang Daimeng Wei Xiaoyu Chen Zhiqiang Rao Shaojun Li Hao Yang 35 1 0 11 Jan 2024
Language Model is a Branch Predictor for Simultaneous Machine Translation Aoxiong Yin Tianyun Zhong Haoyuan Li Siliang Tang Zhou Zhao 35 1 0 22 Dec 2023
Efficient Monotonic Multihead Attention Xutai Ma Anna Y. Sun Siqi Ouyang Hirofumi Inaguma Paden Tomasello 46 4 0 07 Dec 2023
Context Consistency between Training and Testing in Simultaneous Machine Translation M. Zhong Lemao Liu Kehai Chen Mingming Yang Min Zhang LRM 47 0 0 13 Nov 2023
CBSiMT: Mitigating Hallucination in Simultaneous Machine Translation with Weighted Prefix-to-Prefix Training Mengge Liu Wen Zhang Xiang Li Yanzhi Tian Yuhang Guo Jian Luan 000 Bin Wang Shuoying Chen 39 1 0 07 Nov 2023
Unified Segment-to-Segment Framework for Simultaneous Sequence Generation Shaolei Zhang Yang Feng 25 7 0 27 Oct 2023
Enhanced Simultaneous Machine Translation with Word-level Policies Kang Kim Hankyu Cho 59 3 0 25 Oct 2023
Non-autoregressive Streaming Transformer for Simultaneous Translation Zhengrui Ma Shaolei Zhang Shoutao Guo Chenze Shao Min Zhang Yang Feng 34 13 0 23 Oct 2023
Adaptive Policy with Wait- $k$ Model for Simultaneous Translation Libo Zhao Kai Fan Wei Luo Jing Wu Shushu Wang Ziqian Zeng Zhongqiang Huang 61 9 0 23 Oct 2023
Simultaneous Machine Translation with Tailored Reference Shoutao Guo Shaolei Zhang Yang Feng 32 9 0 20 Oct 2023
Segmentation-Free Streaming Machine Translation Javier Iranzo-Sánchez Jorge Iranzo-Sánchez Adria Giménez Jorge Civera Saiz A. Juan VOS 26 1 0 26 Sep 2023
Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff Peter Polák Brian Yan Shinji Watanabe A. Waibel Ondrej Bojar 28 9 0 20 Sep 2023
Simultaneous Machine Translation with Large Language Models Minghan Wang Jinming Zhao Thuy-Trang Vu Fatemeh Shiri Ehsan Shareghi Gholamreza Haffari 42 2 0 13 Sep 2023
Glancing Future for Simultaneous Machine Translation Shoutao Guo Shaolei Zhang Yang Feng 24 9 0 12 Sep 2023
End-to-End Simultaneous Speech Translation with Differentiable Segmentation Shaolei Zhang Yang Feng 32 17 0 25 May 2023
Learning Optimal Policy for Simultaneous Machine Translation via Binary Search Shoutao Guo Shaolei Zhang Yang Feng 26 15 0 22 May 2023
TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model Patrick Kahardipraja Brielen Madureira David Schlangen CLL 34 9 0 18 May 2023
Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks Yun Tang Anna Y. Sun Hirofumi Inaguma Xinyue Chen Ning Dong Xutai Ma Paden Tomasello J. Pino 48 19 0 04 May 2023
LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation Lei Lin Shuangtao Li Xiaodon Shi 29 5 0 21 Mar 2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference Biao Fu Minpeng Liao Kai Fan Zhongqiang Huang Boxing Chen Yidong Chen Xiaodon Shi 48 8 0 14 Mar 2023
Rethinking the Reasonability of the Test Set for Simultaneous Machine Translation Meng Liu Wen Zhang Xiang-Yang Li Jian Luan Bin Wang Yuhang Guo Shuoying Chen LRM ELM 35 0 0 02 Mar 2023
Hidden Markov Transformer for Simultaneous Machine Translation Shaolei Zhang Yang Feng 29 22 0 01 Mar 2023
Efficient Encoders for Streaming Sequence Tagging Ayush Kaushal Aditya Gupta Shyam Upadhyay Manaal Faruqui 27 4 0 23 Jan 2023
Attention as a Guide for Simultaneous Speech Translation Sara Papi Matteo Negri Marco Turchi 26 30 0 15 Dec 2022
A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability Jian Xue Peidong Wang Jinyu Li Eric Sun 32 10 0 04 Nov 2022
Information-Transport-based Policy for Simultaneous Translation Shaolei Zhang Yang Feng 51 47 0 22 Oct 2022
Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation Shoutao Guo Shaolei Zhang Yang Feng 27 15 0 21 Oct 2022
Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation Shaolei Zhang Shoutao Guo Yang Feng 21 23 0 20 Oct 2022
Adaptive Sparse and Monotonic Attention for Transformer-based Automatic Speech Recognition Chendong Zhao Jianzong Wang Wentao Wei Xiaoyang Qu Haoqian Wang Jing Xiao 41 2 0 30 Sep 2022
Data-Driven Adaptive Simultaneous Machine Translation Guangxu Xun Mingbo Ma Yuchen Bian Xingyu Cai Jiaji Huang Renjie Zheng Junkun Chen Jiahong Yuan Kenneth Church Liang Huang 22 0 0 27 Apr 2022
Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation Keqi Deng Shinji Watanabe Jiatong Shi Siddhant Arora 33 15 0 19 Apr 2022