Monotonic Infinite Lookback Attention for Simultaneous Machine Translation

12 June 2019

Colin Cherry

Papers citing "Monotonic Infinite Lookback Attention for Simultaneous Machine Translation"

50 / 122 papers shown

Title
SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translation Ting Xu Zhichao Huang Jiankai Sun Shanbo Cheng Wai Lam OffRL 27 0 0 27 May 2025
Spatial Speech Translation: Translating Across Space With Binaural Hearables Tuochao Chen Qirui Wang Runlin He Shyam Gollakota 75 0 0 25 Apr 2025
Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation Zeeshan Ahmed Frank Seide Zhe Liu Rastislav Rabatin J. Kolár Niko Moritz Ruiming Xie Simone Merello Christian Fuegen OffRL 121 0 0 28 Mar 2025
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation Rui Zhao Jinyu Li Ruchao Fan Matt Post 85 2 0 07 Oct 2024
PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation Libo Zhao Jing Li Ziqian Zeng 94 1 0 05 Oct 2024
What does it take to get state of the art in simultaneous speech-to-speech translation? Vincent Wilmet Johnson Du 38 0 0 02 Sep 2024
Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters Abderrahmane Issam Yusuf Can Semerci Jan Scholtes Gerasimos Spanakis 73 0 0 18 Jul 2024
Navigating the Minefield of MT Beam Search in Cascaded Streaming Speech Translation Rastislav Rabatin Frank Seide Ernie Chang 34 1 0 26 Jun 2024
Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection Haoyu Wang Guoqiang Hu Guodong Lin Wei-Qiang Zhang Jian Li 77 3 0 14 Jun 2024
Speech ReaLLM -- Real-time Streaming Speech Recognition with Multimodal LLMs by Teaching the Flow of Time Frank Seide Morrie Doulaty Yangyang Shi Yashesh Gaur Junteng Jia Chunyang Wu AuLLM KELM 79 11 0 13 Jun 2024
A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Any Translation Zhengrui Ma Qingkai Fang Shaolei Zhang Shoutao Guo Yang Feng Min Zhang 85 11 0 11 Jun 2024
Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models Shoutao Guo Shaolei Zhang Zhengrui Ma Min Zhang Yang Feng LLMAG 96 1 0 11 Jun 2024
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning Shaolei Zhang Qingkai Fang Shoutao Guo Zhengrui Ma Min Zhang Yang Feng 98 10 0 05 Jun 2024
Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair Yusuke Sakai Mana Makinae Hidetaka Kamigaito Taro Watanabe 103 5 0 18 Apr 2024
Conversational SimulMT: Efficient Simultaneous Translation with Large Language Models Minghan Wang Thuy-Trang Vu Yuxia Wang Ehsan Shareghi Gholamreza Haffari 93 3 0 16 Feb 2024
TransLLaMa: LLM-based Simultaneous Translation System Roman Koshkin Katsuhito Sudoh Satoshi Nakamura 51 26 0 07 Feb 2024
Streaming Sequence Transduction through Dynamic Compression Weiting Tan Yunmo Chen Tongfei Chen Guanghui Qin Haoran Xu Heidi C. Zhang Benjamin Van Durme Philipp Koehn 169 2 0 02 Feb 2024
R-BI: Regularized Batched Inputs enhance Incremental Decoding Framework for Low-Latency Simultaneous Speech Translation Jiaxin Guo Zhanglin Wu Zongyao Li Hengchao Shang Daimeng Wei Xiaoyu Chen Zhiqiang Rao Shaojun Li Hao Yang 79 1 0 11 Jan 2024
Language Model is a Branch Predictor for Simultaneous Machine Translation Aoxiong Yin Tianyun Zhong Haoyuan Li Siliang Tang Zhou Zhao 110 1 0 22 Dec 2023
Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Models Victor Agostinelli Max Wild Matthew Raffel Kazi Ahmed Asif Fuad Lizhong Chen 69 8 0 07 Dec 2023
Efficient Monotonic Multihead Attention Xutai Ma Anna Y. Sun Siqi Ouyang Hirofumi Inaguma Paden Tomasello 67 4 0 07 Dec 2023
Bigger is not Always Better: The Effect of Context Size on Speech Pre-Training Sean Robertson Ewan Dunbar SSL 71 1 0 03 Dec 2023
Context Consistency between Training and Testing in Simultaneous Machine Translation M. Zhong Lemao Liu Kehai Chen Mingming Yang Min Zhang LRM 81 0 0 13 Nov 2023
Unified Segment-to-Segment Framework for Simultaneous Sequence Generation Shaolei Zhang Yang Feng 81 8 0 27 Oct 2023
Enhanced Simultaneous Machine Translation with Word-level Policies Kang Kim Hankyu Cho 102 3 0 25 Oct 2023
Non-autoregressive Streaming Transformer for Simultaneous Translation Zhengrui Ma Shaolei Zhang Shoutao Guo Chenze Shao Min Zhang Yang Feng 78 16 0 23 Oct 2023
Adaptive Policy with Wait- $k$ Model for Simultaneous Translation Libo Zhao Kai Fan Wei Luo Jing Wu Shushu Wang Ziqian Zeng Zhongqiang Huang 92 10 0 23 Oct 2023
Segmentation-Free Streaming Machine Translation Javier Iranzo-Sánchez Jorge Iranzo-Sánchez Adria Giménez Jorge Civera Saiz Alfons Juan VOS 88 1 0 26 Sep 2023
Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff Peter Polák Brian Yan Shinji Watanabe A. Waibel Ondrej Bojar 45 9 0 20 Sep 2023
Simultaneous Machine Translation with Large Language Models Minghan Wang Jinming Zhao Thuy-Trang Vu Fatemeh Shiri Ehsan Shareghi Gholamreza Haffari 117 5 0 13 Sep 2023
Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals Running Zhao Jiang-Tao Luca Yu Haiying Zhao Edith C.H. Ngai 81 6 0 16 Aug 2023
End-to-End Simultaneous Speech Translation with Differentiable Segmentation Shaolei Zhang Yang Feng 68 18 0 25 May 2023
Learning Optimal Policy for Simultaneous Machine Translation via Binary Search Shoutao Guo Shaolei Zhang Yang Feng 83 16 0 22 May 2023
TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model Patrick Kahardipraja Brielen Madureira David Schlangen CLL 85 10 0 18 May 2023
Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks Yun Tang Anna Y. Sun Hirofumi Inaguma Xinyue Chen Ning Dong Xutai Ma Paden Tomasello J. Pino 108 22 0 04 May 2023
LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation Lei Lin Shuangtao Li Xiaodon Shi 90 5 0 21 Mar 2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference Biao Fu Minpeng Liao Kai Fan Zhongqiang Huang Boxing Chen Yidong Chen Xiaodon Shi 75 8 0 14 Mar 2023
End-to-End Speech Recognition: A Survey Rohit Prabhavalkar Takaaki Hori Tara N. Sainath Ralf Schluter Shinji Watanabe VLM 82 172 0 03 Mar 2023
Hidden Markov Transformer for Simultaneous Machine Translation Shaolei Zhang Yang Feng 78 27 0 01 Mar 2023
Attention as a Guide for Simultaneous Speech Translation Sara Papi Matteo Negri Marco Turchi 93 31 0 15 Dec 2022
Improving Simultaneous Machine Translation with Monolingual Data Hexuan Deng Liang Ding Xuebo Liu Meishan Zhang Dacheng Tao Min Zhang 93 15 0 02 Dec 2022
Average Token Delay: A Latency Metric for Simultaneous Translation Yasumasa Kano Katsuhito Sudoh Satoshi Nakamura 64 12 0 22 Nov 2022
A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability Jian Xue Peidong Wang Jinyu Li Eric Sun 60 11 0 04 Nov 2022
Monotonic segmental attention for automatic speech recognition Albert Zeyer Robin Schmitt Wei Zhou Ralf Schluter Hermann Ney 61 9 0 26 Oct 2022
Information-Transport-based Policy for Simultaneous Translation Shaolei Zhang Yang Feng 104 52 0 22 Oct 2022
Turning Fixed to Adaptive: Integrating Post-Evaluation into Simultaneous Machine Translation Shoutao Guo Shaolei Zhang Yang Feng 76 17 0 21 Oct 2022
Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation Shaolei Zhang Shoutao Guo Yang Feng 61 24 0 20 Oct 2022
Adaptive Sparse and Monotonic Attention for Transformer-based Automatic Speech Recognition Chendong Zhao Jianzong Wang Wentao Wei Xiaoyang Qu Haoqian Wang Jing Xiao 79 2 0 30 Sep 2022
Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies Zehan Li Haoran Miao Keqi Deng Gaofeng Cheng Sanli Tian Ta Li Yonghong Yan KELM 68 4 0 06 Jul 2022
Data-Driven Adaptive Simultaneous Machine Translation Guangxu Xun Mingbo Ma Yuchen Bian Xingyu Cai Jiaji Huang Renjie Zheng Junkun Chen Jiahong Yuan Kenneth Church Liang Huang 47 0 0 27 Apr 2022