Improving CTC-based speech recognition via knowledge transferring from
pre-trained language models

Improving CTC-based speech recognition via knowledge transferring from pre-trained language models

22 February 2022

Pengyuan Zhang

Papers citing "Improving CTC-based speech recognition via knowledge transferring from pre-trained language models"

19 / 19 papers shown

Title
Cross-modal Knowledge Transfer Learning as Graph Matching Based on Optimal Transport for ASR Xugang Lu Peng Shen Yu Tsao Hisashi Kawai OT 12 0 0 19 May 2025
The evaluation of a code-switched Sepedi-English automatic speech recognition system Amanda Phaladi T. Modipa 43 0 0 11 Mar 2024
FastInject: Injecting Unpaired Text Data into CTC-based ASR training Keqi Deng Phil Woodland 18 2 0 14 Dec 2023
XVO: Generalized Visual Odometry via Cross-Modal Self-Training Tohida Rehman Ronit Mandal Jimuyang Zhang Debarshi Kumar Sanyal SSL 33 17 0 28 Sep 2023
Hierarchical Cross-Modality Knowledge Transfer with Sinkhorn Attention for CTC-based ASR Ambar Pal Jeremias Sulam Yu Tsao Rene Vidal 18 2 0 28 Sep 2023
Cross-modal Alignment with Optimal Transport for CTC-based ASR Xugang Lu Peng Shen Yu Tsao Hisashi Kawai 34 5 0 24 Sep 2023
Multiple Representation Transfer from Large Language Models to End-to-End ASR Systems Takuma Udagawa Masayuki Suzuki Gakuto Kurata Masayasu Muraoka G. Saon 38 2 0 07 Sep 2023
Research on an improved Conformer end-to-end Speech Recognition Model with R-Drop Structure Weidong Ji Shijie Zan Guohui Zhou Xu Wang SyDa 27 1 0 14 Jun 2023
A Lexical-aware Non-autoregressive Transformer-based ASR Model Chong Lin Kuan-Yu Chen AI4TS 30 1 0 18 May 2023
Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalization Hamza Kheddar Yassine Himeur S. Al-Maadeed Abbes Amira F. Bensaali 47 76 0 27 Apr 2023
Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation Minglun Han Feilong Chen Jing Shi Shuang Xu Bo Xu VLM 46 12 0 30 Jan 2023
Speech-text based multi-modal training with bidirectional attention for improved speech recognition Yuhang Yang Haihua Xu Hao-Ming Huang Eng Siong Chng Sheng Li 47 7 0 01 Nov 2022
A context-aware knowledge transferring strategy for CTC-based ASR Keda Lu Kuan-Yu Chen 15 15 0 12 Oct 2022
Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies Zehan Li Haoran Miao Keqi Deng Gaofeng Cheng Sanli Tian Ta Li Yonghong Yan KELM 27 4 0 06 Jul 2022
Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition Zhifu Gao Shiliang Zhang Ian Mcloughlin Zhijie Yan 20 92 0 16 Jun 2022
WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment Lin Yao Jianfei Song Rui Xu Yingfang Yang Zijian Chen Yafeng Deng VLM 21 2 0 22 Apr 2022
Multi-Variant Consistency based Self-supervised Learning for Robust Automatic Speech Recognition Changfeng Gao Gaofeng Cheng Pengyuan Zhang 25 4 0 23 Dec 2021
Intermediate Loss Regularization for CTC-based Speech Recognition Jaesong Lee Shinji Watanabe 118 135 0 05 Feb 2021
Efficiently Fusing Pretrained Acoustic and Linguistic Encoders for Low-resource Speech Recognition Cheng Yi Shiyu Zhou Bo Xu 51 40 0 17 Jan 2021