Multi-channel Transformers for Multi-articulatory Sign Language Translation

1 September 2020

Papers citing "Multi-channel Transformers for Multi-articulatory Sign Language Translation"

50 / 62 papers shown

Title
Graph Network for Sign Language Tasks Shiwei Gan Yafeng Yin Zhiwei Jiang Hongkai Wen Lei Xie Sanglu Lu SLR 164 0 0 16 Apr 2025
Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms Xinyu Wang Yuchen Li Fuling Wang Bo Jiang Yansen Wang Yonghong Tian Jin Tang Bin Luo SLR 104 1 0 09 Mar 2025
Deep Understanding of Sign Language for Sign to Subtitle Alignment Youngjoon Jang Jeongsoo Choi Junseok Ahn Joon Son Chung SLR 152 0 0 05 Mar 2025
Training Strategies for Isolated Sign Language Recognition Karina Kvanchiani Roman Kraynov Elizaveta Petrova Petr Surovcev Aleksandr Nagaev A. Kapitanov 171 1 0 16 Dec 2024
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis Lipisha Chaudhary Fei Xu Ifeoma Nwogu SLR 61 0 0 12 Sep 2024
SEDS: Semantically Enhanced Dual-Stream Encoder for Sign Language Retrieval Longtao Jiang Min Wang Zecheng Li Yao Fang Wen-gang Zhou Houqiang Li SLR 81 2 0 23 Jul 2024
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale Shester Gueuwou Xiaodan Du G. Shakhnarovich Karen Livescu SLR 104 5 0 11 Jun 2024
Improving Gloss-free Sign Language Translation by Reducing Representation Density Jinhui Ye Xing Wang Wenxiang Jiao Junwei Liang Hui Xiong 94 7 0 23 May 2024
From CNNs to Transformers in Multimodal Human Action Recognition: A Survey Muhammad Bilal Shaikh Syed Mohammed Shamsul Islam Douglas Chai Naveed Akhtar 108 10 0 22 May 2024
A Tale of Two Languages: Large-Vocabulary Continuous Sign Language Recognition from Spoken Language Supervision Charles Raude Prajwal K R Liliane Momeni Hannah Bull Samuel Albanie Andrew Zisserman Gül Varol SLR 108 5 0 16 May 2024
Multi-Stream Keypoint Attention Network for Sign Language Recognition and Translation Mo Guan Yan Wang Guangkun Ma Jiarui Liu Mingzu Sun SLR 75 7 0 09 May 2024
SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences Ali Emre Keskin H. Keles SLR 63 0 0 05 May 2024
American Sign Language Video to Text Translation Parsheeta Roy Ji-Eun Han Srishti Chouhan Bhaavanaa Thumu VLM SLR 46 1 0 11 Feb 2024
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars Ronglai Zuo Fangyun Wei Zenggui Chen Brian Mak Jiaolong Yang Xin Tong SLR 95 5 0 09 Jan 2024
Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment Rui Zhao Liang Zhang Biao Fu Cong Hu Jinsong Su Yidong Chen SLR 86 17 0 25 Dec 2023
Sign Language Production with Latent Motion Transformer Pan Xie Taiying Peng Yao Du Qipeng Zhang SLR 71 5 0 20 Dec 2023
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset Andreas Voskou Konstantinos P. Panousis Harris Partaourides Kyriakos Tolias S. Chatzis SLR 96 6 0 07 Oct 2023
Sign Language Translation with Iterative Prototype Huijie Yao Wen-gang Zhou Hao Feng Hezhen Hu Hao Zhou Houqiang Li SLR 49 18 0 23 Aug 2023
Improving Continuous Sign Language Recognition with Cross-Lingual Signs Fangyun Wei Yutong Chen SLR 82 33 0 21 Aug 2023
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse Ozge Mercanoglu Sincan Necati Cihan Camgöz Richard Bowden SLR 53 8 0 18 Aug 2023
Learnt Contrastive Concept Embeddings for Sign Recognition Ryan Wong Necati Cihan Camgöz Richard Bowden 72 5 0 18 Aug 2023
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation Li Liu Lufei Gao Wen-Ling Lei Fengji Ma Xiaotian Lin Jin-Tao Wang CVBM 84 5 0 17 Aug 2023
Gloss Attention for Gloss-free Sign Language Translation Aoxiong Yin Tianyun Zhong Lilian H. Y. Tang Weike Jin Tao Jin Zhou Zhao SLR 82 43 0 14 Jul 2023
Cross-modality Data Augmentation for End-to-End Sign Language Translation Jinhui Ye Wenxiang Jiao Xing Wang Zhaopeng Tu Hui Xiong SLR 69 21 0 18 May 2023
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding Hezhen Hu Weichao Zhao Wen-gang Zhou Houqiang Li ViT 95 74 0 08 May 2023
SLTUNET: A Simple Unified Model for Sign Language Translation Biao Zhang Mathias Müller Rico Sennrich SLR 99 34 0 02 May 2023
Sign Language Translation from Instructional Videos Laia Tarrés Gerard I. Gállego A. Duarte Jordi Torres Xavier Giró-i-Nieto SLR 75 34 0 13 Apr 2023
CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning Yiting Cheng Fangyun Wei Jianmin Bao Dong Chen Wenqian Zhang SLR 83 30 0 22 Mar 2023
Learning from What is Already Out There: Few-shot Sign Language Recognition with Online Dictionaries Matyáš Boháček M. Hrúz 62 5 0 10 Jan 2023
Considerations for meaningful sign language machine translation based on glosses Mathias Müller Zifan Jiang Amit Moryossef Annette Rios Gonzales Sarah Ebling SLR 82 39 0 28 Nov 2022
Two-Stream Network for Sign Language Recognition and Translation Yutong Chen Ronglai Zuo Fangyun Wei Yu-Huan Wu Shujie Liu Brian Mak SLR 81 132 0 02 Nov 2022
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation Jiangbin Zheng Siyuan Li Cheng Tan Chong Wu Yidong Chen Stan Z. Li SLR 88 8 0 01 Nov 2022
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation Jinhui Ye Wenxiang Jiao Xing Wang Zhaopeng Tu SLR 89 9 0 13 Oct 2022
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting Zifan Jiang Amit Moryossef Mathias Müller Sarah Ebling 85 23 0 11 Oct 2022
Combining Efficient and Precise Sign Language Recognition: Good pose estimation library is all you need Matyáš Boháček Zhuo Cao M. Hrúz 54 0 0 30 Sep 2022
Topic Detection in Continuous Sign Language Videos Álvaro Budria Laia Tarrés Gerard I. Gállego Francesc Moreno-Noguer Jordi Torres Xavier Giró-i-Nieto SLR VLM 93 1 0 01 Sep 2022
G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model Pan Xie Qipeng Zhang Zexian Li Hao Tang Yao Du Xiaohui Hu DiffM 95 16 0 19 Aug 2022
Automatic dense annotation of large-vocabulary sign language videos Liliane Momeni Hannah Bull Prajwal K R Samuel Albanie Gül Varol Andrew Zisserman SLR 67 19 0 04 Aug 2022
A Token-level Contrastive Framework for Sign Language Translation Biao Fu Peigen Ye Liang Zhang Pei-Ju Yu Cong Hu Yidong Chen X. Shi SLR 62 15 0 11 Apr 2022
A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation Yutong Chen Fangyun Wei Xiao Sun Zhirong Wu Stephen Lin SLR 88 104 0 08 Mar 2022
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges Mathieu De Coster D. Shterionov Mieke Van Herreweghe J. Dambre SLR 66 42 0 07 Feb 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 141 107 0 16 Jan 2022
All You Need In Sign Language Production R. Rastgoo Kourosh Kiani Sergio Escalera V. Athitsos Mohammad Sabokrou 58 8 0 05 Jan 2022
SimulSLT: End-to-End Simultaneous Sign Language Translation Aoxiong Yin Zhou Zhao Jinglin Liu Weike Jin Meng Zhang Xingshan Zeng Xiaofei He SLR 70 33 0 08 Dec 2021
Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 75 17 0 06 Dec 2021
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation Andreas Voskou Konstantinos P. Panousis D. Kosmopoulos Dimitris N. Metaxas S. Chatzis SLR 97 43 0 01 Sep 2021
FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integration Yu Rong Takaaki Shiratori Hanbyul Joo 3DH CVBM 111 198 0 13 Aug 2021
PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution Pan Xie Mengyi Zhao Xiaohui Hu ViT SLR 97 35 0 27 Jul 2021
Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 90 52 0 23 Jul 2021
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation Hao Zhou Wen-gang Zhou Weizhen Qi Junfu Pu Houqiang Li SLR 65 194 0 26 May 2021