Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation

30 March 2020

Papers citing "Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation"

50 / 59 papers shown

Title
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing Suhyeon Yoo Khai-Nghi Truong Young-Ho Kim 64 0 0 24 Feb 2025
Sign Language Sense Disambiguation Jana Grimm Miriam Winkler Oliver Kraus Tanalp Agustoslu SLR 16 0 0 13 Sep 2024
Improving Gloss-free Sign Language Translation by Reducing Representation Density Jinhui Ye Xing Wang Wenxiang Jiao Junwei Liang Hui Xiong 49 6 0 23 May 2024
Sign Stitching: A Novel Approach to Sign Language Production Harry Walsh Ben Saunders Richard Bowden 52 3 0 13 May 2024
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods Sükrü Öztürk H. Keles SLR 29 0 0 05 May 2024
SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences Ali Emre Keskin H. Keles SLR 33 0 0 05 May 2024
Improving Continuous Sign Language Recognition with Adapted Image Models Lianyu Hu Tongkai Shi Liqing Gao Zekang Liu Wei Feng VLM 26 5 0 12 Apr 2024
Continuous Sign Language Recognition Based on Motor attention mechanism and frame-level Self-distillation Qidan Zhu Jing Li Fei Yuan Quan Gan SLR 53 3 0 29 Feb 2024
SignVTCL: Multi-Modal Continuous Sign Language Recognition Enhanced by Visual-Textual Contrastive Learning Hao Chen Jiaze Wang Ziyu Guo Jinpeng Li Donghao Zhou Bian Wu Chenyong Guan Guangyong Chen Pheng-Ann Heng 33 5 0 22 Jan 2024
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars Ronglai Zuo Fangyun Wei Zenggui Chen Brian Mak Jiaolong Yang Xin Tong SLR 34 4 0 09 Jan 2024
SlowFast Network for Continuous Sign Language Recognition Junseok Ahn Youngjoon Jang Joon Son Chung SLR 35 10 0 21 Sep 2023
Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations Eui Jun Hwang Huije Lee Jong C. Park SLR 37 6 0 21 Sep 2023
Bornil: An open-source sign language data crowdsourcing platform for AI enabled dialect-agnostic communication Shahriar Elahi Dhruvo Mohammad Akhlaqur Rahman M. Mandal Md. Istiak Hossain Shihab A. A. N. Ansary ... Sejuti Rahman Sayma Sultana Chowdhury Sabbir Ahmed Chowdhury Farig Sadeque Asif Sushmit 23 1 0 29 Aug 2023
Improving Continuous Sign Language Recognition with Cross-Lingual Signs Fangyun Wei Yutong Chen SLR 25 28 0 21 Aug 2023
Learnt Contrastive Concept Embeddings for Sign Recognition Ryan Wong Necati Cihan Camgöz Richard Bowden 29 5 0 18 Aug 2023
Gloss Alignment Using Word Embeddings Harry Walsh Ozge Mercanoglu Sincan Ben Saunders Richard Bowden 19 1 0 08 Aug 2023
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining Benjia Zhou Zhigang Chen Albert Clapés Jun Wan Yanyan Liang Sergio Escalera Zhen Lei Du Zhang SLR 33 47 0 27 Jul 2023
Gloss Attention for Gloss-free Sign Language Translation Aoxiong Yin Tianyun Zhong Lilian H. Y. Tang Weike Jin Tao Jin Zhou Zhao SLR 18 37 0 14 Jul 2023
SLTUNET: A Simple Unified Model for Sign Language Translation Biao Zhang Mathias Müller Rico Sennrich SLR 43 33 0 02 May 2023
Sign Language Translation from Instructional Videos Laia Tarrés Gerard I. Gállego A. Duarte Jordi Torres Xavier Giró-i-Nieto SLR 26 30 0 13 Apr 2023
StepNet: Spatial-temporal Part-aware Network for Isolated Sign Language Recognition Xi Shen Zhedong Zheng Yi Yang SLR 30 13 0 25 Dec 2022
Ham2Pose: Animating Sign Language Notation into Pose Sequences Rotem Shalev-Arkushin Amit Moryossef Ohad Fried SLR 32 19 0 24 Nov 2022
Weakly-supervised Fingerspelling Recognition in British Sign Language Videos Prajwal K R Hannah Bull Liliane Momeni Samuel Albanie Gül Varol Andrew Zisserman 26 14 0 16 Nov 2022
Sentence-Level Sign Language Recognition Framework Atra Akandeh SLR 21 3 0 13 Nov 2022
Two-Stream Network for Sign Language Recognition and Translation Yutong Chen Ronglai Zuo Fangyun Wei Yu-Huan Wu Shujie Liu Brian Mak SLR 36 118 0 02 Nov 2022
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation Jiangbin Zheng Siyuan Li Cheng Tan Chong Wu Yidong Chen Stan Z. Li SLR 32 7 0 01 Nov 2022
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation S. Dey Abhilash Pal Cyrine Chaabani Oscar Koller SLR 23 5 0 24 Oct 2022
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting Zifan Jiang Amit Moryossef Mathias Müller Sarah Ebling 20 22 0 11 Oct 2022
Combining Efficient and Precise Sign Language Recognition: Good pose estimation library is all you need Matyáš Boháček Zhuo Cao M. Hrúz 14 0 0 30 Sep 2022
Topic Detection in Continuous Sign Language Videos Álvaro Budria Laia Tarrés Gerard I. Gállego Francesc Moreno-Noguer Jordi Torres Xavier Giró-i-Nieto SLR VLM 47 1 0 01 Sep 2022
G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model Pan Xie Qipeng Zhang Zexian Li Hao Tang Yao Du Xiaohui Hu DiffM 44 12 0 19 Aug 2022
AFT-VO: Asynchronous Fusion Transformers for Multi-View Visual Odometry Estimation Nimet Kaygusuz Oscar Alejandro Mendez Maldonado Richard Bowden 29 5 0 26 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 72 527 0 13 Jun 2022
Scaling up sign spotting through sign language dictionaries Gül Varol Liliane Momeni Samuel Albanie Triantafyllos Afouras Andrew Zisserman 26 14 0 09 May 2022
A Transformer-Based Contrastive Learning Approach for Few-Shot Sign Language Recognition Silvan Ferreira Esdras Costa M. Dahia J. Rocha SLR 14 1 0 05 Apr 2022
Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 30 62 0 29 Mar 2022
A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation Yutong Chen Fangyun Wei Xiao Sun Zhirong Wu Stephen Lin SLR 30 98 0 08 Mar 2022
Including Facial Expressions in Contextual Embeddings for Sign Language Generation Carla Viegas Mert Inan Lorna C. Quandt Malihe Alikhani SLR 26 14 0 11 Feb 2022
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges Mathieu De Coster D. Shterionov Mieke Van Herreweghe J. Dambre SLR 16 40 0 07 Feb 2022
Consistent 3D Hand Reconstruction in Video via self-supervised Learning Zhigang Tu Zhishen Huang Yujin Chen Di Kang Linchao Bao Bisheng Yang Junsong Yuan 3DH 39 39 0 24 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 22 103 0 16 Jan 2022
Towards Zero-shot Sign Language Recognition Yunus Can Bilge R. G. Cinbis Nazli Ikizler-Cinbis SLR 17 36 0 15 Jan 2022
Sign Language Video Retrieval with Free-Form Textual Queries A. Duarte Samuel Albanie Xavier Giró-i-Nieto Gül Varol SLR 50 29 0 07 Jan 2022
Multi-Head Deep Metric Learning Using Global and Local Representations M. K. Ebrahimpour Gang Qian Allison Beach 27 8 0 28 Dec 2021
Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 34 17 0 06 Dec 2021
SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition Hezhen Hu Weichao Zhao Wen-gang Zhou Yuechen Wang Houqiang Li ViT 27 63 0 11 Oct 2021
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation Andreas Voskou Konstantinos P. Panousis D. Kosmopoulos Dimitris N. Metaxas S. Chatzis SLR 36 43 0 01 Sep 2021
Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 27 50 0 23 Jul 2021
AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation Ben Saunders Necati Cihan Camgöz Richard Bowden 19 30 0 22 Jul 2021
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation Hao Zhou Wen-gang Zhou Weizhen Qi Junfu Pu Houqiang Li SLR 35 180 0 26 May 2021