CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational Alignment

10 March 2023

Jiangbin Zheng

Yile Wang

Cheng Tan

Siyuan Li

Stan Z. Li

Papers citing "CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational Alignment"

29 / 29 papers shown

Title
CLIP-SLA: Parameter-Efficient CLIP Adaptation for Continuous Sign Language Recognition Sarah Alyami H. Luqman SLR VLM 67 0 0 02 Apr 2025
OLMD: Orientation-aware Long-term Motion Decoupling for Continuous Sign Language Recognition Yiheng Yu Sheng Liu Yuan Feng Min Xu Zhelun Jin X. J. Yang SLR 181 0 0 11 Mar 2025
DapPep: Domain Adaptive Peptide-agnostic Learning for Universal T-cell Receptor-antigen Binding Affinity Prediction Jiangbin Zheng Qianhui Xu Ruichen Xia Stan Z. Li 69 0 0 26 Nov 2024
Pan-protein Design Learning Enables Task-adaptive Generalization for Low-resource Enzyme Design Jiangbin Zheng Ge Wang Han Zhang Stan Z. Li 63 0 0 26 Nov 2024
Diverse Sign Language Translation Xin Shen Lei Shen Shaozu Yuan Heming Du Haiyang Sun Xin Yu SLR 40 1 0 25 Oct 2024
SCOPE: Sign Language Contextual Processing with Embedding from LLMs Yuqi Liu Wenqian Zhang Sihan Ren Chengyu Huang Jingyi Yu Lan Xu SLR 52 0 0 02 Sep 2024
MetaEnzyme: Meta Pan-Enzyme Learning for Task-Adaptive Redesign Jiangbin Zheng Han Zhang Qianqing Xu An-Ping Zeng Stan Z. Li 22 3 0 05 Aug 2024
Cycle Contrastive Adversarial Learning for Unsupervised image Deraining Chen Zhao Weiling Cai Chengwei Hu Zheng Yuan GAN 40 0 0 16 Jul 2024
Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalities Xueye Zheng Yuanhuiyi Lyu Lin Wang VLM 52 13 0 16 Jul 2024
SignCLIP: Connecting Text and Sign Language by Contrastive Learning Zifan Jiang Gerard Sant Amit Moryossef Mathias Müller Rico Sennrich Sarah Ebling VLM CLIP 39 2 0 01 Jul 2024
A Comparative Study of Continuous Sign Language Recognition Techniques Sarah Alyami H. Luqman SLR 30 1 0 18 Jun 2024
OmniBind: Teach to Build Unequal-Scale Modality Interaction for Omni-Bind of All Yuanhuiyi Lyu Xueye Zheng Dahun Kim Lin Wang 51 13 0 25 May 2024
Continuous Sign Language Recognition with Adapted Conformer via Unsupervised Pretraining Neena Aloysius M. Geetha Prema Nedungadi SLR 21 2 0 20 May 2024
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation Ryan Wong Necati Cihan Camgöz Richard Bowden SLR 51 21 0 07 May 2024
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation Lianyu Hu Wei Feng Liqing Gao Zekang Liu Liang Wan SLR 32 4 0 17 Apr 2024
Improving Continuous Sign Language Recognition with Adapted Image Models Lianyu Hu Tongkai Shi Liqing Gao Zekang Liu Wei Feng VLM 26 5 0 12 Apr 2024
UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All Yuanhuiyi Lyu Xueye Zheng Jiazhou Zhou Lin Wang 32 16 0 19 Mar 2024
Using an LLM to Turn Sign Spottings into Spoken Language Sentences Ozge Mercanoglu Necati Cihan Camgöz Richard Bowden SLR 32 4 0 15 Mar 2024
HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances Supreeth Narasimhaswamy Uttaran Bhattacharya Xiang Chen Ishita Dasgupta Saayan Mitra Minh Hoai DiffM 26 24 0 04 Mar 2024
SignVTCL: Multi-Modal Continuous Sign Language Recognition Enhanced by Visual-Textual Contrastive Learning Hao Chen Jiaze Wang Ziyu Guo Jinpeng Li Donghao Zhou Bian Wu Chenyong Guan Guangyong Chen Pheng-Ann Heng 30 5 0 22 Jan 2024
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars Ronglai Zuo Fangyun Wei Zenggui Chen Brian Mak Jiaolong Yang Xin Tong SLR 34 4 0 09 Jan 2024
Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment Rui Zhao Liang Zhang Biao Fu Cong Hu Jinsong Su Yidong Chen SLR 37 12 0 25 Dec 2023
MMDesign: Multi-Modality Transfer Learning for Generative Protein Design Jiangbin Zheng Siyuan Li Yufei Huang Zhangyang Gao Cheng Tan Bozhen Hu Jun-Xiong Xia Ge Wang Stan Z. Li DiffM 17 5 0 11 Dec 2023
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation Li Liu Lufei Gao Wen-Ling Lei Fengji Ma Xiaotian Lin Jin-Tao Wang CVBM 27 5 0 17 Aug 2023
Enhancing Human-like Multi-Modal Reasoning: A New Challenging Dataset and Comprehensive Framework Jingxuan Wei Cheng Tan Zhangyang Gao Linzhuang Sun Siyuan Li Bihui Yu R. Guo Stan Z. Li LRM 34 8 0 24 Jul 2023
Lightweight Contrastive Protein Structure-Sequence Transformation Jiangbin Zheng Ge Wang Yufei Huang Bozhen Hu Siyuan Li Cheng Tan Xinwen Fan Stan Z. Li 22 6 0 19 Mar 2023
Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal Ronglai Zuo Brian Mak SLR 29 18 0 26 Dec 2022
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation Jiangbin Zheng Siyuan Li Cheng Tan Chong Wu Yidong Chen Stan Z. Li SLR 29 7 0 01 Nov 2022
Co-learning: Learning from Noisy Labels with Self-supervision Cheng Tan Jun-Xiong Xia Lirong Wu Stan Z. Li NoLa 73 116 0 05 Aug 2021