Audio-Visual Contrastive Learning with Temporal Self-Supervision

Audio-Visual Contrastive Learning with Temporal Self-Supervision

15 February 2023

Alexander Black

John Collomosse

Papers citing "Audio-Visual Contrastive Learning with Temporal Self-Supervision"

16 / 16 papers shown

Title
Enhancing Modality Representation and Alignment for Multimodal Cold-start Active Learning Meng Shen Yake Wei Jianxiong Yin D. Rajan D. Hu Simon See 81 0 0 12 Dec 2024
Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization Ling Xing Hongyu Qu Rui Yan Xiangbo Shu Jinhui Tang 45 1 0 12 Sep 2024
Sync from the Sea: Retrieving Alignable Videos from Large-Scale Datasets Ishan Rajendrakumar Dave Fabian Caba Heilbron Mubarak Shah Simon Jenni 46 1 0 02 Sep 2024
Sequential Contrastive Audio-Visual Learning Ioannis Tsiamas Santiago Pascual Chunghsin Yeh Joan Serrà 41 2 0 08 Jul 2024
Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition Sungnyun Kim Kangwook Jang Sangmin Bae Hoirin Kim Se-Young Yun 47 3 0 04 Jul 2024
Siamese Vision Transformers are Scalable Audio-visual Learners Yan-Bo Lin Gedas Bertasius 37 5 0 28 Mar 2024
EquiAV: Leveraging Equivariance for Audio-Visual Contrastive Learning Jongsuk Kim Hyeongkeun Lee Kyeongha Rho Junmo Kim Joon Son Chung 34 4 0 14 Mar 2024
No More Shortcuts: Realizing the Potential of Temporal Self-Supervision I. Dave Simon Jenni Mubarak Shah 35 7 0 20 Dec 2023
A Large-scale Dataset for Audio-Language Representation Learning Luoyi Sun Xuenan Xu Mengyue Wu Weidi Xie 34 20 0 20 Sep 2023
VADER: Video Alignment Differencing and Retrieval Alexander Black Simon Jenni Tu Bui Md. Mehrab Tanjim Stefano Petrangeli Ritwik Sinha Viswanathan Swaminathan John Collomosse 31 2 0 23 Mar 2023
Time-Equivariant Contrastive Video Representation Learning Simon Jenni Hailin Jin SSL AI4TS 143 60 0 07 Dec 2021
VPN: Video Provenance Network for Robust Content Attribution Alexander Black Tu Bui Simon Jenni Vishy Swaminathan John Collomosse 36 9 0 21 Sep 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 191 454 0 29 Apr 2021
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text Hassan Akbari Liangzhe Yuan Rui Qian Wei-Hong Chuang Shih-Fu Chang Huayu Chen Boqing Gong ViT 251 577 0 22 Apr 2021
Video Representation Learning by Recognizing Temporal Transformations Simon Jenni Givi Meishvili Paolo Favaro 131 133 0 21 Jul 2020
Self-Supervised Feature Learning by Learning to Spot Artifacts Simon Jenni Paolo Favaro SSL 150 127 0 13 Jun 2018