Evaluating Off-the-Shelf Machine Listening and Natural Language Models for Automated Audio Captioning

14 October 2021

Benno Weck

Xavier Favory

Konstantinos Drossos

Xavier Serra

ArXiv (abs)PDF HTML

Papers citing "Evaluating Off-the-Shelf Machine Listening and Natural Language Models for Automated Audio Captioning"

27 / 27 papers shown

Title
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 162 1,130 0 08 Jun 2021
Investigating Local and Global Information for Automated Audio Captioning with Transfer Learning Xuenan Xu Heinrich Dinkel Mengyue Wu Zeyu Xie Kai Yu 58 60 0 23 Feb 2021
Audio Captioning using Pre-Trained Large-Scale Language Model Guided by Audio-based Similar Caption Retrieval Yuma Koizumi Yasunori Ohishi Daisuke Niizumi Daiki Takeuchi Masahiro Yasuda 64 41 0 14 Dec 2020
WaveTransformer: A Novel Architecture for Audio Captioning Based on Learning Temporal and Time-Frequency Information An Tran Konstantinos Drossos Tuomas Virtanen 80 19 0 21 Oct 2020
Effects of Word-frequency based Pre- and Post- Processings for Audio Captioning Daiki Takeuchi Yuma Koizumi Yasunori Ohishi Noboru Harada K. Kashino 51 27 0 24 Sep 2020
Multi-task Regularization Based on Infrequent Classes for Audio Captioning Emre Çakir Konstantinos Drossos Tuomas Virtanen 48 17 0 09 Jul 2020
Temporal Sub-sampling of Audio Feature Sequences for Automated Audio Captioning K. Nguyen Konstantinos Drossos Tuomas Virtanen 44 12 0 06 Jul 2020
A Transformer-based Audio Captioning Model with Keyword Estimation Yuma Koizumi Ryo Masumura Kyosuke Nishida Masahiro Yasuda Shoichiro Saito 71 54 0 01 Jul 2020
COALA: Co-Aligned Autoencoders for Learning Semantically Enriched Audio Representations Xavier Favory Konstantinos Drossos Tuomas Virtanen Xavier Serra 114 32 0 15 Jun 2020
Audio Captioning using Gated Recurrent Units Aysegül Özkaya Eren M. Sert 55 10 0 05 Jun 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 92 1,498 0 27 Feb 2020
Clotho: An Audio Captioning Dataset Konstantinos Drossos Samuel Lipping Tuomas Virtanen 101 394 0 21 Oct 2019
Crowdsourcing a Dataset of Audio Captions Samuel Lipping Konstantinos Drossos Tuomas Virtanen 37 33 0 22 Jul 2019
Audio Caption: Listen and Tell Mengyue Wu Heinrich Dinkel Kai Yu 59 61 0 25 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Advances in Pre-Training Distributed Word Representations Tomas Mikolov Edouard Grave Piotr Bojanowski Christian Puhrsch Armand Joulin AI4TS VLM 147 1,244 0 26 Dec 2017
Automated Audio Captioning with Recurrent Neural Networks Konstantinos Drossos Sharath Adavanne Tuomas Virtanen 75 129 0 30 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Look, Listen and Learn Relja Arandjelović Andrew Zisserman SSL 125 906 0 23 May 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.2K 20,892 0 17 Apr 2017
Improved Image Captioning via Policy Gradient optimization of SPIDEr Siqi Liu Zhenhai Zhu Ning Ye S. Guadarrama Kevin Patrick Murphy 157 446 0 01 Dec 2016
CNN Architectures for Large-Scale Audio Classification Shawn Hershey Sourish Chaudhuri D. Ellis J. Gemmeke A. Jansen ... Rif A. Saurous Bryan Seybold M. Slaney Ron J. Weiss K. Wilson 128 2,507 0 29 Sep 2016
YouTube-8M: A Large-Scale Video Classification Benchmark Sami Abu-El-Haija Nisarg Kothari Joonseok Lee Apostol Natsev G. Toderici Balakrishnan Varadarajan Sudheendra Vijayanarasimhan VLM 153 1,272 0 27 Sep 2016
Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books Yukun Zhu Ryan Kiros R. Zemel Ruslan Salakhutdinov R. Urtasun Antonio Torralba Sanja Fidler 133 2,554 0 22 Jun 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 446 20,590 0 10 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,508 0 04 Sep 2014
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 402 33,560 0 16 Oct 2013