Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model

5 June 2017

Jiasen Lu

A. Kannan

Jianwei Yang

Devi Parikh

Dhruv Batra

BDL

ArXiv PDF HTML

Papers citing "Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model"

50 / 71 papers shown

Title
Enhancing Visual Dialog State Tracking through Iterative Object-Entity Alignment in Multi-Round Conversations Wei Pang Ruixue Duan Jinfu Yang Ning Li 23 0 0 13 Aug 2024
Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion Jian Ma Wenguan Wang Yi Yang Feng Zheng DiffM 54 0 0 15 Jul 2024
MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production Jian Ma Wenguan Wang Yi Yang Feng Zheng 45 1 0 04 Jul 2024
$$\mathbb{VD}$-$\mathbb{GR}$: Boosting $\mathbb{V}$isual $\mathbb{D}$ialog with Cascaded Spatial-Temporal Multi-Modal $\mathbb{GR}$aphs$ $\mathbb{VD}$ - $\mathbb{GR}$ : Boosting $\mathbb{V}$ isual $\mathbb{D}$ ialog with Cascaded Spatial-Temporal Multi-Modal $\mathbb{GR}$ aphs Adnen Abdessaied Lei Shi Andreas Bulling 3DH 29 3 0 25 Oct 2023
Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review Hao Wang Bin Guo Y. Zeng Yasan Ding Chen Qiu Ying Zhang Li Yao Zhiwen Yu 30 2 0 02 Jul 2022
The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training Gi-Cheon Kang Sungdong Kim Jin-Hwa Kim Donghyun Kwak Byoung-Tak Zhang 29 10 0 25 May 2022
UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog Cheng Chen Yudong Zhu Zhenshan Tan Qingrong Cheng Xin Jiang Qun Liu X. Gu 28 39 0 01 May 2022
Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning Feilong Chen Xiuyi Chen Shuang Xu Bo Xu VLM 37 18 0 15 Apr 2022
Modeling Coreference Relations in Visual Dialog Mingxiao Li Marie-Francine Moens 11 9 0 06 Mar 2022
A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning Iris A. M. Huijben W. Kool Max B. Paulus Ruud J. G. van Sloun 26 93 0 04 Oct 2021
OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contexts Shuhe Wang Yuxian Meng Xiaoya Li Xiaofei Sun Rongbin Ouyang Jiwei Li MLLM VLM 30 21 0 27 Sep 2021
Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation Feilong Chen Fandong Meng Xiuyi Chen Peng Li Jie Zhou 56 21 0 17 Sep 2021
GoG: Relation-aware Graph-over-Graph Network for Visual Dialog Feilong Chen Xiuyi Chen Fandong Meng Peng Li Jie Zhou 76 34 0 17 Sep 2021
Learning to Ground Visual Objects for Visual Dialog Feilong Chen Xiuyi Chen Can Xu Daxin Jiang OOD 31 17 0 13 Sep 2021
Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser Duo Zheng Zipeng Xu Fandong Meng Xiaojie Wang Jiaan Wang Jie Zhou 20 12 0 06 Sep 2021
Modeling Explicit Concerning States for Reinforcement Learning in Visual Dialogue Zipeng Xu Fandong Meng Xiaojie Wang Duo Zheng Chenxu Lv Jie Zhou OffRL 28 5 0 12 Jul 2021
Modeling Text-visual Mutual Dependency for Multi-modal Dialog Generation Shuhe Wang Yuxian Meng Xiaofei Sun Fei Wu Rongbin Ouyang Rui Yan Tianwei Zhang Jiwei Li 21 15 0 30 May 2021
Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure Lu Ji Jing Li Zhongyu Wei Qi Zhang Xuanjing Huang 29 0 0 17 Apr 2021
Attention, please! A survey of Neural Attention Models in Deep Learning Alana de Santana Correia Esther Luna Colombini HAI 23 175 0 31 Mar 2021
OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts Yuxian Meng Shuhe Wang Qinghong Han Xiaofei Sun Fei Wu Rui Yan Jiwei Li 27 28 0 30 Dec 2020
Learning to Respond with Your Favorite Stickers: A Framework of Unifying Multi-Modality and User Preference in Multi-Turn Dialog Shen Gao Xiuying Chen Li Liu Dongyan Zhao Rui Yan 24 14 0 05 Nov 2020
Transfer Learning in Deep Reinforcement Learning: A Survey Zhuangdi Zhu Kaixiang Lin Anil K. Jain Jiayu Zhou OffRL LRM 14 560 0 16 Sep 2020
KBGN: Knowledge-Bridge Graph Network for Adaptive Vision-Text Reasoning in Visual Dialogue X. Jiang Siyi Du Zengchang Qin Yajing Sun Jiahao Yu 29 37 0 11 Aug 2020
SeqDialN: Sequential Visual Dialog Networks in Joint Visual-Linguistic Representation Space Liu Yang VLM 18 5 0 02 Aug 2020
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data Michael Cogswell Jiasen Lu Rishabh Jain Stefan Lee Devi Parikh Dhruv Batra VLM EgoV 30 15 0 24 Jul 2020
DAM: Deliberation, Abandon and Memory Networks for Generating Detailed and Non-repetitive Responses in Visual Dialogue X. Jiang Jiahao Yu Yajing Sun Zengchang Qin Zihao Zhu Yue Hu Qi Wu MLLM 43 19 0 07 Jul 2020
ORD: Object Relationship Discovery for Visual Dialogue Generation Ziwei Wang Zi Huang Yadan Luo Huimin Lu 19 4 0 15 Jun 2020
Diversifying Dialogue Generation with Non-Conversational Text Hui Su Xiaoyu Shen Sanqiang Zhao Xiao Zhou Pengwei Hu Randy Zhong Cheng Niu Jie Zhou 17 46 0 09 May 2020
VD-BERT: A Unified Vision and Dialog Transformer with BERT Yue Wang Shafiq R. Joty Michael R. Lyu Irwin King Caiming Xiong S. Hoi 24 102 0 28 Apr 2020
A Revised Generative Evaluation of Visual Dialogue Daniela Massiceti Viveka Kulharia P. Dokania N. Siddharth Philip H. S. Torr 15 0 0 20 Apr 2020
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer Gi-Cheon Kang Junseok Park Hwaran Lee Byoung-Tak Zhang Jin-Hwa Kim VLM 16 10 0 14 Apr 2020
Iterative Context-Aware Graph Inference for Visual Dialog Dan Guo Haibo Wang Hanwang Zhang Zhengjun Zha Meng Wang 27 49 0 05 Apr 2020
Learning to Respond with Stickers: A Framework of Unifying Multi-Modality in Multi-Turn Dialog Shen Gao Xiuying Chen Chang Liu Li Liu Dongyan Zhao Rui Yan 19 32 0 10 Mar 2020
DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog Feilong Chen Fandong Meng Jiaming Xu Peng Li Bo Xu Jie Zhou 16 34 0 18 Dec 2019
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline Vishvak Murahari Dhruv Batra Devi Parikh Abhishek Das VLM 23 115 0 05 Dec 2019
Efficient Attention Mechanism for Visual Dialog that can Handle All the Interactions between Multiple Inputs Van-Quang Nguyen Masanori Suganuma Takayuki Okatani 16 7 0 26 Nov 2019
Two Causal Principles for Improving Visual Dialog Jiaxin Qi Yulei Niu Jianqiang Huang Hanwang Zhang CML 16 146 0 24 Nov 2019
DualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual Dialogue X. Jiang Jiahao Yu Zengchang Qin Yingying Zhuang Xingxing Zhang Yue Hu Qi Wu 20 70 0 17 Nov 2019
Visual Dialogue State Tracking for Question Generation Wei Pang Xiaojie Wang 27 33 0 12 Nov 2019
Discrete Argument Representation Learning for Interactive Argument Pair Identification Lu Ji Zhongyu Wei Jing Li Qi Zhang Xuanjing Huang 21 15 0 05 Nov 2019
TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning Baselines Jingxiang Lin Unnat Jain A. Schwing LRM ReLM 31 9 0 31 Oct 2019
Granular Multimodal Attention Networks for Visual Dialog Badri N. Patro Shivansh Patel Vinay P. Namboodiri 25 1 0 13 Oct 2019
Discovering Differential Features: Adversarial Learning for Information Credibility Evaluation Lianwei Wu Y. Rao Ambreen Nazir Haolin Jin AAML 19 27 0 16 Sep 2019
Probabilistic framework for solving Visual Dialog Badri N. Patro Anupriy Vinay P. Namboodiri BDL 27 13 0 11 Sep 2019
What Should I Ask? Using Conversationally Informative Rewards for Goal-Oriented Visual Dialog Pushkar Shukla Carlos E. L. Elmadjian Richika Sharan Vivek Kulkarni Matthew A. Turk William Yang Wang 6 34 0 28 Jul 2019
Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods Aditya Mogadala M. Kalimuthu Dietrich Klakow VLM 20 132 0 22 Jul 2019
Factor Graph Attention Idan Schwartz Seunghak Yu Tamir Hazan A. Schwing 21 110 0 11 Apr 2019
A Simple Baseline for Audio-Visual Scene-Aware Dialog Idan Schwartz A. Schwing Tamir Hazan 19 69 0 11 Apr 2019
Reasoning Visual Dialogs with Structural and Partial Observations Zilong Zheng Wenguan Wang Siyuan Qi Song-Chun Zhu 39 117 0 11 Apr 2019
Generative Visual Dialogue System via Adaptive Reasoning and Weighted Likelihood Estimation Heming Zhang Shalini Ghosh Larry Heck Stephen Walsh Junting Zhang Jie Zhang C.-C. Jay Kuo 13 7 0 26 Feb 2019