Learning to Generate Scene Graph from Natural Language Supervision

6 September 2021

Yiwu Zhong

Jing Shi

Jianwei Yang

Chenliang Xu

Yin Li

SSL

ArXiv PDF HTML

Papers citing "Learning to Generate Scene Graph from Natural Language Supervision"

50 / 57 papers shown

Title
A Call for New Recipes to Enhance Spatial Reasoning in MLLMs Huanyu Zhang Chengzu Li Wenshan Wu Shaoguang Mao Yan Xia Ivan Vulić Z. Zhang Liang Wang Tieniu Tan Furu Wei LRM 36 2 0 21 Apr 2025
Compile Scene Graphs with Reinforcement Learning Zuyao Chen Jinlin Wu Zhen Lei Marc Pollefeys Chang Wen Chen OffRL LRM 57 0 0 18 Apr 2025
Leveraging Static Relationships for Intra-Type and Inter-Type Message Passing in Video Question Answering Lili Liang Guanglu Sun 50 0 0 03 Apr 2025
Natural Language Supervision for Low-light Image Enhancement Jiahui Tang Kaihua Zhou Zhijian Luo Yueen Hou 43 0 0 11 Jan 2025
Unbiased Scene Graph Generation by Type-Aware Message Passing on Heterogeneous and Dual Graphs Guanglu Sun Jin Qiu Lili Liang 79 0 0 20 Nov 2024
Public Health Advocacy Dataset: A Dataset of Tobacco Usage Videos from Social Media N. V. R. Chappa Charlotte McCormick Susana Rodriguez Gongora P. Dobbs Khoa Luu 70 2 0 12 Nov 2024
FLAASH: Flow-Attention Adaptive Semantic Hierarchical Fusion for Multi-Modal Tobacco Content Analysis N. V. R. Chappa P. Dobbs Bhiksha Raj Khoa Luu 36 3 0 25 Oct 2024
Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation Kuanchao Chu Satoshi Yamazaki Hideki Nakayama 45 0 0 27 Jun 2024
4D Panoptic Scene Graph Generation Jingkang Yang Jun Cen Wenxuan Peng Shuai Liu Fangzhou Hong Xiangtai Li Kaiyang Zhou Qifeng Chen Ziwei Liu 45 13 0 16 May 2024
Weakly-Supervised 3D Scene Graph Generation via Visual-Linguistic Assisted Pseudo-labeling Xu Wang Yifan Li Qiudan Zhang Wen-Bin Wu Mark Junjie Li Jianmin Jinag 51 1 0 03 Apr 2024
Iterated Learning Improves Compositionality in Large Vision-Language Models Chenhao Zheng Jieyu Zhang Aniruddha Kembhavi Ranjay Krishna VLM CoGe 54 9 0 02 Apr 2024
From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models Rongjie Li Songyang Zhang Dahua Lin Kai-xiang Chen Xuming He VLM 45 14 0 01 Apr 2024
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning Yiwu Zhong Zi-Yuan Hu Michael R. Lyu Liwei Wang 29 1 0 27 Mar 2024
The All-Seeing Project V2: Towards General Relation Comprehension of the Open World Weiyun Wang Yiming Ren Hao Luo Tiantong Li Chenxiang Yan ... Qingyun Li Lewei Lu Xizhou Zhu Yu Qiao Jifeng Dai MLLM 52 47 0 29 Feb 2024
Position: Graph Foundation Models are Already Here Haitao Mao Zhikai Chen Wenzhuo Tang Jianan Zhao Yao Ma Tong Zhao Neil Shah Mikhail Galkin Jiliang Tang AI4CE 61 26 0 03 Feb 2024
Simple Image-level Classification Improves Open-vocabulary Object Detection Ru Fang Guansong Pang Xiaolong Bai ObjD VLM 53 14 0 16 Dec 2023
Stellar: Systematic Evaluation of Human-Centric Personalized Text-to-Image Methods Panos Achlioptas Alexandros Benetatos Iordanis Fostiropoulos Dimitris Skourtis 23 8 0 11 Dec 2023
GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific Narratives Zuyao Chen Jinlin Wu Zhen Lei Zhaoxiang Zhang Changwen Chen 22 2 0 07 Dec 2023
Language-Informed Visual Concept Learning Sharon Lee Yunzhi Zhang Shangzhe Wu Jiajun Wu CoGe 24 9 0 06 Dec 2023
Panoptic Video Scene Graph Generation Jingkang Yang Wen-Hsiao Peng Xiangtai Li Zujin Guo Liangyu Chen ... Zheng Ma Kaiyang Zhou Wayne Zhang Chen Change Loy Ziwei Liu VOS 58 42 0 28 Nov 2023
Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captions Zeyu Han Fangrui Zhu Qianru Lao Huaizu Jiang ObjD 27 11 0 28 Nov 2023
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge Bowen Jiang Zhijun Zhuang Shreyas S. Shivakumar Camillo J Taylor 31 6 0 21 Nov 2023
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention Zuyao Chen Jinlin Wu Zhen Lei Zhaoxiang Zhang Changwen Chen 25 11 0 18 Nov 2023
LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generation Kibum Kim Kanghoon Yoon Jaeyeong Jeon Yeonjun In Jinyoung Moon Donghyun Kim Chanyoung Park 31 14 0 16 Oct 2023
TextPSG: Panoptic Scene Graph Generation from Textual Descriptions Chengyang Zhao Yikang Shen Zhenfang Chen Mingyu Ding Chuang Gan 51 15 0 10 Oct 2023
Zero-Shot Scene Graph Generation via Triplet Calibration and Reduction Jiankai Li Yunhong Wang Weixin Li 28 2 0 07 Sep 2023
Contrastive Feature Masking Open-Vocabulary Vision Transformer Dahun Kim A. Angelova Weicheng Kuo ObjD VLM 23 27 0 02 Sep 2023
RLIPv2: Fast Scaling of Relational Language-Image Pre-training Hangjie Yuan Shiwei Zhang Xiang Wang Samuel Albanie Yining Pan Tao Feng Jianwen Jiang Dong Ni Yingya Zhang Deli Zhao VLM 21 38 0 18 Aug 2023
Environment-Invariant Curriculum Relation Learning for Fine-Grained Scene Graph Generation Yu Min Aming Wu Cheng Deng 27 6 0 07 Aug 2023
Open-Vocabulary Object Detection via Scene Graph Discovery Hengcan Shi Munawar Hayat Jianfei Cai ObjD 16 12 0 07 Jul 2023
LIC-GAN: Language Information Conditioned Graph Generative GAN Model Robert Lo Arnhav Datar Abishek Sridhar GAN 22 2 0 02 Jun 2023
Fine-Grained is Too Coarse: A Novel Data-Centric Approach for Efficient Scene Graph Generation Maelic Neau Paulo E. Santos Anne-Gwenn Bosser Cédric Buche 29 3 0 30 May 2023
FACTUAL: A Benchmark for Faithful and Consistent Textual Scene Graph Parsing Zhuang Li Yuyang Chai Terry Yue Zhuo Lizhen Qu Gholamreza Haffari Fei Li Donghong Ji Quan Hung Tran 31 23 0 27 May 2023
Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers Dahun Kim A. Angelova Weicheng Kuo ObjD ViT VLM 27 73 0 11 May 2023
Incremental 3D Semantic Scene Graph Prediction from RGB Sequences Shun-cheng Wu Keisuke Tateno Nassir Navab F. Tombari 3DPC 3DV 48 21 0 04 May 2023
Multimodal Graph Transformer for Multimodal Question Answering Xuehai He Xin Eric Wang 36 7 0 30 Apr 2023
Location-Free Scene Graph Generation Ege Ozsoy Felix Holm Tobias Czempiel Tobias Czempiel Benjamin Busam Nassir Navab Benjamin Busam 47 4 0 20 Mar 2023
Decomposed Prototype Learning for Few-Shot Scene Graph Generation Xingchen Li Long Chen Guikun Chen Yinfu Feng Yi Yang Jun Xiao 30 6 0 20 Mar 2023
Schema Inference for Interpretable Image Classification Haofei Zhang Mengqi Xue Xiaokang Liu Kaixuan Chen Jie Song Mingli Song OCL 47 3 0 12 Mar 2023
LANDMARK: Language-guided Representation Enhancement Framework for Scene Graph Generation Xiaoguang Chang Tenggou Wang Shaowei Cai Changyin Sun AI4TS 32 4 0 02 Mar 2023
SGRAM: Improving Scene Graph Parsing via Abstract Meaning Representation Woo Suk Choi Y. Heo Byoung-Tak Zhang GNN 29 3 0 17 Oct 2022
F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Models Weicheng Kuo Huayu Chen Xiuye Gu A. Piergiovanni A. Angelova MLLM VLM ObjD 49 134 0 30 Sep 2022
Scalable Regularization of Scene Graph Generation Models using Symbolic Theories Davide Buffelli Efthymia Tsamoura 22 2 0 06 Sep 2022
Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuning Tao He Lianli Gao Jingkuan Song Yuan-Fang Li VLM 25 50 0 17 Aug 2022
Rethinking the Evaluation of Unbiased Scene Graph Generation Xingchen Li Long Chen Jian Shao Shaoning Xiao Songyang Zhang Jun Xiao 42 12 0 03 Aug 2022
Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation Xingchen Li Long Chen Wenbo Ma Yi Yang Jun Xiao 15 26 0 03 Aug 2022
Panoptic Scene Graph Generation Jingkang Yang Yi Zhe Ang Zujin Guo Kaiyang Zhou Wayne Zhang Ziwei Liu 45 106 0 22 Jul 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 60 527 0 13 Jun 2022
Weakly-Supervised Action Detection Guided by Audio Narration Keren Ye Adriana Kovashka 30 0 0 12 May 2022
HL-Net: Heterophily Learning Network for Scene Graph Generation Xin Lin Changxing Ding Yibing Zhan Zijian Li Dacheng Tao 23 38 0 03 May 2022