Visual Prompting via Image Inpainting

1 September 2022

Papers citing "Visual Prompting via Image Inpainting"

50 / 166 papers shown

Title
GPT Sonograpy: Hand Gesture Decoding from Forearm Ultrasound Images via VLM Keshav Bimbraw Ye Wang Jing Liu T. Koike-Akino VLM MedIm LM&MA 85 3 0 15 Jul 2024
Visual Prompt Selection for In-Context Learning Segmentation Wei Suo Lanqing Lai Mengyang Sun Hanwang Zhang Peng Wang Yanning Zhang VLM 103 3 0 14 Jul 2024
DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understanding Jincen Jiang Qianyu Zhou Yuhang Li Xuequan Lu Meili Wang Lizhuang Ma Jian Chang Jian Jun Zhang OOD 109 13 0 11 Jul 2024
Video In-context Learning: Autoregressive Transformers are Zero-Shot Video Imitators Wentao Zhang Junliang Guo Tianyu He Li Zhao Linli Xu Jiang Bian 126 4 0 10 Jul 2024
Toward a Diffusion-Based Generalist for Dense Vision Tasks Yue Fan Yongqin Xian Xiaohua Zhai Alexander Kolesnikov Muhammad Ferjad Naeem Bernt Schiele Federico Tombari VLM MDE DiffM 69 1 0 29 Jun 2024
OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding Tao Zhang Xiangtai Li Hao Fei Haobo Yuan Shengqiong Wu Shunping Ji Chen Change Loy Shuicheng Yan LRM MLLM VLM 153 63 0 27 Jun 2024
ConStyle v2: A Strong Prompter for All-in-One Image Restoration Dongqi Fan Junhao Zhang Liang Chang VLM 92 2 0 26 Jun 2024
In-Context Symmetries: Self-Supervised Learning through Contextual World Models Sharut Gupta Chenyu Wang Yifei Wang Tommi Jaakkola Stefanie Jegelka 76 3 0 28 May 2024
ARC: A Generalist Graph Anomaly Detector with In-Context Learning Yixin Liu Shiyuan Li Yu Zheng Qingfeng Chen Chengqi Zhang Shirui Pan 90 14 0 27 May 2024
Unsupervised Meta-Learning via In-Context Learning Anna Vettoruzzo Lorenzo Braccaioli Joaquin Vanschoren M. Nowaczyk SSL 137 1 0 25 May 2024
Towards Global Optimal Visual In-Context Learning Prompt Selection Chengming Xu Chen Liu Yikai Wang Yanwei Fu 40 5 0 24 May 2024
Are You Copying My Prompt? Protecting the Copyright of Vision Prompt for VPaaS via Watermark Huali Ren Anli Yan Chong-zhi Gao Hongyang Yan Zhenxin Zhang Jin Li VLM AAML 77 4 0 24 May 2024
Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning Guanglin Zhou Zhongyi Han Shiming Chen Erdun Gao Liming Zhu Salman Khan Xin Gao Lina Yao VLM 107 4 0 20 May 2024
Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers Shengyuan Yang Jiawang Bai Kuofeng Gao Yong-Liang Yang Yiming Li Shu-Tao Xia AAML SILM 122 5 0 17 May 2024
Analogist: Out-of-the-box Visual In-Context Learning with Image Diffusion Model Zheng Gu Shiyuan Yang Jing Liao Jing Huo Yang Gao VLM DiffM 85 8 0 16 May 2024
DocRes: A Generalist Model Toward Unifying Document Image Restoration Tasks Jiaxin Zhang Dezhi Peng Chongyu Liu Peirong Zhang Lianwen Jin VLM 85 13 0 07 May 2024
Customizing Text-to-Image Models with a Single Image Pair Maxwell Jones Sheng-Yu Wang Nupur Kumari David Bau Jun-Yan Zhu DiffM 107 21 0 02 May 2024
DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models Jieru Lin Danqing Huang Tiejun Zhao Dechen Zhan Chin-Yew Lin VLM MLLM 72 3 0 23 Apr 2024
In-Context Translation: Towards Unifying Image Recognition, Processing, and Generation Han Xue Qianru Sun Li Song Wenjun Zhang Zhiwu Huang MLLM 77 0 0 15 Apr 2024
PM2: A New Prompting Multi-modal Model Paradigm for Few-shot Medical Image Classification Zhenwei Wang Qiule Sun Bingbing Zhang Pengfei Wang Jianxin Zhang Qiang Zhang VLM 101 1 0 13 Apr 2024
Finding Visual Task Vectors Alberto Hojel Yutong Bai Trevor Darrell Amir Globerson Amir Bar 124 8 0 08 Apr 2024
Many-to-many Image Generation with Auto-regressive Diffusion Models Ying Shen Yizhe Zhang Shuangfei Zhai Lifu Huang J. Susskind Jiatao Gu 138 6 0 03 Apr 2024
Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction Keyu Tian Yi Jiang Zehuan Yuan Bingyue Peng Liwei Wang VGen 145 351 0 03 Apr 2024
Roadside Monocular 3D Detection Prompted by 2D Detection Yechi Ma Shuoquan Wei Churun Zhang Wei Hua 99 0 0 01 Apr 2024
InstructBrush: Learning Attention-based Instruction Optimization for Image Editing Ruoyu Zhao Qingnan Fan Fei Kou Shuai Qin Hong Gu Wei Wu Pengcheng Xu Mingrui Zhu Nannan Wang Xinbo Gao 75 4 0 27 Mar 2024
Middle Fusion and Multi-Stage, Multi-Form Prompts for Robust RGB-T Tracking Qiming Wang Yongqiang Bai Hongxing Song 90 7 0 27 Mar 2024
In-Context Matting He Guo Zixuan Ye Zhiguo Cao Hao Lu VOS 68 0 0 23 Mar 2024
Few-Shot Adversarial Prompt Learning on Vision-Language Models Yiwei Zhou Xiaobo Xia Zhiwei Lin Bo Han Tongliang Liu VLM 106 16 0 21 Mar 2024
VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning Yongshuo Zong Ondrej Bohdal Timothy M. Hospedales 102 7 0 19 Mar 2024
OSTAF: A One-Shot Tuning Method for Improved Attribute-Focused T2I Personalization Ye Wang Zili Yi Rui Ma DiffM 76 0 0 17 Mar 2024
Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity Zhuo Zhi Ziquan Liu M. Elbadawi Adam Daneshmend Mine Orlu Abdul Basit Andreas Demosthenous Miguel R. D. Rodrigues 92 2 0 14 Mar 2024
Explore In-Context Segmentation via Latent Diffusion Models Chaoyang Wang Xiangtai Li Henghui Ding Lu Qi Jiangning Zhang Yunhai Tong Chen Change Loy Shuicheng Yan DiffM 160 7 0 14 Mar 2024
Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Prompts Jiawen Zhu Guansong Pang VLM 103 40 0 11 Mar 2024
InstructGIE: Towards Generalizable Image Editing Zichong Meng Changdi Yang Jun Liu Hao Tang Pu Zhao Yanzhi Wang DiffM 112 9 0 08 Mar 2024
Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training David Wan Jaemin Cho Elias Stengel-Eskin Mohit Bansal VLM ObjD 125 37 0 04 Mar 2024
Grounding Language Models for Visual Entity Recognition Zilin Xiao Ming Gong Paola Cascante-Bonilla Xingyao Zhang Jie Wu Vicente Ordonez VLM 102 10 0 28 Feb 2024
VRP-SAM: SAM with Visual Reference Prompt Yanpeng Sun Jiahui Chen Shan Zhang Xinyu Zhang Qiang Chen Gang Zhang Errui Ding Jingdong Wang Zechao Li 137 39 0 27 Feb 2024
Video as the New Language for Real-World Decision Making Sherry Yang Jacob Walker Jack Parker-Holder Yilun Du Jake Bruce Andre Barreto Pieter Abbeel Dale Schuurmans VGen 129 57 0 27 Feb 2024
A Simple Framework Uniting Visual In-context Learning with Masked Image Modeling to Improve Ultrasound Segmentation Yuyue Zhou B. Felfeliyan Shrimanti Ghosh Jessica Knight Fatima Alves-Pereira Christopher Keen Jessica Küpper A. Hareendranathan Jacob L. Jaremko 88 0 0 22 Feb 2024
Tumor segmentation on whole slide images: training or prompting? Huaqian Wu C. B. Martin Kevin Bouaou Cédric Clouchoux VLM MedIm 47 2 0 21 Feb 2024
Data-efficient Large Vision Models through Sequential Autoregression Jianyuan Guo Zhiwei Hao Chengcheng Wang Yehui Tang Han Wu Han Hu Kai Han Chang Xu VLM 112 10 0 07 Feb 2024
Can MLLMs Perform Text-to-Image In-Context Learning? Yuchen Zeng Wonjun Kang Yicong Chen Hyung Il Koo Kangwook Lee MLLM 100 11 0 02 Feb 2024
OMG-Seg: Is One Model Good Enough For All Segmentation? Xiangtai Li Haobo Yuan Wei Li Henghui Ding Size Wu Wenwei Zhang Yining Li Kai Chen Chen Change Loy VLM MLLM ViT 150 64 0 18 Jan 2024
A Simple Latent Diffusion Approach for Panoptic Segmentation and Mask Inpainting Wouter Van Gansbeke Bert De Brabandere DiffM 132 11 0 18 Jan 2024
Edit One for All: Interactive Batch Image Editing Thao Nguyen Utkarsh Ojha Yuheng Li Haotian Liu Yong Jae Lee DiffM 106 3 0 18 Jan 2024
Low-Resource Vision Challenges for Foundation Models Yunhua Zhang Hazel Doughty Cees G. M. Snoek VLM 100 8 0 09 Jan 2024
Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactively Haobo Yuan Xiangtai Li Chong Zhou Yining Li Kai Chen Chen Change Loy VLM 130 51 0 05 Jan 2024
3DAxiesPrompts: Unleashing the 3D Spatial Task Capabilities of GPT-4V Dingning Liu Xiaomeng Dong Renrui Zhang Xu Luo Peng Gao Xiaoshui Huang Yongshun Gong Zhihui Wang 92 11 0 15 Dec 2023
Adaptive Human Trajectory Prediction via Latent Corridors Neerja Thakkar K. Mangalam Andrea V. Bajcsy Jitendra Malik 88 5 0 11 Dec 2023
4M: Massively Multimodal Masked Modeling David Mizrahi Roman Bachmann Ouguzhan Fatih Kar Teresa Yeo Mingfei Gao Afshin Dehghan Amir Zamir MLLM 99 75 0 11 Dec 2023