Visual Prompting via Image Inpainting

Neural Information Processing Systems (NeurIPS), 2022

1 September 2022

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Visual Prompting via Image Inpainting"

30 / 180 papers shown

Title
Fine-Grained Visual PromptingNeural Information Processing Systems (NeurIPS), 2023 Lingfeng Yang Yueze Wang Xiang Li Xinlong Wang Jian Yang ObjD VLM 157 87 0 07 Jun 2023
Towards In-context Scene UnderstandingNeural Information Processing Systems (NeurIPS), 2023 Ivana Balazevic David Steiner Nikhil Parthasarathy Relja Arandjelović Olivier J. Hénaff 172 42 0 02 Jun 2023
StyleGAN knows Normal, Depth, Albedo, and MoreNeural Information Processing Systems (NeurIPS), 2023 Anand Bhattad Daniel McKee Derek Hoiem David A. Forsyth GAN 123 45 0 01 Jun 2023
Explicit Visual Prompting for Universal Foreground SegmentationsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Weihuang Liu Xi Shen Chi-Man Pun Xiaodong Cun VPVLM VLM 137 20 0 29 May 2023
Im-Promptu: In-Context Composition from Image PromptsNeural Information Processing Systems (NeurIPS), 2023 Bhishma Dedhia Michael Chang Jake C. Snell Thomas Griffiths N. Jha LRM MLLM 221 3 0 26 May 2023
VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric TasksNeural Information Processing Systems (NeurIPS), 2023 Wen Wang Zhe Chen Xiaokang Chen Jiannan Wu Xizhou Zhu ... Ping Luo Tong Lu Jie Zhou Yu Qiao Jifeng Dai MLLM VLM 210 589 0 18 May 2023
UniControl: A Unified Diffusion Model for Controllable Visual Generation In the WildNeural Information Processing Systems (NeurIPS), 2023 Can Qin Shu Zhen Zhang Ning Yu Yihao Feng Xinyi Yang ... Caiming Xiong Silvio Savarese Stefano Ermon Yun Fu Ran Xu 241 181 0 18 May 2023
Personalize Segment Anything Model with One ShotInternational Conference on Learning Representations (ICLR), 2023 Renrui Zhang Zhengkai Jiang Ziyu Guo Shilin Yan Junting Pan Xianzheng Ma Hao Dong Shiyang Feng Hongsheng Li MLLM VLM 210 267 0 04 May 2023
In-Context Learning Unlocked for Diffusion ModelsNeural Information Processing Systems (NeurIPS), 2023 Zhendong Wang Lezhi Li Yadong Lu Yelong Shen Pengcheng He Weizhu Chen Zhangyang Wang Mingyuan Zhou VLM DiffM 241 92 0 01 May 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 198 18 0 29 Apr 2023
Putting People in Their Place: Affordance-Aware Human Insertion into ScenesComputer Vision and Pattern Recognition (CVPR), 2023 Sumith Kulal Tim Brooks A. Aiken Jiajun Wu Jimei Yang Jingwan Lu Alexei A. Efros Krishna Kumar Singh DiffM 144 56 0 27 Apr 2023
Analogy-Forming Transformers for Few-Shot 3D ParsingInternational Conference on Learning Representations (ICLR), 2023 N. Gkanatsios M. Singh Zhaoyuan Fang Shubham Tulsiani Katerina Fragkiadaki 3DPC 3DV 176 2 0 27 Apr 2023
Segment Anything in Non-Euclidean Domains: Challenges and Opportunities Yongcheng Jing Xinchao Wang Dacheng Tao 149 22 0 23 Apr 2023
What does CLIP know about a red circle? Visual prompt engineering for VLMsIEEE International Conference on Computer Vision (ICCV), 2023 Aleksandar Shtedritski Christian Rupprecht Andrea Vedaldi VLM MLLM 281 209 0 13 Apr 2023
Exploring Effective Factors for Improving Visual In-Context LearningIEEE Transactions on Image Processing (IEEE TIP), 2023 Yanpeng Sun Qiang Chen Xiaofan Li Jian Wang Jingdong Wang Zechao Li VLM LRM 138 39 0 10 Apr 2023
SegGPT: Segmenting Everything In Context Xinlong Wang Xiaosong Zhang Yue Cao Wen Wang Chunhua Shen Tiejun Huang VOS MLLM VLM 136 235 0 06 Apr 2023
Text-to-Image Diffusion Models are Zero-Shot ClassifiersNeural Information Processing Systems (NeurIPS), 2023 Kevin Clark P. Jaini DiffM VLM 224 144 0 27 Mar 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer LearningComputer Vision and Pattern Recognition (CVPR), 2023 Changdae Oh Hyeji Hwang Hee-young Lee Yongtaek Lim Geunyoung Jung Jiyoung Jung Hosik Choi Kyungwoo Song VLM VPVLM 243 72 0 26 Mar 2023
Exploring the Benefits of Visual Prompting in Differential PrivacyIEEE International Conference on Computer Vision (ICCV), 2023 Yizhe Li Yu-Lin Tsai Xuebin Ren Chia-Mu Yu Pin-Yu Chen AAML VPVLM 186 22 0 22 Mar 2023
Explicit Visual Prompting for Low-Level Structure SegmentationsComputer Vision and Pattern Recognition (CVPR), 2023 Weihuang Liu Xi Shen Chi-Man Pun Xiaodong Cun VPVLM VLM 173 184 0 20 Mar 2023
Dual-path Adaptation from Image to Video TransformersComputer Vision and Pattern Recognition (CVPR), 2023 Jungin Park Jiyoung Lee Kwanghoon Sohn ViT 150 54 0 17 Mar 2023
Dynamic Prompting: A Unified Framework for Prompt Tuning Xianjun Yang Wei Cheng Xujiang Zhao Wenchao Yu Linda R. Petzold Haifeng Chen VLM 202 18 0 06 Mar 2023
What Makes Good Examples for Visual In-Context Learning?Neural Information Processing Systems (NeurIPS), 2023 Yuanhan Zhang Kaiyang Zhou Ziwei Liu MLLM VPVLM VLM LRM 186 150 0 31 Jan 2023
A Survey on In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 336 771 0 31 Dec 2022
Understanding Zero-Shot Adversarial Robustness for Large-Scale ModelsInternational Conference on Learning Representations (ICLR), 2022 Chengzhi Mao Scott Geng Junfeng Yang Xin Eric Wang Carl Vondrick VLM 192 100 0 14 Dec 2022
Doubly Right Object Recognition: A Why Prompt for Visual RationalesComputer Vision and Pattern Recognition (CVPR), 2022 Chengzhi Mao Revant Teotia Amrutha Sundar Sachit Menon Junfeng Yang Xin Eric Wang Carl Vondrick 169 34 0 12 Dec 2022
Images Speak in Images: A Generalist Painter for In-Context Visual LearningComputer Vision and Pattern Recognition (CVPR), 2022 Xinlong Wang Wen Wang Yue Cao Chunhua Shen Tiejun Huang VLM MLLM 236 314 0 05 Dec 2022
Multitask Vision-Language Prompt TuningIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022 Sheng Shen Shijia Yang Tianjun Zhang Bohan Zhai Joseph E. Gonzalez Kurt Keutzer Trevor Darrell VLM VPVLM 236 71 0 21 Nov 2022
Understanding and Improving Visual Prompting: A Label-Mapping PerspectiveComputer Vision and Pattern Recognition (CVPR), 2022 Aochuan Chen Yuguang Yao Pin-Yu Chen Yihua Zhang Sijia Liu VPVLM VLM 344 95 0 21 Nov 2022
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 853 4,537 0 17 Jun 2020