Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferences

24 October 2024

Papers citing "Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferences"

50 / 90 papers shown

Title
ORIGEN: Zero-Shot 3D Orientation Grounding in Text-to-Image Generation Yunhong Min Daehyeon Choi Kyeongmin Yeo Jihyun Lee Minhyuk Sung 94 0 0 28 Mar 2025
WorldSimBench: Towards Video Generation Models as World Simulators Yiran Qin Zhelun Shi Jiwen Yu Xijun Wang Enshen Zhou ... Lu Sheng Jing Shao Junlin Wu Wanli Ouyang Ruimao Zhang EGVM VGen 187 444 0 23 Oct 2024
One-Step Diffusion Distillation through Score Implicit Matching Weijian Luo Zemin Huang Zhengyang Geng J. Zico Kolter Guo-Jun Qi DiffM 74 18 0 22 Oct 2024
Stable Audio Open Zach Evans Julian Parker CJ Carr Zack Zukowski Josiah Taylor Jordi Pons 179 52 0 19 Jul 2024
Integrating Amortized Inference with Diffusion Models for Learning Clean Distribution from Corrupted Images Yifei Wang Weimin Bai Weijian Luo Wenzheng Chen He Sun DiffM 43 9 0 15 Jul 2024
Consistency Models Made Easy Zhengyang Geng Ashwini Pokle William Luo Justin Lin J. Zico Kolter 85 31 0 20 Jun 2024
Multistep Distillation of Diffusion Models via Moment Matching Tim Salimans Thomas Mensink Jonathan Heek Emiel Hoogeboom DiffM 57 28 0 06 Jun 2024
Diffusion Models Are Innate One-Step Generators Bowen Zheng Tianming Yang DiffM VLM 49 12 0 31 May 2024
EM Distillation for One-step Diffusion Models Sirui Xie Zhisheng Xiao Diederik P. Kingma Tingbo Hou Ying Nian Wu Kevin Patrick Murphy Tim Salimans Ben Poole Ruiqi Gao VLM DiffM 64 28 0 27 May 2024
Improved Distribution Matching Distillation for Fast Image Synthesis Tianwei Yin Michael Gharbi Taesung Park Richard Zhang Eli Shechtman Frédo Durand William T. Freeman DiffM 98 117 0 23 May 2024
PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator Hanshu Yan Xingchao Liu Jiachun Pan Jun Hao Liew Qiang Liu Jiashi Feng 64 45 0 13 May 2024
Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis Yuxi Ren Xin Xia Yanzuo Lu Jiacheng Zhang Jie Wu Pan Xie Xing Wang Xuefeng Xiao 105 74 0 21 Apr 2024
Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation Mingyuan Zhou Huangjie Zheng Zhendong Wang Mingzhang Yin Hai Huang DiffM 75 64 0 05 Apr 2024
SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions Yuda Song Zehao Sun Xuanwu Yin VLM 70 17 0 25 Mar 2024
One-Step Image Translation with Text-to-Image Models Gaurav Parmar Taesung Park Srinivasa Narasimhan Jun-Yan Zhu 64 52 0 18 Mar 2024
Multistep Consistency Models Jonathan Heek Emiel Hoogeboom Tim Salimans 40 36 0 11 Mar 2024
SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation Hongjian Liu Qingsong Xie Zhijie Deng Chen Chen Shixiang Tang Fueyang Fu Zheng-Jun Zha H. Lu Zheng-jun Zha 75 7 0 03 Mar 2024
Trajectory Consistency Distillation: Improved Latent Consistency Distillation by Semi-Linear Consistency Function with Trajectory Mapping Jianbin Zheng Minghui Hu Zhongyi Fan Chaoyue Wang Changxing Ding Dacheng Tao Tat-Jen Cham 95 30 0 29 Feb 2024
KTO: Model Alignment as Prospect Theoretic Optimization Kawin Ethayarajh Winnie Xu Niklas Muennighoff Dan Jurafsky Douwe Kiela 252 533 0 02 Feb 2024
VideoPoet: A Large Language Model for Zero-Shot Video Generation Dan Kondratyuk Lijun Yu Xiuye Gu José Lezama Jonathan Huang ... Irfan Essa Huisheng Wang David A. Ross Bryan Seybold Lu Jiang VGen 90 259 0 21 Dec 2023
One-Step Diffusion Distillation via Deep Equilibrium Models Zhengyang Geng Ashwini Pokle Trevor Killeen 59 32 0 12 Dec 2023
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation Thuan Hoang Nguyen Anh Tran DiffM 44 64 0 08 Dec 2023
One-step Diffusion with Distribution Matching Distillation Tianwei Yin Michael Gharbi Richard Zhang Eli Shechtman Frédo Durand William T. Freeman Taesung Park DiffM 179 264 0 30 Nov 2023
Adversarial Diffusion Distillation Axel Sauer Dominik Lorenz A. Blattmann Robin Rombach 194 373 0 28 Nov 2023
Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model Kai Yang Jian Tao Jiafei Lyu Chunjiang Ge Jiaxin Chen Qimai Li Weihan Shen Xiaolong Zhu Xiu Li EGVM 55 103 0 22 Nov 2023
Diffusion Model Alignment Using Direct Preference Optimization Bram Wallace Meihua Dang Rafael Rafailov Linqi Zhou Aaron Lou Senthil Purushwalkam Stefano Ermon Caiming Xiong Shafiq Joty Nikhil Naik EGVM 111 266 0 21 Nov 2023
UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs Yanwu Xu Yang Zhao Zhisheng Xiao Tingbo Hou 158 116 0 14 Nov 2023
Fine-tuning Language Models for Factuality Katherine Tian Eric Mitchell Huaxiu Yao Christopher D. Manning Chelsea Finn KELM HILM SyDa 65 178 0 14 Nov 2023
Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness Boya Zhang Weijian Luo Zhihua Zhang 65 11 0 28 Oct 2023
Improved Techniques for Training Consistency Models Yang Song Prafulla Dhariwal 74 175 0 22 Oct 2023
Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference Simian Luo Yiqin Tan Longbo Huang Jian Li Hang Zhao DiffM 78 465 0 06 Oct 2023
Aligning Text-to-Image Diffusion Models with Reward Backpropagation Mihir Prabhudesai Anirudh Goyal Deepak Pathak Katerina Fragkiadaki 95 128 0 05 Oct 2023
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion Dongjun Kim Chieh-Hsin Lai Wei-Hsiang Liao Naoki Murata Yuhta Takida Toshimitsu Uesaka Yutong He Yuki Mitsufuji Stefano Ermon DiffM 76 192 0 01 Oct 2023
PixArt- $α$ : Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis Junsong Chen Jincheng Yu Chongjian Ge Lewei Yao Enze Xie ... Zhongdao Wang James T. Kwok Ping Luo Huchuan Lu Zhenguo Li DiffM 92 437 0 30 Sep 2023
Directly Fine-Tuning Diffusion Models on Differentiable Rewards Amita Gajewar Paul Vicol G. Bansal David J Fleet 60 170 0 29 Sep 2023
Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack Xiaoliang Dai Ji Hou Chih-Yao Ma Sam S. Tsai Jialiang Wang ... Roshan Sumbaly Vignesh Ramanathan Zijian He Peter Vajda Devi Parikh VLM 83 208 0 27 Sep 2023
InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation Xingchao Liu Xiwen Zhang Jianzhu Ma Jian Peng Qiang Liu 142 218 0 12 Sep 2023
SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Models Shuchen Xue Mingyang Yi Weijian Luo Shifeng Zhang Jiacheng Sun Zechao Li Zhi-Ming Ma DiffM 87 50 0 10 Sep 2023
Enhancing Adversarial Robustness via Score-Based Optimization Boya Zhang Weijian Luo Zhihua Zhang DiffM 66 13 0 10 Jul 2023
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis Dustin Podell Zion English Kyle Lacey A. Blattmann Tim Dockhorn Jonas Muller Joe Penna Robin Rombach 214 2,356 0 04 Jul 2023
Training Energy-Based Models with Diffusion Contrastive Divergences Weijian Luo Hao Jiang Tianyang Hu Jiacheng Sun Zechao Li Zhihua Zhang DiffM 72 8 0 04 Jul 2023
Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis Xiaoshi Wu Yiming Hao Keqiang Sun Yixiong Chen Feng Zhu Rui Zhao Hongsheng Li 83 289 0 15 Jun 2023
BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping Jiatao Gu Shuangfei Zhai Yizhe Zhang Lingjie Liu J. Susskind DiffM 53 74 0 08 Jun 2023
Entropy-based Training Methods for Scalable Neural Implicit Sampler Weijian Luo Boya Zhang Zhihua Zhang 54 11 0 08 Jun 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 382 3,942 0 29 May 2023
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models Weijian Luo Tianyang Hu Shifeng Zhang Jiacheng Sun Zhenguo Li Zhihua Zhang 68 129 0 29 May 2023
Training Diffusion Models with Reinforcement Learning Kevin Black Michael Janner Yilun Du Ilya Kostrikov Sergey Levine EGVM 98 361 0 22 May 2023
Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation Yuval Kirstain Adam Polyak Uriel Singer Shahbuland Matiana Joe Penna Omer Levy EGVM 208 396 0 02 May 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 529 4,725 0 17 Apr 2023
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo DiffM MedIm 92 34 0 09 Apr 2023