Q-Diffusion: Quantizing Diffusion Models

8 February 2023

Zhen Dong

Shanghang Zhang

Papers citing "Q-Diffusion: Quantizing Diffusion Models"

50 / 109 papers shown

Title
Low-Bitwidth Floating Point Quantization for Efficient High-Quality Diffusion Models Cheng Chen Christina Giannoula Andreas Moshovos DiffM MQ 24 0 0 13 Aug 2024
Temporal Feature Matters: A Framework for Diffusion Model Quantization Yushi Huang Ruihao Gong Xianglong Liu Jing Liu Yuhang Li Jiwen Lu Dacheng Tao DiffM MQ 49 0 0 28 Jul 2024
SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow Yuanzhi Zhu Xingchao Liu Qiang Liu 46 9 0 17 Jul 2024
Timestep-Aware Correction for Quantized Diffusion Models Yuzhe Yao Feng Tian Jun Chen Haonan Lin Guang Dai Yong Liu Jingdong Wang DiffM MQ 46 5 0 04 Jul 2024
Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers Lei Chen Yuan Meng Chen Tang Xinzhu Ma Jingyan Jiang Xin Wang Zhi Wang Wenwu Zhu MQ 31 23 0 25 Jun 2024
Dreamitate: Real-World Visuomotor Policy Learning via Video Generation Junbang Liang Ruoshi Liu Ege Ozguroglu Sruthi Sudhakar Achal Dave P. Tokmakov Shuran Song Carl Vondrick VGen 42 23 0 24 Jun 2024
Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment Yiheng Li Heyang Jiang Akio Kodaira Masayoshi Tomizuka Kurt Keutzer Chenfeng Xu DiffM 44 7 0 18 Jun 2024
Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Models Alireza Ganjdanesh Reza Shirkavand Shangqian Gao Heng Huang DiffM VLM 56 4 0 17 Jun 2024
An Analysis on Quantizing Diffusion Transformers Yuewei Yang Jialiang Wang Xiaoliang Dai Peizhao Zhang Hongbo Zhang MQ 37 1 0 16 Jun 2024
Binarized Diffusion Model for Image Super-Resolution Zheng Chen Haotong Qin Yong Guo Xiongfei Su Xin Yuan Linghe Kong Yulun Zhang DiffM 34 9 0 09 Jun 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model Yang Sui Yanyu Li Anil Kag Yerlan Idelbayev Junli Cao Ju Hu Dhritiman Sagar Bo Yuan Sergey Tulyakov Jian Ren MQ 44 18 0 06 Jun 2024
ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation Tianchen Zhao Tongcheng Fang Haofeng Huang Enshu Liu Widyadewi Soedarmadji ... Shengen Yan Huazhong Yang Xuefei Ning Xuefei Ning Yu Wang MQ VGen 112 26 0 04 Jun 2024
Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching Xinyin Ma Gongfan Fang Michael Bi Mi Xinchao Wang 61 30 0 03 Jun 2024
A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategies Jinchao Zhu Yuxuan Wang Siyuan Pan Pengfei Wan Di Zhang Gao Huang 31 0 0 31 May 2024
MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization Tianchen Zhao Xuefei Ning Tongcheng Fang En-hao Liu Guyue Huang Zinan Lin Shengen Yan Guohao Dai Yu-Xiang Wang MQ DiffM 72 18 0 28 May 2024
PTQ4DiT: Post-training Quantization for Diffusion Transformers Junyi Wu Haoxuan Wang Yuzhang Shang Mubarak Shah Yan Yan MQ 33 19 0 25 May 2024
TerDiT: Ternary Diffusion Models with Transformers Xudong Lu Aojun Zhou Ziyi Lin Qi Liu Yuhui Xu Renrui Zhang Yafei Wen Shuai Ren Peng Gao Junchi Yan MQ 55 2 0 23 May 2024
FlexEControl: Flexible and Efficient Multimodal Control for Text-to-Image Generation Xuehai He Jian Zheng Jacob Zhiyuan Fang Robinson Piramuthu Mohit Bansal Vicente Ordonez Gunnar A. Sigurdsson Nanyun Peng Xin Eric Wang DiffM 53 1 0 08 May 2024
PTQ4SAM: Post-Training Quantization for Segment Anything Chengtao Lv Hong Chen Jinyang Guo Yifu Ding Xianglong Liu VLM MQ 31 13 0 06 May 2024
LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights Thibault Castells Hyoung-Kyu Song Bo-Kyeong Kim Shinkook Choi 34 21 0 18 Apr 2024
TMPQ-DM: Joint Timestep Reduction and Quantization Precision Selection for Efficient Diffusion Models Haojun Sun Chen Tang Zhi Wang Yuan Meng Jingyan Jiang Xinzhu Ma Wenwu Zhu MQ 39 5 0 15 Apr 2024
RefQSR: Reference-based Quantization for Image Super-Resolution Networks H. Lee Jun-Sang Yoo Seung-Won Jung SupR 18 2 0 02 Apr 2024
Condition-Aware Neural Network for Controlled Image Generation Han Cai Muyang Li Zhuoyang Zhang Qinsheng Zhang Ming-Yu Liu Song Han DiffM 30 8 0 01 Apr 2024
QNCD: Quantization Noise Correction for Diffusion Models Huanpeng Chu Wei Wu Chengjie Zang Kun Yuan DiffM MQ 41 4 0 28 Mar 2024
SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions Yuda Song Zehao Sun Xuanwu Yin VLM 46 16 0 25 Mar 2024
FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models Lin Zhao Tianchen Zhao Zinan Lin Xuefei Ning Guohao Dai Huazhong Yang Yu Wang EGVM 55 7 0 25 Mar 2024
SculptDiff: Learning Robotic Clay Sculpting from Humans with Goal Conditioned Diffusion Policy Alison Bartsch Arvind Car Charlotte Avra A. Farimani 46 5 0 15 Mar 2024
DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models Muyang Li Tianle Cai Jiaxin Cao Qinsheng Zhang Han Cai Junjie Bai Yangqing Jia Ming-Yu Liu Kai Li Song Han DiffM 37 41 0 29 Feb 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
T-Stitch: Accelerating Sampling in Pre-Trained Diffusion Models with Trajectory Stitching Zizheng Pan Bohan Zhuang De-An Huang Weili Nie Zhiding Yu Chaowei Xiao Jianfei Cai A. Anandkumar 36 17 0 21 Feb 2024
Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers Junhan Kim Kyungphil Park Chungman Lee Ho-Young Kim Joonyoung Kim Yongkweon Jeon MQ 28 2 0 14 Feb 2024
QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning Haoxuan Wang Yuzhang Shang Zhihang Yuan Junyi Wu Yan Yan DiffM MQ 11 28 0 06 Feb 2024
Enhanced Distribution Alignment for Post-Training Quantization of Diffusion Models Xuewen Liu Zhikai Li Junrui Xiao Qingyi Gu MQ 34 13 0 09 Jan 2024
Memory-Efficient Fine-Tuning for Quantized Diffusion Model Hyogon Ryu Seohyun Lim Hyunjung Shim DiffM MQ 27 6 0 09 Jan 2024
StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation Akio Kodaira Chenfeng Xu Toshiki Hazama Takanori Yoshimoto Kohei Ohno Shogo Mitsuhori Soichi Sugano Hanying Cho Zhijian Liu Kurt Keutzer 26 31 0 19 Dec 2023
Compensation Sampling for Improved Convergence in Diffusion Models Hui Lu A. A. Salah Ronald Poppe 43 1 0 11 Dec 2023
Offloading and Quality Control for AI Generated Content Services in 6G Mobile Edge Computing Networks Yi-Ting Wang Chang Liu Jun Zhao 13 1 0 11 Dec 2023
Efficient Quantization Strategies for Latent Diffusion Models Yuewei Yang Xiaoliang Dai Jialiang Wang Peizhao Zhang Hongbo Zhang DiffM MQ 24 13 0 09 Dec 2023
Approximate Caching for Efficiently Serving Diffusion Models Shubham Agarwal Subrata Mitra Sarthak Chakraborty Srikrishna Karanam Koyel Mukherjee S. Saini DiffM 33 4 0 07 Dec 2023
FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models Junhyuk So Jungwon Lee Eunhyeok Park DiffM 36 9 0 06 Dec 2023
Diffusion Noise Feature: Accurate and Fast Generated Image Detection Yichi Zhang Xiaogang Xu DiffM 23 12 0 05 Dec 2023
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey Tianyu Ding Tianyi Chen Haidong Zhu Jiachen Jiang Yiqi Zhong Jinxin Zhou Guangzhi Wang Zhihui Zhu Ilya Zharkov Luming Liang 29 22 0 01 Dec 2023
TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models Yushi Huang Ruihao Gong Jing Liu Tianlong Chen Xianglong Liu DiffM MQ 30 38 0 27 Nov 2023
Post-training Quantization for Text-to-Image Diffusion Models with Progressive Calibration and Activation Relaxing Siao Tang Xin Wang Hong Chen Chaoyu Guan Zewen Wu Yansong Tang Wenwu Zhu MQ 41 16 0 10 Nov 2023
Lightweight Diffusion Models with Distillation-Based Block Neural Architecture Search Siao Tang Xin Wang Hong Chen Chaoyu Guan Yansong Tang Wenwu Zhu 37 3 0 08 Nov 2023
Effective Quantization for Diffusion Models on CPUs Hanwen Chang Haihao Shen Yiyang Cai Xinyu. Ye Zhenzhong Xu Wenhua Cheng Kaokao Lv Weiwei Zhang Yintong Lu Heng Guo MQ 35 7 0 02 Nov 2023
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models Yefei He Jing Liu Weijia Wu Hong Zhou Bohan Zhuang DiffM MQ 24 47 0 05 Oct 2023
AdaDiff: Accelerating Diffusion Models through Step-Wise Adaptive Computation Shengkun Tang Yaqing Wang Maksim Dzhigil Yi Liang Heng Chang Dongkuan Xu 40 5 0 29 Sep 2023
Softmax Bias Correction for Quantized Generative Models N. Pandey Marios Fournarakis Chirag I. Patel Markus Nagel DiffM 25 11 0 04 Sep 2023
Diffusion Models for Image Restoration and Enhancement -- A Comprehensive Survey Xin Li Yulin Ren Xin Jin Cuiling Lan X. Wang Wenjun Zeng Xinchao Wang Zhibo Chen 43 86 0 18 Aug 2023