🪶 MagicQuill: An Intelligent Interactive Image Editing System

https://github.com/user-attachments/assets/8ee9663a-fef2-484a-a0b7-8427ab590424

There is an HD video on Youtube.

Zichen Liu^*,1,2, Yue Yu^*,1,2, Hao Ouyang², Qiuyu Wang², Ka Leong Cheng^1,2, Wen Wang^3,2, Zhiheng Liu⁴, Qifeng Chen^†,1, Yujun Shen^†,2
¹HKUST ²Ant Group ³ZJU ⁴HKU ^*equal contribution ^†corresponding author

TLDR: MagicQuill is an intelligent and interactive system achieving precise image editing.

Key Features: 😎 User-friendly interface / 🤖 AI-powered suggestions / 🎨 Precise local editing

MagicQuill ComfyUI Custom Node

MagicQuill is now available in ComfyUI!!!

Setup

Follow the following guide to install the custom node. The ComfyUI workflow is available at MagicQuill.json

clone the repo (comfyui branch) in the custom_nodes directory

git clone -b comfyui https://github.com/magic-quill/MagicQuill.git ComfyUI_MagicQuill
cd ComfyUI_MagicQuill

download and unzip checkpoints
```
wget -O models.zip "https://hkustconnect-my.sharepoint.com/:u:/g/personal/zliucz_connect_ust_hk/EWlGF0WfawJIrJ1Hn85_-3gB0MtwImAnYeWXuleVQcukMg?e=Gcjugg&download=1"
unzip models.zip
```
If the .zip file is not accessible, download it via browser. All checkpoints are about 25 GB in total. It may take some time to download. Alternatively, check our checkpoints at huggingface. Please merge the models folder with the ComfyUI/models.

install the environment

python install.py
pip install -r requirements.txt

Citation

Don't forget to cite this source if it proves useful in your research!

@article{liu2024magicquill, 
	title={MagicQuill: An Intelligent Interactive Image Editing System}, 
	author={Zichen Liu and Yue Yu and Hao Ouyang and Qiuyu Wang and Ka Leong Cheng and Wen Wang and Zhiheng Liu and Qifeng Chen and Yujun Shen}, 
	year={2024}, 
	eprint={2411.09703}, 
	archivePrefix={arXiv}, 
	primaryClass={cs.CV}}

Acknowledgement

Our implementation is based on

Thanks for their remarkable contribution and released code!

Note

Note: This repo is governed by the license of CC BY-NC 4.0 We strongly advise users not to knowingly generate or allow others to knowingly generate harmful content, including hate speech, violence, pornography, deception, etc.

(注：本仓库受CC BY-NC的许可协议限制。我们强烈建议，用户不应传播及不应允许他人传播以下内容，包括但不限于仇恨言论、暴力、色情、欺诈相关的有害信息。)

4.0 KiB Raw Blame History