diff --git a/README.md b/README.md index 37d39f4..1341bab 100644 --- a/README.md +++ b/README.md @@ -3,10 +3,19 @@ A HiDiffusion node for ComfyUI Update ----- -2025-05-15 update -add XL-lighting\Hyper\LCM Unet model support, it's working,but get bad result. LCM is only valid in text2img node，Lightning and Hyper require selecting an XL large model to take effect -增加了lighting、Hyper、LCM的Unet模型支持，但是效果真一般，就当玩玩吧。LCM只在文生图有效。 闪电和Hyper需要选XL大模型才生效 +2025-05-21 update +--增加了对anyline（基于mistuline模型）和controlnet 线稿类的canny支持，增加了openposeXL模型的支持（须搭配controlnet openpose） +--增加了模型输入节点，该节点的菜单用于已下载的本地模型，repo_id更方便，但需要网络支持 +--所有节点都支持XL-lighting\Hyper\LCM Unet加速，但是低步数的效果一般 +--Added Canny support for Anyline (based on the pipeline model) and Controlnet draft classes, and added support for Openpose XL model (to be paired with Controlnet Openpose) +--Added a model input node, whose menu is used for downloaded local models. Repo_id is more convenient, but requires network support +--All nodes support XL lighting \ Hyper \ LCM Unet acceleration, but the effect of low steps is average + + +NOTICE +---- +注意，如果使用本地下载的模型，注意要配套config文件，以及有些模型是需要bin模型，或者模型名称要一样，注意看报错信息提示缺失什么模型。 使用openpose的大模型会预下载VAE模型，无梯子的注意这里会报错。 HiDiffusion From: [link](https://github.com/megvii-research/HiDiffusion) ---- @@ -27,13 +36,14 @@ need diffusers >=0.27.0 3 Download the model ---- - 3种调用模型的方法 + 3种调用模型节点的方法 一种是,在repo_id填写诸如"stabilityai/stable-diffusion-xl-base-1.0" 这样的id,系统自己下载或者查找.cache路径，这个要开全局外网或者你开启了hf镜像 一种是，把你下载好的模型放在comfyUI的"models/diffusers"路径下，记得不要改最尾的模型路径名“比如stable-diffusion-xl-base-1.0”，就可以用菜单直接调用。（注意：要用菜单的方式，必须删掉repo_id默认的"stabilityai/stable-diffusion-xl-base-1.0"，让repo_id留空，controlnet_id一样，要调用菜单，必须留空controlnet_id） 一种是，你在repo_id或controlnet_id直接填写诸如“x:/xx/xx/stabilityai/stable-diffusion-xl-base-1.0” 这样的绝对路径也能用 - + + Three methods for calling model nodes Filling in the corresponding repo_id will download the model or in the diffuse directory, store and use the downloaded model （Notice:in this method,repo_id or controlnet_repo_id must be empty） @@ -47,13 +57,23 @@ Supported models can refer to the comments in the example JSON file 5 example ----- -![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example%20text2img0.png) +use openpose XL model +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/openposeXL.png) -![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example%20img2img.png) -![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example%20text2img.png) +use canny XL model or mistoline（anyline） +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/example%20anyline.png) +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/example%20artline.png) +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/example%20canny.png) +use inpainting XL model +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/inpainting.png) + +txt2img use XL/sd1.5/XL turbo/background... +![](https://github.com/smthemex/ComfyUI_HiDiffusion_Pro/blob/main/example/txt2img.png) + + 6 Citation ------