Recent changes
- [2024-07-17] 新增支持IPAdapter_plus的加载器和高级应用节点MZ_IPAdapterModelLoaderKolors,MZ_IPAdapterAdvancedKolors
- [2024-07-14] 删除自动兼容ControlNet, 新增MZ_KolorsControlNetPatch节点
ComfyUI上Kolors的实现
参考自 https://github.com/kijai/ComfyUI-KwaiKolorsWrapper
使用ComfyUI原生采样
工作流在examples/workflow.png中获取
unet模型放置在 models/unet/ 文件夹下 下载地址: https://huggingface.co/Kwai-Kolors/Kolors/blob/main/unet/diffusion_pytorch_model.fp16.safetensors
chatglm3放置在 models/LLM/ 文件夹下 下载地址: https://huggingface.co/Kijai/ChatGLM3-safetensors/blob/main/chatglm3-fp16.safetensors
官方IP-Adapter-Plus模型下载地址
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_genernal.bin 下载至 models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/blob/main/image_encoder/pytorch_model.bin 下载至 models/clip_vision/
Implementation of Kolors on ComfyUI
Reference from https://github.com/kijai/ComfyUI-KwaiKolorsWrapper
Using ComfyUI Native Sampling
The workflow is obtained in examples/workflow.png
The unet model is placed in the models/unet/ folder Download link: https://huggingface.co/Kwai-Kolors/Kolors/blob/main/unet/diffusion_pytorch_model.fp16.safetensors
The chatglm3 is placed in the models/LLM/ folder Download link: https://huggingface.co/Kijai/ChatGLM3-safetensors/tree/main
Official IP-Adapter-Plus model download link
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_genernal.bin Download to models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/blob/main/image_encoder/pytorch_model.bin Download to models/clip_vision/
FAQ
name 'round_up' is not defined
- 参考:https://github.com/THUDM/ChatGLM2-6B/issues/272#issuecomment-1632164243 , 使用 pip install cpm_kernels 或者 pip install -U cpm_kernels 更新 cpm_kernels
module 'comfy.model_detection' has no attribute 'unet_prefix_from_state_dict'
- 更新ComfyUI本体到最新版本
RuntimeError: Only Tensors of floating point dtype can require gradients
- 尝试使用fp16版本的模型: https://huggingface.co/Kijai/ChatGLM3-safetensors/blob/main/chatglm3-fp16.safetensors
Error occurred when executing MZ_ChatGLM3Loader: 'ChatGLMModel' object has no attribute 'transformer'
- 检查ChatGLM3Loader节点选择的模型是否已经正确下载
Credits
Star History
Contact
- 绿泡泡: minrszone
- Bilibili: minus_zone
- 小红书: MinusZoneAI