shiimizu-ComfyUI-PhotoMaker-Plus/README.md

ComfyUI PhotoMaker Plus

ComfyUI implementation for PhotoMaker.

PhotoMaker implementation that follows the ComfyUI way of doing things. The code is memory efficient, fast, and shouldn't break with Comfy updates.

Example workflow that you can load in ComfyUI.

Installation

1. Install ComfyUI.
2. Clone this repo into custom_nodes by running the following commands in a terminal:

   cd ComfyUI/custom_nodes
   git clone https://github.com/shiimizu/ComfyUI-PhotoMaker-Plus.git
   

Download the model from huggingface and place it in a photomaker folder in your models folder such as ComfyUI/models/photomaker.

Features of this Plus version

• Better face resemblance by using CLIPImageProcessor like in the original code.
• Automatic PhotoMaker LoRA detection and loading in the LoraLoader nodes.
• Customizable trigger_word token
• Allows multiple trigger_word tokens in the prompt
• Extra nodes such as PhotoMakerStyles and PrepImagesForClipVisionFromPath

Important news

2024-01-24

• Official support for PhotoMaker landed in ComfyUI. Therefore, this repo's name has been changed. The PhotoMakerEncode node is also now PhotoMakerEncodePlus.

2024-01-21

• Due to various node updates and changes, you may have to recreate the node.
• Removed ref_images_path input. Added a PrepImagesForClipVisionFromPath node.

2024-01-18

• No need to manually extract the LoRA that's inside the model anymore.

Citation

@article{li2023photomaker,
  title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
  author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
  booktitle={arXiv preprint arxiv:2312.04461},
  year={2023}
}