The code is mostly taken from the original IPAdapter repository and laksjdjf's implementation, all credit goes to them. I just made the extension closer to ComfyUI philosophy.

Example workflow

Installation

Download or git clone this repository inside ComfyUI/custom_nodes/ directory.

The pre-trained models are available on huggingface, download and place them in the ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus/models directory.

For SD1.5 you need:

For SDXL you need:

ip-adapter_sdxl.bin

Additionally you need the clip vision models:

SD 1.5: pytorch_model.bin
SDXL: pytorch_model.bin

You can rename them to something easier to remember (eg: ip-adapter_sd15-image-encoder.bin) and place them under ComfyUI/models/clip_vision/.

How to use

There are two workflows included in this repo.

IMPORTANT: To use the IPAdapter Plus model you must use the new CLIP Vision Encode (IPAdapter) node (the workflow is Plus_workflow.json). The non-plus version works with both the standard CLIP Vision Encode and the new one.