Introduction

This project is used to enable ToonCrafter to be used in ComfyUI.

You can use it to achieve generative keyframe animation(RTX 4090,26s)

https://github.com/AIGODLIKE/ComfyUI-ToonCrafter/assets/116185401/68edb789-5a8e-418f-ae35-e3cfe6ab1300

https://github.com/AIGODLIKE/ComfyUI-ToonCrafter/assets/116185401/86553c22-9395-4b0a-9d8d-0c29c7467bd3

And use it in Blender for animation rendering and prediction

Additionally, it can be used completely without a network

Installation

1. ComfyUI Custom Node

   cd ComfyUI/custom_nodes
   git clone https://github.com/AIGODLIKE/ComfyUI-ToonCrafter
   cd ComfyUI-ToonCrafter
   # install dependencies
   ..\..\..\python_embeded\python.exe -m pip install -r requirements.txt
   

2. Model Prepare

   • Download the weights:

     • 512 full weights High VRAM usage, fp16 reccomended

     • 512 fp16 weights

   • Put it in into ComfyUI-ToonCrafter\ToonCrafter\checkpoints\tooncrafter_512_interp_v1 for example 512x512.

3. Enjoy it!

Showcases

Blender

You can even use it directly in Blender!(ComfyUI-BlenderAI-node)

https://github.com/AIGODLIKE/ComfyUI-ToonCrafter/assets/116185401/ca8ec681-b5bc-40a1-b12a-ad185acff477

Input starting frame	Input ending frame	Generated video