67 lines
3.3 KiB
Markdown
67 lines
3.3 KiB
Markdown
# ComfyUI-FunPack
|
|
A set of custom nodes designed for experiments with video diffusion models.
|
|
EXPERIMENTAL, and I mean it. Constantly updating, changing, adding and removing, just for sake of making something work.
|
|
You have been warned.
|
|
|
|
**FunPack Prompt Enhancer (Standalone)**
|
|
|
|
|
|
|
|
Inputs:
|
|
- Prompt - here you add your prompt to be enhanced;
|
|
- System prompt - here you pass an instruction on how your LLM should interpret the given prompt. Basic system prompt works fine but you can change it however you like;
|
|
- Model path type - choose if you want to load a local .safetensors file from ComfyUI/models/clip or load a HuggingFace pretrained model;
|
|
- Model path - path for a model on HuggingFace;
|
|
- LLM safetensors path - selector for a local model;
|
|
- top_p, top_k, temperature, max_new_tokens - these parameters are responsible for your "enhanced prompt" being creative or strict, short or long. Better watch some video to know how it works.
|
|
For the regular system prompt these settings work really well. If you are not aiming at "extremely creative" or "strictly short" prompts - I won't recommend changing it.
|
|
|
|
Please notice: after changing a prompt, it's better to call model unloading in Comfy. Believe me.
|
|
Also if you have 24GB of VRAM or less, you might go OOM in Comfy - that's expected, just run the sequence again and it will use cached enhanced prompt.
|
|
|
|
Technically speaking, it's possible to load just any model as text encoder.
|
|
|
|
Outputs:
|
|
Just text. Pass it to any node that accepts text as input.
|
|
|
|
**FunPack img2latent Interpolation**
|
|
|
|
|
|
|
|
|
|
Inputs:
|
|
- images - a batch of images e.g. from Load Image, Load Video (Upload), Load Video (Path) et cetera.
|
|
- frame_count - same as frame count in HunyuanVideoEmptyLatent or similar. Actually, works better with WAN.
|
|
|
|
Outputs:
|
|
- img_batch_for_encode - latent output with interpolated image, resize if needed and put it into VAE Encode, pass as latent_image into your sampler;
|
|
- img_for_start_images - takes exactly the last image from the batch. You can pass it to your CLIP Vision and encoders as start_image. Or end_image. Who am I to tell you.
|
|
|
|
FunPackCLIPLoader node is currently in development and seems like not functioning at all. Please don't use it until otherwise is stated.
|
|
|
|
|
|
**FunPack Video Stitch**
|
|
|
|
<img width="288" height="242" alt="{F4541DBC-58EC-41BD-BF5B-99E5AC1EF072}" src="https://github.com/user-attachments/assets/c1ce3b61-c7ea-40bc-b5c9-13153cb587cb" />
|
|
|
|
|
|
Inputs:
|
|
- images - connect up to 8 image batches
|
|
- blend_frames - amount of frames to blend between batches, takes this many frames from the end of first video to blend with this many frames from the beginning of the next video.
|
|
|
|
Outputs:
|
|
- stitched - an image batch containing stitched image batches with cross-section blending.
|
|
|
|
|
|
**FunPack Continue Video**
|
|
|
|
<img width="354" height="153" alt="{45F68EBC-D1BA-4028-BBFF-74DC27637A6B}" src="https://github.com/user-attachments/assets/63120304-6d0a-4e23-b689-84f7da2572b8" />
|
|
|
|
|
|
Inputs:
|
|
- images - connect an image batch with your frames
|
|
- frame_count - select N frames from the end of the batch to pass forward
|
|
|
|
Outputs:
|
|
- continued - image batch containing N frames from the end of the batch
|