Old project/workflow names and browser settings migrate on load; /funpack redirects to /fun. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016acRss69eH1235eRdFTZHY
5.3 KiB
How to start generating with FunUI
This is the short path from "installed" to "first clip". It does not explain every node or loader: the app does that where you use them (hover a control, read its hint).
1. Install
With git, inside ComfyUI/custom_nodes:
git clone https://github.com/digital-garbage/FunUI
For the classic 4.x add -b v4-classic. comfy node install FunUI and ComfyUI-Manager install what is published on Comfy Registry, which is 5.0 only once it is published there; check Settings ▸ About FunUI after installing.
Then pip install -r requirements.txt in the same Python environment ComfyUI uses, and restart ComfyUI. FunUI uses your existing ComfyUI and PyTorch. If pip wants to upgrade a package ComfyUI compiles against (torch, numpy, transformers, comfy-kitchen), read what it will change first: FunUI's own updater only installs what is missing and reports the rest.
2. Open FunUI
Start ComfyUI as usual and open /fun/ on the same address, for example http://127.0.0.1:8188/fun/. The chip at the top right says whether ComfyUI is live.
3. Make a project
File ▸ Project Setup Wizard. Give the project a name and pick Start from: the pipeline of the model you will use. Say yes to the tour if you want a walk through the screen (Help ▸ Start tour runs it again).
| Model | State |
|---|---|
| MiniMax H3 | The model FunUI is built and tested around. |
| Stable Diffusion 1.5 | Experimental. |
| LTX 2.x (UNTESTED) | UNTESTED. Never run on a real LTX model, and nobody plans to test it soon. You are free to try it; if something breaks, please report it in Issues. |
4. Pick your files
The model's pipeline starts empty: it needs your files.
- Open Settings ▸ Ready to generate?. It checks the machine: ffmpeg, GPU, model folders, node packs.
- Open Settings ▸ Models & Pipeline and choose a file in each card marked with an orange dot (diffusion model, text encoder, VAE, and so on). Generate names the first thing still missing.
Put model files where ComfyUI expects them (models/diffusion_models, models/text_encoders, models/vae, models/loras).
.gguf text encoders need the ComfyUI-GGUF node pack (FunUI does not install it) and work only for architectures it understands; otherwise they are refused with a message (Gemma 4 .gguf is one such case). Use the .safetensors file of the same model. A diffusion-model .gguf also loads without the pack, but is expanded to full size in memory.
5. Write the story
Click Composer and write all scenes in one box, separated by the cut word (see the Cuts tab). Each piece becomes one clip on the timeline. Composer also keeps $variables, templates and shortcuts, and has an optional Enhance tab: a language model rewrites each finished prompt. On H3, pick a chat encoder (for example Gemma 4) under Enhance ▸ Encoder, because H3's own encoder cannot write prose. Leave Encoder family at its default unless your encoder belongs to another family (Gemma 4 worked with the default).
6. Generate
- ▶ Generate makes every scene on the timeline (not left-out scenes, video clips or Auto Montage pieces). An earlier render of a scene stays as a take.
- Selected makes only the picked scene. Takes ×N makes the same scene several times, differing only by seed.
- No picture needed: on H3, a scene with no source image is generated from text alone.
Watch the Log window if nothing happens: any module that fails says why there, and the rest of the run goes on without it.
7. Cut, render, export
Trim and split clips on the timeline. ⚡ Auto Montage builds a new cut at the end from your rendered clips; your originals stay as they are. ⧉ Render joins the timeline into one file; ⤓ Export downloads the picked clip (picture only: a clip whose sound was separated is silent there, Render mixes it).
8. Teach it your taste (optional)
Rate a result with Rate scene… (liked, disliked, bad image, bad composition). Set a Taste key (the ⚠ chip on the timeline points to it: Settings ▸ Engine ▸ System) so ratings are remembered. Settings ▸ Refinement & Taste lists, exports and deletes keys. Modules that learn from ratings start acting once they have enough ratings (a few liked clips for some, ten or more rated clips for others; some also need disliked ones) and say so when they need more.
9. Features marked experimental
Settings ▸ Modules switches each feature on or off. Several features are experimental: built and run, but not yet proven over many runs. If a module fails while generating, the run carries on without it, the Log says why, and the module stays off until its code changes and ComfyUI restarts, or you turn it back on in Settings ▸ Modules.
If something goes wrong
- Nothing happens: check the ComfyUI chip and the Log window.
- Wrong look: Settings ▸ Appearance. Lost a layout: View ▸ Reset Layout. Lost a project: File ▸ Open recent.
- A bug or a missing feature: please open an issue.
Known limits in 5.0
- LTX 2.x is untested (see above).
- In the H3 preset the scene picture sets the video's shape only; a start frame is not part of it.
- The H3 "second pass" preset is not offered yet: it has not been verified.