ea33b4531324f03523249f593a8cc874869652e5
Masks were returned as single image, which wouldn't work with AnimateDiff.
ComfyUI-Advanced-ControlNet
These custom nodes allow for scheduling ControlNet strength across latents in the same batch (WORKING) and across timesteps (IN PROGRESS).
Custom weights can also be applied to ControlNets and T2IAdapters to mimic the "My prompt is more important" functionality in AUTOMATIC1111's ControlNet extension.
TODO:
- Add combined Latent Timestep Keyframe nodes to allow faster setup for easier workflows and to use a single ControlNet for a batch of images; too inefficient and redundant right now for common workflows
- Other handy nodes
- Finish and update this README for other workflows
Workflows
AnimateDiff Workflows
Latent Keyframes identify which latents in a batch the ControlNet should apply to, and at what strength. They connect to a Timestep Keyframe to identify at what point in the generation to kick in (for basic use, start_percent on the Timestep Keyframe should be 0.0). Latent Keyframe nodes can be chained to apply the ControlNet to multiple keyframes at various strengths.
Languages
Python
100%