Commit Graph
99 Commits
Author SHA1 Message Date
alisson-anjos dca37ddc0f Apply Colored Mark color to mask previews 2026-10-13 17:06:14 +00:00
alisson-anjos 507d5bc60a Always show Colored Mark region color 2026-10-13 16:59:56 +00:00
alisson-anjos 383fed81a1 Refine Colored Mark on updated main 2026-10-13 16:34:09 +00:00
alisson-anjos 2b0caac30a Fix Color Guide reference history and add global colors 2026-10-13 16:28:18 +00:00
alisson-anjos 27090c979a Add Shot Planner language selector and optional tour 2026-10-13 16:27:56 +00:00
alisson-anjos 3e2d112b03 Add optional Color Guide to Shot Planner 2026-10-13 16:27:29 +00:00
alisson-anjos 5f6e3c8446 Add five-frame shot history continuity 2026-10-13 12:38:58 +00:00
alisson-anjos 72af0aa0c7 Move shot filters to People Filters Masks tab 2026-10-13 07:33:51 +00:00
alisson-anjos 391115b78a Remove duplicate total duration control 2026-10-13 07:23:12 +00:00
alisson-anjos a55054aa0c Move max shots control to Video tab 2026-10-13 07:20:45 +00:00
alisson-anjos 154698f46f Re-split shots when cut settings change 2026-10-13 07:19:54 +00:00
alisson-anjos f1f639f389 Fix Shot Planner splitting and TextGenerate compatibility 2026-10-13 07:12:26 +00:00
alisson-anjos ceeff4803d Add simplified H3 shot conditioning 2026-10-12 13:13:43 +00:00
alisson-anjos 8aeb958ab6 Planner: stabilize VLM descriptions and default videos to 15s 2026-10-12 10:27:36 +00:00
alisson-anjosandClaude Opus 5.5 29cedad7be Shot loop: one-shot split mode, BFS Shot Seed, BFS Shot Noise, BFS Sigmas Preview (1.94.0)
- Planner: Mode "One shot (whole range)" (the range as a single shot, Max seconds / shot not applied) and
  "Range length, seconds" next to it, so a whole shot or pieces of at most X are set in the Video tab alone.
- BFS Shot Seed: one seed per shot from a base seed (same / increment / random per shot) with per-shot overrides.
- BFS Shot Noise (experimental, optional): starting noise for SamplerCustomAdvanced on H3's video + audio latent;
  every amount at 0 is exactly RandomNoise. shared_base (the coarse pattern from a base seed, the same across shots,
  resolutions and lengths), static_share, distribution, spectrum_tilt, pyramid, guide_structure, ref_tint.
- BFS Sigmas Preview: chart of a sigma schedule (steps on layout / shapes / detail), pass-through.

Tested: split logic, seed logic, noise statistics (unit variance, identity at 0) and the chart, in Python.
Not tested yet inside ComfyUI / the panel in a browser.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 23:47:53 +00:00
alisson-anjosandClaude Opus 5.5 187c9a1776 Find people / Cast without insightface: OpenCV Zoo YuNet + SFace (Apache-2.0, run by OpenCV, downloaded once into models/opencv_face); InsightFace only when installed; SAM 3.1 + colours as last resort
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 19:00:36 +00:00
alisson-anjosandClaude Opus 5.5 a04f3116cf {details} filled automatically by the render nodes too: the planner leaves it when it has no VLM, BFS Shot H3 Conditioning / Shot H3 Duet (new vlm input) describe the shot's references
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 12:48:30 +00:00
alisson-anjosandClaude Opus 5.5 84a953e8c5 source_blur (SAM 3.1, keeps the mouth): blur the source person in the guide / native ref video / duet panel so the model reads pose, motion and lips but has no face to copy - Shot Conditioning, Shot Duet, Duet, Duet Conditioning
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 12:10:27 +00:00
alisson-anjosandClaude Opus 5.5 0bf03a8fb7 Planner: chunked upload for big files (8 MB pieces to /bfs/upload/chunk, assembled on disk) - any size, past ComfyUI's 100 MB --max-upload-size
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 09:03:16 +00:00
alisson-anjosandClaude Opus 5.5 390f9e8714 Planner UI: ✕ clear all - removes every reference from the plan (global, shots, cast) and the recent list, after a confirm
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 07:50:53 +00:00
alisson-anjosandClaude Opus 5.5 515ab73c70 Planner UI: collapsible sections keep what the user clicked (re-renders snapped them shut); ✕ clear for the recent reference pictures
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 07:47:46 +00:00
alisson-anjosandClaude Opus 5.5 2e64d989f6 BFS Shot H3 Duet: continuity 'history' too (the previous end before frame 0, panel strip filled with the source under it); shared shot_history() pops it from the shot
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 02:17:41 +00:00
alisson-anjosandClaude Opus 5.5 b1e0fcbbb6 Shot Planner: continuity 'history' is the default for new plans and unset shots (cuts still skip it)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 02:14:20 +00:00
alisson-anjosandClaude Opus 5.5 a03e0be342 Shot Planner: continuity 'history' - the last 17/34/51 frames of the previous result placed just before frame 0 on H3's timeline (sliding history, after Akatz's H3 Relay / Ethanfel's Context Loop), with every mask mode, crop and the duet canvas; cuts reset it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 01:37:36 +00:00
alisson-anjosandClaude Opus 5.5 596a1c2538 Duet prompts: TSC's newer strategy - the finished split screen as plain footage (no kept footage / generated / in sync), the pinned region named by place + one clause of what is seen ({panel_region}/{video_region}: top quarter, bottom three quarters...), motion beat by beat with times on the video clock, sounds of the new scene
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 21:18:07 +00:00
alisson-anjosandClaude Opus 5.5 4e4fc20fdd Duet: optional VLM prompt - writes it from the task, or fills the {...} fields of a hand-written template (TSC's); setting picture described as <Subject 2>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 21:08:35 +00:00
alisson-anjosandClaude Opus 5.5 ad99a9f91a Duet: panel_static (TV static over face/person, SAM 3) + setting picture input + BFS Setting Picture node
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 20:52:18 +00:00
alisson-anjosandClaude Opus 5.5 e43cc14d9a Points: Track -> whole video - one selection tracked by SAM 3 through the whole video or range (chunked, forward and backward, re-found by text after cuts); shots without their own selection take their part (1.81.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 19:47:21 +00:00
alisson-anjosandClaude Opus 5.5 4fab22caa9 Shot Planner range: a player in the Video tab, start / end in frames (start here / end here take the player's exact frame; seconds of older plans still read), aligned layout (1.80.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 19:09:13 +00:00
alisson-anjosandClaude Opus 5.5 96f7e8a1b1 VLM descriptions: temperature and seed (0 = greedy as before), a dice button to try another description, the short preset capped at 30 words (1.79.1)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 18:02:53 +00:00
alisson-anjosandClaude Opus 5.5 34ffcef172 Shot Planner: Start at / End at range - only that part of the video is split, analysed, generated and joined; timeline dims the rest; max total seconds counts from the start (1.79.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 17:42:42 +00:00
alisson-anjosandClaude Opus 5.5 9ae5fc9614 Fit the prompt: only for the short preset, the VLM is told to reply with the blank's words only, and an echo of the prompt sentence is cut; Checks warn when {details} is used with a paragraph preset (1.78.2)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 15:14:58 +00:00
alisson-anjosandClaude Opus 5.5 8e573275b8 Fit the prompt: descriptions ({details}, {target}) are written for the prompt sentence that holds them (blank in place, article matched); {target} is described automatically at run time for shots with a selection and no text (1.78.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 13:34:08 +00:00
alisson-anjosandClaude Opus 5.5 a5535dc77c Describe refs for any subject (person, creature, robot, animal, cartoon: says what it is first); new default preset 'short' - a noun phrase that fits '<Subject 1> is the {details} shown in <Picture 1>'; {target} describes animals/creatures too (1.77.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 11:35:11 +00:00
alisson-anjosandClaude Opus 5.5 39610ab1ef mask_guide_look: what the mask guide shows of the subject - grey blurred (default), colour, silhouette, edges, or pose (people, YOLO pose model from models/ultralytics, no new packages) (1.76.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:47:14 +00:00
alisson-anjosandClaude Opus 5.5 f1388f0463 mask_guide (renamed from person_guide, works for any subject): masked region as an extra guide, instead of the full guide, or as a native reference video (<Video n>, with mask_ref_size); Mask only shots only; Frame + paste takes a per-shot 'new subject' text for the new outline (1.75.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:51:56 +00:00
alisson-anjosandClaude Opus 5.5 5c93d23c88 H3 Conditioning: experimental person_guide - a guide latent with only the masked person (rest grey), added next to the full guide or instead of it (1.74.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:45:55 +00:00
alisson-anjosandClaude Opus 5.5 7d9d7a9e26 Frame + paste mode: the whole frame is generated (pose follows the guide, the new person may be bigger) and BFS Shot Join pastes only the person (shot mask + the new outline found by SAM 3) onto the original frame; mask strength renamed mask opacity (1.73.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:22:16 +00:00
alisson-anjosandClaude Opus 5.5 1de7753be9 Mask strength per shot (mask modes): the masked rows start at strength x the noise level and keep part of the original, like an opacity (1.72.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:09:17 +00:00
alisson-anjosandClaude Opus 5.5 aa545097b7 External masks instead of SAM 3: a mask video per shot, the planner's optional mask input (whole video) or a mask video for the whole video in the panel; used by every mode, {target}, the setting picture and the comparison (1.71.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:01:13 +00:00
alisson-anjosandClaude Opus 5.5 736a7016e8 Shot Planner: wider node by default (1180 px, at least 1040 for older workflows), panel at least 900 px wide
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 11:32:25 +00:00
alisson-anjosandClaude Opus 5.5 88d0f0c159 Shot Planner: the panel scrolls inside a fixed area so switching tabs never resizes the node (Vue nodes mode sized it by content and could collapse its width); plan JSON widget hidden in Vue nodes mode too
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 11:22:08 +00:00
alisson-anjosandClaude Opus 5.5 1ced5f9798 Shot Planner: mask text updates live, Enter previews it, the old preview clears when the text changes
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 11:09:02 +00:00
alisson-anjosandClaude Opus 5.5 718623ecb2 Shot Planner: reorganised panel - tabs (Video, Shots, People & masks, Prompts & refs, Run), views split into web/js/shotloop/, per-shot generation mode (Full frame / Mask only / Crop / Crop + mask) read by H3 Conditioning inpaint = per shot, Copy to other shots, grouped Checks, sideways shot strip with arrow keys; setting picture uses the shot's mask without crop; Auto split keeps {target}
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 10:40:07 +00:00
alisson-anjosandClaude Opus 5.5 907e923816 Shot H3 Conditioning: inpaint 'only the mask' also without crop (whole frame, no crop/uncrop); the mask's expand now grows the generation mask (1.69.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 09:30:48 +00:00
alisson-anjosandClaude Opus 5.5 52000210c3 Shot H3 Conditioning: inpaint 'only the mask (crop)' - latent starts from the cropped shot, the SAM 3 mask becomes the H3 generation mask; credit to Neko (Nekodificador) and AbleJones (1.68.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:44:33 +00:00
alisson-anjosandClaude Opus 5.5 3fc67735b8 Shot Join: stitch finishing for cropped shots - edge hardness, shot-wide colour match (ring around the subject for swaps), seamless edges; adapted from Nekodificador's NKD Inpaint Stitch (MIT) (1.67.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:39:34 +00:00
alisson-anjosandClaude Opus 5.5 ceaec97e63 Shot Join comparison: mask (red) and crop box (yellow) over the original column for cropped shots (comparison_mask) (1.66.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:26:58 +00:00
alisson-anjosandClaude Opus 5.5 e770fb773b Shot Planner: clearer tooltips (mask text is enough, Mask text → all, Crop → all) (1.65.2)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:23:08 +00:00
alisson-anjosandClaude Opus 5.5 6d91809e4c Shot Planner guide: step-by-step {target} selection, Save → all, Clear mask, examples and troubleshooting (1.65.1)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:20:54 +00:00