Commit Graph
45 Commits
Author SHA1 Message Date
alisson-anjos 383fed81a1 Refine Colored Mark on updated main 2026-10-13 16:34:09 +00:00
alisson-anjos 2b0caac30a Fix Color Guide reference history and add global colors 2026-10-13 16:28:18 +00:00
alisson-anjos 27090c979a Add Shot Planner language selector and optional tour 2026-10-13 16:27:56 +00:00
alisson-anjos 3e2d112b03 Add optional Color Guide to Shot Planner 2026-10-13 16:27:29 +00:00
alisson-anjos 5f6e3c8446 Add five-frame shot history continuity 2026-10-13 12:38:58 +00:00
alisson-anjos 72af0aa0c7 Move shot filters to People Filters Masks tab 2026-10-13 07:33:51 +00:00
alisson-anjos 391115b78a Remove duplicate total duration control 2026-10-13 07:23:12 +00:00
alisson-anjos a55054aa0c Move max shots control to Video tab 2026-10-13 07:20:45 +00:00
alisson-anjos ceeff4803d Add simplified H3 shot conditioning 2026-10-12 13:13:43 +00:00
alisson-anjos 8aeb958ab6 Planner: stabilize VLM descriptions and default videos to 15s 2026-10-12 10:27:36 +00:00
alisson-anjosandClaude Opus 5.5 29cedad7be Shot loop: one-shot split mode, BFS Shot Seed, BFS Shot Noise, BFS Sigmas Preview (1.94.0)
- Planner: Mode "One shot (whole range)" (the range as a single shot, Max seconds / shot not applied) and
  "Range length, seconds" next to it, so a whole shot or pieces of at most X are set in the Video tab alone.
- BFS Shot Seed: one seed per shot from a base seed (same / increment / random per shot) with per-shot overrides.
- BFS Shot Noise (experimental, optional): starting noise for SamplerCustomAdvanced on H3's video + audio latent;
  every amount at 0 is exactly RandomNoise. shared_base (the coarse pattern from a base seed, the same across shots,
  resolutions and lengths), static_share, distribution, spectrum_tilt, pyramid, guide_structure, ref_tint.
- BFS Sigmas Preview: chart of a sigma schedule (steps on layout / shapes / detail), pass-through.

Tested: split logic, seed logic, noise statistics (unit variance, identity at 0) and the chart, in Python.
Not tested yet inside ComfyUI / the panel in a browser.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 23:47:53 +00:00
alisson-anjosandClaude Opus 5.5 187c9a1776 Find people / Cast without insightface: OpenCV Zoo YuNet + SFace (Apache-2.0, run by OpenCV, downloaded once into models/opencv_face); InsightFace only when installed; SAM 3.1 + colours as last resort
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 19:00:36 +00:00
alisson-anjosandClaude Opus 5.5 a04f3116cf {details} filled automatically by the render nodes too: the planner leaves it when it has no VLM, BFS Shot H3 Conditioning / Shot H3 Duet (new vlm input) describe the shot's references
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 12:48:30 +00:00
alisson-anjosandClaude Opus 5.5 84a953e8c5 source_blur (SAM 3.1, keeps the mouth): blur the source person in the guide / native ref video / duet panel so the model reads pose, motion and lips but has no face to copy - Shot Conditioning, Shot Duet, Duet, Duet Conditioning
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 12:10:27 +00:00
alisson-anjosandClaude Opus 5.5 0bf03a8fb7 Planner: chunked upload for big files (8 MB pieces to /bfs/upload/chunk, assembled on disk) - any size, past ComfyUI's 100 MB --max-upload-size
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 09:03:16 +00:00
alisson-anjosandClaude Opus 5.5 2e64d989f6 BFS Shot H3 Duet: continuity 'history' too (the previous end before frame 0, panel strip filled with the source under it); shared shot_history() pops it from the shot
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 02:17:41 +00:00
alisson-anjosandClaude Opus 5.5 b1e0fcbbb6 Shot Planner: continuity 'history' is the default for new plans and unset shots (cuts still skip it)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 02:14:20 +00:00
alisson-anjosandClaude Opus 5.5 a03e0be342 Shot Planner: continuity 'history' - the last 17/34/51 frames of the previous result placed just before frame 0 on H3's timeline (sliding history, after Akatz's H3 Relay / Ethanfel's Context Loop), with every mask mode, crop and the duet canvas; cuts reset it
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 01:37:36 +00:00
alisson-anjosandClaude Opus 5.5 596a1c2538 Duet prompts: TSC's newer strategy - the finished split screen as plain footage (no kept footage / generated / in sync), the pinned region named by place + one clause of what is seen ({panel_region}/{video_region}: top quarter, bottom three quarters...), motion beat by beat with times on the video clock, sounds of the new scene
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 21:18:07 +00:00
alisson-anjosandClaude Opus 5.5 4e4fc20fdd Duet: optional VLM prompt - writes it from the task, or fills the {...} fields of a hand-written template (TSC's); setting picture described as <Subject 2>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 21:08:35 +00:00
alisson-anjosandClaude Opus 5.5 ad99a9f91a Duet: panel_static (TV static over face/person, SAM 3) + setting picture input + BFS Setting Picture node
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 20:52:18 +00:00
alisson-anjosandClaude Opus 5.5 e43cc14d9a Points: Track -> whole video - one selection tracked by SAM 3 through the whole video or range (chunked, forward and backward, re-found by text after cuts); shots without their own selection take their part (1.81.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 19:47:21 +00:00
alisson-anjosandClaude Opus 5.5 4fab22caa9 Shot Planner range: a player in the Video tab, start / end in frames (start here / end here take the player's exact frame; seconds of older plans still read), aligned layout (1.80.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 19:09:13 +00:00
alisson-anjosandClaude Opus 5.5 34ffcef172 Shot Planner: Start at / End at range - only that part of the video is split, analysed, generated and joined; timeline dims the rest; max total seconds counts from the start (1.79.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 17:42:42 +00:00
alisson-anjosandClaude Opus 5.5 8e573275b8 Fit the prompt: descriptions ({details}, {target}) are written for the prompt sentence that holds them (blank in place, article matched); {target} is described automatically at run time for shots with a selection and no text (1.78.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 13:34:08 +00:00
alisson-anjosandClaude Opus 5.5 a5535dc77c Describe refs for any subject (person, creature, robot, animal, cartoon: says what it is first); new default preset 'short' - a noun phrase that fits '<Subject 1> is the {details} shown in <Picture 1>'; {target} describes animals/creatures too (1.77.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 11:35:11 +00:00
alisson-anjosandClaude Opus 5.5 39610ab1ef mask_guide_look: what the mask guide shows of the subject - grey blurred (default), colour, silhouette, edges, or pose (people, YOLO pose model from models/ultralytics, no new packages) (1.76.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:47:14 +00:00
alisson-anjosandClaude Opus 5.5 f1388f0463 mask_guide (renamed from person_guide, works for any subject): masked region as an extra guide, instead of the full guide, or as a native reference video (<Video n>, with mask_ref_size); Mask only shots only; Frame + paste takes a per-shot 'new subject' text for the new outline (1.75.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:51:56 +00:00
alisson-anjosandClaude Opus 5.5 5c93d23c88 H3 Conditioning: experimental person_guide - a guide latent with only the masked person (rest grey), added next to the full guide or instead of it (1.74.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:45:55 +00:00
alisson-anjosandClaude Opus 5.5 7d9d7a9e26 Frame + paste mode: the whole frame is generated (pose follows the guide, the new person may be bigger) and BFS Shot Join pastes only the person (shot mask + the new outline found by SAM 3) onto the original frame; mask strength renamed mask opacity (1.73.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:22:16 +00:00
alisson-anjosandClaude Opus 5.5 1de7753be9 Mask strength per shot (mask modes): the masked rows start at strength x the noise level and keep part of the original, like an opacity (1.72.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:09:17 +00:00
alisson-anjosandClaude Opus 5.5 aa545097b7 External masks instead of SAM 3: a mask video per shot, the planner's optional mask input (whole video) or a mask video for the whole video in the panel; used by every mode, {target}, the setting picture and the comparison (1.71.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 14:01:13 +00:00
alisson-anjosandClaude Opus 5.5 718623ecb2 Shot Planner: reorganised panel - tabs (Video, Shots, People & masks, Prompts & refs, Run), views split into web/js/shotloop/, per-shot generation mode (Full frame / Mask only / Crop / Crop + mask) read by H3 Conditioning inpaint = per shot, Copy to other shots, grouped Checks, sideways shot strip with arrow keys; setting picture uses the shot's mask without crop; Auto split keeps {target}
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 10:40:07 +00:00
alisson-anjosandClaude Opus 5.5 907e923816 Shot H3 Conditioning: inpaint 'only the mask' also without crop (whole frame, no crop/uncrop); the mask's expand now grows the generation mask (1.69.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 09:30:48 +00:00
alisson-anjosandClaude Opus 5.5 52000210c3 Shot H3 Conditioning: inpaint 'only the mask (crop)' - latent starts from the cropped shot, the SAM 3 mask becomes the H3 generation mask; credit to Neko (Nekodificador) and AbleJones (1.68.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:44:33 +00:00
alisson-anjosandClaude Opus 5.5 3fc67735b8 Shot Join: stitch finishing for cropped shots - edge hardness, shot-wide colour match (ring around the subject for swaps), seamless edges; adapted from Nekodificador's NKD Inpaint Stitch (MIT) (1.67.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:39:34 +00:00
alisson-anjosandClaude Opus 5.5 ceaec97e63 Shot Join comparison: mask (red) and crop box (yellow) over the original column for cropped shots (comparison_mask) (1.66.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:26:58 +00:00
alisson-anjosandClaude Opus 5.5 e770fb773b Shot Planner: clearer tooltips (mask text is enough, Mask text → all, Crop → all) (1.65.2)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:23:08 +00:00
alisson-anjosandClaude Opus 5.5 6d91809e4c Shot Planner guide: step-by-step {target} selection, Save → all, Clear mask, examples and troubleshooting (1.65.1)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:20:54 +00:00
alisson-anjosandClaude Opus 5.5 1b53a83860 Shot Planner: save points to every shot, Points → all, Clear mask per shot (1.65.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:18:49 +00:00
alisson-anjosandClaude Opus 5.5 1468279071 Shot Planner: {target} placeholder - pick the person (SAM 3 points / text), the VLM describes them, the prompt names who is replaced (1.64.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 08:16:18 +00:00
alisson-anjosandClaude Opus 5.5 90face345c Shot H3 Conditioning: setting_ref, the shot's frame with the person in TV static as an extra reference (TSC's tip), generation or source size (1.63.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 23:38:02 +00:00
alisson-anjosandClaude Opus 5.5 6015065898 Shot H3 Conditioning: optional duet prompt writer (task + instruction, VLM or template, prompt output); {layout} filled per duet mode; template without split-screen wording in shifted mode (1.62.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 23:26:57 +00:00
alisson-anjosandClaude Opus 5.5 e8d2e68bde BFS H3 Duet Conditioning: duet conditioning for your own sampler with a VLM prompt writer (task + instruction); field-based prompt assembly; shifted mode no longer describes a split screen (1.61.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 18:30:36 +00:00
alisson-anjosandClaude Opus 5.5 3541a830a6 H3 Duet: How to use window with drawn examples of every setting, advanced settings tucked away; node guides moved under the served web folder (help panel and Guide links work) (1.60.0)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 15:48:47 +00:00