ausboss
ac0bb08949
32 of the ? help pages checked against the code and corrected. Wrong claims fixed: Stitch Inpaint's empty-area check (20/255), what a new video keeps on both Video Crop + Rotate + Pad pages, Load Video's frame picker and player height, where Run Timer lists earlier runs, inpainting on the Krea 2 Outpaint Model Patch page, Workflow Note's banner layout and pack detection, Image Resize's pad bars and mask, Save Image's path preview and tags, Free Memory's steps, and Latent Size's sockets. Image Crop + Rotate + Pad now follows the node from top to bottom; the saved values no row shows moved under Technical details. Controls are named the way the node shows them, with the input name beside. Pages that opened with jargon now open with what the node does and when to use it. LoRA Loader gained the Civitai lookup, suggested strength and the gear options it did not name.
58 lines
2.7 KiB
Markdown
58 lines
2.7 KiB
Markdown
# Frame Interpolate
|
|
|
|
Changes a clip's frame rate, for example 24 to 30, by making the in-between
|
|
pictures. Use it to smooth a generated clip or to match another clip's rate;
|
|
`24 -> 30` works as naturally as doubling. Every output frame maps to a
|
|
position on the source timeline: positions that land exactly on a source
|
|
frame are copied untouched, and only the true in-betweens are synthesized.
|
|
|
|
## Methods
|
|
|
|
- **blend**: A crossfade between the two neighboring frames. Instant and
|
|
dependency-free, but fast motion looks soft because it averages instead of
|
|
moving pixels.
|
|
- **optical flow (RAFT)** (`optical flow (requires cached RAFT weights)`):
|
|
Estimates RAFT motion vectors in both directions, warps both neighbors
|
|
toward the in-between time, and blends the warps. Much sharper on motion.
|
|
It reads torchvision's official RAFT-small checkpoint,
|
|
`raft_small_C_T_V2-01064c6d.pth`, from the torch hub cache
|
|
(`~/.cache/torch/hub/checkpoints/` unless `TORCH_HOME` moves it) and never
|
|
downloads it during a run. Download it from
|
|
`https://download.pytorch.org/models/raft_small_C_T_V2-01064c6d.pth` into
|
|
that folder; without it the node names the exact path it looked in. Or use
|
|
**blend**.
|
|
|
|
## Scene cuts
|
|
|
|
Interpolating across a hard cut produces morph artifacts: two unrelated
|
|
shots smeared into each other for a frame or two. When the mean absolute
|
|
difference between adjacent source frames rises above **Scene cut**
|
|
(`scene_cut_threshold`), the node treats that pair as a cut and holds the
|
|
last frame before it instead of morphing. Set the threshold to `0` to
|
|
disable detection and interpolate everything.
|
|
|
|
## Controls
|
|
|
|
- **frames**: Video frames as a BHWC `IMAGE` batch.
|
|
- **FPS**, left box (`source_fps`): Frame rate of the incoming batch; wire
|
|
Load Video's fps output to match the source.
|
|
- **FPS**, right box (`target_fps`): Frame rate to change to. Matching the
|
|
source rate passes the batch through unchanged. A new node starts at
|
|
24 → 30.
|
|
- **Method** (`method`): `blend` or **optical flow (RAFT)**, as described above.
|
|
- **Scene cut** (`scene_cut_threshold`): Cut sensitivity from 0 to 1; `0.35`
|
|
suits most footage, `0` disables.
|
|
- **Batch** (`batch_size`, starts at `8`): In-between frames computed per batch. Higher is
|
|
faster but uses more VRAM; results land in system memory as each batch
|
|
finishes.
|
|
|
|
## Outputs
|
|
|
|
- **frames**: The resampled BHWC frame batch.
|
|
- **fps**: The actual output rate. The output length is rounded to keep the
|
|
clip duration, so this can differ slightly from the request on short
|
|
clips; wire it into Save Video and the timing never drifts.
|
|
|
|
Neither method performs network requests or writes files. The optical-flow
|
|
method reads an existing checkpoint from the local torch hub cache.
|