Vito
0095db8cbc
* feat(inspect): bounded browser PNG reader matching the server's
The Inspect page will read a chosen file entirely in the browser, and the
record it shows must equal what Images shows for the same bytes. This adds
to web/js/png-metadata.js (loaded by the legacy pages as before, with
parsePngTextChunks unchanged):
- readPngMetadataFile(file, {signal, prefix, yieldControl, decompress}):
a port of utils/prompt_inspector.py's _png_metadata, _PngRecords,
_png_text, _inflate and _batch_normalized. It slices only chunk headers,
80-byte keyword prefixes and the retained prompt, workflow, parameters
and comfyassets_prompt_pairs records, CRC-checks what it keeps, applies
the same budgets (2 MiB shared role budget encoded and decoded, 4 MiB
workflow that becomes limited, 8 MiB and 4 MiB duplicate budgets, 4 MiB
duplicate decoded parameters, 10,000 chunks, the batch-index rule for
parameters copies) and compares duplicate chunks byte for byte. Every
range is checked against file.size before slicing and charged against a
19,794,389-byte ceiling, so a multi-gigabyte PNG costs only its metadata.
Compressed text inflates through DecompressionStream with one 256-byte
write in flight and the output capped at the record's allowance; an
AbortSignal rejects the read with an AbortError and leaves no unhandled
rejection; yieldControl runs about every 8 ms of work.
- classifyPrefix(bytes): png, jpeg, webp, iso-bmff, matroska, avi, asf or
null from the first 32 bytes.
- readImageHeader(file, kind): JPEG (SOFn walk as Pillow) and WebP (VP8,
VP8L, VP8X) dimensions from at most 64 KiB.
tests/test_local_inspect_parity.py drives tests/js/support/local-inspect-
oracle.mjs over the committed and test-time inspection parity corpus plus
compressed, oversized, Latin-1, batch-duplicate and all-four-record shapes,
and asserts records, record formats, dimensions and readability equal
read_inspection_file on each file; the two JPEG/WebP fixtures are checked
against Pillow. tests/js/png-local-reader.test.js pins each server rule,
the sparse 3 GiB read, the prefix reuse, inflation back-pressure and abort.
tests/fixtures/local-inspect/tiny.{jpg,webp} are CC0 FFmpeg test patterns.
* feat(inspect): bounded browser video tag readers
Add web/js/workspace/local-video.mjs: ISO-BMFF (MP4/MOV/M4V) and Matroska
(MKV/WebM) walkers that read only the container tags the server asks ffprobe
for, slicing box and element headers, carrier names and retained values within
the server's budgets and never a byte inside mdat or a Cluster; a port of
utils/video_metadata.select_video_carrier with the record budgets of
read_inspection_file; and a byte-exact json.loads/json.dumps round trip so
envelope objects reserialize as the server spells them.
Every naming rule mirrors ffprobe 9.0.2 on hand-built files: legacy ilst atoms,
mdta keys, joined repeats, data types, Matroska language and default handling,
and Tags behind a Cluster found only through a SeekHead.
Tests: node units over byte-exact container builders and the committed
fixtures; a Python parity test comparing the local carrier with the server's
selection from the same tag maps (mocked probe) and from the same files (real
ffprobe, including 1 MiB + 2.5 MiB per-key records); an ffprobe
characterization of the recorded fixture maps.
* feat(inspect): server-identical local projection and payload
Port utils/inspection_response.py to the browser: a strict parse with Python's
Decimal spelling, duplicate-key rejection, NaN/Infinity as null and integers
past 2^53-1 as text; the prompt, workflow and carrier projection with the
depth-64 and 20,000-node ceilings; _metadata; and the 8 MiB omission steps
(workflow graph, then prompt graph, then all raw) measured as UTF-8 bytes.
local-inspection.mjs builds the inspection_version 1 wire for one chosen File
from the Task 1 and Task 2 readers (observation selected-local-file, interim
unresolved roles, unavailable library), fits it to the response budget, and
exposes localFileAdapter for the shared controller, inspector and viewer:
handles are session-owned by a private token, so a tampered or hand-made
descriptor is rejected and blob: URLs are never resolved through the API
client. projectInspectionPayload admits selected-local-file only for a
local-file identity.
A Python oracle test compares projectMetadata with _metadata byte for byte over
the parity PNG corpus, the committed video fixtures and tag maps, 75 committed
adversarial record sets (projection-cases.json) and node-ceiling sets built at
test time.
* test(inspect): import oracle modules by file URL for Windows
The local-inspect oracle imported product modules with path.join(...), which
Node parses as a URL scheme on Windows (D:\... -> ERR_UNSUPPORTED_ESM_URL_SCHEME),
failing every tests/test_local_inspect_parity.py oracle test on the Windows CI
job. Every dynamic import in tests/js/support now goes through moduleUrl, a
pathToFileURL wrapper, and a node unit proves the Windows form on any host and
scans the oracles so a path import cannot return.
* fix(inspect): read video tags as ffprobe reports them
Same bytes now give the server's record in five shapes where the local
reader was stricter or kept different tags (PR #277 final review I1, I2,
M1, M2, M4):
- Invalid UTF-8 in a tag value is replaced as ffprobe's default
string_validation=replace does (av_utf8_decode, one U+FFFD per failing
decode step), instead of failing the read. Key names and TagNames that
do not decode are no carrier and are skipped.
- An ilst item whose keys index is 0 or out of range is skipped, as
ffmpeg does, instead of failing the read.
- Only the first keys box is read, as ffmpeg does.
- A first per-key workflow over 4 MiB keeps its place in the carrier
choice as an unread marker, so the server's carrier (per-key, workflow
limited) is chosen; when the server's first probe would overflow, the
re-probe leaves it out and its own bound applies.
- An envelope integer of more than 4300 digits fails the Python json
port, so that envelope is skipped as CPython's json.loads skips it.
Each shape was checked against ffprobe 9.0.2 and read_inspection_file;
the real-ffprobe parity test now builds them, and a 600-case random-byte
comparison of the replacement against ffprobe matched.
* perf(inspect): measure the local response size natively and yield between steps
fitInspectionPayload counted the UTF-8 size of an 8-12 MB wire with a
per-character loop and ran every omission step on the main thread in one
turn (PR #277 final review M7). The size is now counted by TextEncoder
encodeInto through one bounded scratch buffer, and each re-measure
follows a yieldControl turn, with an abort signal checked between steps.
The fit is async; the fitted payload is the same as before.
* fix(inspect): hold video tags as ffmpeg's dictionary does, decode Mac Roman text
Three more same-bytes divergences, found while verifying the review
fixes against ffprobe 9.0.2 and read_inspection_file:
- ffmpeg keeps one tag per ASCII-folded name under the spelling set
last (ISO-BMFF joins the values with ";", Matroska keeps the last), so
PROMPT and Prompt are one record on the server; the local reader kept
both and failed the read as a duplicate. A legacy comment atom and a
later COMMENT key likewise leave no exact-case envelope.
- ffprobe's format_tags filter folds ASCII case only, so a name that is
"workflow" only under Unicode case rules is never reported; the local
reader took it.
- ISO-BMFF data types 0 and 3 are Mac Roman text to ffmpeg, written into
twice the input size (a long value is cut); the local reader decoded
type 0 as UTF-8 and skipped type 3.
The real-ffprobe parity test builds each shape.
* docs(testing): list the local Inspect divergences; raise touched coverage floors
TESTING.md now tracks the local Inspect (#249 PR L1) divergences that
remain after the review fixes, each checked on a host with ffprobe 9.0.2:
media kind by bytes versus extension (parity is for the same bytes with a
matching extension), JPEG dimensions past the 64 KiB header read, classic
QuickTime udta text atoms, raw versus escaped tag bounds, the 10,000
element ceiling, unknown EBML DocTypes, the JSON depth approximation and
the C _decimal assumption.
coverage:update raised the branch floors of the three local Inspect
modules this PR touches; the unrelated activity-scan raise it proposed is
left at main's values.
434 lines
18 KiB
Python
434 lines
18 KiB
Python
"""Tests for utils/video_metadata.py: prompt metadata from video containers.
|
|
|
|
Current ComfyUI savers (core SaveVideo/SaveWEBM, VideoHelperSuite) write one
|
|
container tag per key (``prompt``, ``workflow``, ``parameters``,
|
|
``comfyassets_prompt_pairs``); older VideoHelperSuite wrote one ``comment``
|
|
JSON envelope, with ``description`` as a fallback. One selector picks a single
|
|
carrier for the inspector and the scan. ffprobe reads the tags; when ffprobe
|
|
is missing videos are skipped without noise.
|
|
"""
|
|
|
|
import json
|
|
import os
|
|
import shutil
|
|
import subprocess
|
|
import sys
|
|
import tempfile
|
|
import unittest
|
|
from unittest import mock
|
|
|
|
sys.path.insert(0, os.path.dirname(os.path.dirname(os.path.abspath(__file__))))
|
|
|
|
from utils import video_metadata # noqa: E402
|
|
from utils.video_metadata import ( # noqa: E402
|
|
VIDEO_EXTENSIONS,
|
|
DuplicateVideoTagError,
|
|
is_video_path,
|
|
metadata_from_tags,
|
|
read_video_metadata,
|
|
select_video_carrier,
|
|
)
|
|
|
|
HAVE_FFMPEG = bool(shutil.which("ffmpeg") and shutil.which("ffprobe"))
|
|
GRAPH = json.dumps({"1": {"class_type": "CLIPTextEncode", "inputs": {"text": "a cat"}}})
|
|
|
|
|
|
def write_video(path, metadata_tags=True, **tags):
|
|
"""Write a tiny black video carrying one container tag per keyword.
|
|
|
|
MP4 keeps arbitrary keys only with ``use_metadata_tags`` (mdta atoms), the
|
|
movflag the core SaveVideo node sets; without it ffmpeg writes the legacy
|
|
ilst atoms (``comment`` becomes ``©cmt``) that old VideoHelperSuite files
|
|
carry. Matroska and WebM upper-case the key names.
|
|
"""
|
|
command = [
|
|
"ffmpeg",
|
|
"-v",
|
|
"quiet",
|
|
"-f",
|
|
"lavfi",
|
|
"-i",
|
|
"color=c=black:s=16x16:d=0.2",
|
|
]
|
|
if metadata_tags and str(path).lower().endswith((".mp4", ".mov", ".m4v")):
|
|
command += ["-movflags", "use_metadata_tags"]
|
|
for key, value in tags.items():
|
|
command += ["-metadata", f"{key}={value}"]
|
|
subprocess.run(command + ["-y", str(path)], check=True, timeout=60)
|
|
|
|
|
|
def write_mp4(path, comment):
|
|
"""Write a tiny black MP4 with ``comment`` in its legacy ilst ``©cmt`` atom."""
|
|
write_video(path, metadata_tags=False, comment=comment)
|
|
|
|
|
|
class TestMetadataFromTags(unittest.TestCase):
|
|
|
|
def test_prompt_string_and_workflow_dict_become_text_chunks(self):
|
|
tags = {"comment": json.dumps({"prompt": GRAPH, "workflow": {"nodes": []}})}
|
|
meta = metadata_from_tags(tags)
|
|
self.assertEqual(meta["prompt"], GRAPH)
|
|
self.assertEqual(json.loads(meta["workflow"]), {"nodes": []})
|
|
|
|
def test_missing_or_non_json_comment_is_empty(self):
|
|
self.assertEqual(metadata_from_tags({}), {})
|
|
self.assertEqual(metadata_from_tags({"comment": "just a note"}), {})
|
|
self.assertEqual(metadata_from_tags({"comment": "[1, 2]"}), {})
|
|
self.assertEqual(metadata_from_tags({"comment": json.dumps({"other": 1})}), {})
|
|
self.assertEqual(metadata_from_tags({"comment": 7}), {})
|
|
|
|
def test_description_tag_is_a_fallback(self):
|
|
tags = {"description": json.dumps({"prompt": GRAPH})}
|
|
self.assertEqual(metadata_from_tags(tags), {"prompt": GRAPH})
|
|
|
|
|
|
class TestSelectVideoCarrier(unittest.TestCase):
|
|
"""Spec 2026-10-19 resolution parity section 8: one carrier, never merged."""
|
|
|
|
WORKFLOW = json.dumps({"nodes": [{"id": "per-key"}]})
|
|
|
|
def test_per_key_tags_win_over_comment(self):
|
|
tags = {
|
|
"prompt": GRAPH,
|
|
"workflow": self.WORKFLOW,
|
|
"comment": json.dumps({"prompt": json.dumps({"9": {}})}),
|
|
}
|
|
metadata, formats, carrier = select_video_carrier(tags)
|
|
self.assertEqual(metadata, {"prompt": GRAPH, "workflow": self.WORKFLOW})
|
|
self.assertEqual(
|
|
formats, {"prompt": "original-text", "workflow": "original-text"}
|
|
)
|
|
self.assertIsNone(carrier)
|
|
|
|
def test_matroska_uppercase_keys_fold(self):
|
|
tags = {"PROMPT": GRAPH, "Workflow": self.WORKFLOW, "ENCODER": "Lavf"}
|
|
metadata, formats, carrier = select_video_carrier(tags)
|
|
self.assertEqual(metadata, {"prompt": GRAPH, "workflow": self.WORKFLOW})
|
|
self.assertEqual(
|
|
formats, {"prompt": "original-text", "workflow": "original-text"}
|
|
)
|
|
self.assertIsNone(carrier)
|
|
# Envelope keys are read exactly as legacy did: no fold, so a Matroska
|
|
# upper-cased COMMENT is not an envelope.
|
|
self.assertIsNone(
|
|
select_video_carrier({"COMMENT": json.dumps({"prompt": GRAPH})})
|
|
)
|
|
|
|
def test_folded_duplicate_keys_fail(self):
|
|
for tags in (
|
|
{"PROMPT": GRAPH, "prompt": json.dumps({"9": {}})},
|
|
{"Workflow": self.WORKFLOW, "WORKFLOW": "{}", "prompt": GRAPH},
|
|
):
|
|
with self.assertRaises(DuplicateVideoTagError):
|
|
select_video_carrier(tags)
|
|
# Byte-identical duplicates are one record, as for PNG text chunks.
|
|
metadata, _, _ = select_video_carrier({"PROMPT": GRAPH, "prompt": GRAPH})
|
|
self.assertEqual(metadata, {"prompt": GRAPH})
|
|
# Envelope keys never fold, so a foreign COMMENT note is not a duplicate.
|
|
envelope = json.dumps({"prompt": GRAPH})
|
|
metadata, _, carrier = select_video_carrier(
|
|
{"comment": envelope, "COMMENT": "a free-text note"}
|
|
)
|
|
self.assertEqual(metadata, {"prompt": GRAPH})
|
|
self.assertEqual(carrier, envelope)
|
|
|
|
def test_comment_envelope_still_read(self):
|
|
envelope = json.dumps({"prompt": GRAPH, "workflow": {"nodes": []}})
|
|
metadata, formats, carrier = select_video_carrier(
|
|
{"comment": envelope, "encoder": "Lavf"}
|
|
)
|
|
self.assertEqual(metadata["prompt"], GRAPH)
|
|
self.assertEqual(json.loads(metadata["workflow"]), {"nodes": []})
|
|
self.assertEqual(
|
|
formats, {"prompt": "original-text", "workflow": "reserialized-json"}
|
|
)
|
|
self.assertEqual(carrier, envelope)
|
|
|
|
def test_description_fallback(self):
|
|
envelope = json.dumps({"prompt": GRAPH})
|
|
tags = {"comment": "not json", "description": envelope}
|
|
self.assertEqual(
|
|
select_video_carrier(tags),
|
|
({"prompt": GRAPH}, {"prompt": "original-text"}, envelope),
|
|
)
|
|
self.assertIsNone(select_video_carrier({"comment": "note", "encoder": "x"}))
|
|
self.assertIsNone(select_video_carrier({"comment": "[1]"}))
|
|
self.assertIsNone(select_video_carrier({}))
|
|
self.assertIsNone(select_video_carrier(None))
|
|
self.assertIsNone(select_video_carrier({"comment": 7}))
|
|
|
|
def test_role_carrier_beats_workflow_only_carrier(self):
|
|
envelope = json.dumps({"prompt": GRAPH, "workflow": {"nodes": ["c"]}})
|
|
metadata, formats, carrier = select_video_carrier(
|
|
{"workflow": self.WORKFLOW, "comment": envelope}
|
|
)
|
|
self.assertEqual(metadata["prompt"], GRAPH)
|
|
self.assertEqual(json.loads(metadata["workflow"]), {"nodes": ["c"]})
|
|
self.assertEqual(carrier, envelope)
|
|
for role in ("parameters", "comfyassets_prompt_pairs"):
|
|
metadata, _, carrier = select_video_carrier(
|
|
{"comment": json.dumps({"workflow": {}}), role: "x"}
|
|
)
|
|
self.assertEqual(metadata, {role: "x"})
|
|
self.assertIsNone(carrier)
|
|
# Without a role anywhere, the first workflow-only carrier wins.
|
|
metadata, _, carrier = select_video_carrier(
|
|
{"workflow": self.WORKFLOW, "comment": json.dumps({"workflow": {}})}
|
|
)
|
|
self.assertEqual(metadata, {"workflow": self.WORKFLOW})
|
|
self.assertIsNone(carrier)
|
|
|
|
def test_carriers_never_merge(self):
|
|
metadata, _, carrier = select_video_carrier(
|
|
{
|
|
"prompt": GRAPH,
|
|
"comment": json.dumps({"workflow": {"nodes": ["comment"]}}),
|
|
"description": json.dumps({"parameters": "Steps: 1"}),
|
|
}
|
|
)
|
|
self.assertEqual(metadata, {"prompt": GRAPH})
|
|
self.assertIsNone(carrier)
|
|
metadata, _, carrier = select_video_carrier(
|
|
{
|
|
"workflow": self.WORKFLOW,
|
|
"comment": json.dumps({"prompt": GRAPH}),
|
|
"description": json.dumps({"parameters": "Steps: 1"}),
|
|
}
|
|
)
|
|
self.assertEqual(metadata, {"prompt": GRAPH})
|
|
self.assertEqual(carrier, json.dumps({"prompt": GRAPH}))
|
|
|
|
def test_per_key_values_are_original_text_and_envelope_objects_reserialized(
|
|
self,
|
|
):
|
|
exact = '{"3":{"inputs":{"cfg":6.5000000000000000001}}}'
|
|
metadata, formats, _ = select_video_carrier({"prompt": exact})
|
|
self.assertEqual(metadata, {"prompt": exact})
|
|
self.assertEqual(formats, {"prompt": "original-text"})
|
|
envelope = json.dumps(
|
|
{"prompt": {"3": {}}, "workflow": {"nodes": []}, "parameters": "Steps: 1"}
|
|
)
|
|
metadata, formats, carrier = select_video_carrier({"comment": envelope})
|
|
self.assertEqual(json.loads(metadata["prompt"]), {"3": {}})
|
|
self.assertEqual(json.loads(metadata["workflow"]), {"nodes": []})
|
|
self.assertEqual(metadata["parameters"], "Steps: 1")
|
|
self.assertEqual(
|
|
formats,
|
|
{
|
|
"prompt": "reserialized-json",
|
|
"workflow": "reserialized-json",
|
|
"parameters": "original-text",
|
|
},
|
|
)
|
|
self.assertEqual(carrier, envelope)
|
|
|
|
def test_null_role_markers_and_invalid_workflow_keep_their_shape(self):
|
|
# The inspector refuses a null role marker rather than falling back.
|
|
metadata, formats, _ = select_video_carrier(
|
|
{"comment": json.dumps({"prompt": None, "workflow": [1]})}
|
|
)
|
|
self.assertEqual(metadata, {"prompt": None})
|
|
self.assertEqual(formats, {"workflow": "invalid"})
|
|
metadata, formats, _ = select_video_carrier({"prompt": 7, "workflow": 1})
|
|
self.assertEqual(metadata, {"prompt": None})
|
|
self.assertEqual(formats, {"workflow": "invalid"})
|
|
|
|
|
|
class TestIsVideoPath(unittest.TestCase):
|
|
|
|
def test_extensions(self):
|
|
for ext in VIDEO_EXTENSIONS:
|
|
self.assertTrue(is_video_path(f"clip{ext.upper()}"), ext)
|
|
self.assertFalse(is_video_path("image.png"))
|
|
self.assertFalse(is_video_path("noext"))
|
|
|
|
|
|
class TestReadVideoMetadataWithoutFfprobe(unittest.TestCase):
|
|
|
|
def setUp(self):
|
|
video_metadata.ffprobe_path.cache_clear()
|
|
self.addCleanup(video_metadata.ffprobe_path.cache_clear)
|
|
|
|
def test_missing_ffprobe_returns_empty_without_spawning(self):
|
|
with mock.patch.object(video_metadata.shutil, "which", return_value=None):
|
|
with mock.patch.object(video_metadata.subprocess, "run") as run:
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
run.assert_not_called()
|
|
|
|
def test_missing_ffprobe_is_mentioned_once(self):
|
|
video_metadata.reset_missing_notice()
|
|
with mock.patch.object(video_metadata.shutil, "which", return_value=None):
|
|
with self.assertLogs("prompt_manager.video", level="INFO") as cm:
|
|
read_video_metadata("a.mp4")
|
|
read_video_metadata("b.mp4")
|
|
self.assertEqual(len(cm.output), 1)
|
|
self.assertIn("ffprobe", cm.output[0])
|
|
|
|
def _run_returning(self, **attrs):
|
|
return mock.patch.object(
|
|
video_metadata.subprocess,
|
|
"run",
|
|
return_value=mock.Mock(**{"returncode": 0, "stdout": "{}", **attrs}),
|
|
)
|
|
|
|
def test_ffprobe_failure_timeout_and_garbage_are_empty(self):
|
|
with mock.patch.object(
|
|
video_metadata.shutil, "which", return_value="/bin/ffprobe"
|
|
):
|
|
with self._run_returning(returncode=1):
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
with self._run_returning(stdout="not json"):
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
with mock.patch.object(
|
|
video_metadata.subprocess,
|
|
"run",
|
|
side_effect=subprocess.TimeoutExpired("ffprobe", 1),
|
|
):
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
with mock.patch.object(
|
|
video_metadata.subprocess, "run", side_effect=OSError
|
|
):
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
|
|
def test_read_video_metadata_returns_per_key_prompt(self):
|
|
payload = {
|
|
"format": {
|
|
"tags": {
|
|
"PROMPT": GRAPH,
|
|
"WORKFLOW": '{"nodes":[]}',
|
|
"COMFYASSETS_PROMPT_PAIRS": '{"version":1}',
|
|
"COMMENT": json.dumps({"prompt": "must not win"}),
|
|
"ENCODER": "Lavf",
|
|
}
|
|
}
|
|
}
|
|
with mock.patch.object(
|
|
video_metadata.shutil, "which", return_value="/bin/ffprobe"
|
|
):
|
|
with self._run_returning(stdout=json.dumps(payload)):
|
|
self.assertEqual(
|
|
read_video_metadata("clip.mkv"),
|
|
{
|
|
"prompt": GRAPH,
|
|
"workflow": '{"nodes":[]}',
|
|
"comfyassets_prompt_pairs": '{"version":1}',
|
|
},
|
|
)
|
|
duplicates = {"format": {"tags": {"PROMPT": GRAPH, "prompt": "{}"}}}
|
|
with self._run_returning(stdout=json.dumps(duplicates)):
|
|
self.assertEqual(read_video_metadata("clip.mkv"), {})
|
|
markers = {"format": {"tags": {"comment": json.dumps({"prompt": None})}}}
|
|
with self._run_returning(stdout=json.dumps(markers)):
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {})
|
|
|
|
def test_ffprobe_output_is_parsed(self):
|
|
payload = {"format": {"tags": {"comment": json.dumps({"prompt": GRAPH})}}}
|
|
with mock.patch.object(
|
|
video_metadata.shutil, "which", return_value="/bin/ffprobe"
|
|
):
|
|
with self._run_returning(stdout=json.dumps(payload)) as run:
|
|
self.assertEqual(read_video_metadata("clip.mp4"), {"prompt": GRAPH})
|
|
cmd = run.call_args.args[0]
|
|
self.assertEqual(cmd[0], "/bin/ffprobe")
|
|
self.assertEqual(cmd[-1], "clip.mp4")
|
|
self.assertIn("format_tags", cmd)
|
|
|
|
|
|
@unittest.skipUnless(HAVE_FFMPEG, "ffmpeg/ffprobe not installed")
|
|
class TestReadVideoMetadataWithRealFfprobe(unittest.TestCase):
|
|
|
|
def setUp(self):
|
|
video_metadata.ffprobe_path.cache_clear()
|
|
self.tmpdir = tempfile.mkdtemp()
|
|
self.addCleanup(shutil.rmtree, self.tmpdir, True)
|
|
|
|
def test_round_trip_through_a_real_mp4(self):
|
|
path = os.path.join(self.tmpdir, "clip.mp4")
|
|
write_mp4(path, json.dumps({"prompt": GRAPH, "workflow": {"v": 1}}))
|
|
|
|
meta = read_video_metadata(path)
|
|
|
|
self.assertEqual(meta["prompt"], GRAPH)
|
|
self.assertEqual(json.loads(meta["workflow"]), {"v": 1})
|
|
|
|
def test_per_key_tags_round_trip_through_real_containers(self):
|
|
for name in ("per_key.mp4", "per_key.mkv", "per_key.webm"):
|
|
path = os.path.join(self.tmpdir, name)
|
|
write_video(path, prompt=GRAPH, workflow='{"nodes":[]}')
|
|
self.assertEqual(
|
|
read_video_metadata(path),
|
|
{"prompt": GRAPH, "workflow": '{"nodes":[]}'},
|
|
name,
|
|
)
|
|
|
|
def test_legacy_ilst_comment_atom_is_read(self):
|
|
path = os.path.join(self.tmpdir, "vhs.mp4")
|
|
write_mp4(path, json.dumps({"prompt": GRAPH}))
|
|
probe = subprocess.run(
|
|
[
|
|
shutil.which("ffprobe"),
|
|
"-v",
|
|
"quiet",
|
|
"-show_entries",
|
|
"format_tags",
|
|
"-of",
|
|
"json",
|
|
path,
|
|
],
|
|
capture_output=True,
|
|
text=True,
|
|
check=True,
|
|
timeout=60,
|
|
)
|
|
tags = json.loads(probe.stdout)["format"]["tags"]
|
|
self.assertIn("comment", tags)
|
|
self.assertEqual(read_video_metadata(path), {"prompt": GRAPH})
|
|
|
|
def test_video_without_a_comment_is_empty(self):
|
|
path = os.path.join(self.tmpdir, "plain.mp4")
|
|
write_mp4(path, "")
|
|
self.assertEqual(read_video_metadata(path), {})
|
|
|
|
|
|
@unittest.skipUnless(HAVE_FFMPEG, "ffmpeg/ffprobe not installed")
|
|
class VideoFixtureFfprobeTests(unittest.TestCase):
|
|
"""Characterization: the committed local-inspect video fixtures still carry the
|
|
tag maps recorded in ``video-tags-v1.json``, which the browser reader parity
|
|
tests use in place of ffprobe. A different ffprobe that reports other names or
|
|
values for the same bytes shows up here, not as a silent parity gap."""
|
|
|
|
FIXTURES = os.path.join(
|
|
os.path.dirname(os.path.abspath(__file__)), "fixtures", "local-inspect"
|
|
)
|
|
|
|
def test_committed_fixtures_produce_their_recorded_tags(self):
|
|
with open(
|
|
os.path.join(self.FIXTURES, "video-tags-v1.json"), encoding="utf-8"
|
|
) as stream:
|
|
recorded = json.load(stream)["fixtures"]
|
|
self.assertEqual(len(recorded), 8)
|
|
for name, tags in recorded.items():
|
|
with self.subTest(fixture=name):
|
|
probe = subprocess.run(
|
|
[
|
|
shutil.which("ffprobe"),
|
|
"-v",
|
|
"quiet",
|
|
"-show_entries",
|
|
"format_tags",
|
|
"-of",
|
|
"json",
|
|
os.path.join(self.FIXTURES, name),
|
|
],
|
|
capture_output=True,
|
|
text=True,
|
|
encoding="utf-8",
|
|
check=True,
|
|
timeout=60,
|
|
)
|
|
self.assertEqual(json.loads(probe.stdout)["format"]["tags"], tags)
|
|
|
|
|
|
if __name__ == "__main__":
|
|
unittest.main()
|