Compare commits

...
37 Commits
Author SHA1 Message Date
ketle-manandClaude Sonnet 5.5 787bf01381 release: v0.7.8 - Video Edit multi-track (overlay/text/audio), timeline text, sounds, backup fix
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 13:44:32 +09:00
ketle-manandClaude Sonnet 5.5 ca5649b926 docs: backup help/README mention sounds and overlay clips media
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 13:38:46 +09:00
ketle-manandClaude Sonnet 5.5 93d13e1fd0 fix: full backup now includes media used by Video Edit timeline sounds and overlay clips
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 13:38:24 +09:00
ketle-manandClaude Sonnet 5.5 94840dade5 docs: mention Asset 'Add as overlay' in Video help
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 13:31:54 +09:00
ketle-manandClaude Sonnet 5.5 9a98e3e50a feat: add 'Add as overlay (PinP)' button to the Video Asset detail panel
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:46:14 +09:00
ketle-manandClaude Sonnet 5.5 f20e13e093 fix: overlay/sound file pickers use a transparent native input over the button
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:39:49 +09:00
ketle-manandClaude Sonnet 5.5 98645407d9 feat: Video Edit tool menu follows the track view (video/text/overlay/audio), export stays fixed
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:30:01 +09:00
ketle-manandClaude Sonnet 5.5 e5e2daf523 feat: cascade default position of newly added overlay clips
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:15:31 +09:00
ketle-manandClaude Sonnet 5.5 2413dd2d77 feat: overlay (PinP) video/image track in Video Edit, composited on export
Overlay clips are placed/scaled/faded per clip, drawn over the main video in the
same PyAV pass that burns in text. Includes track view, panel, preview boxes,
undo/redo and project save/load.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:09:14 +09:00
ketle-manandClaude Sonnet 5.5 e197356c6b docs: update Video Edit help for track views, timeline texts and sounds
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 12:03:41 +09:00
ketle-manandClaude Sonnet 5.5 1d7f5721ad feat: timeline sounds on the Video Edit audio track (placeable, trimmable extra audio clips)
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 11:43:49 +09:00
ketle-manandClaude Sonnet 5.5 74d1a5579b refactor: store Video Edit text overlays on the timeline (absolute time) instead of per clip
Texts can now be dragged across clip boundaries; legacy projects with
clip-relative texts are migrated on load.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 11:40:33 +09:00
ketle-manandClaude Sonnet 5.5 60e94b0ab2 feat: drag/resize text bands on the Video Edit text track
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 11:34:49 +09:00
ketle-manandClaude Sonnet 5.5 81d7d65af6 feat: add Video/Text/Audio track view switch to Video Edit timeline
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-01 11:34:31 +09:00
ketle-manandClaude Opus 5.5 130ba05bd6 chore(release): v0.7.7 - Ollama意思決定モデル対応・Unslothキーなし対応・ヘルプ点検
- docs(help): Video Edit save contents / backup hint, 5 previously
  undocumented Settings sections (helpSettings18-22), font count fix,
  English template fallbacks synced with i18n (EN/JA/ZH)
- docs: DEVLOG
- bump version to 0.7.7

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 13:36:43 +09:00
ketle-manandClaude Opus 5.5 fe1b896405 feat(decision): add Ollama 0.35+ as a decision model backend
- decision-client.js: "ollama" backend calls Ollama's /v1/systemone directly
  from the browser (no key, CORS allowed) and surfaces its {error} messages;
  listDecisionModels() lists installed models whose /api/tags capabilities
  include "decision" (tev1, tev1:0.8b, nimble)
- Settings: backend switch (Unsloth / Ollama) updates URL and model list,
  refresh button, pull hint when no decision model is installed; section
  renamed to "Decision Model"
- A model name from the other backend falls back to that backend's default
- docs: help (EN/JA/ZH), README

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 13:26:17 +09:00
ketle-manandClaude Opus 5.5 5dbdbd519b feat(unsloth): allow keyless access when UNSLOTH_API_KEY is unset
- Proxy (AI TOOL / sidepanel / Decision API) and the Tagger's Unsloth VLM
  path now send requests without an Authorization header when no key is
  set, for Unsloth Desktop's Keyless API access -> "Chat and inference"
  (localhost-only restriction unchanged)
- A 401 with no key set returns a message explaining both options
- docs: help (EN/JA/ZH), README, .env.example (LAN exposure / keep
  "Allow tools" off)

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 13:17:06 +09:00
ketle-manandClaude Opus 5.5 20aff8236b chore(release): v0.7.6 - 意思決定モデル設定・フルバックアップのVideo Edit素材対応
- feat(backup): opt-in "Include media used by Video Edit projects" bundles the
  input-dir clips/BGM referenced by saved projects under _video_edit_media/;
  restored into input/ without overwriting existing files
- fix(backup): stream full-backup uploads to a temp file with read_chunk()
  so restores over ComfyUI's --max-upload-size (default 100 MB) no longer fail
  with "Request Entity Too Large"
- docs: help (Decision Model settings, backup), README, DEVLOG
- bump version to 0.7.6

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 12:39:09 +09:00
ketle-manandClaude Opus 5.5 dfe31374cf feat(settings): add dedicated Decision Model (Laya) settings
- New Settings section, stored under wfm_decision_settings independently of
  the AI TOOL / Tagger backends so a decision model can run alongside any
  LLM/VLM: backend (Unsloth for now), URL, model (laya / laya-multilingual /
  laya-english / laya-typed-decisions), default probability threshold
- Test button sends one yes/no question with the unsaved form values and
  shows latency + answer
- decision-client.js reads URL/model/threshold from these settings instead
  of borrowing the AI TOOL backend URL; isYes/pickChoice/pickScore default to
  the saved threshold
- i18n (en/ja/zh)

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 12:05:46 +09:00
ketle-manandClaude Opus 5.5 f826b54239 chore(release): v0.7.5 - Ming Image対応・widgets_valuesズレ修正・Unsloth Decision APIクライアント土台
- feat: Unsloth Decision API (/v1/systemone, Laya) relay via the existing
  key-attaching proxy + static/js/decision-client.js (decide/decideMany,
  noul/choice/score builders, probability-threshold helpers)
- docs: README/DEVLOG/help for Ming Image support and the decision client
- bump version to 0.7.5

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 11:04:17 +09:00
ketle-manandClaude Opus 5.5 cee7ef1bfa feat: support Ming Image workflows in GenerateUI, Gallery/Metadata and sidepanel I tab
- Detect TextEncodeMingImageEdit prompts (role from sampler/guider wiring,
  propagate role through linked prompt) and EmptyQwenImageLayeredLatentImage
- Settings: disable Sampler field when the SAMPLER source has no sampler_name
  (e.g. SamplerLCM)
- Metadata/I tab: treat BasicGuider "conditioning" as positive; prefer linked
  text source over stale widgets_values[0] in UI-format workflows
- Fix: normalize "legacy full" widgets_values on top-level nodes whose widgets
  are converted to wired inputs (previously only subgraph nodes), which shifted
  later values (e.g. EmptyLatentImage batch_size became 1024)

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-30 10:41:20 +09:00
ketle-manandClaude Opus 5.5 5fb1b1eb01 chore(release): v0.7.4 - Video EditにBGM合成・テキストオーバーレイ・クロップ・Undo/Redoを追加
Video Editサブタブの残りフェーズ(Phase 2〜5)を実装。
- BGM/音声トラック合成: Core音声ノード+ConcatenateVideoのcomplete_audioでグラフ内完結。複数クリップ結合時も各クリップの音声を保持。BGMはボタン/ドロップ/AssetのBGMに設定で指定
- テキストオーバーレイ: クリップ単位の字幕(位置・区間・色・縁取り・背景)、PyAVストリーム処理で焼き込み
- クロップ: Sourceプレビュー上の矩形エディタ(アスペクト固定・キャンセル)、VideoCropで書き出し
- Undo/Redo: 編集状態のスナップショット履歴(ボタン+Ctrl+Z/Y)
- クリアでオーディオ欄も初期化、BGM/Loadのファイル選択が開かない不具合を修正

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-29 15:43:32 +09:00
ketle-manandClaude Opus 5.5 4fa39daf0e docs: document Video Edit BGM, text overlays, crop and undo/redo
README (Video Tab section) and DEVLOG gain an "Unreleased" entry for the
feature/video-edit-bgm-text-overlay branch: audio/BGM track mixing,
per-clip text overlays, crop, undo/redo, BGM from Asset videos / drag &
drop, Clear resetting audio, crop Cancel/auto-exit, and the <label>-based
file picker fix.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-29 15:41:51 +09:00
ketle-manandClaude Opus 5.5 8beec6abdf feat(video-edit): crop edit Cancel button and auto-exit on tab switch
- "Cancel" appears next to "Done" while editing a crop and restores
  the crop the clip had when editing started (including none).
- Switching to the Plan/Asset subtab, another main tab, or another clip
  ends crop editing, keeping the adjusted rect (same as Done). The
  sidebar Project button doesn't, since the Edit subtab stays visible.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:57:13 +09:00
ketle-manandClaude Opus 5.5 99ffc1fedd feat(video-edit): Clear also resets the Audio section
Clear now empties the clips and restores the soundtrack settings (BGM,
volumes, keep-original, BGM start) to their defaults; it is enabled
whenever either clips exist or audio differs from the defaults, so a
BGM-only timeline can be cleared too. Undo restores both. The confirm
message and help text mention the audio reset.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:45:04 +09:00
ketle-manandClaude Opus 5.5 a63c6ec53b fix(video-edit): open BGM/Load file pickers via native <label>
The BGM picker (and the project Load button) opened a hidden file input
by calling input.click() from a button's click handler. On the user's
browser this silently showed no dialog, while the Video Source picker in
the same tab — a <label>-wrapped input — worked. Both are now
<label>-wrapped inputs styled as buttons, with Enter/Space wired for
keyboard activation.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:28:42 +09:00
ketle-manandClaude Opus 5.5 4e39547a4f feat(video-edit): pick BGM from Asset videos and by drag & drop
- Asset subtab: "Set as BGM (audio only)" on video assets uses the
  video's audio track as the Edit BGM (LoadAudio decodes audio from video
  files); videos without an audio track are rejected with a message.
- Audio section accepts a dropped audio/video file, and the BGM file
  input lists common audio extensions and mp4 explicitly instead of only
  audio/*.
- A failed BGM pick no longer clears the previously set BGM.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:20:46 +09:00
ketle-manandClaude Opus 5.5 c6487ad923 feat(video-edit): add undo/redo for timeline edits
Snapshot history of the editorial state (clip order, trim, crop, text
overlays, audio settings), recorded via a debounced hook on the existing
redraw paths and pushed only when the serialized state changes, so
selection/preview/resize never create entries. Deleted clips come back
from a clip registry without re-uploading. Toolbar buttons plus
Ctrl+Z / Ctrl+Y / Ctrl+Shift+Z (ignored inside text fields); history is
reset on project load.

Also fixes a lost click: committing a trim/hold-length value on blur
rebuilt the text overlay section, replacing a "+ Add text" button that
was being clicked; it now only updates the rows' bounds.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:04:55 +09:00
ketle-manandClaude Opus 5.5 0c6787f712 feat(video-edit): add per-clip crop with on-preview rectangle editor
Video clips get a normalized crop rect edited directly on the Source
preview (move / corner resize, optional 16:9, 9:16, 1:1, 4:3, 3:4 lock).
Export inserts core VideoCrop (double-nested {"crop": {...}} input, even
pixel values) after Video Slice. The export size is the first video
clip's cropped size; other clips of a different size are center-fit with
ImageScale. Text overlay previews are drawn relative to the cropped
frame, and crops are saved in Edit projects.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 12:01:32 +09:00
ketle-manandClaude Opus 5.5 59e96ce180 feat(video-edit): add BGM/audio track mixing and simple text overlays
Phase 4 (audio): the Edit tab export now builds a separate soundtrack in
the same ComfyUI graph and passes it to ConcatenateVideo's complete_audio.
Each clip contributes an exact-length segment (EmptyAudio + AudioMerge with
the clip's own GetVideoComponents audio), chained with AudioConcat, with an
optional BGM (LoadAudio -> TrimAudioDuration -> AudioAdjustVolume) mixed on
top. This also removes the old limitation that multi-clip exports lost
their audio. Export panel gets an Audio section (keep original audio +
volume, BGM file, BGM volume, BGM start offset).

Phase 3 (text): per-clip text overlays (text, start/end, size %, color,
9-grid anchor, outline, background) with a live CSS preview over the
Source/Result panes. Export burns them in via the new
/api/wfm/video/edit/overlay-text endpoint (PyAV streaming decode -> Pillow
composite -> libx264 encode, audio packets remuxed untouched, CJK-capable
system font lookup).

Text overlays and audio settings are persisted in Edit projects.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 11:49:55 +09:00
ketle-manandClaude Sonnet 5 6b262a9cf4 chore(release): v0.7.3 - GenerateUIタブにQwen Image 2.1対応を追加
TextEncodeQwenImage21ノード(Comfy-OrgのQwen-Image-2.1テンプレート、T2I/Edit兼用)のprompt/negative_prompt/resolutionをanalyzeWorkflow()で認識し、Input タブのPrompt欄・Settings欄から編集できるようにした。モデルロード・複数参照画像のLoadImageカードは既存の汎用ロジックで無改修対応。

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-24 17:23:13 +09:00
ketle-manandClaude Sonnet 5 cdf18e89ce chore(release): v0.7.2 - Workflowタブソート機能、Video Editプロジェクト永続化、Assetタイプフィルタ
Workflowタブにグループフィルタ右隣のソートドロップダウン(Date/Name昇順降順)を
追加。VideoタブではEditサブタブのトリムパネルの不具合修正(「現在位置を使用」
でスクラバー表示が更新されないバグ、バッジ重なり)とUI調整(左ペイン幅・スクラバー
高さ)を行い、Video Edit Phase 5としてタイムラインのSave/Save As/Load永続化
(VideoEditProjectService新設)とサイドバーProjectタブのPlan/Editモード切替を
実装。Asset subtabには動画/画像タイプフィルタドロップダウンを追加した。

DEVLOG.md/README.mdを更新し、pyproject.tomlのバージョンを0.7.2に更新。

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-18 10:48:36 +09:00
ketle-manandClaude Sonnet 5 7237bec315 feat: add sort dropdown to Workflow tab toolbar
Adds date/name asc/desc sorting next to the group filter, matching the
Gallery tab's existing sort UI and localStorage persistence pattern.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-18 09:10:52 +09:00
ketle-man f687f8d8ea chore(release): v0.7.1 - Unsloth Tagger経路のSSRFキー漏洩を修正
backend=="unsloth"のTagger VLM呼び出し(vlm_models/vlm_predict)が
unsloth_routes.pyと同じlocalhost allowlistを持たず、クライアント指定の
api_urlへAPIキーを無検証で送信していた問題を修正。副次的にgmic_qt_path
の検証も絶対パス/.exe拡張子/実ファイルチェックへ強化。
2026-09-17 17:53:58 +09:00
ketle-manandClaude Sonnet 5 8a3de00440 chore: QWEN_CHAT_INTEGRATION_PLAN.mdもgit管理対象外に追加
VIDEO_EDIT_TAB_PLAN.mdと同様、作業用の計画メモのため.gitignoreに追加。
未追跡ファイルだったためrm --cachedは不要。

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-17 17:40:13 +09:00
ketle-manandClaude Sonnet 5 cddfa4fdc1 chore: graphify-out全体とVIDEO_EDIT_TAB_PLAN.mdをgit管理対象外に変更
graphify-out/はこれまでgraph.json等の一部ファイルをバージョン管理下に
置いていたが、他クローンへの共有価値がないローカル専用出力として全体を
.gitignore対象にした。VIDEO_EDIT_TAB_PLAN.mdも作業用の計画メモとして
対象外にした。いずれもワーキングツリー上のファイルは削除せず、git管理
からのみ除外している。

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-17 13:44:38 +09:00
ketle-manandClaude Sonnet 5 ac675ce74f docs: VIDEO_EDIT_TAB_PLAN.mdにv0.7.0でリリースしたUI改善一式を追記
Asset subtabの中央下部移設・トリムスクラバー・プレビュー枠固定・
Frame/Asset連携の4件を第11節として追記し、Phase 1 MVPからv0.7.0
リリースまでの状態を冒頭に明記。Critical Filesにも今回変更した
ファイルを追加した。

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-17 13:40:26 +09:00
39 changed files with 4567 additions and 95897 deletions
+5
View File
@@ -3,6 +3,11 @@
# Unsloth Desktop requires an API key even for local access
# (Settings -> API in the Unsloth app, shown only once when issued).
#
# Alternatively leave the key empty and turn on Keyless API access ->
# "Chat and inference" in Unsloth Desktop's Settings -> API; requests are then
# sent without a key. That setting also serves your private LAN, and keep
# "Allow tools" OFF.
#
# 1. Copy this file to ".env" (same directory as this example file)
# 2. Paste your key after the "=" below (do NOT add a leading #, or the
# line becomes a comment and the key will not be loaded)
+6 -8
View File
@@ -6,11 +6,9 @@ __pycache__/
*.egg-info/
data/
# graphify: keep the knowledge graph itself under version control,
# but exclude the run-by-run cost/token log, the local extraction
# cache (both churn every rebuild and have no value to other clones),
# and the machine-local interpreter/scan-root pointers.
graphify-out/cost.json
graphify-out/cache/
graphify-out/.graphify_python
graphify-out/.graphify_root
# graphify: local-only knowledge graph output, not shared with other clones
graphify-out/
# Working-notes plan docs — local scratch, not meant to ship with the repo
VIDEO_EDIT_TAB_PLAN.md
QWEN_CHAT_INTEGRATION_PLAN.md
+8
View File
@@ -2,6 +2,14 @@
Condensed version-by-version index of DEVLOG.md (each line: version + one-line summary of what changed and why). Full rationale, code details, and "How to apply" lessons live in the excluded DEVLOG.md itself; this index exists so graphify can extract a queryable semantic node per release without feeding the full log to the local Ollama model. Regenerate with `python tools/generate_doc_index.py devlog` whenever DEVLOG.md changes.
- **v0.7.8(2026-10-01)** — Video Edit: マルチトラック化(ビデオ/オーバーレイ/テキスト/オーディオ)
- **v0.7.7(2026-09-30)** — 意思決定モデル: Ollama 0.35+ バックエンド追加
- **v0.7.6(2026-09-30)** — Settings: 意思決定モデル (Laya) の専用設定
- **v0.7.5(2026-09-30)** — Ming Image ワークフロー対応(GenerateUI / Gallery・Metadata / サイドパネルIタブ)
- **v0.7.4(2026-09-29)** — Video Edit: BGM/音声トラック合成(Phase 4)— 複数クリップ結合時の音声消失も解消
- **v0.7.3(2026-09-24)** — GenerateUIタブにQwen Image 2.1(TextEncodeQwenImage21)対応を追加
- **v0.7.2(2026-09-18)** — Workflowタブにソート機能追加(Date/Name 昇順降順)
- **v0.7.1(2026-09-17)** — セキュリティ修正: Tagger VLM の Unsloth 経路でAPIキーがSSRFにより外部送信され得る不備を修正
- **v0.7.0(2026-09-17)** — プレビュー枠の高さ固定・AssetサブタブをPlan/Editと並ぶ中央下部へ移設・トリムパネルにClipchamp風スクラバー追加・Frame保存のVideo Assets登録とAsset→Plan画像連携
- **v0.6.3** — Send CCボタンでMP4動画をComic Creatorの新設「動画ツール」へ送れるように対応
- **v0.6.2** — Image Editタブにペンタブレット筆圧対応とFillツール(バケツ塗りつぶし)を追加
+227
View File
@@ -2,6 +2,233 @@
---
## v0.7.8(2026-10-01)
### Video Edit: マルチトラック化(ビデオ/オーバーレイ/テキスト/オーディオ)
タイムライン上部のボタンでトラック表示を切り替える(ビデオ=青 `#4a9eff`・オーバーレイ=青・テキスト=緑 `#3fb950`・オーディオ=赤 `#f85149`)。下のツールメニューも連動して切り替わる(ビデオ=トリム+クロップ、オーバーレイ=オーバーレイクリップ、テキスト=テキストオーバーレイ、オーディオ=オーディオ設定)。Save/Load/書き出しは右に固定。
- **テキストをタイムライン直付けに変更**: 時間をクリップ相対でなくタイムライン絶対秒で持つ(`_s.texts`)。テキスト帯のドラッグ移動(クリップをまたげる)と端ドラッグでのリサイズに対応。旧形式プロジェクト(クリップ内`texts`)は読込時に絶対秒へ自動変換する(変換処理は実機未検証)。クリップ複製ではテキストは複製されなくなった。
- **追加サウンド**: オーディオトラックに「+ サウンド...」で効果音・ナレーションを何個でも配置(開始/長さ/音量dB、帯のドラッグで移動・端ドラッグでトリム)。書き出しは`LoadAudio→TrimAudioDuration→AudioAdjustVolume→AudioConcat(無音パディング)→AudioMerge`でBGMの上にミックス。実際のComfyUIで実行成功を確認(音の位置自体は耳では未確認)。
- **オーバーレイ(PinP)**: 動画/画像をメイン動画の上に重ねる。時間・位置(9方向プリセット/X/Y)・サイズ・不透明度を個別指定。追加位置は4隅→中央の順にずらす。プレビューには点線枠+サムネイルを表示。Assetタブの詳細パネルに「オーバーレイに追加(PinP)」ボタンを追加。
- **合成方式**: ComfyUIグラフには手を入れず、既存のテキスト焼き込みと同じPyAV 1パス(`/api/wfm/video/edit/overlay-text`に`pips`を追加)で、オーバーレイ→テキストの順に描画。動画オーバーレイは終端フレームを保持。オーバーレイ自身の音声はミックスしない。実際の書き出し出力のフレームを目視確認。
- Undo/Redo・プロジェクト保存/読込・ヘルプ(3言語)に対応。
### フルバックアップ: 追加サウンド/オーバーレイの素材漏れを修正
「Video Editプロジェクトの素材を含める」が、クリップとBGMしか集めていなかったため、追加サウンドとオーバーレイクリップの素材がZIPに入らなかった(`_iter_video_edit_media_refs`が`clips`とBGMだけを走査)。`sounds`/`pips`も走査するよう修正。単体テストと実APIでの出力ZIPの中身確認済み(パストラバーサル・出力フォルダ参照・旧形式・壊れたJSONの扱いも確認)。復元側は無変更。
### 実機で分かったこと
- **ファイル選択ダイアログ**: Overlay追加ボタン(label+非表示input、BGMと同方式)が、ユーザーの通常ブラウザタブではダイアログを出さず、Shift+クリックの別ウィンドウでは出た。コードの欠陥ではなく通常タブ環境側の可能性が高い(未特定)。念のためOverlay/Soundボタンは透明な本物の`<input type=file>`をボタンに重ねる方式に変更。Playwrightはダイアログを横取りするため、この種の不具合は自動テストでは検出できない。
- 検証用ブラウザに待機中のファイル選択が溜まると、ページが古い状態のままになりうる(サーバーは`Cache-Control: no-store`)。
---
## v0.7.7(2026-09-30)
### 意思決定モデル: Ollama 0.35+ バックエンド追加
Ollama v0.35.0(2026-09-28)が`POST /v1/systemone`で意思決定モデルに対応した(質問・回答の形式はUnsloth/ollayaと同じ)。モデルは`tev1`(Together AI、4B・4.5GB)/ `tev1:0.8b`(812MB)/ `nimble`(Bespoke Labs、9B・9.5GB)で、`ollama pull`で取得する。
- `decision-client.js`: バックエンド`ollama`を追加。APIキー不要でCORSも許可されているため、Unslothのようなサーバー中継は通さずブラウザから直接呼ぶ(既存のOllama LLMバックエンドと同じ)。Ollamaのエラー`{"error": ...}`(例: `model "tev1" not found, try pulling it first`)はそのまま表示。
- `listDecisionModels()`: `/api/tags`の`capabilities`に`"decision"`を持つインストール済みモデルだけを返す(通常のLLMは出ない)。
- Settings「意思決定モデル」: バックエンド切替でURL(11434)とモデル一覧を更新、↻ボタン、意思決定モデルが無い場合は`ollama pull tev1:0.8b`等を案内。Laya専用でなくなったためセクション名を「意思決定モデル」に変更。保存済みモデル名が別バックエンドのもの(Ollamaなのに`laya`等)なら既定モデルへ戻す。
- **実測**: Layaが外した画像プロンプト(「masterpiece, 1girl, silver hair, school uniform…」)の判定を、`tev1:0.8b`は主題person 0.98〜0.99・NSFW「none」0.97〜0.98と全問正解。2回目以降0.2〜0.6秒。ユーザー実機のテストボタンで「接続成功 ✓ 280 ms、yes=0.914」。
- **作業中の不具合**: Pythonスクリプト経由で書いた正規表現の`\b`がバックスペース制御文字(0x08)に化け、モデル名補正が効かなかった(構文エラーにならず単体テストで発覚)。修正後、リポジトリ全体に制御文字が無いことを確認。
### Unsloth: APIキー未設定時はキー無しで送信(Keyless API access対応)
Unsloth Desktopの Settings → API → Keyless API access →「Chat and inference」をオンにするとキー無しで使えるため、`UNSLOTH_API_KEY`未設定を許容した。
- 対象は中継(`py/routes/unsloth_routes.py`: AI TOOL・サイドパネル・意思決定API)とTaggerのUnsloth VLM経路(`py/services/tagger_service.py`)の2か所。キー未設定なら事前エラーにせず`Authorization`無しで送る。localhost限定(SSRF対策)は維持。
- キー無しでUnslothが401を返した場合は「.envにキーを設定するか、Keyless API access →『Chat and inference』をオンに」という案内を返す。
- 偽Unslothサーバー(キー必須/不要)で、キー無し成功・案内メッセージ・キー付与・非localhost拒否を検証(5回連続合格)、ユーザー実機でも確認。
- ヘルプ・README・`.env.example`に、この設定は同じLAN内にもAPIを開放すること、「Allow tools」(キー無しの接続元にPython/ターミナル実行を許す)はオフのままにすることを明記。
- **実機で発生した不具合**: 英語ヘルプ文に`"Chat and inference"`をエスケープせずに入れ、`i18n.js`が構文エラーになりSPA全体が「Loading workflows...」で停止した。この環境では`node --check x.js`がESモジュールの構文エラーを見逃す(終了コード0)ことが原因で、以後は`.mjs`にコピーして`node --check`する方式で確認している。
### ヘルプ(英日中)の点検と修正
Settings・Video(Edit)ページを3言語で点検。言語間の内容差は無かったが、3言語共通の記載漏れ・不正確な点を修正した。
- Video Edit: Saveで保存される内容に、クロップ・テキストオーバーレイ・音声/BGM設定を追記(従来は順序・トリム・参照ファイルのみ記載)。本文に出ていた内部キー名「(see helpVideo9)」を「Projectタブの項目を参照」に。素材はinput内ファイルへの参照のみであること、フルバックアップの素材オプションで保存できることを追記。
- Settings: 未記載だった5セクション(Video Volume、Gallery出力フォルダ、デフォルトCheckpoint、CivitAI APIキー、G'MIC-Qtパス)をhelpSettings18〜22として追加。
- フォント数「Google Fonts 16種」→「15種+システム既定」に訂正。
- テンプレート(index.html)の英語初期表示のうち古くなっていた項目を、Settings・Video全項目についてi18nの英語と同期。
---
## v0.7.6(2026-09-30)
### Settings: 意思決定モデル (Laya) の専用設定
v0.7.5で入れた`decision-client.js`は接続先を「AI TOOLのバックエンドがUnslothならそのURL、それ以外は8888」とAI TOOL設定から借りていたため、LLM/VLMと併用するとURL変更が連動する・モデルやしきい値を選べない問題があった。Settingsタブに独立したセクションを新設し、`wfm_decision_settings`(backend / baseUrl / model / threshold)としてAI TOOL・Tagger設定とは別に保存する。
- backendは現状Unslothのみだが、同じTypeSafe互換APIを話すollaya(:11435、キー不要)等を後から足せるようフィールドとして持つ。
- モデル: `laya`(Unsloth側で選択中)/ `laya-multilingual` / `laya-english` / `laya-typed-decisions`。
- 既定しきい値(0.5〜0.99、既定0.8): `isYes`/`pickChoice`/`pickScore`でしきい値省略時に使う。
- テストボタン: 保存前のフォーム値でnoul1問を送り、応答時間と回答を表示(`testDecisionConnection()`)。
- **実機確認**: 初回はUnsloth側で Settings → API → Decision API → Serve requests がオフのため HTTP 404 `The Decision API is off`(中継・APIキーは正常に通っている)。オン後は「接続成功 ✓ 10430 ms、テスト回答 yes=0.945」(初回はモデル読み込み込み)。
### Settings: フルバックアップのVideo Edit対応
Video Editのプロジェクト(`video_edit_project/*.json`)はデータフォルダ内なので元からZIPに入っていたが、中身はComfyUIの`input/`にアップロードしたクリップ・BGMへの参照(`serverRef`)だけで、素材そのものは含まれていなかった。別環境への復元や`input/`整理後はプロジェクトを開いてもクリップが読み込めない。説明文にもVideo Editの記載がなかった。
- 3つ目のオプション「Video Editプロジェクトの素材を含める」(`include_video_media=1`): 全プロジェクトの`clips[].serverRef`と`audio.bgm.serverRef`(type=input)を`_video_edit_media/<subfolder>/<filename>`に同梱。重複・欠損は除外し、`input/`の外を指す参照(`..`等)は含めない。
- 復元時、`_video_edit_media/`はデータフォルダではなく`input/`へ戻す。同名ファイルが既にあれば上書きしない(`input/`は他のワークフローと共有のため)。結果に`media_restored`/`media_existing`を返し「Video Edit素材: ○件復元、○件は既存」と表示。エクスポート専用の`_external/`とは扱いが異なる。
- 説明文(Settings注記・ヘルプ・README)のバックアップ対象にVideo Editプロジェクトを追加。
**実機で判明した既存問題(Request Entity Too Large)**: aiohttp 3.14の`BodyPartReader.read()`はComfyUIの`--max-upload-size`(既定100MB)を強制する。workflows/wildcardオプション込みのバックアップは約125MB(`_external/`だけで118MB)で超過し復元できなかった(今回の追加以前から起こり得た)。`handle_import_full`を`read_chunk()`で1MBずつ一時ファイルへ流し込む方式に変更し、上限に関係なく復元できるようにした(ZIP全体をメモリに載せることもなくなった)。
**検証**: 一時フォルダでの単体テスト(素材収集・重複/欠損除外・パストラバーサル遮断・既存非上書き)、上限1MBのaiohttpテストサーバー(ComfyUIと同じ3.14.3)への5MBアップロード、ユーザー実機で「インポート完了: 45件 / Video Edit素材: 1件復元、3件は既存」を確認。
### ヘルプ
Settingsページの「Connections」カードに意思決定モデルの項目(helpSettings17、英日中)を追加。フルバックアップの項目(helpSettings15/16)にVideo Editプロジェクトと素材オプションを追記し、テンプレート側の英語初期表示もi18nと同期(15はVideo Plansが抜けたままになっていた)。
---
## v0.7.5(2026-09-30)
### Ming Image ワークフロー対応(GenerateUI / Gallery・Metadata / サイドパネルIタブ)
ユーザー提供の`ming_image_test1〜5.json`(T2I・参照画像Edit・レイヤー分解×2・標準KSampler T2I)に対応。
- `comfyui-workflow.js`: `TextEncodeMingImageEdit`(`prompt`単一ウィジェット+`images.image_N`最大8枚のAutogrow参照画像)を`TextEncodeQwenImageEdit`と同じ扱いで検出。ロールはsampler/guider配線から決まるので、レイヤー分解ワークフローでKSamplerのnegativeに繋がる空プロンプトの2つ目のインスタンスはNegativeとして出る。linked promptへのロール伝播も追加。`EmptyQwenImageLayeredLatentImage`をLatentパネル対象に追加。
- SamplerCustomAdvancedのSAMPLER入力が`sampler_name`を持たないノード(`SamplerLCM`)の場合は`samplerNodeId=null`とし、SettingsパネルのSampler欄をN/A無効化(従来は無関係なsampler名が選択表示され、Applyで存在しない入力に書き込んでいた)。
- `metadata-tab.js` / `node_sets_menu.js`: `BasicGuider`の`conditioning`入力をpositive扱い(従来は判別不能テキスト扱い)。UI形式でCLIPTextEncodeの`text`がリンクされている場合、`widgets_values[0]`に残る古い入力値よりリンク先(`PrimitiveStringMultiline`等)を優先。
**汎用バグ修正(top-levelノードのwidgets_valuesズレ)**: ウィジェットをリンク入力化しても現行フロントエンドは値を`widgets_values`に残す(legacy full形式)。サブグラフ内部ノードは`_stripLegacyLinkedWidgetValues`で正規化していたが、top-levelノードは未対応で、リンクされたウィジェットより後ろの値が1つずつズレていた(`EmptyLatentImage`のwidth/heightを`GetImageSize`/`PrimitiveInt`に繋ぐと`batch_size=1024`、`EmptyQwenImageLayeredLatentImage`の`layers=1024`等)。判定ロジックを`_normalizeLinkedWidgetValues`に切り出し、`convertUiToApi`の本ループ前にも適用。
**検証**: Node上で稼働中ComfyUIの`/object_info`を使い3系統(analyzeWorkflow / metadata-tab / node_sets_menu、UI形式・API形式両方)を5ワークフローで確認。回帰確認として`user/default/workflows`配下366件を修正前後の`convertUiToApi`で比較し、差分35件はすべてズレていた値が正しくなったもの(KSampler `steps=397027830130951`→10、`cfg=25`→8等)。変換エラー1件は修正前から発生する無関係なもの。ユーザー実機で生成まで確認済み。
### Unsloth Decision API(Laya決定モデル)クライアントの土台
Unsloth DesktopがTypeSafe互換の意思決定API(`POST /v1/systemone`、Laya)を提供するようになったため、活用機能の試行に先立って呼び出しの土台のみ実装(UIからの利用は未実装)。
- `py/routes/unsloth_routes.py`: 既存プロキシ(`.env`のAPIキー付与+localhost限定)の`_ALLOWED_PATHS`に`/v1/systemone`を追加。HTTPエラー時はUnsloth側エラー本文の先頭300字をmessageに含める(質問スキーマ誤りをフロントから診断できるように)。
- `static/js/decision-client.js`(新規、SPA用): `decide(state, questions, {model, baseUrl})`・`decideMany`(同時実行数制限、個別失敗は`{error}`)、ビルダー`noul`/`choice`/`score`(Unslothの`instructions`+`criteria`形式)、上限チェック(64問/255選択肢/10段階)、`isYes`/`pickChoice`/`pickScore`。ドキュメントの推奨どおり`confidence`ではなく`probabilities`でしきい値判定し、しきい値未満は`confident:false`(自動適用せず提案表示する用途向け)。接続先はAI TOOL設定がUnslothならそのURL、それ以外は`http://localhost:8888`。
- Layaはテキスト専用(画像入力なし)。画像の判定にはTaggerタグやVLMキャプションを経由させる必要がある。
- 検証はプロキシをモックしたNode単体テストのみ(作業時にUnslothのDecision APIが待ち受けておらず実APIは未検証)。
---
## v0.7.4(2026-09-29)
### Video Edit: BGM/音声トラック合成(Phase 4)— 複数クリップ結合時の音声消失も解消
[VIDEO_EDIT_TAB_PLAN.md](VIDEO_EDIT_TAB_PLAN.md)のPhase 4。着手前に既存の動画編集系ノードを調査し、ComfyUI Core 0.37.0の音声ノード群(`LoadAudio`/`TrimAudioDuration`/`AudioConcat`/`AudioMerge`/`AudioAdjustVolume`/`EmptyAudio`)と`ConcatenateVideo`の`complete_audio`入力(結合動画全体の音声を上書き)だけで、書き出しグラフ内で完結できると判明したため、計画にあった独自`mix-audio` APIは作らなかった。音声トラックの組み方はH3Studioのreel書き出し(クリップ音声を尺にconform→連結→musicを重ねる)を参考にした。
**グラフ構成**: クリップごとに`EmptyAudio(クリップ尺)`+`AudioMerge(自クリップの音声)`で尺ぴったりのセグメントを作り(`AudioMerge`はaudio2をaudio1の長さにpad/trimし、音声なしクリップ=Noneならaudio1をそのまま返す)、`AudioConcat`で連結→(元音量≠0dBなら`AudioAdjustVolume`)→BGM(`LoadAudio→TrimAudioDuration(開始位置, 総尺)→AudioAdjustVolume`)を`AudioMerge`で重ねて`complete_audio`へ渡す。単一の動画クリップで元音声そのまま・BGMなしの場合のみ従来通り再エンコードなしでパススルー。
**UI**: 書き出しパネルにオーディオ欄(元の音声を残す+音量dB、BGMファイル、BGM音量、BGM開始位置)。BGMは「BGM選択...」ボタン、オーディオ欄への音声/動画ファイルのドラッグ&ドロップ、AssetサブタブのVideoに追加した「BGMに設定(音声のみ)」(動画の音声トラックを使う。Galleryは音声ファイルを扱わないため)で指定できる。▶プレビュー中はBGMも`<audio>`で同時再生。クリアボタンでオーディオ欄も初期状態に戻る(BGMのみ設定されている状態でもクリア可能)。
**実機で判明した注意点**: 生の`Video Slice`出力と画像由来の`CreateVideo`クリップを`ConcatenateVideo`へ直接混ぜると`Video chunk N could not be encoded compatibly`(extradata/color space不一致)で失敗する——complete_audioの有無に関係なく。既存の「複数クリップ時は全クリップを`GetVideoComponents→CreateVideo`で再構成する」処理は音声対策だけでなくこのためにも必要だったので維持した。
**検証**: 動画2本(片方トリム)+静止画+BGM(-6dB)をUIから書き出し、尺6.625秒・音声同尺、区間ごとのRMSで元音声+BGM/BGMのみを確認。音声なし動画(audio=None)+BGM、mp4をBGMにした書き出しも確認。
### Video Edit: テキストオーバーレイ(Phase 3)
クリップ単位のテキスト(文字・クリップ内の開始/終了秒・サイズ(フレーム高さ%)・色・9方向アンカー・縁取り・背景)。クリップ相対時刻で保持するので並べ替えに追従し、書き出し時に絶対時刻へ変換する。
Core `TextOverlay`は上/下固定・区間指定なし・既定フォントがCJK非対応、既存のテキスト系カスタムノード(advanced-textoverlay等)も静止画向けか独立パイプラインで、かつ全フレームをIMAGEテンソル化するとメモリが厳しい(720p×720フレームで約8GB)ため、新設の`POST /api/wfm/video/edit/overlay-text`(`VideoService.overlay_text_on_video()`、`asyncio.to_thread`)でPyAVストリーム処理にした: 1フレームずつデコード→該当区間のテキストレイヤー(事前に1回だけ描画)をPillowで合成→libx264でエンコード、音声パケットは再エンコードせずリマックス。書き出しはグラフ出力を`wfm_edit_pre`中間ファイルに保存→焼き込み→中間ファイル削除(`wfm_edit_pre`接頭辞かつoutput内のみ削除対象)の2段構成。フォントはmeiryo→YuGothM→NotoSansJP→msgothic→arialの順に探索。プレビューはSource/Result枠上にCSSで近似表示(`video-preview.js`に`getPreviewPaneElements()`を追加)。
**検証**: ComfyUI再起動後、動画+画像クリップに英日テキスト2件を付けて書き出し、各時刻のフレームで表示/非表示・位置・日本語描画・背景、音声長の一致、中間ファイル削除を確認。
### Video Edit: クロップ(Phase 2)
動画クリップごとに正規化座標(0..1)のクロップ矩形を持ち(ComfyUI-LoadVideoCropと同じ方式)、Sourceプレビュー上で移動+四隅リサイズ(アスペクト比 自由/16:9/9:16/1:1/4:3/3:4固定可、外側は暗転)。「完了」で確定、「キャンセル」で編集前のクロップに戻す。Plan/Assetサブタブ・他タブへの移動、別クリップ選択時は「完了」扱いで編集モードを自動終了。書き出しはCore `VideoCrop`(0.37.0でもexperimental)を`Video Slice`の直後に挿入——`crop`入力は計画どおり二重ネスト`{"crop":{"x","y","width","height"}}`で、偶数ピクセルに丸める(H.264 4:2:0制約)。出力サイズは先頭動画クリップのクロップ後サイズで、サイズの異なる他クリップは`ImageScale(crop=center)`でフィット。解像度不一致ガードはクロップなしの動画クリップ同士だけ比較。`ImageCrop`は0.37でdeprecatedのため不採用。
**検証**: 608x352→300x200のクロップ出力が元フレームの同領域と一致(平均画素差3.1=コーデック誤差程度)。UIで1:1クロップしたクリップを先頭に書き出し、280x280・字幕がクロップ後の枠内・2本目が中央フィットされることを確認。
### Video Edit: Undo/Redo(Phase 5残り)
編集状態(クリップ順・トリム・保持時間・クロップ・テキスト・オーディオ設定)のJSONスナップショット履歴(上限100)。各編集経路に個別に仕込むのではなく、全編集が必ず通る既存の再描画3関数(`_renderTimeline`/`_refreshTextPreview`/`_syncAudioPanel`)から300msデバウンスで記録し、状態が変わったときだけpushする(選択・プレビュー・リサイズでは積まれず、連続入力やドラッグは1ステップにまとまる)。削除クリップはFile参照を持つ`_clipRegistry`から再アップロードなしで復元。↶/↷ボタンとCtrl+Z / Ctrl+Y / Ctrl+Shift+Z(入力欄内はブラウザ標準のundoを優先)。プロジェクト読込時は履歴リセット。
### その他
- **プロジェクト保存**にクロップ・テキスト・オーディオ設定を追加(旧プロジェクトは既定値で読込)。
- **BGM選択・Loadボタンが実ブラウザでダイアログを開かない不具合を修正**: hidden `<input type=file>`をボタンのclickハンドラから`input.click()`で開く方式が、ユーザー環境ではエラーも出さずに無反応だった(同タブのVideo Sourceは`<label>`で包む方式で正常動作)。両ボタンを`<label>`方式に変更。Playwrightはファイル選択を横取りするため自動テストでは再現できなかった。
- **トリム値入力直後に「+ テキスト追加」のクリックが効かない不具合を修正**(テキスト欄実装時に混入): blur時の`change`でテキスト欄全体を再構築し、押そうとしたボタンが置き換わっていた。上限値だけ更新する方式に変更。
**How to apply**: ComfyUI Coreの新しい動画/音声ノードは、`execution_success`で判断せず出力をprobe・画素比較まで実測すること(`VideoTrim`/`VideoCrop`の二重ネストのように、形式を誤ってもエラーにならず無視されるノードがある)。ファイル選択UIは`<label>`で包むネイティブ方式で作り、動作確認はユーザー実機で行うこと。
---
## v0.7.3(2026-09-24)
### GenerateUIタブにQwen Image 2.1(TextEncodeQwenImage21)対応を追加
Comfy-Orgのnightly workflowテンプレート`qwen_image2.1_t2i.json`系(`TextEncodeQwenImage21`ノードでprompt/negative_prompt/resolutionとimage_1〜image_10参照画像を一手に扱う、T2IとEdit兼用のsubgraph構成)をGenerateUIタブで使えるようにした。
**変更内容**: `comfyui-workflow.js`の`analyzeWorkflow()`に`TextEncodeQwenImage21`の分岐を追加。`TextEncodeBooguEdit`と同じ「1ノードにprompt/negative_prompt両方を持ち、ロールは固定(KSampler側の配線をたどらない)」パターンで`prompt_nodes`へ登録し、Input タブのPositive/Negative Prompt欄に反映されるようにした。あわせて`_getWidgetMapping()`に`TextEncodeQwenImage21: ["prompt", "negative_prompt", "resolution"]`を追加し、Settings欄からの書き戻しにも対応。
**調査で判明した既存アーキテクチャ**: GenerateUIのModel/Diffusion Model/Text Encoder/VAE/KSampler/EmptyLatentImage検出は元々ノードタイプ非依存の汎用ロジックなので、UNETLoader+CLIPLoader+VAELoaderの3分割ロード構成(Flux/Qwen Image系で共通)は無改修でそのまま動作した。また画像アップロードUI(Input タブのImageサブパネル)は`generate-tab.js`ではなく`comfyui-editor.js`が担当しており、`analysis.load_image_nodes`に載る全LoadImageノード(1個に限らず)に対して個別カードを描画する汎用実装だったため、Qwen Image 2.1の複数参照画像編集(image_1・image_2をそれぞれ別のLoadImageで接続したワークフロー)もコード変更なしでそのまま動作した——ユーザー提供のI2Iテストワークフローで実機確認済み。
**How to apply**: 新しい「1ノードでprompt+negative_prompt+複数画像入力」型の text-encoder ノードをGenerateUIに対応させる際は、まず`analyzeWorkflow()`のprompt_nodes検出だけ確認すればよい場合が多い——モデルロード・サンプラー・LoadImageカードは大抵ノードタイプに依存しない汎用ロジックが既にカバーしている。画像アップロードUIを探すときは`generate-tab.js`ではなく`comfyui-editor.js`を見ること(両者は別ファイル)。
関連: [[project_v071_unsloth_ssrf_fix_and_outer_gitignore]]
---
## v0.7.2(2026-09-18)
### Workflowタブにソート機能追加(Date/Name 昇順降順)
Workflowタブのグループフィルター右隣に、Galleryタブと同じパターンのソートドロップダウン(Date Newest/Oldest、Name A-Z/Z-A)を追加した。`wf.mtime`(バックエンドが既に返していたファイル更新時刻)を使ったクライアント側ソートで、選択状態は`localStorage`(`wfm_workflow_sort`)に永続化する。
**変更ファイル**: `templates/index.html`(`#wfm-sort` select追加)、`static/js/workflow-tab.js`(`sortWorkflows()`追加、`renderGrid()`で`filterWorkflows()`の結果に適用)
### Videoタブ左ペイン幅調整・Editトリムパネルのバグ修正とUI調整
**左ペイン幅**: PlanサブタブのフォームパネルをGenerateUI寄りの380px固定から253px(約2/3)に縮小し、中央プレビュー/タイムラインを広げた(`.wfm-video-form-panel`の`width`のみの変更、`flex:1`の中央パネルが自動で広がる)。
**「現在位置を使用」ボタンでトリムスクラバーの見た目が更新されないバグを修正**: トリムのStart/End数値入力とスクラバー(ドラッグハンドル・ハイライト範囲)は同じ`commit()`関数を経由する設計だが、`commit()`はスクラバー自身の`updateRange()`(ハンドル位置・ハイライト帯の再描画)を呼んでいなかった。ハンドルをドラッグした場合のみ呼び出し元が直接`updateRange()`を叩いていたため気付かれておらず、数値入力や「現在位置を使用」ボタンではclipのtrimStart/trimEndは正しく更新されるのにスクラバーの表示だけ古いままになっていた。`_wireTrimScrubber()`が`updateRange`関数自体を返すようにし、`_renderTrimPanel()`側で`commit()`から必ずそれを呼べるようにして解消。
**トリムスクラバーのバッジ重なりを解消**: 開始/終了/再生位置の時刻バッジ(ハンドルから浮き上がるラベル)がクリップ名やルーラー目盛りと重なる、また再生位置がトリム開始/終了に近いとStart/EndバッジとPlayheadバッジ同士が重なって読めなくなる不具合をユーザーが発見。クリップ名とスクラバーの間隔を拡大、スクラバー上部にバッジ専用の余白(`padding-top`)を確保、トラック高さを36px→52pxに拡大した上で、Playheadバッジのみ`top`をStart/Endバッジより高い位置(2段目)にずらして重なりを回避した。
**変更ファイル**: `static/css/video-tab.css`(`.wfm-video-form-panel`, `.wfm-video-trim-scrubber/-track/-badge/-badge-playhead`)、`static/js/video-edit-tab.js`(`_wireTrimScrubber()`が`updateRange`を返すよう変更、`_renderTrimPanel()`の`commit()`から呼び出し、クリップ名/トリム行の余白調整)
**How to apply**: 同じ状態変更を複数の入力経路(数値入力・ボタン・ドラッグ)から行える場合、各経路が同じ「見た目を再描画する関数」を実際に呼んでいるかを確認すること——1経路(ドラッグ)だけがたまたま直接呼んでいたために、他の経路のバグが長く気付かれずに残っていた。
### Video Assetタブに動画/画像フィルタドロップダウン追加
Asset切替ドロップダウン(`__Video Assets__`/`__Video Temp__`/All Video Assets)の右隣に、幅を約半分にした動画/画像タイプフィルタ(All Types / Video Only / Image Only)を追加。既存の`isVideoFile()`判定を再利用してクライアント側でリストを絞り込む。
**変更ファイル**: `templates/index.html`(`#wfm-video-asset-kind` select追加)、`static/js/video-asset-tab.js`(`_s.kindFilter`追加、`_filteredImages()`で適用)
### Video Edit プロジェクト永続化(Phase 5)とサイドバーProjectのPlan/Editモード切替
[VIDEO_EDIT_TAB_PLAN.md](VIDEO_EDIT_TAB_PLAN.md)のPhase 5(永続化)を実装。他の未着手フェーズ(クロップ/テキストオーバーレイ/BGM合成)と比べ、`video_plan_service.py`と同型のCRUDパターンをほぼそのまま流用できるため最軽量(見積もり1〜1.5日相当)と判断し、最初に着手した。
**バックエンド**: `video_plan_service.py`と同じ形(パス安全性チェック付きlist/get/save/delete、`updated_at`自動付与)の`VideoEditProjectService`を新設し、`video_edit_project/`ディレクトリに`ws_videoeditproj_*.json`として保存する。`video_plan_service.py`との共通base化は行わず独立クラスのまま(両者のスキーマは無関係なので、無理に共通化しても行数が減るだけで得るものがないという既存の`VideoPlanService`のドキュメント方針を踏襲)。
**保存対象**: タイムラインのクリップ順序・トリム区間・各クリップが参照するアップロード済みサーバーファイル(`serverRef`)のみ。アップロード未完了のクリップは保存対象から除外する。
**読込方式**: 保存されたクリップをComfyUIの`/view`エンドポイントからBlobとして再取得し、`File`化した上で既存の「クリップ追加」経路(`addClipFromFile()`→アップロード→probe)にそのまま通してから、保存済みのトリム値を上書き適用する方式にした。`serverRef`とメタデータを信頼してプレビュー生成ロジックを別に書く(再アップロードを省く)選択肢もあったが、既存の十分テスト済みの1経路だけを通ることを優先し、実装量とリスクを抑えた。
**サイドバーProjectタブの切替**: 中央のPlan/Editどちらのサブタブがアクティブかを`video-tab.js`が`_centerSubtabMode`として記憶し、サイドバーのProjectパネルを開く/切り替えるたびにそのモードを渡すようにした。`video-project-tab.js`は元々Video Plan専用だったリスト表示・削除ロジックを、モードごとの設定テーブル(取得/削除エンドポイント、開く関数、件数ラベル等)に切り出して汎用化。Editモードでのアイテムクリックは新設した`video-edit-tab.js`の`openSavedVideoEditProject()`(`video-plan-tab.js`の`openSavedVideoPlan()`と同型)に委譲する。
**検証**: 全JS/Pythonファイルを`node --check`/`py_compile`で構文確認、開発元リポジトリと実行時`custom_nodes`フォルダ間でファイルのdiffが空になることを確認して同期。Python側(新規サービス・ルート追加)はComfyUI完全再起動が必須(インポートは起動時一度きりのため)である旨をユーザーに案内済み。
**変更ファイル**: `py/services/video_edit_project_service.py`(新規)、`py/config.py`(`VIDEO_EDIT_PROJECT_DIR`)、`py/routes/video_routes.py`(`/api/wfm/video/edit/projects`系4エンドポイント)、`static/js/video-edit-tab.js`(`_buildProjectData()`/`_saveProject()`/`_restoreClipFromSaved()`/`_loadProjectData()`/`openSavedVideoEditProject()`、Save/Save As/Loadボタン配線)、`static/js/video-project-tab.js`(`_MODES`設定テーブルによるPlan/Edit汎用化)、`static/js/video-tab.js`(`_centerSubtabMode`追跡)、`templates/index.html`(Save/Save As/Load UI)、`static/js/i18n.js`(新規メッセージキー・ヘルプ本文更新、英/日/中3言語)
**How to apply**: 新機能の永続化を設計する際、対象データを直接シリアライズしてサーバー参照込みで復元しようとすると(プレビュー生成・probe結果の整合性など)別経路のロジックを新たに書く必要が出やすい。既存の「新規追加」経路がテスト済みで十分軽ければ、保存データを最小限(サーバー参照+差分パラメータ)に絞り、読込時はその経路をそのまま再利用する方が実装・保守コストが低い。
関連: [[project_video_edit_tab_feature_branch]]
---
## v0.7.1(2026-09-17)
### セキュリティ修正: Tagger VLM の Unsloth 経路でAPIキーがSSRFにより外部送信され得る不備を修正
セキュリティレビューで、Unsloth Desktop連携の2つの経路のうちAI TOOLタブ用プロキシ(`unsloth_routes.py`)にはリクエスト先ホストを`localhost`/`127.0.0.1`/`::1`に制限するallowlistが入っていたが、Taggerタブ VLM経路(`tagger_service.py`の`vlm_models`/`vlm_predict`、`backend=="unsloth"`時)には同等の検証が無く、クライアントがリクエストごとに指定する`api_url`へそのまま`Authorization: Bearer <UNSLOTH_API_KEY>`を送信してしまう実装になっていた。ComfyUIを`--listen 0.0.0.0`等で外部公開している環境では、設定変更なしにこの経路経由でAPIキーが任意の外部ホストへ流出し得る。`unsloth_routes.py`と同じallowlistロジックを`tagger_service.py`側にも追加し、loopback以外の`api_url`はキーを付与せずエラーを返すようにした。
副次的に、G'MIC-Qt起動(`gmic_routes.py`)の`gmic_qt_path`検証も、存在チェックのみだったのを絶対パス・`.exe`拡張子・実ファイルであることの検証に強化した(`shell=True`は使用しておらずコマンドインジェクションではないが、外部公開環境で設定変更と組み合わさった際のローカル実行リスクを下げる防御的対応)。
**How to apply**: 同一サービス(Unslothなど認証キーを要する外部API)へ複数の呼び出し経路がある場合、ホスト制限などのセキュリティ検証はルート/サービス単位ではなく呼び出し経路ごとに漏れなく入れる必要がある。片方だけ実装して安心しないこと。
## v0.7.0(2026-09-17)
### プレビュー枠の高さ固定・AssetサブタブをPlan/Editと並ぶ中央下部へ移設・トリムパネルにClipchamp風スクラバー追加・Frame保存のVideo Assets登録とAsset→Plan画像連携
+7 -7
View File
@@ -26,18 +26,18 @@ A comprehensive workflow, asset management, and generation UI plugin for [ComfyU
- Built-in AI tools (translation and more)
![Workflow Studio](https://img.shields.io/badge/ComfyUI-Custom_Node-blue)
![Version](https://img.shields.io/badge/version-0.6.2-green)
![Version](https://img.shields.io/badge/version-0.7.8-green)
## Features (tab -> feature names)
### Workflow Tab
Thumbnail / Table views, Thumbnail side panel, Badge filtering, Search, Side panel tabs, Badge management, AI summary, Import / Export, Side panel toolbar buttons, Default view setting, Search clear (✕), Clear all filters (✕ Clear)
Thumbnail / Table views, Thumbnail side panel, Badge filtering, Search, Side panel tabs, Badge management, AI summary, Import / Export, Side panel toolbar buttons, Default view setting, Search clear (✕), Clear all filters (✕ Clear), Sort
### Canvas Snapshot (v0.1.2)
One-click capture, Auto-save as thumbnail, Embedded workflow metadata, Auto-import
### GenerateUI Tab (v0.3.5)
6-tab layout, Save button, Input tab, Model tab, Settings tab, Always-visible Raw JSON, Bypass/Mute node handling, One-click generation, Seed control, Style selector, Create Catalog / Catalog buttons, Batch type selector, Batch tab, UI-to-API conversion, Video workflow support, Eagle integration
6-tab layout, Save button, Input tab, Model tab, Settings tab, Always-visible Raw JSON, Bypass/Mute node handling, One-click generation, Seed control, Style selector, Create Catalog / Catalog buttons, Batch type selector, Batch tab, UI-to-API conversion, Video workflow support, Eagle integration, Qwen Image 2.1 support, Ming Image support
### Feeder subtab (v0.3.5 / v0.3.42)
ImageFeeder node control, Image library, Selection management, Presets, Continuous Run loop, Index sync, Seed, WFS_GalleryFeeder node, Node & group selector, Image grid, After Gen modes, Run / Stop controls
@@ -75,11 +75,11 @@ Model Browser, Thumbnail / Table views, Table column sort, Search & Filter, User
### Image Edit Tab (v0.3.65)
Layer-based image editor, Loading images, Open PSD button, Close button, New button, Tools, Layer panel, Duplicate layer (⧉), Layer lock, Text quality, Export, Canvas navigation, Undo / Redo
### Video Tab (v0.5.0 – v0.7.0)
Dedicated video generation UI, independent of GenerateUI, Plan subtab, Base settings row, Edit subtab, Asset subtab, Project subtab, Two center previews, First Frame / Last Frame are both optional, Semantic node lookup, not hardcoded IDs, Field highlight color, Load in Video, Frame tab, GIF tab, Playback volume
### Video Tab (v0.5.0 – v0.7.4)
Dedicated video generation UI, independent of GenerateUI, Plan subtab, Base settings row, Edit subtab, Edit: Multi-track, Edit: Audio / BGM, Edit: Text overlays, Edit: Crop, Edit: Undo / Redo, Edit project persistence, Asset subtab, Project subtab, Two center previews, First Frame / Last Frame are both optional, Semantic node lookup, not hardcoded IDs, Field highlight color, Load in Video, Frame tab, GIF tab, Playback volume
### AI TOOL Tab (v0.3.14)
4-pane layout, Translation pane, Chat pane, Chat pane — image generation via Tool Calling, Chat pane — generate_image extra parameters, TOOLS pane (VLM), TOOLS pane — shared Chat attachment, TOOLS pane (Wildcards), Chat pane — image-to-image (I2I), Chat pane — SVG generation, no ComfyUI workflow involved, Chat pane — Skills, Settings pane, Unsloth backend, Settings pane — Chat Image Generation, Settings pane — Chat I2I Generation, Settings pane — Generation, Model unload, Settings shared, Backend support, URL security, Lemonade's other endpoints (not integrated)
4-pane layout, Translation pane, Chat pane, Chat pane — image generation via Tool Calling, Chat pane — generate_image extra parameters, TOOLS pane (VLM), TOOLS pane — shared Chat attachment, TOOLS pane (Wildcards), Chat pane — image-to-image (I2I), Chat pane — SVG generation, no ComfyUI workflow involved, Chat pane — Skills, Settings pane, Unsloth backend, Decision API client, Settings pane — Chat Image Generation, Settings pane — Chat I2I Generation, Settings pane — Generation, Model unload, Settings shared, Backend support, URL security, Lemonade's other endpoints (not integrated)
### Workflow Studio Library (ComfyUI Side Panel) (v0.3.9)
Tab layout (W / N / P / M / I / A), W — Workflows tab, N — Nodes tab, M — Models tab, P — Prompts tab, I — Information tab, A — AI TOOL tab, Drag & drop workflows, Drag & drop nodes, Drag & drop prompts, Send to Canvas, Copy prompts, Double-click, Search, ⚙ Theme settings
@@ -157,7 +157,7 @@ Click the **camera icon** (next to the W button) in ComfyUI's top bar to capture
- **[Ollama](https://ollama.com/)** — for AI chat assistant, translation, and VLM features
- **[LM Studio](https://lmstudio.ai/)** — alternative backend for translation and VLM (OpenAI-compatible API)
- **[Lemonade Server](https://lemonade-server.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API)
- **[Unsloth](https://unsloth.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API); always requires an API key, set via `UNSLOTH_API_KEY` in a `.env` file — `pip install -r requirements.txt` for `python-dotenv`
- **[Unsloth](https://unsloth.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API); needs an API key set via `UNSLOTH_API_KEY` in a `.env` file, or Unsloth's Keyless API access → "Chat and inference" turned on — `pip install -r requirements.txt` for `python-dotenv`
- **[Eagle](https://eagle.cool/)** — for auto-saving generated images with metadata
- **[comfyui-mask-editor-one](https://github.com/ketle-man/comfyui-mask-editor-one) (v0.1.9+)** — enables BiRefNet background removal, SAM3 text-prompt segmentation, and ABR stamp-brush library in the Image Edit Mask tool; `birefnet.safetensors` must be placed in `ComfyUI/models/background_removal/` for BiRefNet
- **[psd-tools](https://pypi.org/project/psd-tools/)** (v0.6.0) — enables all PSD (Photoshop) features: Gallery bulk "Create PSD" export, Gallery browsing/thumbnails for `.psd` files, and Image Edit's Save PSD / Open PSD buttons; `pip install -r requirements.txt` (ships prebuilt wheels, no C compiler required); without it, PSD-related actions show an error toast with the install command instead of failing silently
+22 -8
View File
@@ -22,7 +22,7 @@ A comprehensive workflow, asset management, and generation UI plugin for [ComfyU
- Built-in AI tools (translation and more)
![Workflow Studio](https://img.shields.io/badge/ComfyUI-Custom_Node-blue)
![Version](https://img.shields.io/badge/version-0.6.2-green)
![Version](https://img.shields.io/badge/version-0.7.8-green)
## Screenshots
@@ -46,6 +46,10 @@ A comprehensive workflow, asset management, and generation UI plugin for [ComfyU
| :----------------------------------: | :--------------------------------------: |
| ![Video Tab](docs/14_videotab.png) | ![AI TOOL Tab](docs/17_aitooltab.png) |
| Video Tab - Edit | Video Tab - Asset |
| :----------------------------------: | :-----------------------------------: |
| ![Video Tab - Edit](docs/18_videotab_Edit.png) | ![Video Tab - Asset](docs/19_videotab_Asset.png) |
| Lab Tab | Lab Index Image |
| :--------------------------------: | :------------------------------------------: |
| ![Lab Tab](docs/15_labtab.png) | ![Lab Index Image](docs/16_lab_index.png) |
@@ -69,6 +73,7 @@ A comprehensive workflow, asset management, and generation UI plugin for [ComfyU
- **Default view setting** — persist your preferred view mode (Thumbnail / Table)
- **Search clear (✕)** — inline ✕ button appears inside the search box whenever text is entered; click to clear immediately
- **Clear all filters (✕ Clear)** — rightmost toolbar button; resets search text, group filter, and badge filter (ALL) in one click
- **Sort** (v0.7.2) — Date (Newest/Oldest) / Name (A-Z/Z-A) dropdown next to the group filter, persisted via localStorage — same pattern as the Gallery tab's sort control
</details>
@@ -117,6 +122,8 @@ A comprehensive workflow, asset management, and generation UI plugin for [ComfyU
- **Video workflow support** (v0.5.2) — loading a MiniMax H3 (or other all-in-one video-generation) workflow now works from GenerateUI too, not just the dedicated Video tab: the Input tab's Prompt field picks up its `prompt` widget, the Image tab picks up its LoadImage-based `first_frame` the same way any other I2I workflow does, and generation runs with a longer timeout since video generation takes much longer than a still image; the result preview shows the generated mp4 inline (`<video>`) instead of trying to render it as an image
- **LTX-2.5 / Wan2.2 support** (v0.5.4) — these follow ComfyUI's regular node-graph pattern rather than an all-in-one node, so they needed their own detection: Positive/Negative Prompt now traces through LTX-2.5's `LTXVDualCFGGuider`/`LTXVConditioning` nodes to the actual prompt text, and the Settings tab's Latent Image section recognizes Wan2.2's `EmptyHunyuanLatentVideo` and LTX-2.5's `EmptyLTXVLatentVideo` (width/height/batch size, plus an added **Length (frames)** field) instead of showing "No EmptyLatentImage node found"; the extended generation timeout now also triggers off a `SaveVideo`/`CreateVideo` node anywhere in the graph, not just an all-in-one node
- **Eagle integration** — auto-save generated images to [Eagle](https://eagle.cool/) with metadata
- **Qwen Image 2.1 support** (v0.7.3) — `TextEncodeQwenImage21` (the unified T2I/Edit encoder used by Comfy-Org's Qwen-Image-2.1 workflow templates) is now recognized: its `prompt`/`negative_prompt` widgets populate the Input tab's Positive/Negative Prompt textareas and are editable like any other prompt node; its `resolution` (a pixel-budget int, not width/height) is exposed for Raw JSON editing. No extra work was needed for the model's up to 10 reference images (`image_1`…`image_10`, used for image editing) — each one arrives as an ordinary LoadImage node, so it already gets its own card in the Input tab's Image sub-panel via the existing generic LoadImage detection
- **Ming Image support** (v0.7.5) — `TextEncodeMingImageEdit` (single `prompt` widget, up to 8 optional `images.image_N` reference inputs; role taken from the sampler/guider wiring, so the empty-prompt negative instance in layer-decomposition workflows shows as Negative) and `EmptyQwenImageLayeredLatentImage` (Latent panel; `layers` kept as-is) are recognized in GenerateUI, and Gallery/Metadata/sidepanel I tab now show their prompts as Positive. The Sampler field is disabled (N/A) when the SAMPLER input comes from a node without `sampler_name` (e.g. `SamplerLCM`). **Fix:** top-level nodes whose widgets are converted to wired inputs (e.g. `EmptyLatentImage` width/height fed by `GetImageSize`) keep those values in `widgets_values`; they were not stripped outside subgraphs, shifting later values (`batch_size` became `1024`, KSampler `steps`/`cfg` misread). Also: `BasicGuider`'s `conditioning` is treated as positive, and a linked text input wins over the stale widget text in UI-format metadata
</details>
@@ -231,7 +238,7 @@ An experimental batch generator: runs the workflow currently loaded in GenerateU
- ~~AI Assistant Settings~~ (removed in v0.5.4) — the central Ollama backend/URL/model panel that used to live here was replaced by a ⚙ Settings button + modal directly in the Prompt tab and the Tagger tab, each with its own independent configuration (backend, URL, model, Thinking mode, Max tokens, and a model Unload button) — see those tabs below; the AI TOOL tab's own Settings pane is unaffected
- **Video Playback Volume** (v0.5.4) — the video preview's volume is remembered here and shared across every video player in the plugin (Video tab, Gallery tab), instead of resetting to maximum whenever a different video is opened
- **Data Management** — export core settings/metadata/prompts/CivitAI cache to a single JSON file; import to restore data (useful when migrating or reinstalling); API keys are excluded from exports for security
- **Full Backup (ZIP)** (v0.5.2) — additionally covers what the JSON bundle can't represent: folder-based data (AI Skills, Lab Plans, Video Plans, Style presets) and the Tagger SQLite database; two opt-in checkboxes can also include ComfyUI's default workflows folder (`user/default/workflows`) and the Impact Pack's wildcard folder in the export — both of those are export-only and stored under an `_external/` prefix in the ZIP that Restore always skips, since auto-overwriting files a different plugin/ComfyUI core manages would be unsafe; copy them back by hand if needed. Restoring overwrites existing files; restart ComfyUI afterward for either restore path
- **Full Backup (ZIP)** (v0.5.2) — additionally covers what the JSON bundle can't represent: folder-based data (AI Skills, Lab Plans, Video Plans, Video Edit projects, Style presets) and the Tagger SQLite database; two opt-in checkboxes can also include ComfyUI's default workflows folder (`user/default/workflows`) and the Impact Pack's wildcard folder in the export — both of those are export-only and stored under an `_external/` prefix in the ZIP that Restore always skips, since auto-overwriting files a different plugin/ComfyUI core manages would be unsafe; copy them back by hand if needed. A third opt-in checkbox (v0.7.6) bundles the clips/BGM/sounds/overlay clips that saved Video Edit projects reference in ComfyUI's input folder (the project JSON only stores references) under `_video_edit_media/`; unlike `_external/`, these are restored into the input folder, never overwriting a file that already exists there. Restoring overwrites existing files; restart ComfyUI afterward for either restore path
- **Text Size** — one slider (10–28 px) adjusts font size for all prompt and chat textareas at once: Generate UI positive/negative prompts, AI Assistant chat input, Preset prompts, Wildcard prompt and file editor, and Metadata prompt full preview; takes effect immediately and saved with Save Settings
- **RAW JSON Colors** — customize the 6 syntax highlight colors for the Raw JSON editor in Generate UI: Default Text (base), Name/Scheduler (yellow), Title (pink), Width/Height (green), Prompt/Text (cyan), Image/File (red); changes apply immediately on color pick; Reset Defaults restores the original scheme; saved to `localStorage` under `wfm_settings.jsonColors` and applied on startup
- **GenerateUI Model Tab Highlight** (v0.3.98) — pick the color used to mark Checkpoint/VAE/Diffusion Model/Text Encoder/ControlNet/Hypernetwork labels and the LoRA column header in GenerateUI's Model tab when the loaded workflow actually contains that type of node; default bright green; changes apply immediately, Reset Defaults restores it; saved to `localStorage` under `wfm_settings.modelTabActiveColor`; the same color and mechanism also drives the Video tab's field highlighting (v0.5.4, see above)
@@ -409,14 +416,20 @@ An experimental batch generator: runs the workflow currently loaded in GenerateU
</details>
<details>
<summary><h3>Video Tab (v0.5.0 – v0.7.0)</h3></summary>
<summary><h3>Video Tab (v0.5.0 – v0.7.4)</h3></summary>
- **Dedicated video generation UI, independent of GenerateUI** — a purpose-built tab for MiniMax H3 (Image to Video), LTX-2.5 (Text / Image / First & Last Frame to Video), and Wan2.2 (Text to Video) workflows (LTX-2.5/Wan2.2: v0.5.4); does not share state with the GenerateUI tab, and model selection (UNet/CLIP/VAE/Audio VAE) is fixed to the loaded workflow's own defaults rather than editable here
- **Plan subtab** (center panel, batch redesign in v0.5.5) — a **plan** is a sequence of timeline blocks, each a fully self-contained generation job with its own Prompt, Duration, and First/Last Image; split the timeline with **+ Split** / **+ Block** / **Delete**, then **Run** to generate every block in order (Pause/Cancel work mid-run) — a plan with a single block behaves exactly like the old one-shot form. First Image can be None, an explicit image, or "use previous block's last frame" (chaining — an explicit Last Image on the previous block always wins over extracting one from its generated output). Save / Save As / Clear a plan (`ws_videoplan_*.json`, with a PNG contact-sheet thumbnail that embeds the full plan data so dropping the image back on works too)
- **Base settings row** (topbar, v0.5.7) — Aspect Ratio / Megapixels / Multiple / Duration (seconds) / Noise Seed on one row — Duration always reflects the currently selected block (each block keeps its own value), the rest are plan-wide — plus a second row of model-specific fields: Width / Height (become directly editable for workflows with no Resolution Selector node, e.g. Wan2.2 and LTX-2.5's First & Last Frame to Video), Turbo Mode / Strength / Steps (MiniMax H3's turbo LoRA — Turbo Mode doubles as Wan2.2's own turbo toggle, sharing one field), and Prompt Enhance (LTX-2.5 only). Every field in both rows is enabled only when the loaded workflow actually has it — see Field highlight color below (one exception: Wan2.2's Text-to-Video variant doesn't expose Noise Seed at all, so it alone leaves that field disabled)
- **Edit subtab** (v0.7.0) — a lightweight clip timeline for trimming and concatenating video/image clips outside of generation: add clips via the Video Source panel's **Add to Edit** button or the Asset subtab's **Send to Edit** button, drag blocks to reorder (or use the ◀/▶ toolbar buttons), Duplicate/Delete the selected clip, Clear to empty the timeline. The trim panel for a selected video clip shows a Clipchamp-style scrubber — a time ruler, a draggable playhead synced to the Source preview, and draggable in/out handles with time badges (image clips get a simple hold-duration field instead). **▶ Preview** plays every ready clip back-to-back (trimmed to its in/out points) in the result preview, and **Export** builds and runs the actual ComfyUI graph (trim → concatenate if more than one clip → save), tagging the result into Video Temp automatically — exporting more than one clip currently drops audio, since ComfyUI's concatenation node requires uniform audio across all inputs
- **Asset subtab** (center panel, next to Plan/Edit — moved here from the sidebar in v0.7.0) — browses generated videos/images through three groups: **Video Assets** (a manually-curated keeper group you organize yourself, on your own schedule), **Video Temp** (every plan run's output lands here automatically regardless of whether the plan itself was saved — a **Clear Video Temp** button in the Gallery tab's detail panel empties it in one click), and **All Video Assets** (the union of both); a filename search box and a thumbnail-grid/table (▦/☰) view toggle sit above the list (v0.7.0). Selecting an item shows it in the center preview and lets you tag/memo it, **Send to Edit** (queues it as a clip in the Edit subtab), jump straight to the full Gallery tab, or — for images only — **Set as First Image** / **Set as Last Image** (v0.7.0, uploads it straight into the currently-selected Plan block and switches to the Plan subtab)
- **Project subtab** (sidebar) — lists every saved plan file (thumbnail, block count, last updated) — click one to load it into the Plan editor, or delete it with the × button; the panel collapses back down when its own tab is clicked again
- **Edit subtab** (v0.7.0) — a lightweight clip timeline for trimming and concatenating video/image clips outside of generation: add clips via the Video Source panel's **Add to Edit** button or the Asset subtab's **Send to Edit** button, drag blocks to reorder (or use the ◀/▶ toolbar buttons), Duplicate/Delete the selected clip, Clear to empty the timeline. The trim panel for a selected video clip shows a Clipchamp-style scrubber — a time ruler, a draggable playhead synced to the Source preview, and draggable in/out handles with time badges (image clips get a simple hold-duration field instead); the playhead's own time badge sits a row above the in/out handle badges (v0.7.2) so it stays legible even when the playhead lands right on a trim point, and the scrubber has extra headroom/height and spacing from the clip name above it (v0.7.2). **▶ Preview** plays every ready clip back-to-back (trimmed to its in/out points) in the result preview, and **Export** builds and runs the actual ComfyUI graph (trim → crop → concatenate if more than one clip → save), tagging the result into Video Temp automatically. Multi-clip exports keep each clip's own audio (v0.7.4 — previously they were always silent). **Clear** empties the clips and also resets the Audio section to its defaults (v0.7.4)
- **Edit: Multi-track** (v0.7.8) — the buttons above the timeline switch the track view: **Video** (blue), **Overlay** (blue), **Text** (green) and **Audio** (red), and the tool menu below follows it (Video: trim + crop / Overlay: overlay clips / Text: text overlays / Audio: audio settings); Save / Load / Export stay fixed on the right. **Text** now belongs to the timeline (absolute seconds, no longer to a clip): drag a band to move it — even across clips — or drag its edges to retime it; projects saved with clip-relative text are converted on load. **Audio** adds any number of **+ Sound...** clips (sound effects, voice) that you place by dragging their bands, trim by dragging an edge, with their own start / length / volume, on top of the full-length BGM. **Overlay** adds picture-in-picture clips (video or image) via **+ Overlay clip...** or the Asset subtab's **Add as overlay (PinP)** button, each with its own time, position (9 presets or X/Y), size and opacity, shown as dashed boxes in the previews and composited over the main video in the same pass that burns in text on Export (an overlay's own audio is not mixed). Undo/Redo and project Save/Load cover all of it, and Full Backup's "Include media used by Video Edit projects" now also bundles the sounds' and overlays' media.
- **Edit: Audio / BGM** (v0.7.4) — the export panel's **Audio** section sets the soundtrack: **Keep original audio** (with its own volume in dB) keeps every clip's audio aligned to its segment even across multiple clips (image clips contribute silence), and one **BGM** file is laid over the whole video with its own volume and start offset (a longer BGM is cut to the video length). Pick the BGM with **BGM...**, by dropping an audio/video file onto the Audio section, or with **Set as BGM** on a video in the Asset subtab (that video's audio track is used; videos without audio are rejected). Built entirely inside the export graph with ComfyUI core audio nodes (EmptyAudio / AudioMerge / AudioConcat / LoadAudio / TrimAudioDuration / AudioAdjustVolume) passed to ConcatenateVideo's `complete_audio` — no extra dependencies. ▶ Preview plays the BGM alongside the clips
- **Edit: Text overlays** (v0.7.4) — each clip can carry any number of text overlays (**+ Add text** under the trim panel): text, start/end seconds within the clip, size as % of frame height, color, 9-position anchor, outline, and an optional background box. They follow the clip when it's reordered, are previewed live over the Source/Result panes, and are burned in on Export as a final pass (PyAV decode → Pillow → H.264 encode, frame by frame so memory stays flat; the soundtrack is remuxed untouched). Japanese/CJK text renders with a system CJK font (Meiryo / Yu Gothic / Noto Sans JP on Windows)
- **Edit: Crop** (v0.7.4) — **Edit crop** puts a draggable/corner-resizable rectangle over the Source preview (optionally locked to 16:9 / 9:16 / 1:1 / 4:3 / 3:4); **Done** keeps it, **Cancel** restores the crop from before editing, and switching to another subtab/tab ends editing like Done. Export applies it with ComfyUI core `VideoCrop`; the output size is the first video clip's cropped size, and other clips of a different size are center-fit to it. Text overlay previews are drawn relative to the cropped frame
- **Edit: Undo / Redo** (v0.7.4) — **↶ / ↷** in the timeline toolbar (or Ctrl+Z / Ctrl+Y / Ctrl+Shift+Z outside text fields) step through edits to clips, trims, crops, text and audio settings; a deleted clip comes back without re-uploading. History resets when a project is loaded
- **Edit project persistence** (v0.7.2) — **Save** / **Save As** / **Load** buttons in the Edit subtab's export panel persist the timeline itself (clip order, trim points, and which uploaded server-side file each clip refers to — plus crops, text overlays and audio/BGM settings since v0.7.4) as a `ws_videoeditproj_*.json` project file; Load re-fetches and re-probes each clip from its saved server reference, so the original files need to still exist
- **Asset subtab** (center panel, next to Plan/Edit — moved here from the sidebar in v0.7.0) — browses generated videos/images through three groups: **Video Assets** (a manually-curated keeper group you organize yourself, on your own schedule), **Video Temp** (every plan run's output lands here automatically regardless of whether the plan itself was saved — a **Clear Video Temp** button in the Gallery tab's detail panel empties it in one click), and **All Video Assets** (the union of both); a filename search box, a video/image type filter dropdown (All Types / Video Only / Image Only, v0.7.2), and a thumbnail-grid/table (▦/☰) view toggle sit above the list (v0.7.0). Selecting an item shows it in the center preview and lets you tag/memo it, **Send to Edit** (queues it as a clip in the Edit subtab), **Set as BGM** for videos (v0.7.4 — uses its audio track as the Edit BGM), jump straight to the full Gallery tab, or — for images only — **Set as First Image** / **Set as Last Image** (v0.7.0, uploads it straight into the currently-selected Plan block and switches to the Plan subtab)
- **Project subtab** (sidebar) — lists saved plan files while the center Plan subtab is active, or saved Edit projects while the center Edit subtab is active (v0.7.2 — thumbnail/block-or-clip-count/last-updated) — click one to load it into the matching editor, or delete it with the × button; the panel collapses back down when its own tab is clicked again, and switching Plan↔Edit while it's open refreshes the list in place
- **Two center previews** (v0.5.5) — the left preview shows either the video currently selected in the Asset subtab or whatever's dropped/picked in the **Video Source** panel to its left (**Clear** resets it to empty); the right preview always shows the most recently generated clip; both preview frames are a fixed height (v0.7.0) so switching sources never shifts the Plan/Edit/Asset panel below them. The Frame/GIF tools act on whichever preview was touched most recently
- **First Frame / Last Frame are both optional** — leaving First Image empty runs the workflow text-only (the node is simply left unconnected — a "bypass"); workflows that don't even include a LoadImage node for First Frame are supported out of the box (Wan2.2's Text-to-Video graph has neither slot at all), and a LoadImage node is only injected into the graph on the fly if an image is actually supplied
- **Semantic node lookup, not hardcoded IDs** (generalized in v0.5.4) — detects which of the three families is loaded from its subgraph's internal node types (or, for Wan2.2, the subgraph's own name — it has no distinctive internal node type), then locates its Resolution Selector and LoadImage node(s) by the subgraph's *public input label* (`prompt`, `duration`, `width`, `first_frame`, `last_frame`) rather than a fixed slot index — so it keeps working even though the three families expose those inputs under different internal names; a workflow no longer needs to match any bundled reference file's exact node IDs, and no fallback test workflow is auto-loaded on tab open
@@ -444,7 +457,8 @@ An experimental batch generator: runs the workflow currently loaded in GenerateU
- **Chat pane — SVG generation, no ComfyUI workflow involved** (v0.3.77) — the LLM can also produce SVG graphics directly as text; if a reply contains SVG code (wrapped in a markdown code fence or written directly as a bare `<svg>...</svg>`), it's rendered inline as a preview and a "Save to Gallery" button writes it as a `.svg` file to the Gallery tab's output folder; unlike the Tool Calling image generation flow above, this is plain text pattern matching, so it works with any model regardless of tool-calling support
- **Chat pane — Skills** (v0.3.79) — select a `.md` skill file from a dropdown above the message list to prepend its instructions to the conversation as a system prompt (not shown in the visible chat log); a pencil button opens an in-pane manager (list + inline editor, same pattern as the Prompt tab's wildcard file manager) to create, edit, or delete skill files stored in `user/default/Workflow-Studio/ai_skills/`; a file's `---`-delimited frontmatter (`name`/`description`) is shown in the dropdown; two starter skills are bundled — **SVG Icon Generator** (explicitly decomposes the subject into parts before drawing, which markedly improves recognizability from small local models) and **Skill Creator** (interviews you conversationally and drafts a new skill as a ```skill code block; a "Save as new skill" button appears under such replies and opens the manager pre-filled with the draft)
- **Settings pane** — choose backend (Ollama / LM Studio / Lemonade / Unsloth), set the API URL, test connection, select a model (with refresh button), and configure Free language names for translation source and destination
- **Unsloth backend** (v0.3.99) — Unsloth Desktop's OpenAI-compatible API always requires an API key, even for local access; unlike the other backends it's proxied server-side (`py/routes/unsloth_routes.py`, `POST /api/wfm/unsloth/proxy`) so the key never reaches the browser: set `UNSLOTH_API_KEY` in a `.env` file in the plugin folder (copy `.env.example`, loaded via `python-dotenv` in `prestartup_script.py`) and restart ComfyUI; also requires **"Auto model switching (OpenAI API)"** to be turned on in the Unsloth Desktop app's own Settings screen — with it off, requests fail with HTTP 404 unless a model was already manually loaded in the Unsloth Studio UI
- **Unsloth backend** (v0.3.99) — Unsloth Desktop's OpenAI-compatible API requires an API key even for local access unless its **Keyless API access → "Chat and inference"** setting is on; unlike the other backends it's proxied server-side (`py/routes/unsloth_routes.py`, `POST /api/wfm/unsloth/proxy`) so the key never reaches the browser: set `UNSLOTH_API_KEY` in a `.env` file in the plugin folder (copy `.env.example`, loaded via `python-dotenv` in `prestartup_script.py`) and restart ComfyUI — or, since v0.7.7, leave `UNSLOTH_API_KEY` unset and turn on Keyless API access → "Chat and inference" in Unsloth Desktop (requests are then relayed without an `Authorization` header, still only to localhost; that Unsloth setting also opens the API to your private LAN, and "Allow tools" should stay off). A 401 with no key set returns a message explaining both options; also requires **"Auto model switching (OpenAI API)"** to be turned on in the Unsloth Desktop app's own Settings screen — with it off, requests fail with HTTP 404 unless a model was already manually loaded in the Unsloth Studio UI
- **Decision API client** (v0.7.5, foundation) — `static/js/decision-client.js` calls Unsloth Desktop's Decision API (`/v1/systemone`, TypeSafe-compatible Laya decision models) through the same key-attaching server proxy: `decide(state, questions)` / `decideMany`, question builders `noul`/`choice`/`score`, and `isYes`/`pickChoice`/`pickScore` helpers that threshold on `probabilities` (as Unsloth recommends) and flag low-probability answers as not confident. Requires **Decision API → Serve requests** enabled in Unsloth Desktop. Text only — Laya has no image input. **Ollama 0.35+ backend** (v0.7.7) — Ollama's own `/v1/systemone` (decision models `tev1` 4B / `tev1:0.8b` 812 MB / `nimble` 9B, pulled with `ollama pull`; no key, called directly from the browser); the model list shows only installed models whose `capabilities` include `decision`, with a ↻ refresh button and a pull hint when none are installed. Connection settings live in the Settings tab's own **Decision Model** section (v0.7.6): backend (Unsloth / Ollama), URL, model and default probability threshold, stored under `wfm_decision_settings` independently of the AI TOOL / Tagger backends, with a Test button (one yes/no question). No feature uses it yet
- **Settings pane — Chat Image Generation** (v0.3.73) — "Use dedicated workflow" checkbox lets Chat-triggered image generation use a saved workflow of your choice instead of the one currently loaded in GenerateUI, without disturbing what's shown there (same pattern as Image Edit's Inpaint dedicated workflow)
- **Settings pane — Chat I2I Generation** (v0.3.74) — same "Use dedicated workflow" pattern as above, but for image-to-image generation when an image is attached; independent of the text-to-image dedicated workflow setting
- **Settings pane — Generation** (v0.3.98) — **Thinking mode** toggle (off by default; sends Ollama's `think` flag, and regardless of backend, any `<think>...</think>` block is stripped from the output when off so reasoning models don't clutter Translation/Chat/TOOLS results) and **Max tokens** (Ollama: `options.num_predict`; LM Studio/Lemonade/Unsloth: `max_tokens`; `0` = unlimited)
@@ -565,7 +579,7 @@ Click the **camera icon** (next to the W button) in ComfyUI's top bar to capture
- **[Ollama](https://ollama.com/)** — for AI chat assistant, translation, and VLM features
- **[LM Studio](https://lmstudio.ai/)** — alternative backend for translation and VLM (OpenAI-compatible API)
- **[Lemonade Server](https://lemonade-server.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API)
- **[Unsloth](https://unsloth.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API); always requires an API key, set via `UNSLOTH_API_KEY` in a `.env` file — `pip install -r requirements.txt` for `python-dotenv`
- **[Unsloth](https://unsloth.ai/)** — alternative backend for translation, chat, and VLM (OpenAI-compatible API); needs an API key set via `UNSLOTH_API_KEY` in a `.env` file, or Unsloth's Keyless API access → "Chat and inference" turned on — `pip install -r requirements.txt` for `python-dotenv`
- **[Eagle](https://eagle.cool/)** — for auto-saving generated images with metadata
- **[comfyui-mask-editor-one](https://github.com/ketle-man/comfyui-mask-editor-one) (v0.1.9+)** — enables BiRefNet background removal, SAM3 text-prompt segmentation, and ABR stamp-brush library in the Image Edit Mask tool; `birefnet.safetensors` must be placed in `ComfyUI/models/background_removal/` for BiRefNet
- **[psd-tools](https://pypi.org/project/psd-tools/)** (v0.6.0) — enables all PSD (Photoshop) features: Gallery bulk "Create PSD" export, Gallery browsing/thumbnails for `.psd` files, and Image Edit's Save PSD / Open PSD buttons; `pip install -r requirements.txt` (ships prebuilt wheels, no C compiler required); without it, PSD-related actions show an error toast with the install command instead of failing silently
-291
View File
@@ -1,291 +0,0 @@
# Video Editサブタブ「簡易動画編集機能」実装計画
## Context
Video タブは Plan(バッチ動画生成)/ Asset・Project(生成済み動画の一覧)まで実装済みだが、Edit サブタブは `templates/index.html:2895` の空div `#wfm-video-subtab-edit`(「Editing tools coming soon」のプレースホルダーテキストのみ)で、JSロジックは一切無い。ユーザーからは「Adobe Premiereのような簡易動画編集機能」を追加したいという要望があり、調査の結果ComfyUI Core 0.35.0〜0.36.0(2026年9月時点の最新)で `VideoSlice`/`VideoTrim`/`VideoCrop`/`ConcatenateVideo` 等のネイティブ動画編集プリミティブが追加されたばかりであることが判明した。これらを活用しつつ、wf-manager独自のタイムラインUIを被せることで、フルスクラッチでの動画処理実装を避けつつ「複数クリップの配置・トリム・結合」という編集の核となる機能を提供する。
**方針確認済み(ユーザー承認):**
- MVPスコープは最小限(タイムライン配置・トリム・結合書き出しのみ)とし、クロップ・テキストオーバーレイ・BGM合成は明確にPhase 2以降の拡張として切り離す。
- グラフ組立(トリム/クロップ/結合)はComfyUIワークフローに丸投げする方式(Plan tabの`video-workflow.js`と同じ`/prompt`実行基盤を再利用)で進める。`VideoTrim`/`VideoCrop`がexperimental扱いであることのAPI変更リスクは、Phase 0での`/object_info`検証とクラス名参照で軽減する。
実装は下記のPlanエージェント設計をベースに、MVPスコープをPhase 1(タイムライン+トリム+結合)のみに絞り込んで進める。
---
## 1. スコープ定義
### 設計原則(切り分けの判断基準)
| 種別 | 判断基準 | 実装場所 |
|---|---|---|
| **プレビュー/操作UI**(scrub再生、タイムライン上でのドラッグ、トリムハンドル、テキスト位置決めなど、ユーザーが「見ながら触る」もの) | ブラウザの`<video>`/`<canvas>`だけで完結し、即座にフィードバックが必要 | wf-manager独自JS(video-edit-tab.js) |
| **実際の書き出し処理**(トリム確定、複数クリップ結合、クロップ確定、テキスト焼き込み) | 重い処理・GPU不要・単純なメディア操作で、ComfyUI Coreの新ノード(VideoSlice/VideoTrim/VideoCrop/ConcatenateVideo)がほぼそのままカバーする | ComfyUIワークフローを動的組立して`/prompt`に投げる(Plan tabのvideo-workflow.jsパターンを踏襲) |
| **既存方針(PyAV+Pillowのみ、ffmpeg非依存)で完結できないもの**(テキスト/字幕の焼き込み、BGM音量ミックス、簡単なフェード) | ComfyUI Coreノードにも無く、かつ静止画向けtext-overlay系カスタムノードのロジックを流用できる規模 | wf-manager独自Python(video_service.py拡張、PyAV decode + Pillow ImageDraw合成 + PyAV encode) |
| **サムネイル/ファイル一覧/タグ管理** | 既存Galleryインフラで完結 | 既存流用(新規実装なし) |
### MVP(初回リリース、承認済み: 最小限スコープ)
以下の1〜4のみを初回リリース対象とする。クロップ/テキストオーバーレイ/BGM合成/プレビュー高度化は明確にPhase 2以降へ切り出す。
1. **タイムラインへのクリップ配置・並べ替え**
- Asset タブ / Gallery からドラッグ or 「Editへ送る」ボタンで動画をタイムラインに追加。
- 水平方向に複数クリップを並べたシンプルな1トラック構成(Adobe Premiereの「V1」トラック1本のみ、複数トラック無し)。
- ドラッグで順序入れ替え、削除、複製。
2. **クリップ単位のトリム(開始/終了)**
- 各クリップサムネイル上でハンドルをドラッグしてin/outを指定 → プレビューは`<video>`要素のcurrentTimeシークのみ(デコード不要、軽量)。
- 書き出し時にComfy Core `VideoSlice`("Trim Video")ノードで実処理。
3. **複数クリップの結合書き出し**
- タイムライン順に`ConcatenateVideo`ノードをAutogrowで連結し1本のVIDEO出力に。
4. **プレビューと書き出し**
- プレビューはMVPでは「各クリップを順番に`<video>`要素で連続再生する疑似プレビュー」(トリム区間のみ再生してクリップ切り替え)に留める。真の合成プレビューは行わない。
- 「書き出し」ボタン押下でComfyUIワークフロー(`VideoSlice`×N → `ConcatenateVideo`(Autogrow) → `SaveVideo`)を動的組立し`/prompt`に投げ、進捗はWebSocketで表示、完了後Galleryの`VIDEO_GROUP`に自動登録。
### Phase 2以降(MVP対象外、将来拡張として明記)
- **クリップ単位の空間クロップ**: 矩形選択UI(Image Edit Tabのキャンバス選択パターンを流用)→ 書き出し時に`VideoCrop`ノードへ座標を渡す。
- **簡易テキストオーバーレイ(クリップ単位、固定位置・フェード無し)**: テキスト内容・フォントサイズ・色・位置(9グリッドアンカー)・表示区間(開始秒-終了秒)を指定。書き出しはPyAVでフレームデコード→対象区間のフレームだけPillow ImageDraw.textで焼き込み→再エンコード(wf-manager独自Python実装。ComfyUI Coreに動画テキストオーバーレイノードは無いため)。
- **BGM/音声トラック1本の合成**: 元動画の音声をmute/keep選択 + 1本のBGM音声ファイルを全体に重ねる(音量スライダーのみ、ミキシングはPyAVのAudioResampler+単純加算 or `CreateVideo`のcomplete_audio差し替え機能で代替)。複雑なマルチトラックオーディオミキシングは対象外。
- 複数トラック(V1/V2でのピクチャーインピクチャー、オーバーレイ合成)
- クリップ間トランジション(クロスフェード等) — フレーム単位のアルファブレンドはPyAVで可能だが計算コストが高く、CPUのみだと低速。GPU処理が要るなら別途ComfyUIノード化を検討。
- 波形表示付きオーディオトラック編集
- キーフレームアニメーション(テキストの移動/フェードイン等)
- Undo/Redo履歴、複数プロジェクトの保存/読込(Video Planの`video_plan_service.py`と同様の永続化)
- リアルタイム合成プレビュー(WebCodecs APIによるブラウザ内デコード合成、または低解像度プロキシファイルを都度サーバー生成してプレビュー用に配信)
---
## 2. アーキテクチャ
> **補足(実際のサブタブ構造)**: Videoタブは単純な「Plan/Asset/Edit」3分割ではなく、中央ペインが Plan/Edit の2-way切替(`_initCenterSubtabToggle()`, `static/js/video-tab.js:37`)、サイドバーが Asset/Project の独立ペア(`_initSidebarSubtabToggle()`, 同ファイル55行目)という構成。エントリポイントは `static/js/video-tab.js:317` の `export function initVideoTab()` で、ここに `initVideoEditTab()` の呼び出しを追加する。
### フロントエンド(JS)
新規ファイル: `static/js/video-edit-tab.js`
- `class VideoEditTab`(Image Edit Tabの`class ImageEditTab`パターンを踏襲。単一グローバルインスタンスをexportする形も選択可)
- `constructor()`: タイムライン状態(`this.clips = []`、各要素は`{ sourceRef, inPoint, outPoint, cropRect, textOverlay, id }`)、選択中クリップID、DOM参照を初期化。
- `init()`: DOM生成・イベント配線のエントリポイント。`video-tab.js`の`initVideoTab()`から`initVideoEditTab()`として呼ばれる形にする。
- `_setupActionBar()`: Image Edit Tab 1385行目のアクションバー実装を参考に「クリップ追加」「書き出し」「プレビュー再生/停止」ボタン群を構築。
- `_setupTimelinePanel()`: レイヤーパネル(`_setupLayerPanel()` 2194行目)のリスト+サムネ+ドラッグ並べ替えパターンを、縦のレイヤーリストではなく横のタイムラインクリップ列に転用。
- `_setupTrimHandles()`: pointerdown/move/upベースのドラッグ操作(1130-1249行目のポインタイベント処理パターン)をトリムハンドルのドラッグに転用。
- `_setupCropOverlay()`: 同じくpointerイベントパターンをクロップ矩形選択に転用(レイヤーごとに独立canvasを持つ構造は流用しないが、矩形描画のオーバーレイcanvas1枚で足りる)。
- `_setupTextOverlayPanel()`: テキスト内容/フォント/色/アンカー/表示区間の入力フォーム。プレビューは選択中クリップの`<video>`上にCSS絶対配置したdiv要素でオーバーレイ表示(実際の焼き込みはサーバー側、プレビューは近似でよい)。
- `_buildExportWorkflow()`: タイムライン状態からComfyUIワークフローJSON(内部APIフォーマット)を動的組立。`video-workflow.js`の`injectFrameNode()`のノード注入パターン(last_node_id/last_link_id採番、links[]整合性維持)を流用し、`LoadVideo → VideoSlice → (VideoCrop) → ConcatenateVideo(Autogrow) → SaveVideo`のグラフを構築。
- `_exportTimeline()`: `comfyUI.queuePrompt()`/`comfyUI.trackProgress()`(comfyui-client.js既存メソッド、Plan tabと同じ呼び出し方)でグラフを実行し、進捗表示・完了後にGallery登録。
- `_applyTextOverlayJob()`: テキストオーバーレイがある場合のみ、結合済み動画に対して追加で`/api/wfm/video/edit/overlay-text`(新設)を呼ぶ後処理ステップ(ComfyUIグラフでは焼き込めないため、書き出しフローの最終段に独立したPython後処理を挟む二段構成)。
- 既存ファイルへの変更:
- `static/js/video-tab.js`: `initVideoEditTab()`のimportと`initVideoTab()`内呼び出しを追加。`_applyVideoI18n()`にEdit用キーを追加。
- `templates/index.html`: `#wfm-video-subtab-edit`内にタイムライン/アクションバー/クロップオーバーレイ/テキストパネル用のDOM骨格を追加(Plan/Assetサブタブの既存マークアップ構造に合わせる)。
- `static/js/i18n.js`: `videoEditPlaceholder`を削除し、新規i18nキー群(`videoEditTimeline`, `videoEditTrim`, `videoEditCrop`, `videoEditTextOverlay`, `videoEditBgm`, `videoEditExport`等、英/日/中3言語)を追加。
- `static/css/video-tab.css`(存在すれば。無ければ新規`video-edit-tab.css`): タイムラインのクリップブロック、トリムハンドル、クロップオーバーレイのスタイル。
- Asset→Edit連携用の変更:
- `static/js/video-asset-tab.js`: 詳細パネル(`_renderDetail()`)に「Editへ送る」ボタンを追加。クリック時、選択中動画の`{filename, subfolder, type}`または`{kind:"local", file}`参照を`video-edit-tab.js`のエクスポート関数(例: `addClipFromAsset(ref)`)に渡し、Editサブタブに切り替えてタイムライン末尾に追加。
### バックエンド(Python)
判断基準: **ComfyUIワークフローに丸投げできる処理(VIDEO型を保つ、GPU不要でもCPUノードとしてグラフ内で完結できる処理)は`/prompt`実行に任せ、グラフ側に存在しない処理(テキスト焼き込み、音声ミックス、詳細メタ取得)だけを独自Pythonで実装する。** 理由: ワークフロー実行に丸投げすることで実行キュー管理・WebSocket進捗通知・キャンセル(`interrupt`)・履歴(`/history`)を無料で使い回せる一方、独自Python実装は同期/非同期の進捗通知を自前で作る必要があるため、既存インフラで代替できるものは極力グラフに寄せる。
- `py/routes/video_routes.py` 追加エンドポイント:
- `POST /api/wfm/video/edit/probe`: アップロード済み/output上の動画の基本メタ(duration, fps, width, height, has_audio)をPyAVで取得。タイムラインUIがクリップ追加時に必要な長さ・解像度をComfyUIの`/prompt`実行なしで即座に得るため(`GetVideoComponents`ノードを都度実行するのは重く実行キューも消費するため避ける)。
- `POST /api/wfm/video/edit/overlay-text`: 結合済み動画1本 + テキストオーバーレイ指定リスト(区間・アンカー・文字列・色・フォントサイズ)を受け取り、PyAVでデコード→対象区間のみPillow ImageDraw合成→PyAV(av.open(mode="w"))で再エンコードしoutputへ保存。`video_service.convert_to_gif()`のデコード/エンコードパターンを流用。
- `POST /api/wfm/video/edit/mix-audio`(BGM合成が`CreateVideo`ノードのcomplete_audio差し替えだけでは足りない場合の予備、例えば音量調整付き重ね合わせが必要な時): PyAVのAudioResamplerで元音声とBGMをリサンプル→単純加算ミックス→動画に再アタッチ。
- Phase 1では上記のうち`probe`のみ必須、`overlay-text`はテキストオーバーレイ機能実装時に追加、`mix-audio`は`CreateVideo`の`complete_audio`で足りるなら不要(後述リスク参照)。
- `py/services/video_service.py` 追加メソッド:
- `probe_video(path) -> dict`: `av.open()`でstreams[0]の`duration`, `average_rate`, `width`, `height`、`streams.audio`の有無を返す。
- `overlay_text_on_video(src_path, overlays, fps=None) -> dict`: 既存`convert_to_gif`と同じ`_resolve_media_path`を使った安全なパス解決 → フレームループでtがoverlayの区間に該当する時だけPillowで文字を描画 → `av.open(dst, mode="w")`で同じcodec/fpsで書き出し。既存クラスの`_resolve_media_path()`を再利用。
- `mix_audio(...)`: 必要になった場合のみ追加。
- ワークフロー動的組立は**フロントエンドJS側**(`_buildExportWorkflow()`)で行い、バックエンドは実行そのものに関与しない(Plan tabと同じ役割分担: `video-workflow.js`はJSでグラフJSONを操作し、`comfyUI.queuePrompt()`で`/prompt`に投げるのみ)。バックエンドに「ワークフロー組立API」を新設する必要は無い。
### 判断基準まとめ(再掲)
- VIDEO型のまま完結する操作(トリム/クロップ/結合/保存) → ComfyUIグラフ(フロントJSで組立、`/prompt`実行)
- VIDEO型を抜けてピクセル単位の追加合成が要る操作(文字焼き込み、音声ミックス) → wf-manager独自Python(PyAV+Pillow)
- 操作中のインタラクティブ操作(scrub、トリムハンドルのドラッグ、矩形選択) → ブラウザJSのみ、サーバー往復なし
---
## 3. 既存資産の再利用ポイント(具体的な参照箇所)
| 転用元 | 参照箇所 | 転用先 |
|---|---|---|
| Image Edit Tab アクションバー | `static/js/image-edit-tab.js:1385` `_setupActionBar()` | video-edit-tab.jsのツールバー(クリップ追加/書き出し/再生ボタン) |
| Image Edit Tab レイヤーパネル | `static/js/image-edit-tab.js:2194` `_setupLayerPanel()`(リスト/サムネ/透明度スライダー) | タイムラインのクリップリストUI(サムネ表示・並べ替え・削除) |
| Image Edit Tab pointerイベント | `static/js/image-edit-tab.js:1130-1249` | トリムハンドルドラッグ、クロップ矩形選択のドラッグ操作 |
| Image Edit Tab レイヤー合成構造 | `static/js/image-edit-tab.js:2035,2067,2081` | (参考程度)テキストオーバーレイのプレビュー用オーバーレイdiv重畳の考え方 |
| Gallery mp4サムネ/プレビュー | `static/js/gallery-tab.js:63` `isVideoFile()`、`972-985,1750-1766` `<video controls>` | クリップサムネイル生成、プレビューエリアの`<video>`要素の扱い |
| Gallery mp4サーバー側サムネ | `py/services/gallery_metadata.py:1349-1364` `serve_thumbnail`(PyAVで先頭フレームJPEG化) | クリップ追加時のサムネイル取得APIとして直接再利用可能(新規実装不要、`/wfm/gallery/image/thumb`をそのまま叩く) |
| Gallery mp4メタ | `py/services/gallery_metadata.py:766` `_read_mp4_metadata()` | `probe_video()`実装の参考(既存関数を直接呼ぶかロジック共有できないか要確認) |
| video-workflow.js ノード検出/注入パターン | `static/js/video-workflow.js` `locateVideoModelNodes()`, `injectFrameNode()`(last_node_id/last_link_id採番、links[]整合性) | `_buildExportWorkflow()`でVideoSlice/VideoCrop/ConcatenateVideoノードを動的追加する際のID採番・リンク整合性ロジックをそのまま流用 |
| comfyui-client.js 実行基盤 | `static/js/comfyui-client.js:196` `queuePrompt()`, `217` `trackProgress()`, `312` `generate()` | 書き出し実行・進捗表示(新規実装不要) |
| Video Asset Galleryグループ | `static/js/video-asset-tab.js` の`VIDEO_GROUP`/`VTEMP_GROUP`活用パターン | 書き出し完了後の動画を`VIDEO_GROUP`へ自動登録する処理の参考 |
| video_service.py デコード/エンコードパターン | `py/services/video_service.py:60` `convert_to_gif()`(PyAV decode→Pillow処理→再エンコード、`_resolve_media_path`によるパストラバーサル対策) | `overlay_text_on_video()`実装のテンプレートとしてほぼそのまま流用 |
---
## 3.5. 外部カスタムノードの参考実装(追加調査、ユーザー指定4件)
Video Edit実装の設計判断を補強するため、既に「フルスクリーンタイムラインエディタ」を実装している既存カスタムノードを調査した。**これらをそのまま依存として組み込むのではなく、UI/UX設計とノード分割方針の参考にする**(wf-managerはComfyUI Coreの`VideoSlice`/`ConcatenateVideo`丸投げ方針を維持するため、方式は異なる)。
| リポジトリ | 関連度 | 参考にすべき点 |
|---|---|---|
| [SonderSaid/ComfyUI-Sonder-Editor](https://github.com/SonderSaid/ComfyUI-Sonder-Editor) | **高** | マルチレーン(Video/Audio/Prompt/Guide/Driverレーン)タイムラインUI、クリップのドラッグ/トリム/分割/ミュート、レーンのロック/非表示など、Premiereライクな編集UIの完成度が高い実装例。ただし**FFmpeg 7.0以上を必須依存**としており、wf-managerの「ffmpeg非依存(PyAV+Pillowのみ)」方針とは真逆。UIレイアウト(左サイドバー=ギャラリー、中央=ビューポート+トランスポート、下部=マルチレーンタイムライン)は`video-edit-tab.js`のDOM構成の参考にする価値が高いが、実装(FFmpeg CLI呼び出し)はそのまま流用しない。 |
| [shootthesound/ComfyUI-H3Studio](https://github.com/shootthesound/ComfyUI-H3Studio) | **高** | MiniMax H3特化の統合編集ツール。単一ノードから「⤢ open timeline editor」ボタンでフルスクリーンタイムラインを起動する導線、クリップのトリム/クロスフェード/音声ミックスをまとめた「リール」書き出し機能、フィルムストリップ表示・波形表示が参考になる。**「追加のPythonライブラリ不要」と明記**されており、wf-managerの依存最小化方針と親和性が高い(実装詳細は非公開のため、"ノードのカスタムウィジェットからフルスクリーンモーダルを開く"というUIパターンのみ参考にする)。 |
| [domg73/ComfyUI-LoadVideoCrop](https://github.com/domg73/ComfyUI-LoadVideoCrop) | **中(Phase 2クロップ機能に直結)** | 公式`LoadVideo`を拡張し、動画プレビュー上でWYSIWYGにクロップ矩形を描画できる`Load Video Crop`ノード。アスペクト比ロック(1:1/2:3/3:2/3:4/4:3/9:16/16:9/21:9/Free)、`start_time`/`duration`/`strict_duration`によるロード時トリムも兼備。**「追加依存ライブラリ不要」**と明記。Phase 2の`_setupCropOverlay()`実装時、このノードの隠し入力設計(`crop_x/crop_y/crop_w/crop_h`を0..1正規化値で渡す)をComfyUI Core `VideoCrop`ノードとのパラメータ形式比較の参考にする。ノード自体を依存に追加するかはPhase 0で`VideoCrop`(Core)とどちらが安定・高機能か比較検討する。 |
| [astropuzzo/ComfyUI-MiniMax-H3-Image-Studio](https://github.com/astropuzzo/ComfyUI-MiniMax-H3-Image-Studio) | **低** | MiniMax H3モデルを使った**静止画**のT2I/I2I/参照編集ツールで、動画のタイムライン編集や結合とは無関係(対象読者はH3の画像生成ワークフロー利用者)。Video Edit実装への直接的な参考価値は無いため、調査対象から除外し将来のGenerateUI/画像生成系機能検討時の参考候補としてのみ記録する。 |
**設計への反映:**
- `_setupTimelinePanel()`(video-edit-tab.js)のDOM構成は、Sonder Editor/H3Studioのレイアウト(サイドバー=クリップ一覧、中央=プレビュー+トランスポート、下部=タイムライン)を踏襲する。ただし将来のマルチレーン拡張(Phase 2以降のBGMトラック等)を見越し、MVPの単一トラックでも「レーン」という概念でデータ構造を設計しておく(`this.clips`を`this.lanes = [{type:"video", clips:[...]}]`のような形にしておくと将来拡張が容易)。
- Phase 2のクロップUIは、LoadVideoCropの「正規化座標(0..1)でのクロップ矩形」という設計をそのまま踏襲し、ComfyUI Core `VideoCrop`ノードの実際のINPUT_TYPES(Phase 0で`/object_info`確認)と突き合わせて座標系を合わせる。
- H3Studioの「ノードのカスタムウィジェットからフルスクリーンモーダルを開く」という導線は、wf-managerでは既にVideo Editが独立サブタブとして存在するため直接は不要だが、将来「ワークフローグラフ上のノードからEditタブへジャンプする」ショートカットを追加する際の参考にする。
---
## 4. 段階的な実装ステップ(Phase分け)
### Phase 0: 下調査・技術検証(実装前必須)— **完了(2026-09-16、ComfyUI_5実機・ポート8189で検証済み)**
**確定事項(`_buildExportWorkflow()`実装時はこの仕様に厳密に従うこと):**
1. **【2026-09-16 訂正】`VideoSlice`は「クラス名にスペースが入る」ため`/object_info/VideoSlice`が空に見えていただけで、実際には`"Video Slice"`(スペース込み)という正式なclass_typeで存在する。** ソース(`comfy_extras/nodes_video.py:448`)の`node_id="Video Slice"`を確認して判明。**トリムはこちらを使う** — `video`/`start_time`(FLOAT)/`duration`(FLOAT, 0で無制限)/`strict_duration`(BOOLEAN)というフラットな入力のみで、`VIDEO_EDIT`型のネスト構造が一切無く、`experimental`でもない。実機で`start_time=2.0, duration=3.0`を指定し、出力が実際に3.0秒になることをPyAV probeで確認済み(**当初の`VideoTrim`検証は`execution_success`だけを見て「動いた」と誤判定していた——後述の訂正参照**)。
2. **【訂正の経緯・重要な教訓】`VideoTrim`の`trim`入力(`VIDEO_EDIT`型)に一見素直なフラット値`{"start_time":.., "duration":..}`を渡すと、`node_errors`無しで`execution_success`するが、実際には一切トリムされず元動画がそのまま出力される(サイレント無視)。** 原因はソース(`comfy_extras/nodes_video.py:524`)の`execute()`が`(trim or {}).get("trim")`と一段余計にネストを剥がしてから`apply_video_trim()`に渡す実装になっており、`apply_video_trim()`は`trim=None`のとき`start_time=0.0, duration=0.0`とみなして**無条件に元動画をそのまま返す**(`comfy_extras/nodes_video.py:417-424`)ため。正しく`VideoTrim`を使うならフラットではなく**二重に入れ子**にした`{"trim": {"start_time": 0.0, "duration": 1.5}}`が必要。ただし本実装ではより単純な`Video Slice`を採用したため、`VideoTrim`は不使用。**教訓: `execution_success`は「グラフの型検証を通った」ことしか意味せず、パラメータが実際に意図通り効いたかは出力を実際にprobeして確認しない限り分からない。** 以後の実機検証では必ず出力の実測値まで確認すること。
3. **`VideoCrop`の`crop`入力も`VideoTrim`と同じ二重ネスト`.get("crop")`パターン(`comfy_extras/nodes_video.py:555`)。** Phase 2で採用する場合は`{"crop": {"x":0,"y":0,"width":W,"height":H}}`のように二重に入れ子にする必要がある(`VideoCrop`はスペース無しの`"VideoCrop"`のままで、`Video Slice`のような別名は無い)。Phase 2着手時に必ず出力を実測して再確認する。
4. **`ConcatenateVideo`の`videos`(`COMFY_AUTOGROW_V3`)は、ネストしたJSONオブジェクトではなく、ドット区切りの単一文字列キーをinputsのトップレベルに並べる。** これが最大のハマりどころで、`{"videos": {"video0": [...]}}` 等の直感的なネスト表現は**すべて`required_input_missing`で弾かれる**。正しい形式:
```json
"inputs": {
"videos.video0": ["<node_id>", 0],
"videos.video1": ["<node_id>", 0],
"codec": "auto"
}
```
(0始まり、`prefix + index`を単純結合した文字列がそのままキー名。ComfyUI Core `comfy_api/latest/_io.py`の`Autogrow.TemplatePrefix`/`finalize_prefix()`のドット結合ロジックに由来)。実機で2クリップ結合の`execution_success`を確認済み。
5. **`ConcatenateVideo`は解像度不一致で実行時ハードエラーになる。** 実機で960x540と1024x576の2クリップを結合させたところ`ValueError: Accumulated videos have incompatible frame dimensions`で失敗(`comfy_extras/nodes_video.py:178`)。事前チェック無しでの結合は失敗するため、**Phase 1のタイムラインUI側で解像度不一致クリップの警告表示・結合前チェックを必須実装**とする(リスク節で「推奨」としていたものを「必須」に格上げ)。
6. 動画アップロードは標準の`/upload/image`エンドポイント(`OPTIONS`で200確認済み)をそのまま使う想定(`LoadVideo`の`file`ウィジェットが`video_upload: true`を持ち、Core LoadVideo/VHS双方がこのエンドポイントを動画にも流用する既知の挙動)。Phase 1実装時に実際のアップロード→`LoadVideo`参照までを通しで確認する。
7. `LoadVideo`の`file`はCOMBO(inputフォルダ内動画ファイル名の列挙)。Asset/GalleryからEditタブへ渡す動画がComfyUI input配下に無い場合(Gallery出力やVTEMP_GROUP由来)は、書き出し前に`/upload/image`でinputへコピーしてからファイル名を`LoadVideo.file`に渡す必要がある。
### Phase 1: MVP基盤(タイムライン表示・単純トリム結合書き出しのみ)
- 新規: `static/js/video-edit-tab.js`(クラス骨格、タイムラインリスト、クリップ追加/削除/並べ替え)
- 変更: `templates/index.html`(Edit subtab DOM骨格)
- 変更: `static/js/video-tab.js`(init呼び出し追加)
- 変更: `static/js/i18n.js`(新規キー)
- 新規API: `py/routes/video_routes.py`に`/api/wfm/video/edit/probe`追加
- 変更: `py/services/video_service.py`に`probe_video()`追加
- 変更: `static/js/video-asset-tab.js`(「Editへ送る」ボタン)
- 実装内容: クリップ追加→トリムハンドルUI→書き出し(VideoSlice+ConcatenateVideo+SaveVideoのグラフ組立て`/prompt`実行)まで通す。
### Phase 2: クロップ機能
- video-edit-tab.jsに`_setupCropOverlay()`追加
- `_buildExportWorkflow()`を拡張し`VideoCrop`ノードを挿入
### Phase 3: テキストオーバーレイ
- video-edit-tab.jsに`_setupTextOverlayPanel()`追加
- 新規API: `/api/wfm/video/edit/overlay-text`
- `video_service.py`に`overlay_text_on_video()`追加
- 書き出しフローを「グラフ実行→結合済みファイル取得→overlay-text後処理呼び出し」の2段構成に変更
### Phase 4: BGM/音声合成
- `CreateVideo`ノードのcomplete_audio機能で足りるか検証した上で、足りなければ`mix-audio` API追加
- video-edit-tab.jsにBGMアップロード/音量UI追加
### Phase 5: 仕上げ・永続化(任意)
- タイムライン状態の保存/読込(`video_plan_service.py`と同様のJSON永続化を検討、`VideoEditProjectService`として新設するか判断)
- Undo/Redo(将来拡張スコープだが、Phase 5で簡易版のみ着手する場合はここ)
---
## 5. リスク・技術的懸念点
1. **VideoTrim/VideoCropのexperimental扱いリスク**
- ComfyUI Core側で今後のマイナーバージョンでノード名・入出力仕様が変更される可能性がある。`io.VideoEdit`ウィジェット型はフロントエンドのインタラクティブUI前提の設計であり、wf-managerは独自UIから直接パラメータをJSON投入する形になるため、公式フロントエンドUIの挙動と乖離があっても気づきにくい。
- 対策: 表示名ではなくノードのクラス名で参照する。最終的にトリムは`experimental`でも`VIDEO_EDIT`ネストでもない`"Video Slice"`(スペース込みのclass_type、`node_id="Video Slice"`)を採用したため、この項目のリスクは実質解消した。Phase 2で`VideoCrop`(こちらは`experimental`かつ`VIDEO_EDIT`の二重ネスト、代替ノード無し)を使う際は本リスクが残るため、必ず出力を実測確認する。
- CLAUDE.mdの「ワークフローJSON整合性ルール」(last_node_id/last_link_id、links[]の3箇所整合)を`_buildExportWorkflow()`実装時に厳守する。
2. **ffmpeg非依存方針の機能的限界**
- トランジション(クロスフェード等)やアルファブレンド合成はComfyUI Coreノードに無く、PyAVで自前実装するとフレーム単位のデコード→NumPy/Pillow合成→再エンコードとなり、CPU処理でかなり低速になる(特に長尺・高解像度動画)。MVPではトランジション無しとし、将来拡張でも「対応するなら低解像度プレビュー限定」等のスコープ限定を検討すべき。
- コーデック非互換なクリップ同士の結合は`ConcatenateVideo`が自動的に一度デコードしてから再結合するため、異なる解像度/フレームレートのクリップを混在させると処理コストが跳ね上がる可能性がある。タイムラインUI側で「解像度/fps不一致クリップ」を警告表示する簡易チェックをPhase 1に含めることを推奨。
- テキストオーバーレイの再エンコード(Phase 3)は全フレームを一度デコード・Pillow処理・再エンコードするため、長尺動画では書き出しに時間がかかる。プログレス表示(Frame N/Total等)をAPIレスポンスではなくポーリング or 簡易WebSocket通知で出す設計を検討(現状の`convert_to_gif`は同期一括処理でプログレス無し、これをそのまま踏襲すると長尺でUIが固まって見える点に注意)。
3. **既存Video Plan/Assetタブとのデータ連携**
- AssetタブからEditタブへの動画受け渡しは、Asset側が持つ参照形式(Galleryの絶対パス`img.path`)とEdit側のタイムラインが必要とする形式(ComfyUIの`{filename, subfolder, type}`、またはローカルFileオブジェクト)の変換が必要。`video-asset-tab.js`の`_loadIntoSourcePreview()`が既にこの変換(Blob取得→File化→`kind:"local"`)を行っているので、同じパターンをEditタブのクリップ追加処理でも使う。ただし書き出しグラフの`LoadVideo`ノードはComfyUI input/output/temp配下のファイルを期待するため、ローカルFileの場合は動画アップロードAPIを経由してから`LoadVideo`に渡す必要がある(Phase 0の技術検証項目)。
- Video Planタブが生成した動画は`VTEMP_GROUP`に入るため、Editタブの「クリップ追加」ソースとして「Video Plan実行結果」も選択できるようにする導線(Assetタブ経由で十分か、Editタブ内に直接「最近の生成結果」ショートカットを設けるか)はUX判断が必要。
- タイムライン編集結果を保存/読込する永続化機能(Phase 5想定)を作る場合、`video_plan_service.py`のディレクトリ構成・ファイル命名規則を踏襲し、別サービスクラス(`VideoEditProjectService`)として分離するか、既存`VideoPlanService`を拡張するかの設計判断が必要(データモデルが「バッチ生成の入力」と「編集後のタイムライン状態」で意味的に異なるため、別クラス推奨)。
4. **並行実行時のリソース競合**
- Edit書き出しはPlan tabのバッチ生成と同じ`/prompt`キューを使うため、Plan実行中にEdit書き出しを投げると同じキューに並ぶ。ユーザーへの「実行中」表示や二重実行防止のUI制御をPlan tab側の既存パターン(生成中はボタンdisable等)に倣って実装する。
5. **開発・デプロイ運用(CLAUDE.md既存ルール)**
- 開発元リポジトリ(`c:\Users\statsu-11\Desktop\now_work\comfyUI-wf-maneger\ComfyUI-Workflow-Studio`)と実行時`custom_nodes`(`...\ComfyUI_5\custom_nodes\comfyui-workflow-studio`)は別実体。実機確認のたびに同期スクリプトでの全体反映が必要(部分同期は原因不明のエラーの元)。
- `_buildExportWorkflow()`実装時はワークフローJSON整合性ルール(`last_node_id`/`last_link_id`が最大値以上、`links[]`とノード両端の`links`/`link`の3箇所整合)を厳守する。
- Python側変更(`video_service.py`, `video_routes.py`)反映にはComfyUI完全再起動が必須(`py_compile`キャッシュではなくインポート自体が起動時一度きりのため)。
---
## 6. UI再設計(2026-09-16、ユーザー指示によりPlanタブ寄りに変更)
初回MVP実装(縦リスト+各行ボタン方式)を、以下のとおりPlan subtabのUIパターンに揃える形で再設計・実機確認済み。
- **タイムライン**: 縦リスト(`wfm-video-edit-clip-list`)から、Planタブと同じ横トラック構造(`wfm-video-edit-timeline-track`)へ変更。ただしPlanのブロックは`flex-grow`でトラック幅いっぱいに引き伸ばされるのに対し、Editのブロックは実秒数×固定px/秒(20px/秒、最小56px)の幅を持ち**左詰め**で並ぶ(空きトラックはそのまま空く)。
- **並べ替えの共有化**: 各クリップ行が持っていた▲▼⧉✕ボタンを廃止し、タイムライン直下の共有ツールバー(◀ 左へ移動 / ▶ 右へ移動 / 複製 / 削除 / クリア)に統合。Planタブの「+ Split / + Block / Delete」ツールバーと同じ「選択中の対象に対して働く共通ボタン」方式。
- **ドラッグ並べ替え**: ネイティブHTML5 D&Dでブロック同士のドラッグ&ドロップによる並べ替えにも対応(ボタンと併用可)。`_reorderByDrop()`は「削除→対象の新インデックスを探索→挿入」の順で行い、素朴な二段splice実装にありがちなオフバイワンを回避している。
- **Clearボタン新設**: タイムライン全体をクリアする専用ボタン(`videoEditConfirmClear`で確認ダイアログ表示)。
- **上部「動画ソース」パネルとの連携**: 自動連携ではなく、Video Sourceパネルに明示的な「Editに追加」ボタン(`#wfm-video-source-add-to-edit`)を新設。Frame/GIF目的の単発動画ドロップでEditタイムラインが意図せず汚れないよう、ユーザーが選択・確認済み。ローカルFile/サーバー参照(`kind:"local"`/`"input"`/`"output"`)の両方に対応し、クリックでEditサブタブへ自動切替。
- Frame抽出・GIF化(右ペイン、単独動画操作)とEdit(タイムライン編集・結合、複数クリップ操作)の役割分担は従来通り変更なし——ユーザーからの確認事項としてこの分離を維持している。
実機(ComfyUI_5・ポート8189、Kapture)で以下を確認済み: 左詰めタイムライン描画、Asset選択→「Editに追加」経路、2クリップの◀移動での順序入れ替え、複製、削除、クリア(確認ダイアログのi18n適用含む)、クリア後の単一クリップ書き出し(22.13秒で正常出力)。
## 7. レイアウト修正(2026-09-16、追加指示)
UI再設計直後、実機で「空のタイムライン/書き出しパネルが中央に縮んで表示され、Planタブのように横幅いっぱい・右端固定にならない」という不具合をユーザーが発見。原因はCSSのバグで、修正内容は以下の3点。
1. **Editタブ自身のドロップゾーンを削除**: `#wfm-video-edit-drop-zone`をtemplates/index.htmlから削除し、`video-edit-tab.js`の`_wireAddClipDropZone()`も削除。クリップ追加は Asset タブの「Editへ送る」ボタンと、Video Sourceパネルの「Editに追加」ボタン(第4節参照)の2経路に一本化。
2. **【根本原因】`static/css/video-tab.css`に旧プレースホルダー時代の重複`.wfm-video-edit-panel`ルールが残存していた。** Edit サブタブが「Editing tools coming soon」という1行プレースホルダーだった頃の`display:flex; align-items:center; justify-content:center; border:1px dashed ...`というルール(中央に1行だけ表示するための定義)が、実装を追加した後も削除されておらず、CSSカスケード順(後勝ち)で新しい`.wfm-video-edit-panel { padding: 0 16px 16px; }`の直後に来て`align-items:center`等を上書きし続けていた。これによりタイムライン・トリムパネル・書き出しパネルの全てが横方向に縮んで中央寄せされていた。該当ルールを完全に削除して解消。
3. `.wfm-video-edit-timeline-track`に`width:100%; box-sizing:border-box; flex:none;`を明示し、クリップの有無に関わらずトラック自体がPlanの`.wfm-video-timeline-track`と同様に横幅いっぱい・高さ固定のバーであり続けるようにした(今回のバグの根本原因はCSSの重複ルールだったが、将来の再発防止として明示指定を追加)。
修正後、実機で「空のタイムラインが横幅いっぱいに固定表示される」「クリップ追加後もトラックがフル幅を保ち、クリップは左詰め」「書き出しパネルがPlanのRun/Planパネルと同じ右端固定位置に表示される」ことをスクリーンショットで確認済み。
## 8. トリムパネル・ツールバーの細部調整(2026-09-16、追加指示)
- **開始/終了(秒)入力欄+「現在位置を使用」ボタン**: 従来は横並び(`display:flex`)で、ボタンのテキストが枠からはみ出しコンテナ幅を超えていた。入力欄とボタンを縦積み(`.wfm-video-edit-trim-field { flex-direction:column }`)にし、`.wfm-video-edit-trim-row`のグリッド列幅を`minmax(0,160px)`に縮小。ボタンは`.wfm-video-edit-playhead-btn`(font-size:10px、padding:2px 6px)で一回り小さくし、入力欄との見分けを明確化。
- **タイムライン総合時間の表示**: ツールバーのClearボタン左隣に、全クリップのトリム後長さ合計を表示する`#wfm-video-edit-total-duration`(`合計: 22.1s`のような表示)を追加。`_updateTotalDuration()`が`_updateToolbarState()`(タイムライン再描画のたびに呼ばれる)から自動更新される。
## 9. タイムライン連続プレビュー(2026-09-16、追加指示)
「タイムラインの動画を上部の『生成された動画』プレビューで表示したい。このプレビューの動画=書き出しされる動画としたい」という要望に対応。新規に`<video>`要素を追加するのではなく、Exportの結果が最終的に書き出される**同じ「Result」プレビュー枠**(`#wfm-video-preview-video`、`video-preview.js`の`setResultPreview()`が使う枠)を共有し、タイムライン上の全クリップ(トリム区間反映済み)を順番に連続再生する「疑似合成プレビュー」を実装した。当初計画のMVP項目4「各クリップを順番に`<video>`要素で連続再生する疑似プレビュー」を正式に実装したものにあたる。
- **UI**: タイムラインツールバーに「▶ プレビュー / ■ 停止」トグルボタンを追加(Delete と 合計時間表示の間)。クリップが0件のときは無効化。
- **実装**(`video-edit-tab.js`): `_startPreview()`が`serverRef`ありかつエラー無しのクリップを`_previewClips`として捕捉し先頭から`setResultPreview()`で読み込み・`trimStart`へシーク・再生。`timeupdate`イベントで`currentTime >= trimEnd`を検知した時点、または`ended`イベントで次クリップへ自動遷移(`_advancePreview()`)。全クリップ終了で自動停止。
- `video-preview.js`に`getResultPreviewVideoElement()`を新規export(Resultペインの`<video>`要素へ直接アクセスし、`timeupdate`/`ended`購読や`currentTime`制御を行うため。`setResultPreview()`自体はsrc差し替えのみで再生制御はできないため)。
- クリップ削除・クリア・書き出し開始時には`_stopPreview()`を呼び、再生中の疑似プレビューを確実に停止する(書き出し完了後は同じ枠に実際の書き出し結果が上書き表示される——「プレビューの動画=書き出しされる動画」という要望通り、同一枠が編集中プレビューと最終結果の両方を担う)。
実機で2クリップ(22.1s+19.1s)の連続プレビュー再生→クリップ境界での自動切替→停止→書き出し(結合後41.2s)→Resultペインへの結果反映、という一連の流れを確認済み。
## 10. 静止画/アニメーション画像クリップ対応(2026-09-16、追加指示)
「Assetの画像(静止画)を動画ソースでプレビュー、Editに追加可能にしたい。静止画、アニメーション画像をタイムラインに追加時間を設定できるようにしたい」という要望に対応。既存のAsset一覧(`__Video Assets__`/`__Video Temp__`グループ、ユーザー選択によりこの2グループのみを対象、Gallery全体には拡張しない)には元々ビデオ専用フィルタが無く、手動でタグ付けされた画像もそのまま一覧に出ていたが、プレビューが常に`<video>`要素前提だったため画像では何も表示されず、Editに追加しても動画として扱われ破綻していた。
**設計判断(ユーザー承認事項):**
- 静止画/アニメーション画像は区別せず、どちらも「表示時間(秒)」を指定するhold型クリップとして統一的に扱う。
- 画像クリップの解像度が他の動画クリップと不一致の場合は、`ImageScale`ノード(`crop="center"`)で自動的に動画側の解像度へフィット(ブロックしない)。
**実装:**
- `video-preview.js`: Source/Resultの両プレビュー枠に`<img>`コンパニオン要素を追加し、`setSourcePreview()`/`setResultPreview()`に`mediaType`("video"|"image")引数を追加。`getActivePreviewVideoElement()`は画像表示中は`null`を返す(Frame/GIFツールの誤動作防止)。
- `gallery-tab.js`: `isVideoFile()`をexport。
- `video-asset-tab.js`/`video-tab.js`: プレビュー読み込み・「Editへ送る」/「Editに追加」の各経路で`isVideoFile()`により`mediaType`を判定して渡すよう修正。Video Sourceドロップゾーンも`image/*`を受け付けるよう拡張。
- `video-edit-tab.js`: クリップに`kind:"video"|"image"`を追加。画像クリップは`file.type`から自動判定(`addClipFromFile()`)、サーバーへアップロード後、寸法はPyAV probeではなくブラウザの`Image()`で読み取り(`_readImageDimensions()`、PyAVは任意の静止画形式を安定して開けないため)。トリムパネルはStart/Endペアの代わりに単一の「表示時間(秒)」入力に分岐。タイムラインブロックには🖼/🎬の種別アイコンを付与。解像度不一致ガード(`_findResolutionMismatch`)は`kind==="video"`同士のみ比較するよう変更(画像は自動フィットで解決するため対象外)。
- **書き出しグラフ(画像クリップ)**: `LoadImage` → (解像度不一致時のみ)`ImageScale(crop=center)` → `RepeatImageBatch(amount = 表示秒数 × 24fps)` → `CreateVideo(fps=24, codec="auto")`。実機で48フレーム/24fps→1.998秒の正確な動画生成を確認済み。
- **【追加発見・修正】音声トラック不整合によるConcatenateVideo失敗**: 動画クリップ(音声あり、例: 32kHz stereo)と画像由来クリップ(音声なし)を結合すると`ConcatenateVideo`が`audio layout: expected None, got 'stereo'`で失敗することを実機で発見。対策として、**2クリップ以上を結合する場合のみ**、動画クリップも`GetVideoComponents`→`CreateVideo`(audio未指定)で無音再構成してから結合するよう統一。単一クリップの書き出し(結合が発生しない)は従来通り音声を保持する。**この結果、複数クリップを結合した書き出しは音声を持たないという制約がMVPの既知の限界として残る**(Phase 2以降で音声トラックの取り扱いを検討する余地あり)。
実機で以下を確認済み: 静止画の`<img>`プレビュー表示、Editへの追加(🖼アイコン・表示時間入力)、単独画像クリップの書き出し(2.998秒の正確な動画化)、動画クリップ+画像クリップ混在時の自動解像度フィット・音声除去による結合成功(5.996秒)。
---
### Critical Files for Implementation
- static/js/video-edit-tab.js(新規、中心となるクラス実装)
- templates/index.html(Edit subtab DOM骨格、2895行目付近を拡張)
- static/js/video-workflow.js(ノード注入・ID採番パターンの流用元)
- py/services/video_service.py(probe_video/overlay_text_on_video追加)
- py/routes/video_routes.py(新規APIエンドポイント追加)
- static/js/image-edit-tab.js(アクションバー・レイヤーパネル・pointerイベントパターンの流用元、1385行目・2194行目・1130-1249行目)
- static/js/video-asset-tab.js(Asset→Edit連携ボタン追加)
Binary file not shown.

After

Width:  |  Height:  |  Size: 279 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 427 KiB

-183
View File
@@ -1,183 +0,0 @@
{
"0": "escapeHtml",
"1": "prompt-table.js",
"2": "models_routes.py",
"3": "generate-tab.js",
"4": "_openCellModal",
"5": "gallery_routes.py",
"6": "gallery-tab.js",
"7": "ImageEditTab",
"8": "ai-tab.js",
"9": "eagle_routes.py",
"10": "feeder-tab.js",
"11": "NodesService",
"12": "settings_routes.py",
"13": "metadata-tab.js",
"14": "node_sets_menu.js",
"15": "GalleryService",
"16": "settings-tab.js",
"17": "tagger_routes.py",
"18": "WildcardService",
"19": "tagger-tab.js",
"20": "renderContent",
"21": "comfyui-editor.js",
"22": "ComfyUI-Workflow-Studio",
"23": "TaggerService",
"24": "top_menu_extension.js",
"25": "nodes-tab.js",
"26": "setupAiHandlers",
"27": "workflow-tab.js",
"28": "workflow_routes.py",
"29": "GalleryMetadataStore",
"30": "WorkflowService",
"31": "LabPlanService",
"32": "skill_routes.py",
"33": "LayerManager",
"34": "SelectTool",
"35": "CivitaiService",
"36": "DrawTool",
"37": "MaskTool",
"38": "index.html Template",
"39": "gallery_service.py",
"40": "FileExport",
"41": "image-prompt-tab.js",
"42": "KSampler Node",
"43": "image-edit-tab.js",
"44": "style-catalog-tab.js",
"45": "add",
"46": "comfyui-workflow.js",
"47": "BlurTool",
"48": "MaskShapeTool",
"49": "MaskVectorTool",
"50": "ShapeTool",
"51": "gmic_routes.py",
"52": "ollama_routes.py",
"53": "TextTool",
"54": "analyze_workflow",
"55": "MaskTextTool",
"56": "lab-tab.js",
"57": ".list_images",
"58": "MaskAlphaTool",
"59": "MaskColorTool",
"60": "gallery_feeder_extension.js",
"61": "createPanel",
"62": "_runLabBatch",
"63": "BgRemove",
"64": "Workflow JSON",
"65": "WFS_GalleryFeeder",
"66": "initGenerateTab",
"67": "InpaintI2IActions",
"68": "Sam3Segmentation",
"69": "fromWorkflow",
"70": "_extractPromptsAPI",
"71": "generate_doc_index.py",
"72": "WS Inpaint Basic Workflow",
"73": "._bg_index_folder",
"74": "aiohttp",
"75": "import_style_prompt_seed.py",
"76": "Image Edit (FireRed Image Edit 1.1) node",
"77": "Version 0.3.9",
"78": "DWPose Image Feeder Workflow",
"79": "wfm.py",
"80": "README.index.md",
"81": "WFS_PromptText",
"82": "workflow_service.py",
"83": "SPA",
"84": "prompt-ai-chat.js",
"85": "Tagger Tab requirements.txt",
"86": "data directory",
"87": "t",
"88": "Chinese Language Support",
"89": "Version 0.3.95",
"90": "Windows",
"91": "add_routes",
"92": "Bounded Cache",
"93": "Business Logic",
"94": "check_lazy_status",
"95": "HF_HOME",
"96": "IS_CHANGED",
"97": "Lab Subtab",
"98": "lab_routes.py",
"99": "PowerShell",
"100": "prestartup_script.py",
"101": ".get_image_prompt_root",
"102": ".get_style_catalog_root",
"103": ".start_background_index",
"104": ".update_workflows_dir",
"105": "Version 0.4.2",
"106": "Workflow Studio Banner",
"107": "Workflow Studio Icon",
"108": "BiRefNet Model",
"109": "Chinese",
"110": "SDXL 2D Pose Editor I2I Workflow",
"111": "ComfyUI Manager",
"112": "Tagger Tab Screenshot (WD Tagger/DeepDanbooru)",
"113": "Models Tab UI Screenshot",
"114": "Workflow Studio Topbar Icon Strip",
"115": "GenerateUI LoRA Stack Tab Screenshot",
"116": "Workflow Studio Favicon Icon",
"117": "2D Pose Editor to Image Edit (FireRed) Workflow",
"118": "3D Pose Editor to Image Edit (Flux.2 Klein) Workflow",
"119": "SDXL DWPose ControlNet Workflow",
"120": "SDXL From Metadata T2I Workflow",
"121": "SDXL Img2Img + FaceDetailer Workflow",
"122": "SDXL Image Feeder Img2Img Workflow",
"123": "SDXL T2I + FaceDetailer Workflow",
"124": "GenerateUI Batch Tab Screenshot",
"125": "Multiple Select Menu Screenshot",
"126": "Image Edit Tab Screenshot",
"127": "Workflow Tab Screenshot",
"128": "Prompt Tab Input Assistance Screenshot",
"129": "GenerateUI Feeder Tab Screenshot",
"130": "Workflow Studio Library Panel (Lora Info View)",
"131": "Library Panel I Tab (Prompts) Screenshot",
"132": "Settings Tab Screenshot (Language, Theme)",
"133": "ComfyUI Workflow Studio Thumbnail",
"134": "English",
"135": "Feeder Subtab",
"136": "folder_paths",
"137": "Help & Support Tab",
"138": "i18n",
"139": "Japanese",
"140": "Metadata Tab",
"141": "NODE_CLASS_MAPPINGS",
"142": "OrderedDict",
"143": "get_output_directory",
"144": "comfyui-workflow-studio",
"145": "ComfyUI PromptServer",
"146": "py/__init__.py",
"147": "nodes/__init__.py",
"148": "routes/__init__.py",
"149": "services/__init__.py",
"150": "python-dotenv",
"151": "Silent Failure Diagnosis",
"152": "get_temp_directory",
"153": "prompts_routes.py",
"154": "VALIDATE_INPUTS",
"155": "SD1.5 Basic Text-to-Image Workflow",
"156": "SDXL Text-to-Image Basic Workflow Screenshot",
"157": "SettingsService",
"158": "on_doc_edit.py",
"159": "ComfyUI-Custom-Scripts",
"160": "ComfyUI-Gallery",
"161": "ComfyUI-Lora-Manager",
"162": "Eagle",
"163": "Fooocus",
"164": "Gallery Tab",
"165": "GenerateUI Tab",
"166": "Image Edit Tab",
"167": "infinite-image-browsing",
"168": "Lemonade Server",
"169": "LM Studio",
"170": "Ollama",
"171": "Settings Tab",
"172": "Tagger Tab",
"173": "Unsloth",
"174": "app.js",
"175": "PromptsService",
"176": "util.js",
"177": "civitai_service.py",
"178": "config.py",
"179": "createModelItem",
"180": "_renderBatchPreview"
}
-605
View File
@@ -1,605 +0,0 @@
# Graph Report - ComfyUI-Workflow-Studio (2026-08-22)
## Corpus Check
- 113 files · ~567,985 words
- Verdict: corpus is large enough that graph structure adds value.
## Summary
- 2314 nodes · 5664 edges · 181 communities (87 shown, 94 thin omitted)
- Extraction: 95% EXTRACTED · 5% INFERRED · 0% AMBIGUOUS · INFERRED: 302 edges (avg confidence: 0.88)
- Token cost: 0 input · 0 output
## Graph Freshness
- Built from commit: `ad9d06d3`
- Run `git rev-parse HEAD` and compare to check if the graph is stale.
- Run `graphify update .` after code changes (no API cost).
## Community Hubs (Navigation)
- escapeHtml
- prompt-table.js
- models_routes.py
- generate-tab.js
- _openCellModal
- gallery_routes.py
- gallery-tab.js
- ImageEditTab
- ai-tab.js
- eagle_routes.py
- feeder-tab.js
- NodesService
- settings_routes.py
- metadata-tab.js
- node_sets_menu.js
- GalleryService
- settings-tab.js
- tagger_routes.py
- WildcardService
- tagger-tab.js
- renderContent
- comfyui-editor.js
- ComfyUI-Workflow-Studio
- TaggerService
- top_menu_extension.js
- nodes-tab.js
- setupAiHandlers
- workflow-tab.js
- workflow_routes.py
- GalleryMetadataStore
- WorkflowService
- LabPlanService
- skill_routes.py
- LayerManager
- SelectTool
- CivitaiService
- DrawTool
- MaskTool
- index.html Template
- gallery_service.py
- FileExport
- image-prompt-tab.js
- KSampler Node
- image-edit-tab.js
- style-catalog-tab.js
- add
- comfyui-workflow.js
- BlurTool
- MaskShapeTool
- MaskVectorTool
- ShapeTool
- gmic_routes.py
- ollama_routes.py
- TextTool
- analyze_workflow
- MaskTextTool
- lab-tab.js
- .list_images
- MaskAlphaTool
- MaskColorTool
- gallery_feeder_extension.js
- createPanel
- _runLabBatch
- BgRemove
- Workflow JSON
- WFS_GalleryFeeder
- initGenerateTab
- InpaintI2IActions
- Sam3Segmentation
- fromWorkflow
- _extractPromptsAPI
- generate_doc_index.py
- WS Inpaint Basic Workflow
- ._bg_index_folder
- aiohttp
- import_style_prompt_seed.py
- Image Edit (FireRed Image Edit 1.1) node
- Version 0.3.9
- DWPose Image Feeder Workflow
- wfm.py
- README.index.md
- WFS_PromptText
- workflow_service.py
- SPA
- prompt-ai-chat.js
- Tagger Tab requirements.txt
- data directory
- t
- Chinese Language Support
- Version 0.3.95
- Windows
- add_routes
- Bounded Cache
- Business Logic
- check_lazy_status
- HF_HOME
- IS_CHANGED
- Lab Subtab
- lab_routes.py
- PowerShell
- prestartup_script.py
- .get_image_prompt_root
- .get_style_catalog_root
- .start_background_index
- .update_workflows_dir
- Version 0.4.2
- Workflow Studio Banner
- Workflow Studio Icon
- BiRefNet Model
- Chinese
- SDXL 2D Pose Editor I2I Workflow
- ComfyUI Manager
- Tagger Tab Screenshot (WD Tagger/DeepDanbooru)
- Models Tab UI Screenshot
- Workflow Studio Topbar Icon Strip
- GenerateUI LoRA Stack Tab Screenshot
- Workflow Studio Favicon Icon
- 2D Pose Editor to Image Edit (FireRed) Workflow
- 3D Pose Editor to Image Edit (Flux.2 Klein) Workflow
- SDXL DWPose ControlNet Workflow
- SDXL From Metadata T2I Workflow
- SDXL Img2Img + FaceDetailer Workflow
- SDXL Image Feeder Img2Img Workflow
- SDXL T2I + FaceDetailer Workflow
- GenerateUI Batch Tab Screenshot
- Multiple Select Menu Screenshot
- Image Edit Tab Screenshot
- Workflow Tab Screenshot
- Prompt Tab Input Assistance Screenshot
- GenerateUI Feeder Tab Screenshot
- Workflow Studio Library Panel (Lora Info View)
- Library Panel I Tab (Prompts) Screenshot
- Settings Tab Screenshot (Language, Theme)
- ComfyUI Workflow Studio Thumbnail
- English
- Feeder Subtab
- folder_paths
- Help & Support Tab
- i18n
- Japanese
- Metadata Tab
- NODE_CLASS_MAPPINGS
- OrderedDict
- get_output_directory
- comfyui-workflow-studio
- ComfyUI PromptServer
- python-dotenv
- Silent Failure Diagnosis
- get_temp_directory
- prompts_routes.py
- VALIDATE_INPUTS
- SD1.5 Basic Text-to-Image Workflow
- SDXL Text-to-Image Basic Workflow Screenshot
- SettingsService
- on_doc_edit.py
- ComfyUI-Custom-Scripts
- ComfyUI-Gallery
- ComfyUI-Lora-Manager
- Eagle
- Fooocus
- Gallery Tab
- GenerateUI Tab
- Image Edit Tab
- infinite-image-browsing
- Lemonade Server
- LM Studio
- Ollama
- Settings Tab
- Tagger Tab
- Unsloth
- app.js
- PromptsService
- util.js
- civitai_service.py
- config.py
- createModelItem
- _renderBatchPreview
## God Nodes (most connected - your core abstractions)
1. `t()` - 233 edges
2. `showToast()` - 192 edges
3. `escapeHtml()` - 73 edges
4. `ImageEditTab` - 53 edges
5. `GalleryService` - 45 edges
6. `setup_routes()` - 32 edges
7. `initSettingsTab()` - 31 edges
8. `add()` - 31 edges
9. `renderModelGrid()` - 29 edges
10. `TaggerService` - 26 edges
## Surprising Connections (you probably didn't know these)
- `beforeRegisterNodeDef()` --indirect_call--> `saveSelectedAsNodeSet()` [INFERRED]
web/comfyui/top_menu_extension.js → web/comfyui/node_sets_menu.js
- `Publish to Comfy Registry Workflow` --conceptually_related_to--> `index.html Template` [INFERRED]
.github/workflows/publish.yml → templates/index.html
- `Version 0.3.9` --references--> `Models Tab` [EXTRACTED]
DEVLOG.index.md → README.index.md
- `Version 0.3.9` --references--> `Nodes Tab` [EXTRACTED]
DEVLOG.index.md → README.index.md
- `Version 0.3.9` --references--> `Prompt Tab` [EXTRACTED]
DEVLOG.index.md → README.index.md
## Import Cycles
- 3-file cycle: `static/js/app.js -> static/js/generate-tab.js -> static/js/feeder-tab.js -> static/js/app.js`
- 3-file cycle: `static/js/feeder-tab.js -> static/js/gallery-tab.js -> static/js/generate-tab.js -> static/js/feeder-tab.js`
- 3-file cycle: `static/js/app.js -> static/js/prompt-tab.js -> static/js/prompt-presets.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/prompt-tab.js -> static/js/prompt-ai-chat.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/prompt-tab.js -> static/js/prompt-styles.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/prompt-tab.js -> static/js/prompt-wildcards.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/models-tab.js -> static/js/models/badges.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/gallery-tab.js -> static/js/image-prompt-tab.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/Sam3Segmentation.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/GmicIntegration.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/FileExport.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/MaskEditorOneBridge.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/models-tab.js -> static/js/comfyui-editor.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/comfyui-editor.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/BgRemove.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/BlurTool.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/image-edit-tab.js -> static/js/image-edit/InpaintI2IActions.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/gallery-tab.js -> static/js/style-catalog-tab.js -> static/js/app.js`
- 3-file cycle: `static/js/app.js -> static/js/generate-tab.js -> static/js/comfyui-editor.js -> static/js/app.js`
- 3-file cycle: `static/js/ai-tab.js -> static/js/app.js -> static/js/gallery-tab.js -> static/js/ai-tab.js`
## Hyperedges (group relationships)
- **Architecture Layers** — workflowstudio, add_routes, py_wfm, py_routes, py_services, business_logic, web_comfyui, static, templates, data, settings_json, metadata_json, node_metadata_json [EXTRACTED 0.80]
- **Graphify Index Generation** — readme_index, devlog_index, generate_doc_index, graphifyignore, readme, devlog, claude_hooks, git_hooks [EXTRACTED 0.85]
- **Workflow Studio UI Navigation Tabs** — templates_index_html_workflow, templates_index_html_nodes, templates_index_html_models, templates_index_html_generate, templates_index_html_prompt, templates_index_html_gallery, templates_index_html_image_edit, templates_index_html_tagger, templates_index_html_settings, templates_index_html_help, templates_index_html_ai [EXTRACTED 0.85]
- **Workflow JSON Consistency Group** — last_node_id, last_link_id, links, workflow_json [EXTRACTED 0.85]
- **i18n Languages** — i18n, english, japanese, chinese [EXTRACTED 0.90]
- **Mask Editor One Inpainting Pipeline** — comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_load_checkpoint_node, comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_mask_editor_one_node, comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_clip_text_encode_positive_node, comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_clip_text_encode_negative_node, comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_vae_encode_for_inpainting_node, comfyui-workflow-studio_workflows_ws_inpaint_mask_editor_one_save_image_node [INFERRED]
## Communities (181 total, 94 thin omitted)
### Community 0 - "escapeHtml"
Cohesion: 0.09
Nodes (80): openModal(), comfyUI, badgeHtml(), bindBadgeModalEvents(), bindBadgeRowEvents(), getBadgePalette(), modelBadgesHtml(), _onGridChange() (+72 more)
### Community 1 - "prompt-table.js"
Cohesion: 0.06
Nodes (99): closeModal(), refreshStylesList(), apiCreatePreset(), apiDeletePreset(), apiUpdatePreset(), clearBatchPresets(), createPmItem(), esc() (+91 more)
### Community 2 - "models_routes.py"
Cohesion: 0.06
Nodes (55): handle_change_preview(), handle_civitai_batch(), handle_civitai_cache(), handle_civitai_fetch(), handle_delete_models(), handle_get_disabled(), handle_get_filepath(), handle_get_groups() (+47 more)
### Community 3 - "generate-tab.js"
Cohesion: 0.09
Nodes (41): _applyNamedStyle(), _applyStyleToWorkflow(), _batchGroupState, _batchStyleSelected, _blobToDataUrl(), _buildFolderTree(), _ckptBatch, _ckptState (+33 more)
### Community 4 - "_openCellModal"
Cohesion: 0.24
Nodes (12): _applyStyleToText(), _cellHtml(), _cellLabel(), _effectiveDisplayValue(), _isEmptyValue(), _isLiveDisplay(), _liveValueFor(), _openCellModal() (+4 more)
### Community 5 - "gallery_routes.py"
Cohesion: 0.10
Nodes (54): add_to_group(), bulk_favorite(), bulk_group(), clear_group_images(), create_folder_route(), create_group(), delete_folder_route(), delete_group() (+46 more)
### Community 6 - "gallery-tab.js"
Cohesion: 0.10
Nodes (53): addTag(), API, apiFetch(), _appendNextPage(), _applySelectionToDOM(), _attachScrollSentinel(), bindEvents(), bulkAddToGroup() (+45 more)
### Community 8 - "ai-tab.js"
Cohesion: 0.09
Nodes (52): appendChatBubble(), _appendSkillSaveButton(), _appendSvgPreview(), _applyGenOptions(), buildTranslationMessages(), callChat(), callLLM(), callVLM() (+44 more)
### Community 9 - "eagle_routes.py"
Cohesion: 0.14
Nodes (20): _eagle_add(), _eagle_add_from_path(), _eagle_test(), handle_add(), handle_test(), Application, Request, Response (+12 more)
### Community 10 - "feeder-tab.js"
Cohesion: 0.10
Nodes (50): _applyGalToWorkflow(), _applyPreset(), _applyToGalNode(), _applyToNode(), _applyToWorkflow(), _deletePreset(), _deselectAll(), _feederNodes() (+42 more)
### Community 11 - "NodesService"
Cohesion: 0.09
Nodes (27): handle_create_set(), handle_delete_set(), handle_export_set(), handle_get_groups(), handle_get_metadata(), handle_list_sets(), handle_save_groups(), handle_save_metadata() (+19 more)
### Community 12 - "settings_routes.py"
Cohesion: 0.09
Nodes (44): _apply_import_bundle(), _build_export_bundle(), _find_style(), _get_comfyui_output_dir(), handle_create_style(), handle_delete_style(), handle_export(), handle_get() (+36 more)
### Community 13 - "metadata-tab.js"
Cohesion: 0.11
Nodes (40): buildLoRAItem(), buildModelItem(), buildPromptItem(), collectAllNodes(), collectUnique(), extractAllMetadata(), fromWorkflow(), extractCheckpoints() (+32 more)
### Community 14 - "node_sets_menu.js"
Cohesion: 0.08
Nodes (38): AI_BACKEND_DEFAULT_URLS, AI_LANG_NAMES, convertApiToUiWorkflow(), _extractAllMetadata(), _extractWorkflowFromEXIF(), fetchGroups(), fetchMetadata(), fetchNodeSets() (+30 more)
### Community 15 - "GalleryService"
Cohesion: 0.10
Nodes (13): GalleryService, Path, 許可するルートパスを更新する(Settings変更時に呼ぶ), ComfyUI実outputフォルダの不変ルートを設定する(起動時に一度だけ呼ぶ), パスが許可ルート配下かチェック(パストラバーサル防止)。 Output ギャラリーの _allowed_root、またはComfyUI実outputフォルダの…, outputフォルダのフォルダツリーを返す, 画像と同名の.txtサイドカーにプロンプトテキストを保存する, ワークフローを抽出する。 優先順位: PNG[workflow] > PNG[prompt] > gallery_metadata.json[workflow] (+5 more)
### Community 16 - "settings-tab.js"
Cohesion: 0.09
Nodes (40): getLang(), getLanguageOptions(), getSummaryLang(), getSummaryLanguageOptions(), getSummaryPrompt(), LANGUAGE_OPTIONS, LANGUAGES, setLang() (+32 more)
### Community 17 - "tagger_routes.py"
Cohesion: 0.14
Nodes (24): Connection, handle_batch_start(), handle_batch_status(), handle_batch_stop(), handle_db_delete(), handle_db_export(), handle_db_list(), handle_db_save() (+16 more)
### Community 18 - "WildcardService"
Cohesion: 0.12
Nodes (21): handle_create_link(), handle_delete(), handle_get_content(), handle_link_status(), handle_list(), handle_remove_link(), handle_save(), Application (+13 more)
### Community 19 - "tagger-tab.js"
Cohesion: 0.14
Nodes (29): _applyI18n(), _batchStart(), _batchStop(), _dbDelete(), _dbExport(), _dbLoad(), _dbSave(), _dbSearch() (+21 more)
### Community 20 - "renderContent"
Cohesion: 0.16
Nodes (28): createDraggableItem(), createDraggablePromptItem(), createDraggableWfItem(), esc(), extractPackageName(), getNodeCategory(), getNodePackage(), getWfBadges() (+20 more)
### Community 21 - "comfyui-editor.js"
Cohesion: 0.08
Nodes (28): _applyLoraToNode(), _attachPromptWeightControl(), _buildLoraManagerSyntax(), _buildLoraSyntax(), _buildPresetOptions(), _compositeImageWithMask(), _I2I_PLACEHOLDER_DEFAULT, _imageInputToDataURL() (+20 more)
### Community 22 - "ComfyUI-Workflow-Studio"
Cohesion: 0.50
Nodes (4): CivitAI, ComfyUI-Workflow-Studio, Mask Editor One, Version 0.3.65
### Community 23 - "TaggerService"
Cohesion: 0.14
Nodes (5): Image, Path, WD Tagger / DeepDanbooru / Ollama VLM 推論サービス。, パストラバーサル防止: セパレータ・NUL・相対参照を拒否, TaggerService
### Community 24 - "top_menu_extension.js"
Cohesion: 0.14
Nodes (27): ../../scripts/ui/components/button.js, ../../scripts/ui/components/buttonGroup.js, getNodeSetsIcon(), NODE_SETS_TOOLTIP, attachTopMenuButton(), beforeRegisterNodeDef(), captureCanvasSnapshot(), compareVersions() (+19 more)
### Community 25 - "nodes-tab.js"
Cohesion: 0.11
Nodes (40): _applyNodeSelectionToDOM(), bulkNodeAddToGroup(), bulkNodeCreateAndAddToGroup(), bulkNodeRemoveFromGroup(), bulkNodeSetFavorite(), categoryBadgeHtml(), createNodeCard(), createNodeSet() (+32 more)
### Community 26 - "setupAiHandlers"
Cohesion: 0.11
Nodes (28): _aiApplyGenOptions(), aiCallChat(), aiCallLLM(), aiCallVLM(), aiFetchModels(), aiFileToBase64(), aiLooksUntranslated(), aiSkillDeleteFile() (+20 more)
### Community 27 - "workflow-tab.js"
Cohesion: 0.13
Nodes (34): readJsonStorage(), badgeHtml(), _buildStructuredSummaryText(), _buildSummarySourceText(), clearBatch(), closeSidePanel(), deleteWorkflow(), fetchWorkflows() (+26 more)
### Community 28 - "workflow_routes.py"
Cohesion: 0.15
Nodes (26): handle_analyze(), handle_change_thumbnail(), handle_delete(), handle_import(), handle_list(), handle_metadata(), handle_raw(), handle_reanalyze_all() (+18 more)
### Community 29 - "GalleryMetadataStore"
Cohesion: 0.13
Nodes (9): GalleryMetadataStore, Path, グループ名を変更し、全画像のgroupsフィールドも更新する, gallery_metadata.json の構造: { "images": { "<abs_path>": { "favorite": bool,…, 存在しないパスをグループから一括削除する(1回の保存で完結), グループメンバーのパスをsetで返す(高速フィルタ用), グループ内の全画像を除外する(グループ自体は残す), 画像のパスキーを変更する(ファイル移動後のメタデータ引継ぎ) (+1 more)
### Community 30 - "WorkflowService"
Cohesion: 0.13
Nodes (13): Get raw workflow JSON content., Save metadata (tags, memo, summary, etc.) for a workflow., Manages workflow files and metadata., Import workflow files. Returns list of results., Rename workflow and its associated thumbnail., Delete workflow JSON and associated thumbnail., Re-analyze a workflow and save results to metadata., Re-analyze all workflows and update metadata. (+5 more)
### Community 31 - "LabPlanService"
Cohesion: 0.23
Nodes (4): LabPlanService, Path, Lab tab plan file management service (JSON plan + optional PNG index thumbnail)., Saves the contact-sheet index image into ComfyUI's own output folder, alongside…
### Community 32 - "skill_routes.py"
Cohesion: 0.14
Nodes (16): handle_delete(), handle_get_content(), handle_list(), handle_save(), Application, Request, Response, AI skill (.md system prompt) file management API routes. (+8 more)
### Community 35 - "CivitaiService"
Cohesion: 0.15
Nodes (11): CivitaiService, Build request headers, optionally including Bearer token., Calculate SHA256 hash of a file., Fetch model version info from CivitAI by SHA256 hash (GET). 429/5xx…, POST /model-versions/by-hash でハッシュリストを一括取得(最大100件/リクエスト)。 レスポンスの…, Extract relevant fields from CivitAI API response., Batch fetch CivitAI info for multiple model files. Phase 1: SHA256…, Clear cache for a specific hash or all. (+3 more)
### Community 38 - "index.html Template"
Cohesion: 0.10
Nodes (22): actions/checkout@v4, Comfy-Org/publish-node-action@main, DEVLOG.md, Publish to Comfy Registry Workflow, graphifyignore, main Branch, pyproject.toml, README.md (+14 more)
### Community 39 - "gallery_service.py"
Cohesion: 0.10
Nodes (13): Gallery Metadata Store - ギャラリー画像のメタデータ永続化, _clean_vault_tags(), _decode_image_data_url(), _FolderCache, _parse_vault_yaml_leaves(), Gallery Service - outputフォルダの画像管理、メタデータ閲覧, フォルダ単位の画像スキャン結果キャッシュ。 フォルダのmtimeが変わった場合、またはTTL超過時に再スキャンする。, data URL (data:<mime>;base64,<data>) をデコードし (バイト列, 拡張子) を返す。 ヘッダが無ければPNG扱い(旧互換)。 (+5 more)
### Community 41 - "image-prompt-tab.js"
Cohesion: 0.21
Nodes (20): activateImagePromptTab(), addSelectedToChips(), API, apiFetch(), cleanPromptText(), clearAllChips(), copyFinalPrompt(), createThumbCard() (+12 more)
### Community 42 - "KSampler Node"
Cohesion: 0.19
Nodes (20): CLIP Text Encode Negative Prompt Node, CLIP Text Encode Positive Prompt Node, Inpaint with Mask Editor One (Workflow Screenshot), Load Checkpoint Node, Mask Editor One Node, Save Image Node, VAE Encode (for Inpainting) Node, 3D Pose Editor Node (comfyui-vrm-pose-editor) (+12 more)
### Community 43 - "image-edit-tab.js"
Cohesion: 0.12
Nodes (8): comfyEditor, comfyWorkflow, GmicIntegration, MaskEditorOneBridge, MASK_TEXT_FONTS, fitToCanvas(), TOOL_DEFS, TEXT_FONTS
### Community 44 - "style-catalog-tab.js"
Cohesion: 0.22
Nodes (18): selectStyleByName(), activateStyleCatalogTab(), API, apiFetch(), copyText(), createThumbCard(), debounce(), initStyleCatalogTab() (+10 more)
### Community 45 - "add"
Cohesion: 0.22
Nodes (19): add(), fetchWorkflowRaw(), getCanvasDropPos(), handleInfoFile(), installCanvasDropHandler(), loadWorkflowOnCanvas(), placeClipTextEncodeNode(), placeLoraMgrNode() (+11 more)
### Community 46 - "comfyui-workflow.js"
Cohesion: 0.20
Nodes (13): _CONTROL_AFTER_GENERATE, _findInjectedWidgetIndex(), _flattenSubgraphs(), _getDynamicComboSubNames(), _getWidgetInputNames(), _getWidgetInputTypes(), _isExtraWidgetValue(), _isLinkedWidgetName() (+5 more)
### Community 51 - "gmic_routes.py"
Cohesion: 0.21
Nodes (14): _gmic_run_gui(), handle_open(), handle_result(), handle_status(), Application, Request, Response, G'MIC-Qt integration API routes. (+6 more)
### Community 52 - "ollama_routes.py"
Cohesion: 0.23
Nodes (14): _get_ollama_config(), handle_chat(), handle_models(), handle_test(), Application, Request, Response, Ollama API proxy routes. (+6 more)
### Community 54 - "analyze_workflow"
Cohesion: 0.20
Nodes (13): analyze_workflow(), _clip_type_from_ui_node(), _collect_all_ui_nodes(), _detect_model_type_from_name(), _model_name_from_api_node(), _model_name_from_ui_node(), Workflow analyzer - detects model types and counts input/output nodes., Analyze workflow JSON and return model types, input/output node counts. (+5 more)
### Community 56 - "lab-tab.js"
Cohesion: 0.12
Nodes (41): _applyPlanData(), _buildIndexImageDataUrl(), _buildPlanData(), _clearPlan(), COLUMN_KEYS, _defaultValueFor(), _emptyColumns(), _emptyLabState() (+33 more)
### Community 57 - ".list_images"
Cohesion: 0.17
Nodes (6): os.scandir() で画像ファイルを1回のシステムコールで列挙。 キャッシュがあればそれを返す。 Returns: [(name,…, os.walk() でフォルダ配下を再帰的に列挙する(サブフォルダの画像も含む)。 ImagePrompt/Style…, 指定フォルダ内の画像一覧を返す(recursive=Trueならサブフォルダも含める), 画像のプロンプトテキストを返す。 1. 画像と同名の .txt サイドカーがあればそれを使う 2. 無ければ ponyxlWildcardsVault 形式…, image_path の祖先を辿り、直下に thumbnails(_option2) を持つフォルダ…, ponyxlWildcardsVault形式のフォールバック解決。 thumbnails_option2 の "{leaf}.preview3.ext"…
### Community 60 - "gallery_feeder_extension.js"
Cohesion: 0.36
Nodes (11): beforeRegisterNodeDef(), fetchGroupImages(), getInputWidget(), getOrCreate(), _ns, setWidgetValue(), startLoop(), stopLoop() (+3 more)
### Community 61 - "createPanel"
Cohesion: 0.22
Nodes (13): applyTheme(), buildThemePanel(), createPanel(), fetchModelGroups(), fetchModelMetadata(), fetchPrompts(), fetchWorkflows(), injectStyles() (+5 more)
### Community 62 - "_runLabBatch"
Cohesion: 0.20
Nodes (10): _annotatedImageRef(), _applyLabLoraToWorkflow(), _buildLoraPromptInjection(), _buildWorkflowForIteration(), _fetchLabLoraMetadataCache(), _labTriggerWordsFor(), _runLabBatch(), _setRunUiState() (+2 more)
### Community 64 - "Workflow JSON"
Cohesion: 0.20
Nodes (10): EXTRA_PNGINFO, last_link_id, last_node_id, links array, Position Index, PROMPT, widgets_values, workflow_analyzer.py (+2 more)
### Community 65 - "WFS_GalleryFeeder"
Cohesion: 0.27
Nodes (4): Path, WFS_GalleryFeeder – Feeds images from a gallery group into a workflow., Gallery グループ内の画像をインデックス順に1枚ずつ出力するノード。, WFS_GalleryFeeder
### Community 66 - "initGenerateTab"
Cohesion: 0.22
Nodes (7): initGenerateTab(), _loadStyles(), _renderStyleDropdown(), updateStatus(), highlightJSON(), syncJsonHighlight(), syncScroll()
### Community 69 - "fromWorkflow"
Cohesion: 0.36
Nodes (10): _collectAllNodes(), _collectUnique(), fromWorkflow(), _extractCheckpoints(), _extractDiffusionModels(), _extractLoRAs(), _extractMarkdownNoteModels(), addU() (+2 more)
### Community 70 - "_extractPromptsAPI"
Cohesion: 0.33
Nodes (10): _extractPrompts(), _extractPromptsAPI(), _extractPromptsFromNodeSet(), _extractPromptsLiteGraph(), _isPromptStylerNode(), _isSamplerNode(), _isTextEncoderNode(), _resolveEditPlusText() (+2 more)
### Community 71 - "generate_doc_index.py"
Cohesion: 0.53
Nodes (5): generate_devlog_index(), generate_readme_index(), main(), Path, Regenerate README.index.md / DEVLOG.index.md from README.md / DEVLOG.md.…
### Community 72 - "WS Inpaint Basic Workflow"
Cohesion: 0.53
Nodes (9): CLIP Text Encode (Prompt) - negative conditioning, CLIP Text Encode (Prompt) - positive conditioning, KSampler node (ddim sampler, 30 steps, cfg 4.0, denoise 1.00), Load Checkpoint node (hayochamixIDXL_v11+_bl checkpoint), Load Image node (clipspace painted mask input), Save Image node (ComfyUI filename prefix), VAE Decode node, VAE Encode (for Inpainting) node with grow_mask_by (+1 more)
### Community 73 - "._bg_index_folder"
Cohesion: 0.25
Nodes (5): Event, バックグラウンドスレッドで未キャッシュ画像のprompt_cacheを構築する。 10枚処理するたびに50msスリープしてメインスレッドへの影響を最小化。, PNG/JPEGからメタデータを抽出し、保存済みメタと合わせて返す, PNGのtEXtチャンクからメタデータを抽出, JPEGのEXIF/commentからメタデータを抽出(簡易)
### Community 74 - "aiohttp"
Cohesion: 0.16
Nodes (14): aiohttp, py/routes, _get_api_key(), handle_proxy(), _is_allowed_base_url(), Application, Request, Response (+6 more)
### Community 75 - "import_style_prompt_seed.py"
Cohesion: 0.36
Nodes (8): clean_tags(), import_category(), main(), parse_yaml_leaves(), Path, Style/Prompt ギャラリー用シードデータ投入スクリプト。 comfyui_prompt_gallery / prompt_builder_proto…, comfyui_prompt_gallery の parseYamlForImages と同じ簡易パーサ(PyYAML不要)。 「key:」行の直後が「-…, 1カテゴリ分を投入する。戻り値: (copied, images_without_prompt, leaves_total)
### Community 76 - "Image Edit (FireRed Image Edit 1.1) node"
Cohesion: 0.32
Nodes (8): 3D Pose Editor node, FireRed-Image-Edit-1.1_fp8mixed_comfy.safetensors, FireRed-Image-Edit-1.0-Lightning-8steps-v1.0.safetensors (LoRA), Image Edit (FireRed Image Edit 1.1) node, qwen_2.5_vl_7b_fp8_scaled.safetensors (CLIP), qwen_image_vae.safetensors (VAE), Save Image node, 3D Pose Editor to Image Edit (Fire Red) Workflow
### Community 77 - "Version 0.3.9"
Cohesion: 0.18
Nodes (11): AI TOOL Tab, Models Tab, Nodes Tab, Prompt Tab, Version 0.1.2, Version 0.1.7, Version 0.2.3, Version 0.3.14 (+3 more)
### Community 78 - "DWPose Image Feeder Workflow"
Cohesion: 0.52
Nodes (7): DWPose Image Feeder Workflow, Apply ControlNet Node, DWPose Estimator Node (comfyui-controlnet-aux), Image Feeder Node (comfyui-image-feeder), KSampler Node, Load Checkpoint Node (animagineXLRealistic_v6), Load ControlNet Model Node (OpenPoseXL2)
### Community 79 - "wfm.py"
Cohesion: 0.21
Nodes (12): Jinja2, Request, Response, Serve the main SPA page., Serve files from the current workflows directory (dynamic path)., Serve files (index thumbnails) from the Lab plan directory., Main entry point for Workflow Studio plugin., Register all routes with ComfyUI's server. (+4 more)
### Community 80 - "README.index.md"
Cohesion: 0.40
Nodes (6): on_doc_edit.py, DEVLOG.index.md, generate_doc_index.py, pre-commit, graphify, README.index.md
### Community 81 - "WFS_PromptText"
Cohesion: 0.33
Nodes (3): WFS_PromptText – Prompt preset node with positive/negative STRING outputs., Outputs positive and negative prompt strings., WFS_PromptText
### Community 82 - "workflow_service.py"
Cohesion: 0.40
Nodes (4): extract_png_workflow(), Extract ComfyUI workflow JSON from PNG metadata., Extract ComfyUI workflow JSON from PNG byte data. Returns dict or None., Workflow CRUD and metadata management service.
### Community 83 - "SPA"
Cohesion: 0.40
Nodes (5): ComfyUI, SPA, static, templates, web/comfyui
### Community 84 - "prompt-ai-chat.js"
Cohesion: 0.34
Nodes (14): addChatMessage(), applyToGenerateUI(), attachFile(), chatWithAi(), clearChat(), fetchAiModels(), getPromptAiConfig(), initAiChatUI() (+6 more)
### Community 85 - "Tagger Tab requirements.txt"
Cohesion: 0.40
Nodes (5): Tagger Tab requirements.txt, onnxruntime (WD Tagger / SwinV2), piexif (JPEG EXIF tag writing), python-dotenv (Unsloth .env loading), tensorflow (optional, DeepDanbooru)
### Community 86 - "data directory"
Cohesion: 0.50
Nodes (4): data directory, metadata.json, node_metadata.json, settings.json
### Community 87 - "t"
Cohesion: 0.25
Nodes (20): showToast(), _applyDefaultCheckpointIfEnabled(), loadWorkflowIntoEditor(), saveCurrentWorkflow(), t(), _initPlanDropZone(), _loadPlanFromFile(), _loadPlanFromIndexImage() (+12 more)
### Community 88 - "Chinese Language Support"
Cohesion: 1.00
Nodes (3): Chinese Language Support, English Language Support, Japanese Language Support
### Community 89 - "Version 0.3.95"
Cohesion: 0.67
Nodes (3): ImagePrompt Gallery Subtab, Style_Catalog Subtab, Version 0.3.95
### Community 90 - "Windows"
Cohesion: 0.67
Nodes (3): LongPathsEnabled, MAX_PATH, Windows
### Community 98 - "lab_routes.py"
Cohesion: 0.42
Nodes (10): handle_delete(), handle_get_content(), handle_list(), handle_save(), handle_save_index_to_output(), Application, Request, Response (+2 more)
### Community 153 - "prompts_routes.py"
Cohesion: 0.25
Nodes (13): handle_create(), handle_delete(), handle_list(), handle_update(), Application, Request, Response, Prompt presets API routes. (+5 more)
### Community 157 - "SettingsService"
Cohesion: 0.28
Nodes (4): Return CivitAI API key. Env var CIVITAI_API_KEY takes priority over…, Merge updates into existing settings., Manages application settings (data/settings.json)., SettingsService
### Community 174 - "app.js"
Cohesion: 0.22
Nodes (8): applyI18nToHtml(), initModal(), _onHelpSearch(), initI18n(), applyJsonColors(), applyModelTabActiveColor(), applyTextareaFontSize(), getSettings()
### Community 176 - "util.js"
Cohesion: 0.43
Nodes (7): AI_BACKEND_DEFAULT_URLS, _bytesToDataUrl(), _dataUrlToBytes(), embedPngTextChunk(), _joinBytes(), _n2b(), _pngCrc32()
### Community 177 - "civitai_service.py"
Cohesion: 0.33
Nodes (5): _get_ssl_context(), _make_ssl_context(), CivitAI API integration service., Return an SSL context with CA verification. 1. certifi CA bundle (available in…, Download an image from URL and save to save_path. Returns True on success.
### Community 178 - "config.py"
Cohesion: 0.22
Nodes (5): Resolve workflows dir from settings, falling back to default., _resolve_workflows_dir(), Node metadata and node sets management service., Prompt presets management service., Settings management service.
### Community 179 - "createModelItem"
Cohesion: 0.57
Nodes (7): createModelItem(), fetchModelList(), matchesModelSearch(), renderModelAll(), renderModelByType(), renderModelFavorites(), renderModelGroups()
### Community 180 - "_renderBatchPreview"
Cohesion: 0.20
Nodes (18): _buildSimpleGroupList(), _getGroupSelCount(), _getGroupSelCountFrom(), initBatchTab(), _loadBatchCheckpointGroups(), _loadBatchLoraGroups(), _loadPromptGroupsForBatch(), _loadWorkflowGroupsForBatch() (+10 more)
## Knowledge Gaps
- **216 isolated node(s):** `comfyui-workflow-studio`, `LANG_NAMES`, `VLM_PROMPTS`, `IMAGE_GEN_TOOLS`, `skillFiles` (+211 more)
These have ≤1 connection - possible missing edges or undocumented components.
- **94 thin communities (<3 nodes) omitted from report** — run `graphify query` to explore isolated nodes.
## Suggested Questions
_Questions this graph is uniquely positioned to answer:_
- **Why does `showToast()` connect `t` to `escapeHtml`, `prompt-table.js`, `generate-tab.js`, `_openCellModal`, `gallery-tab.js`, `ImageEditTab`, `ai-tab.js`, `feeder-tab.js`, `settings-tab.js`, `tagger-tab.js`, `comfyui-editor.js`, `nodes-tab.js`, `workflow-tab.js`, `FileExport`, `image-prompt-tab.js`, `image-edit-tab.js`, `style-catalog-tab.js`, `app.js`, `BlurTool`, `lab-tab.js`, `_runLabBatch`, `BgRemove`, `initGenerateTab`, `InpaintI2IActions`, `Sam3Segmentation`, `prompt-ai-chat.js`?**
_High betweenness centrality (0.071) - this node is a cross-community bridge._
- **Why does `t()` connect `t` to `escapeHtml`, `prompt-table.js`, `generate-tab.js`, `_openCellModal`, `gallery-tab.js`, `ai-tab.js`, `feeder-tab.js`, `metadata-tab.js`, `settings-tab.js`, `tagger-tab.js`, `comfyui-editor.js`, `nodes-tab.js`, `workflow-tab.js`, `image-prompt-tab.js`, `style-catalog-tab.js`, `app.js`, `lab-tab.js`, `_runLabBatch`, `initGenerateTab`, `prompt-ai-chat.js`?**
_High betweenness centrality (0.058) - this node is a cross-community bridge._
- **Why does `ImageEditTab` connect `ImageEditTab` to `image-edit-tab.js`, `app.js`?**
_High betweenness centrality (0.028) - this node is a cross-community bridge._
- **What connects `comfyui-workflow-studio`, `LANG_NAMES`, `VLM_PROMPTS` to the rest of the system?**
_216 weakly-connected nodes found - possible documentation gaps or missing edges._
- **Should `escapeHtml` be split into smaller, more focused modules?**
_Cohesion score 0.09288389513108614 - nodes in this community are weakly interconnected._
- **Should `prompt-table.js` be split into smaller, more focused modules?**
_Cohesion score 0.06366691560866318 - nodes in this community are weakly interconnected._
- **Should `models_routes.py` be split into smaller, more focused modules?**
_Cohesion score 0.0554954954954955 - nodes in this community are weakly interconnected._
File diff suppressed because one or more lines are too long
File diff suppressed because it is too large Load Diff
-890
View File
@@ -1,890 +0,0 @@
{
"CLAUDE.md": {
"mtime": 1787279658.5963283,
"seen": 1787380810.3754587,
"ast_hash": "b2c014309df240903aa90a26914c8c19",
"semantic_hash": "b2c014309df240903aa90a26914c8c19"
},
".claude/settings.json": {
"mtime": 1787279595.344592,
"seen": 1787380810.2925637,
"ast_hash": "cd2c4308b55c5d1aa1b647cdec814b79",
"semantic_hash": "cd2c4308b55c5d1aa1b647cdec814b79"
},
"__init__.py": {
"mtime": 1781939762.254596,
"seen": 1787279199.0011544,
"ast_hash": "72d9ef06026dff7be74da81ff98a306a",
"semantic_hash": "72d9ef06026dff7be74da81ff98a306a"
},
"prestartup_script.py": {
"mtime": 1787036267.332648,
"seen": 1787279199.0011563,
"ast_hash": "7b5d482ef21a480d1b38356e8d82970b",
"semantic_hash": "7b5d482ef21a480d1b38356e8d82970b"
},
"py/__init__.py": {
"mtime": 1773797715.629029,
"seen": 1787279199.0011575,
"ast_hash": "d41d8cd98f00b204e9800998ecf8427e",
"semantic_hash": "d41d8cd98f00b204e9800998ecf8427e"
},
"py/config.py": {
"mtime": 1786245317.3352194,
"seen": 1787279199.001159,
"ast_hash": "b013c27bb7cd9a79449961539fdcd30f",
"semantic_hash": "b013c27bb7cd9a79449961539fdcd30f"
},
"py/nodes/__init__.py": {
"mtime": 1774423045.6646452,
"seen": 1787279199.00116,
"ast_hash": "d41d8cd98f00b204e9800998ecf8427e",
"semantic_hash": "d41d8cd98f00b204e9800998ecf8427e"
},
"py/nodes/gallery_feeder_node.py": {
"mtime": 1781943269.5205867,
"seen": 1787279199.0011609,
"ast_hash": "d37c520b0f76e70e60ec7c72db904bf4",
"semantic_hash": "d37c520b0f76e70e60ec7c72db904bf4"
},
"py/nodes/prompt_text.py": {
"mtime": 1774423045.6669831,
"seen": 1787279199.0011618,
"ast_hash": "43cf16f182b9eda5fade2b52c2439372",
"semantic_hash": "43cf16f182b9eda5fade2b52c2439372"
},
"py/routes/__init__.py": {
"mtime": 1773797716.663036,
"seen": 1787279199.0011628,
"ast_hash": "d41d8cd98f00b204e9800998ecf8427e",
"semantic_hash": "d41d8cd98f00b204e9800998ecf8427e"
},
"py/routes/eagle_routes.py": {
"mtime": 1785464911.9023821,
"seen": 1787279199.0011635,
"ast_hash": "edd32039935a892317c55b434c9839ab",
"semantic_hash": "edd32039935a892317c55b434c9839ab"
},
"py/routes/gallery_routes.py": {
"mtime": 1786682156.6899943,
"seen": 1787279199.001165,
"ast_hash": "59e4c5d34ee2329ab9e0a66f841d1676",
"semantic_hash": "59e4c5d34ee2329ab9e0a66f841d1676"
},
"py/routes/gmic_routes.py": {
"mtime": 1782544784.03979,
"seen": 1787279199.0011659,
"ast_hash": "b909c65af6590c0ca058136cb0b9234e",
"semantic_hash": "b909c65af6590c0ca058136cb0b9234e"
},
"py/routes/lab_routes.py": {
"mtime": 1786322410.571655,
"seen": 1787279199.0011666,
"ast_hash": "48e94f71b11f2e494bb98bb7113e2baa",
"semantic_hash": "48e94f71b11f2e494bb98bb7113e2baa"
},
"py/routes/models_routes.py": {
"mtime": 1782289767.1073005,
"seen": 1787279199.0011675,
"ast_hash": "067aa9c89085fa3e077fdfacbb6be2cd",
"semantic_hash": "067aa9c89085fa3e077fdfacbb6be2cd"
},
"py/routes/nodes_routes.py": {
"mtime": 1774255599.0841086,
"seen": 1787279199.0011685,
"ast_hash": "dc5f7b12dce346631ff945c31bf03ac9",
"semantic_hash": "dc5f7b12dce346631ff945c31bf03ac9"
},
"py/routes/ollama_routes.py": {
"mtime": 1784126582.1613884,
"seen": 1787279199.0011694,
"ast_hash": "80552c0676f7bbd4209eb95cf7a03f5b",
"semantic_hash": "80552c0676f7bbd4209eb95cf7a03f5b"
},
"py/routes/prompts_routes.py": {
"mtime": 1774423045.6696556,
"seen": 1787279199.0011702,
"ast_hash": "53b5641f3ad6f65e8ae665601c4739d7",
"semantic_hash": "53b5641f3ad6f65e8ae665601c4739d7"
},
"py/routes/settings_routes.py": {
"mtime": 1786681377.025748,
"seen": 1787279199.001171,
"ast_hash": "bb2f332c04474ee39319c2d0b8107db9",
"semantic_hash": "bb2f332c04474ee39319c2d0b8107db9"
},
"py/routes/skill_routes.py": {
"mtime": 1785634791.033795,
"seen": 1787279199.0011723,
"ast_hash": "3318c506163c720c5412ec0f8ff3a28a",
"semantic_hash": "3318c506163c720c5412ec0f8ff3a28a"
},
"py/routes/tagger_routes.py": {
"mtime": 1781503496.8879485,
"seen": 1787279199.001173,
"ast_hash": "9c0559b594a69354882da0b1643e11f0",
"semantic_hash": "9c0559b594a69354882da0b1643e11f0"
},
"py/routes/unsloth_routes.py": {
"mtime": 1787036726.267709,
"seen": 1787279199.001174,
"ast_hash": "93d4de97937f472f9618a35a0b4211d6",
"semantic_hash": "93d4de97937f472f9618a35a0b4211d6"
},
"py/routes/wildcard_routes.py": {
"mtime": 1777370036.4121041,
"seen": 1787279199.0011756,
"ast_hash": "1d0ea981a44ffab77d62c214951f4536",
"semantic_hash": "1d0ea981a44ffab77d62c214951f4536"
},
"py/routes/workflow_routes.py": {
"mtime": 1773896239.095392,
"seen": 1787279199.0011766,
"ast_hash": "e64f3e7b5d0dfe3543ffbfeb137aacb3",
"semantic_hash": "e64f3e7b5d0dfe3543ffbfeb137aacb3"
},
"py/services/__init__.py": {
"mtime": 1773797717.739297,
"seen": 1787279199.0011773,
"ast_hash": "d41d8cd98f00b204e9800998ecf8427e",
"semantic_hash": "d41d8cd98f00b204e9800998ecf8427e"
},
"py/services/civitai_service.py": {
"mtime": 1780233122.7587051,
"seen": 1787279199.001178,
"ast_hash": "3b4a2a118bc56dd27e768a2819b401e7",
"semantic_hash": "3b4a2a118bc56dd27e768a2819b401e7"
},
"py/services/gallery_metadata.py": {
"mtime": 1786170828.9941547,
"seen": 1787279199.0011792,
"ast_hash": "9d02a71d56b7ca2a88cdf8c56fadf912",
"semantic_hash": "9d02a71d56b7ca2a88cdf8c56fadf912"
},
"py/services/gallery_service.py": {
"mtime": 1786638406.9058151,
"seen": 1787279199.0011802,
"ast_hash": "c8b9858f015f7f4a934c4b630e905107",
"semantic_hash": "c8b9858f015f7f4a934c4b630e905107"
},
"py/services/lab_plan_service.py": {
"mtime": 1786322396.0192728,
"seen": 1787279199.001181,
"ast_hash": "5d2c928c077ad7b788f15419b39ef51f",
"semantic_hash": "5d2c928c077ad7b788f15419b39ef51f"
},
"py/services/models_service.py": {
"mtime": 1782393318.5989842,
"seen": 1787279199.0011816,
"ast_hash": "0885cc6852199fa45271192ea0d6713a",
"semantic_hash": "0885cc6852199fa45271192ea0d6713a"
},
"py/services/nodes_service.py": {
"mtime": 1774255599.0862236,
"seen": 1787279199.0011828,
"ast_hash": "8819590ffdc136fb2912d9c5696e26e0",
"semantic_hash": "8819590ffdc136fb2912d9c5696e26e0"
},
"py/services/png_extractor.py": {
"mtime": 1773797967.5810304,
"seen": 1787279199.0011837,
"ast_hash": "1282b6032d78cba2a4bbbfb876126bc1",
"semantic_hash": "1282b6032d78cba2a4bbbfb876126bc1"
},
"py/services/prompts_service.py": {
"mtime": 1774423045.6711988,
"seen": 1787279199.0011845,
"ast_hash": "79a98e220d2b556106e8530054547155",
"semantic_hash": "79a98e220d2b556106e8530054547155"
},
"py/services/settings_service.py": {
"mtime": 1773798498.9270506,
"seen": 1787279199.0011854,
"ast_hash": "dade5ea667a2c6408434ad3061c76db7",
"semantic_hash": "dade5ea667a2c6408434ad3061c76db7"
},
"py/services/skill_service.py": {
"mtime": 1785637306.8654232,
"seen": 1787279199.0011866,
"ast_hash": "5ebe579995c1c674e4219e58b3bd5855",
"semantic_hash": "5ebe579995c1c674e4219e58b3bd5855"
},
"py/services/tagger_db_service.py": {
"mtime": 1781503496.8949444,
"seen": 1787279199.0011873,
"ast_hash": "de0ca007db5159484e8ff3b8a36a3b84",
"semantic_hash": "de0ca007db5159484e8ff3b8a36a3b84"
},
"py/services/tagger_service.py": {
"mtime": 1781503496.8969479,
"seen": 1787279199.0011883,
"ast_hash": "7bfde3ebe93f6fa0062a6aecba3f10d9",
"semantic_hash": "7bfde3ebe93f6fa0062a6aecba3f10d9"
},
"py/services/wildcard_service.py": {
"mtime": 1777380000.0054882,
"seen": 1787279199.0011892,
"ast_hash": "5814ed3cf2e31bf8b4abaa15c697b0cd",
"semantic_hash": "5814ed3cf2e31bf8b4abaa15c697b0cd"
},
"py/services/workflow_analyzer.py": {
"mtime": 1785474766.4736228,
"seen": 1787279199.00119,
"ast_hash": "937d6b02a6235795cb22ceb39e81f719",
"semantic_hash": "937d6b02a6235795cb22ceb39e81f719"
},
"py/services/workflow_service.py": {
"mtime": 1775439760.4805496,
"seen": 1787279199.0011911,
"ast_hash": "a2e47c0b8780ec7ca292310b16733a8c",
"semantic_hash": "a2e47c0b8780ec7ca292310b16733a8c"
},
"py/wfm.py": {
"mtime": 1787036294.0749958,
"seen": 1787279199.0011919,
"ast_hash": "cb1c96536f67edb380d1010b6165d74d",
"semantic_hash": "cb1c96536f67edb380d1010b6165d74d"
},
"pyproject.toml": {
"mtime": 1787378263.2900941,
"seen": 1787380810.3265483,
"ast_hash": "f514fae02a3b48726f5073e932cfa1b3",
"semantic_hash": "f514fae02a3b48726f5073e932cfa1b3"
},
"static/js/ai-tab.js": {
"mtime": 1787293482.4888227,
"seen": 1787380810.3265514,
"ast_hash": "960b474155386a36000e6961b0b2e0c3",
"semantic_hash": "960b474155386a36000e6961b0b2e0c3"
},
"static/js/app.js": {
"mtime": 1787377516.2436306,
"seen": 1787380810.3265538,
"ast_hash": "7df994a3e8f6c34d27a1ccd88b207a5c",
"semantic_hash": "7df994a3e8f6c34d27a1ccd88b207a5c"
},
"static/js/comfyui-client.js": {
"mtime": 1786676208.2330563,
"seen": 1787279199.0011961,
"ast_hash": "bb546a6ae7bd35d1c16fee311681be73",
"semantic_hash": "bb546a6ae7bd35d1c16fee311681be73"
},
"static/js/comfyui-editor.js": {
"mtime": 1787293462.7015421,
"seen": 1787380810.3274822,
"ast_hash": "fe27626a41d18f02bdea2b89aaaf740b",
"semantic_hash": "fe27626a41d18f02bdea2b89aaaf740b"
},
"static/js/comfyui-workflow.js": {
"mtime": 1787293410.2500806,
"seen": 1787380810.3274848,
"ast_hash": "255cfe0c2172639ed698a5e9397d7144",
"semantic_hash": "255cfe0c2172639ed698a5e9397d7144"
},
"static/js/feeder-tab.js": {
"mtime": 1781939989.0796032,
"seen": 1787279199.0011988,
"ast_hash": "dcd5977c5fe691b87e2379cd0e018a12",
"semantic_hash": "dcd5977c5fe691b87e2379cd0e018a12"
},
"static/js/gallery-tab.js": {
"mtime": 1787368748.1550386,
"seen": 1787380810.328425,
"ast_hash": "0144bbe48e21eccc498714404e29e29e",
"semantic_hash": "0144bbe48e21eccc498714404e29e29e"
},
"static/js/generate-tab.js": {
"mtime": 1787401222.9019487,
"seen": 1787401432.6967273,
"ast_hash": "dbfc96b6400bd780990725e390f275c9",
"semantic_hash": ""
},
"static/js/i18n.js": {
"mtime": 1787377822.448605,
"seen": 1787380810.32843,
"ast_hash": "d925b681cc485326659fbc24f5a87dda",
"semantic_hash": "d925b681cc485326659fbc24f5a87dda"
},
"static/js/image-edit-tab.js": {
"mtime": 1787199901.562169,
"seen": 1787279199.001202,
"ast_hash": "be7b15d85bb185e2fd3492f4d5657f21",
"semantic_hash": "be7b15d85bb185e2fd3492f4d5657f21"
},
"static/js/image-edit/BgRemove.js": {
"mtime": 1787126632.8601232,
"seen": 1787279199.0012033,
"ast_hash": "add6a58068bdadc0c7641202f36ddb27",
"semantic_hash": "add6a58068bdadc0c7641202f36ddb27"
},
"static/js/image-edit/BlurTool.js": {
"mtime": 1787126263.0542421,
"seen": 1787279199.0012043,
"ast_hash": "1e52bc3757110a271ec17d923784a91b",
"semantic_hash": "1e52bc3757110a271ec17d923784a91b"
},
"static/js/image-edit/DrawTool.js": {
"mtime": 1782717315.6436062,
"seen": 1787279199.001205,
"ast_hash": "a97a6a97ae28c804a7c5fa50448a2c87",
"semantic_hash": "a97a6a97ae28c804a7c5fa50448a2c87"
},
"static/js/image-edit/FileExport.js": {
"mtime": 1787192008.741717,
"seen": 1787279199.0012057,
"ast_hash": "cf645b775e537ad276c9e070c7849349",
"semantic_hash": "cf645b775e537ad276c9e070c7849349"
},
"static/js/image-edit/GmicIntegration.js": {
"mtime": 1787125777.3889306,
"seen": 1787279199.0012069,
"ast_hash": "023d9d19e57d8fa6ebedc3c489ecf7ca",
"semantic_hash": "023d9d19e57d8fa6ebedc3c489ecf7ca"
},
"static/js/image-edit/InpaintI2IActions.js": {
"mtime": 1787127273.4351766,
"seen": 1787279199.0012076,
"ast_hash": "9ea57922985b63d4ec8eb44219a8341b",
"semantic_hash": "9ea57922985b63d4ec8eb44219a8341b"
},
"static/js/image-edit/LayerManager.js": {
"mtime": 1782717943.772222,
"seen": 1787279199.0012085,
"ast_hash": "596cd1906208fe72e1c2953d4d7f7135",
"semantic_hash": "596cd1906208fe72e1c2953d4d7f7135"
},
"static/js/image-edit/MaskEditorOneBridge.js": {
"mtime": 1787199887.897264,
"seen": 1787279199.0012095,
"ast_hash": "db2ef8c024c7e72baa0dfdb79b8abd4d",
"semantic_hash": "db2ef8c024c7e72baa0dfdb79b8abd4d"
},
"static/js/image-edit/MaskEditorOneTools.js": {
"mtime": 1782719665.7021136,
"seen": 1787279199.0012105,
"ast_hash": "b6b16c43ce528f7c9921eab0f4eda335",
"semantic_hash": "b6b16c43ce528f7c9921eab0f4eda335"
},
"static/js/image-edit/MaskTool.js": {
"mtime": 1782699721.4711535,
"seen": 1787279199.0012114,
"ast_hash": "116469f33829c5b2e6270f4b278b2b9c",
"semantic_hash": "116469f33829c5b2e6270f4b278b2b9c"
},
"static/js/image-edit/Sam3Segmentation.js": {
"mtime": 1787126893.774897,
"seen": 1787279199.0012121,
"ast_hash": "98c3a330ae7ea3369c00168c54c66d53",
"semantic_hash": "98c3a330ae7ea3369c00168c54c66d53"
},
"static/js/image-edit/SelectTool.js": {
"mtime": 1782368193.2572634,
"seen": 1787279199.0012128,
"ast_hash": "cb8db6bd5ee742b15f3beee4a5173377",
"semantic_hash": "cb8db6bd5ee742b15f3beee4a5173377"
},
"static/js/image-edit/ShapeTool.js": {
"mtime": 1782375200.0253434,
"seen": 1787279199.001214,
"ast_hash": "36d00bf6b80ebea13314d2853528c44f",
"semantic_hash": "36d00bf6b80ebea13314d2853528c44f"
},
"static/js/image-edit/TextTool.js": {
"mtime": 1782368193.2592669,
"seen": 1787279199.0012147,
"ast_hash": "88f9e60251c2f78957e42c33ed5196f8",
"semantic_hash": "88f9e60251c2f78957e42c33ed5196f8"
},
"static/js/image-prompt-tab.js": {
"mtime": 1786638406.9362252,
"seen": 1787279199.0012157,
"ast_hash": "cf39285a30e3f8b79f6f51dfe13f86b5",
"semantic_hash": "cf39285a30e3f8b79f6f51dfe13f86b5"
},
"static/js/json-highlight.js": {
"mtime": 1773834925.1977189,
"seen": 1787279199.0012164,
"ast_hash": "e83e7a7a507d160b9cd503235a79135c",
"semantic_hash": "e83e7a7a507d160b9cd503235a79135c"
},
"static/js/lab-tab.js": {
"mtime": 1787310963.3056493,
"seen": 1787380810.343902,
"ast_hash": "11a5776c4163e2a97ef490e85de7db63",
"semantic_hash": "11a5776c4163e2a97ef490e85de7db63"
},
"static/js/metadata-tab.js": {
"mtime": 1787377525.9536967,
"seen": 1787380810.3439052,
"ast_hash": "5ac004dd3708aa4dc8890256232fd99e",
"semantic_hash": "5ac004dd3708aa4dc8890256232fd99e"
},
"static/js/models-tab.js": {
"mtime": 1787145102.2314196,
"seen": 1787279199.001219,
"ast_hash": "dcee8a68713cd300d0862b1c376d442f",
"semantic_hash": "dcee8a68713cd300d0862b1c376d442f"
},
"static/js/models/badges.js": {
"mtime": 1787143926.3653927,
"seen": 1787279199.00122,
"ast_hash": "0c1901a90a12f1b23df416d9eef11e1d",
"semantic_hash": "0c1901a90a12f1b23df416d9eef11e1d"
},
"static/js/models/detail-panel.js": {
"mtime": 1787144898.6748104,
"seen": 1787279199.0012212,
"ast_hash": "9907a4af0524b35d80e3b9fc7925324e",
"semantic_hash": "9907a4af0524b35d80e3b9fc7925324e"
},
"static/js/models/filters.js": {
"mtime": 1787144201.7602522,
"seen": 1787279199.001222,
"ast_hash": "afd754f68d01f64c51995929b3841e56",
"semantic_hash": "afd754f68d01f64c51995929b3841e56"
},
"static/js/models/grid-view.js": {
"mtime": 1787144745.5522888,
"seen": 1787279199.0012226,
"ast_hash": "492e91fff2b8743a5243f85a736eb689",
"semantic_hash": "492e91fff2b8743a5243f85a736eb689"
},
"static/js/models/helpers.js": {
"mtime": 1787144193.741004,
"seen": 1787279199.0012236,
"ast_hash": "1c7b796f2507f55403fa5d11f304580a",
"semantic_hash": "1c7b796f2507f55403fa5d11f304580a"
},
"static/js/models/selection-bulk.js": {
"mtime": 1787144787.0092065,
"seen": 1787279199.0012245,
"ast_hash": "d445ff4dc4e9810afea73ff53c76b05b",
"semantic_hash": "d445ff4dc4e9810afea73ff53c76b05b"
},
"static/js/models/state.js": {
"mtime": 1787143674.705312,
"seen": 1787279199.0012252,
"ast_hash": "172ced5fdc4c96095f2760d7ef12d77d",
"semantic_hash": "172ced5fdc4c96095f2760d7ef12d77d"
},
"static/js/nodes-tab.js": {
"mtime": 1782619197.3828287,
"seen": 1787279199.0012262,
"ast_hash": "3467d4682a8c20a2b209b5db224ce6e2",
"semantic_hash": "3467d4682a8c20a2b209b5db224ce6e2"
},
"static/js/prompt-tab.js": {
"mtime": 1787399045.1690862,
"seen": 1787399276.0028682,
"ast_hash": "184961647ceccdf98c8c031c4da96889",
"semantic_hash": ""
},
"static/js/settings-tab.js": {
"mtime": 1787227602.6323576,
"seen": 1787279199.001228,
"ast_hash": "85b55cac9901afc9e94e32f0aa220d2b",
"semantic_hash": "85b55cac9901afc9e94e32f0aa220d2b"
},
"static/js/style-catalog-tab.js": {
"mtime": 1786678976.6511285,
"seen": 1787279199.001229,
"ast_hash": "a2956544bf800ac34f8084b8acd0714b",
"semantic_hash": "a2956544bf800ac34f8084b8acd0714b"
},
"static/js/tagger-tab.js": {
"mtime": 1781503496.933307,
"seen": 1787279199.0012298,
"ast_hash": "5e1c858a13e95148eeac1d5b5be5e4f3",
"semantic_hash": "5e1c858a13e95148eeac1d5b5be5e4f3"
},
"static/js/util.js": {
"mtime": 1787036300.7369778,
"seen": 1787279199.001231,
"ast_hash": "29774ed440f2b60a708c70db1b3ae208",
"semantic_hash": "29774ed440f2b60a708c70db1b3ae208"
},
"static/js/workflow-tab.js": {
"mtime": 1785474064.011484,
"seen": 1787279199.001232,
"ast_hash": "65caea21e8e02d81f2e85c75c7231dca",
"semantic_hash": "65caea21e8e02d81f2e85c75c7231dca"
},
"tools/import_style_prompt_seed.py": {
"mtime": 1786616195.405381,
"seen": 1787279199.0012326,
"ast_hash": "02997888c17a6061b7910cddfdd4d89a",
"semantic_hash": "02997888c17a6061b7910cddfdd4d89a"
},
"web/comfyui/gallery_feeder_extension.js": {
"mtime": 1781943835.232655,
"seen": 1787279199.0012345,
"ast_hash": "0048b031e64a433e29a5f7112e82012d",
"semantic_hash": "0048b031e64a433e29a5f7112e82012d"
},
"web/comfyui/node_sets_menu.js": {
"mtime": 1787199930.9575465,
"seen": 1787279199.0012355,
"ast_hash": "a9d7ad5d194ac2f4b125978a7b048042",
"semantic_hash": "a9d7ad5d194ac2f4b125978a7b048042"
},
"web/comfyui/top_menu_extension.js": {
"mtime": 1782696309.9055538,
"seen": 1787279199.0012362,
"ast_hash": "2c74498722b46d42bcc15f61ec35dfc4",
"semantic_hash": "2c74498722b46d42bcc15f61ec35dfc4"
},
"workflows/ws_2d_pose_editor_to_Image_Edit( FireRed ).json": {
"mtime": 1779256606.5720088,
"seen": 1787279199.0012372,
"ast_hash": "52801ad2b42eca5e3a5f8fc51332d2c3",
"semantic_hash": "52801ad2b42eca5e3a5f8fc51332d2c3"
},
"workflows/ws_3d_pose_editor_to_Image_Edit( Fire Red).json": {
"mtime": 1779257129.3572881,
"seen": 1787279199.001238,
"ast_hash": "8260ca467693c21c497f98113abf37f9",
"semantic_hash": "8260ca467693c21c497f98113abf37f9"
},
"workflows/ws_3d_pose_editor_to_Image_Edit( Flux2 Klein ).json": {
"mtime": 1779257864.2496417,
"seen": 1787279199.001239,
"ast_hash": "7eba746ab9fdca0aefabdc7c7c7bd13e",
"semantic_hash": "7eba746ab9fdca0aefabdc7c7c7bd13e"
},
"workflows/ws_dwpose_image_feeder.json": {
"mtime": 1779255324.1402953,
"seen": 1787279199.0012398,
"ast_hash": "282ce14b11b8b88ddc91e1d318756c0d",
"semantic_hash": "282ce14b11b8b88ddc91e1d318756c0d"
},
"workflows/ws_inpaint_basic.json": {
"mtime": 1784801838.7836998,
"seen": 1787279199.0012407,
"ast_hash": "43e83496dec4856ab9d97c8b950148ec",
"semantic_hash": "43e83496dec4856ab9d97c8b950148ec"
},
"workflows/ws_inpaint_mask_editor_one.json": {
"mtime": 1784801946.0336668,
"seen": 1787279199.001242,
"ast_hash": "ac0a865c1dacd2b30c489f08f8b4df4d",
"semantic_hash": "ac0a865c1dacd2b30c489f08f8b4df4d"
},
"workflows/ws_sd15_t2i_basic.json": {
"mtime": 1779253098.1947012,
"seen": 1787279199.0012426,
"ast_hash": "cb1b5f84ac1b37af8715bf2ab0b38a51",
"semantic_hash": "cb1b5f84ac1b37af8715bf2ab0b38a51"
},
"workflows/ws_sdxl_2d_pose_editor_i2i.json": {
"mtime": 1779256158.4671156,
"seen": 1787279199.0012436,
"ast_hash": "cfe237775d6fb844ac726639e3ae928b",
"semantic_hash": "cfe237775d6fb844ac726639e3ae928b"
},
"workflows/ws_sdxl_3d pose editor_dwpose.json": {
"mtime": 1779255768.6302803,
"seen": 1787279199.0012448,
"ast_hash": "0e1955da91149ba6280d39db7a54db6f",
"semantic_hash": "0e1955da91149ba6280d39db7a54db6f"
},
"workflows/ws_sdxl_dwpose.json": {
"mtime": 1779255037.8698418,
"seen": 1787279199.0012455,
"ast_hash": "d670222d71df92e262ce8cb7299fd531",
"semantic_hash": "d670222d71df92e262ce8cb7299fd531"
},
"workflows/ws_sdxl_from_metadata_t2i.json": {
"mtime": 1779254360.9712114,
"seen": 1787279199.0012462,
"ast_hash": "463fca53dd0a4030555ff639661f2772",
"semantic_hash": "463fca53dd0a4030555ff639661f2772"
},
"workflows/ws_sdxl_i2i_facedetailer.json": {
"mtime": 1779253668.0067616,
"seen": 1787279199.0012474,
"ast_hash": "e2c677ee6670e37b466829c43ff9cd96",
"semantic_hash": "e2c677ee6670e37b466829c43ff9cd96"
},
"workflows/ws_sdxl_image_feeder_i2i.json": {
"mtime": 1779254714.0149894,
"seen": 1787279199.0012484,
"ast_hash": "8f14f2e0d1ebed40f95a8b728a5ecc79",
"semantic_hash": "8f14f2e0d1ebed40f95a8b728a5ecc79"
},
"workflows/ws_sdxl_t2i_basic.json": {
"mtime": 1779253180.3940487,
"seen": 1787279199.0012493,
"ast_hash": "beacbe857606b44d13aa2fc2f4872b76",
"semantic_hash": "beacbe857606b44d13aa2fc2f4872b76"
},
"workflows/ws_sdxl_t2i_facedetaller.json": {
"mtime": 1779253367.7975926,
"seen": 1787279199.00125,
"ast_hash": "0706c31d93f980b581e0e6eb376c0bcc",
"semantic_hash": "0706c31d93f980b581e0e6eb376c0bcc"
},
"DEVLOG.index.md": {
"mtime": 1787378424.0888915,
"seen": 1787399276.0029197,
"ast_hash": "f5e13974b9f8770e6f49bf74fc2c421e",
"semantic_hash": ""
},
"README.index.md": {
"mtime": 1787378423.9177885,
"seen": 1787399276.0029216,
"ast_hash": "4eaa4581c6f969c663176b216fde4596",
"semantic_hash": ""
},
"requirements.txt": {
"mtime": 1787036261.1817627,
"seen": 1787279199.0012598,
"ast_hash": "5942e1febf9611227a9145b3f9a91c6e",
"semantic_hash": "5942e1febf9611227a9145b3f9a91c6e"
},
"assets/banner.svg": {
"mtime": 1776081443.419675,
"seen": 1787279199.0012608,
"ast_hash": "059ec317eaba9e353d220d883477927a",
"semantic_hash": "059ec317eaba9e353d220d883477927a"
},
"assets/icon.svg": {
"mtime": 1776081443.4219253,
"seen": 1787279199.0012615,
"ast_hash": "9689aa0178236c19d5240250e08a303e",
"semantic_hash": "9689aa0178236c19d5240250e08a303e"
},
"docs/10_GenUI_Batch.png": {
"mtime": 1781057457.561953,
"seen": 1787279199.0012627,
"ast_hash": "351c1647aa5becfb4a2dbfa7da043b24",
"semantic_hash": "351c1647aa5becfb4a2dbfa7da043b24"
},
"docs/11_multiple_select_menu.png": {
"mtime": 1781057528.0140572,
"seen": 1787279199.0012636,
"ast_hash": "b3082324b8200a4eac8868f94ec4e6c7",
"semantic_hash": "b3082324b8200a4eac8868f94ec4e6c7"
},
"docs/12_Tagger.png": {
"mtime": 1782551031.7107866,
"seen": 1787279199.0012643,
"ast_hash": "42806369c4c08140c87daea348b6fc0f",
"semantic_hash": "42806369c4c08140c87daea348b6fc0f"
},
"docs/13_ImageEdit.png": {
"mtime": 1782550946.6263509,
"seen": 1787279199.0012655,
"ast_hash": "25a313806ba3c2396c9361b42599b063",
"semantic_hash": "25a313806ba3c2396c9361b42599b063"
},
"docs/1_workflowtab.png": {
"mtime": 1779078100.5980048,
"seen": 1787279199.0012662,
"ast_hash": "5aa53a79b8bd9e7b11a76f1ff89c9297",
"semantic_hash": "5aa53a79b8bd9e7b11a76f1ff89c9297"
},
"docs/2_modelstab.png": {
"mtime": 1779077971.8302422,
"seen": 1787279199.0012672,
"ast_hash": "2c89e877f01e8de3151e655f305df6aa",
"semantic_hash": "2c89e877f01e8de3151e655f305df6aa"
},
"docs/3_PromptInputAssistance.png": {
"mtime": 1779077804.0445502,
"seen": 1787279199.001268,
"ast_hash": "6634ec20d561648ce223807d2fb010cc",
"semantic_hash": "6634ec20d561648ce223807d2fb010cc"
},
"docs/4_GenUI_feeder.png": {
"mtime": 1779077729.1484556,
"seen": 1787279199.001269,
"ast_hash": "e6b3607b7c53a2f601aff487c278a3fb",
"semantic_hash": "e6b3607b7c53a2f601aff487c278a3fb"
},
"docs/5_topbar.png": {
"mtime": 1779076905.6012611,
"seen": 1787279199.0012698,
"ast_hash": "bafc74e7452f83ae9c585aa11f76f208",
"semantic_hash": "bafc74e7452f83ae9c585aa11f76f208"
},
"docs/6_ws_library.png": {
"mtime": 1781057870.2308166,
"seen": 1787279199.0012705,
"ast_hash": "6645a6c3d9ea09d75d34255c76cfc68b",
"semantic_hash": "6645a6c3d9ea09d75d34255c76cfc68b"
},
"docs/7_library_Infomation.png": {
"mtime": 1779076410.2629254,
"seen": 1787279199.0012715,
"ast_hash": "acb54f299c244fd41457f8fe4ccfc1d6",
"semantic_hash": "acb54f299c244fd41457f8fe4ccfc1d6"
},
"docs/8_Customize.png": {
"mtime": 1779077388.8494852,
"seen": 1787279199.0012722,
"ast_hash": "c9f979d40753ce41c015b2d594007658",
"semantic_hash": "c9f979d40753ce41c015b2d594007658"
},
"docs/9_GenUI_LoraStack.png": {
"mtime": 1781057821.3736062,
"seen": 1787279199.0012734,
"ast_hash": "e2b08e5f2059554d305563c63286bd74",
"semantic_hash": "e2b08e5f2059554d305563c63286bd74"
},
"docs/thumb.png": {
"mtime": 1778457744.7955222,
"seen": 1787279199.0012743,
"ast_hash": "92a0dcf2c3457777f2945f6df2dff017",
"semantic_hash": "92a0dcf2c3457777f2945f6df2dff017"
},
"static/favicon.svg": {
"mtime": 1773877378.0368707,
"seen": 1787279199.0012753,
"ast_hash": "0cd547c25c922d632890be287d6084ff",
"semantic_hash": "0cd547c25c922d632890be287d6084ff"
},
"workflows/ws_2d_pose_editor_to_Image_Edit( FireRed ).png": {
"mtime": 1779256606.562932,
"seen": 1787279199.0012763,
"ast_hash": "79b9d1e5e1303b523349b539d3dc1af3",
"semantic_hash": "79b9d1e5e1303b523349b539d3dc1af3"
},
"workflows/ws_3d_pose_editor_to_Image_Edit( Fire Red).png": {
"mtime": 1779257129.3453796,
"seen": 1787279199.001277,
"ast_hash": "02c572ab1c659d71dfd56e6b2b0334a5",
"semantic_hash": "02c572ab1c659d71dfd56e6b2b0334a5"
},
"workflows/ws_3d_pose_editor_to_Image_Edit( Flux2 Klein ).png": {
"mtime": 1779257864.2375357,
"seen": 1787279199.001278,
"ast_hash": "bb03ed86c7d4460a3568a4a8f90e5f40",
"semantic_hash": "bb03ed86c7d4460a3568a4a8f90e5f40"
},
"workflows/ws_dwpose_image_feeder.png": {
"mtime": 1779255324.1356418,
"seen": 1787279199.0012789,
"ast_hash": "e5db6889f59078e4ead6b89b8c07e91e",
"semantic_hash": "e5db6889f59078e4ead6b89b8c07e91e"
},
"workflows/ws_inpaint_basic.png": {
"mtime": 1784801838.7777002,
"seen": 1787279199.00128,
"ast_hash": "79321edb85aed7c0a8c777accc005486",
"semantic_hash": "79321edb85aed7c0a8c777accc005486"
},
"workflows/ws_inpaint_mask_editor_one.png": {
"mtime": 1784801946.027666,
"seen": 1787279199.001281,
"ast_hash": "bdd62facd6a8176c50e92264994dbbc2",
"semantic_hash": "bdd62facd6a8176c50e92264994dbbc2"
},
"workflows/ws_sd15_t2i_basic.png": {
"mtime": 1779253098.1897035,
"seen": 1787279199.0012817,
"ast_hash": "9582bb698439fff1a748315145538777",
"semantic_hash": "9582bb698439fff1a748315145538777"
},
"workflows/ws_sdxl_2d_pose_editor_i2i.png": {
"mtime": 1779256158.4621174,
"seen": 1787279199.001283,
"ast_hash": "bb7b9e26eae992abe62cd50299da9cb2",
"semantic_hash": "bb7b9e26eae992abe62cd50299da9cb2"
},
"workflows/ws_sdxl_3d pose editor_dwpose.png": {
"mtime": 1779255768.6191878,
"seen": 1787279199.0012836,
"ast_hash": "ac0fc8184ff7e42389fd0d562daa88c4",
"semantic_hash": "ac0fc8184ff7e42389fd0d562daa88c4"
},
"workflows/ws_sdxl_dwpose.png": {
"mtime": 1779255037.8606594,
"seen": 1787279199.0012846,
"ast_hash": "564f58d85a0b960154bd0a30ea111599",
"semantic_hash": "564f58d85a0b960154bd0a30ea111599"
},
"workflows/ws_sdxl_from_metadata_t2i.png": {
"mtime": 1779254360.9671092,
"seen": 1787279199.0012853,
"ast_hash": "98dfdb3ba374b0952c06995843f45171",
"semantic_hash": "98dfdb3ba374b0952c06995843f45171"
},
"workflows/ws_sdxl_i2i_facedetailer.png": {
"mtime": 1779253668.0007572,
"seen": 1787279199.0012865,
"ast_hash": "7285bb2a06aaf8dc7c5b37b84261be61",
"semantic_hash": "7285bb2a06aaf8dc7c5b37b84261be61"
},
"workflows/ws_sdxl_image_feeder_i2i.png": {
"mtime": 1779254714.0099926,
"seen": 1787279199.0012872,
"ast_hash": "13d4e7f87a87fd4c9a78427b38800cc6",
"semantic_hash": "13d4e7f87a87fd4c9a78427b38800cc6"
},
"workflows/ws_sdxl_t2i_basic.png": {
"mtime": 1779253180.3890488,
"seen": 1787279199.0012882,
"ast_hash": "9d8dda899602b8d74c6b23350e58a0d0",
"semantic_hash": "9d8dda899602b8d74c6b23350e58a0d0"
},
"workflows/ws_sdxl_t2i_facedetaller.png": {
"mtime": 1779253367.7925913,
"seen": 1787279199.0012891,
"ast_hash": "51cae742b39316023cf5332f1d794854",
"semantic_hash": "51cae742b39316023cf5332f1d794854"
},
".claude/hooks/on_doc_edit.py": {
"mtime": 1787279578.9362085,
"seen": 1787380810.2925577,
"ast_hash": "1a39a0e2ffaac441e8decccad0e1c42c",
"semantic_hash": "1a39a0e2ffaac441e8decccad0e1c42c"
},
"tools/generate_doc_index.py": {
"mtime": 1787279532.9148839,
"seen": 1787380810.3572273,
"ast_hash": "d0cdaf32b36fdef641a9396fd4ec403f",
"semantic_hash": "d0cdaf32b36fdef641a9396fd4ec403f"
},
".github/workflows/publish.yml": {
"mtime": 1778460176.5699222,
"seen": 1787380810.3754551,
"ast_hash": "a83dab23e8d09fdc8626689e96dfeb0e",
"semantic_hash": "a83dab23e8d09fdc8626689e96dfeb0e"
},
"templates/index.html": {
"mtime": 1787377487.6004047,
"seen": 1787380810.3754609,
"ast_hash": "639c4691eb3439d1707cd972bbed1402",
"semantic_hash": "639c4691eb3439d1707cd972bbed1402"
},
"static/js/prompt-table.js": {
"mtime": 1787400288.156035,
"seen": 1787400419.0870566,
"ast_hash": "bb722a8d63b1a7578f136bf99798f679",
"semantic_hash": ""
},
"static/js/prompt-ai-chat.js": {
"mtime": 1787398970.5236483,
"seen": 1787399276.0028632,
"ast_hash": "cdb87c58d22faa43d64b4f71a8d8e0f7",
"semantic_hash": ""
},
"static/js/prompt-presets.js": {
"mtime": 1787398926.1807213,
"seen": 1787399276.0028653,
"ast_hash": "7fd37f214f881138d21559c267241c5d",
"semantic_hash": ""
},
"static/js/prompt-styles.js": {
"mtime": 1787399033.0976152,
"seen": 1787399276.0028667,
"ast_hash": "800e1d042f6800d057b60801461d80aa",
"semantic_hash": ""
},
"static/js/prompt-wildcards.js": {
"mtime": 1787399711.3928645,
"seen": 1787399943.1509204,
"ast_hash": "0e1312911fa197ab5a1858fa449dfc69",
"semantic_hash": ""
}
}
+1
View File
@@ -72,6 +72,7 @@ WILDCARD_DIR = DATA_DIR / "wildcard"
AI_SKILLS_DIR = DATA_DIR / "ai_skills"
LAB_PLAN_DIR = DATA_DIR / "lab_plan"
VIDEO_PLAN_DIR = DATA_DIR / "video_plan"
VIDEO_EDIT_PROJECT_DIR = DATA_DIR / "video_edit_project"
# Tagger
TAGGER_DB_FILE = DATA_DIR / "tagger.db"
+2 -2
View File
@@ -82,9 +82,9 @@ async def handle_open(request: web.Request) -> web.Response:
# Retrieve setting for gmic path
data = _settings.load()
gmic_exe = data.get("gmic_qt_path", "")
if not os.path.exists(gmic_exe):
if not os.path.isabs(gmic_exe) or os.path.splitext(gmic_exe)[1].lower() != ".exe" or not os.path.isfile(gmic_exe):
return web.json_response({
"error": f"G'MIC executable not found at: {gmic_exe}. Please configure the path in settings."
"error": f"G'MIC executable not found at: {gmic_exe}. Please configure an absolute .exe path in settings."
}, status=400)
ext = ".png"
+113 -10
View File
@@ -5,13 +5,14 @@ import io
import json
import logging
import shutil
import tempfile
import zipfile
from pathlib import Path
from aiohttp import web
from ..services.settings_service import SettingsService
from ..config import DEFAULT_WORKFLOWS_DIR, DATA_DIR
from ..config import DEFAULT_WORKFLOWS_DIR, DATA_DIR, VIDEO_EDIT_PROJECT_DIR
logger = logging.getLogger(__name__)
@@ -305,7 +306,67 @@ def _add_external_dir_to_zip(zf: zipfile.ZipFile, src_dir: Path, zip_prefix: str
zf.write(path, rel)
def _build_full_backup_zip(include_workflows: bool = False, include_wildcard: bool = False) -> bytes:
# Video Edit projects (video_edit_project/*.json, inside DATA_DIR so always backed up) only
# store *references* — serverRef {filename, subfolder, type:"input"} — to clips, the BGM,
# timeline sounds and overlay (PinP) clips uploaded into ComfyUI's input dir, not the media itself. Backing up just the JSON means a
# restored project on another machine (or after input/ is cleaned up) opens with its clips
# missing. Opt-in (include_video_media) because the media can be large; stored under its own
# prefix so _apply_full_backup_zip can route it back into the input dir, not DATA_DIR.
_VIDEO_MEDIA_PREFIX = "_video_edit_media/"
def _comfyui_input_dir() -> Path:
import folder_paths
return Path(folder_paths.get_input_directory())
def _iter_video_edit_media_refs():
"""Yields (subfolder, filename) for every input-dir file referenced by a saved Video
Edit project (clips + BGM + timeline sounds + overlay clips). Unreadable project files
are skipped."""
if not VIDEO_EDIT_PROJECT_DIR.is_dir():
return
for path in sorted(VIDEO_EDIT_PROJECT_DIR.glob("*.json")):
try:
with open(path, "r", encoding="utf-8") as f:
data = json.load(f)
except Exception:
continue
# "sounds" / "pips" are top-level lists of {name, serverRef, ...} (absent in older projects).
refs = [
c.get("serverRef")
for key in ("clips", "sounds", "pips")
for c in data.get(key) or []
if isinstance(c, dict)
]
bgm = (data.get("audio") or {}).get("bgm")
if isinstance(bgm, dict):
refs.append(bgm.get("serverRef"))
for ref in refs:
if not isinstance(ref, dict) or not ref.get("filename"):
continue
if (ref.get("type") or "input") != "input":
continue
yield (ref.get("subfolder") or "").strip("/\\"), ref["filename"]
def _add_video_edit_media_to_zip(zf: zipfile.ZipFile) -> None:
input_dir = _comfyui_input_dir().resolve()
seen = set()
for subfolder, filename in _iter_video_edit_media_refs():
src = (input_dir / subfolder / filename).resolve()
try:
rel = src.relative_to(input_dir) # a crafted project file must not reach outside input/
except ValueError:
continue
if rel in seen or not src.is_file():
continue
seen.add(rel)
zf.write(src, _VIDEO_MEDIA_PREFIX + str(rel).replace("\\", "/"))
def _build_full_backup_zip(include_workflows: bool = False, include_wildcard: bool = False,
include_video_media: bool = False) -> bytes:
"""Zips everything under DATA_DIR except the excluded names above. Walks
top-level entries first so an excluded symlinked directory (wildcard/) is never
even opened, rather than filtering after a recursive walk has already followed it.
@@ -327,10 +388,12 @@ def _build_full_backup_zip(include_workflows: bool = False, include_wildcard: bo
_add_external_dir_to_zip(zf, _default_workflows_dir(), "_external/default_workflows")
if include_wildcard:
_add_external_dir_to_zip(zf, _impact_pack_wildcard_dir(), "_external/wildcard")
if include_video_media:
_add_video_edit_media_to_zip(zf)
return buf.getvalue()
def _apply_full_backup_zip(zip_bytes: bytes) -> dict:
def _apply_full_backup_zip(zip_source) -> dict:
"""Extracts a full-backup ZIP into DATA_DIR, overwriting existing files. Guards
against Zip Slip (entries whose path resolves outside DATA_DIR via '..' or an
absolute path) by checking each entry before writing it.
@@ -339,17 +402,43 @@ def _apply_full_backup_zip(zip_bytes: bytes) -> dict:
_build_full_backup_zip) are always skipped here rather than restored: they live
outside DATA_DIR and are managed by ComfyUI core / a different custom_node, so
auto-restoring them could silently overwrite files this plugin doesn't own. They
stay in the ZIP for the user to copy back manually if they want them."""
summary = {"extracted": [], "skipped": []}
stay in the ZIP for the user to copy back manually if they want them.
Entries under "_video_edit_media/" (media referenced by Video Edit projects) are restored
into ComfyUI's input dir instead, but never overwrite an existing file there — a file
with the same name is assumed to be the same upload (ComfyUI dedupes uploads by renaming),
and input/ is shared with every other workflow."""
summary = {"extracted": [], "skipped": [], "media_restored": [], "media_existing": []}
DATA_DIR.mkdir(parents=True, exist_ok=True)
base = DATA_DIR.resolve()
with zipfile.ZipFile(io.BytesIO(zip_bytes)) as zf:
input_base = None
# zip_source: raw bytes, or a seekable file object (the upload handler spools to a temp file).
if isinstance(zip_source, (bytes, bytearray)):
zip_source = io.BytesIO(zip_source)
with zipfile.ZipFile(zip_source) as zf:
for info in zf.infolist():
if info.is_dir():
continue
if info.filename.startswith("_external/"):
summary["skipped"].append(info.filename)
continue
if info.filename.startswith(_VIDEO_MEDIA_PREFIX):
if input_base is None:
input_base = _comfyui_input_dir().resolve()
target = (input_base / info.filename[len(_VIDEO_MEDIA_PREFIX):]).resolve()
try:
target.relative_to(input_base)
except ValueError:
summary["skipped"].append(info.filename)
continue
if target.exists():
summary["media_existing"].append(info.filename)
continue
target.parent.mkdir(parents=True, exist_ok=True)
with zf.open(info) as src, open(target, "wb") as dst:
shutil.copyfileobj(src, dst)
summary["media_restored"].append(info.filename)
continue
target = (base / info.filename).resolve()
try:
target.relative_to(base)
@@ -368,11 +457,15 @@ async def handle_export_full(request: web.Request) -> web.Response:
directory, including data the flat JSON bundle (handle_export) can't represent.
Optional query params include_workflows=1 / include_wildcard=1 additionally bundle
ComfyUI's default workflows dir / the Impact Pack's wildcard dir (see
_build_full_backup_zip) — both restore-excluded, export-only, manual-copy-back."""
_build_full_backup_zip) — both restore-excluded, export-only, manual-copy-back.
include_video_media=1 adds the input-dir media referenced by Video Edit projects,
which *is* restored (into input/, without overwriting)."""
try:
include_workflows = request.rel_url.query.get("include_workflows") == "1"
include_wildcard = request.rel_url.query.get("include_wildcard") == "1"
zip_bytes = await asyncio.to_thread(_build_full_backup_zip, include_workflows, include_wildcard)
include_video_media = request.rel_url.query.get("include_video_media") == "1"
zip_bytes = await asyncio.to_thread(
_build_full_backup_zip, include_workflows, include_wildcard, include_video_media)
return web.Response(
body=zip_bytes,
content_type="application/zip",
@@ -390,8 +483,18 @@ async def handle_import_full(request: web.Request) -> web.Response:
field = await reader.next()
if field is None or field.name != "file":
return web.json_response({"error": "file field required"}, status=400)
zip_bytes = await field.read(decode=False)
summary = await asyncio.to_thread(_apply_full_backup_zip, zip_bytes)
# Stream to a temp file with read_chunk() instead of field.read(): aiohttp (3.14+)
# enforces ComfyUI's --max-upload-size (default 100 MB) inside BodyPartReader.read(),
# and a backup with the opt-in workflows/wildcard/Video Edit media easily exceeds it
# ("Request Entity Too Large"). Also avoids holding the whole ZIP in memory.
with tempfile.TemporaryFile() as tmp:
while True:
chunk = await field.read_chunk(1024 * 1024)
if not chunk:
break
await asyncio.to_thread(tmp.write, chunk)
tmp.seek(0)
summary = await asyncio.to_thread(_apply_full_backup_zip, tmp)
return web.json_response({"status": "ok", **summary})
except zipfile.BadZipFile:
return web.json_response({"error": "Not a valid ZIP file"}, status=400)
+27 -11
View File
@@ -5,7 +5,13 @@ for local access (Authorization: Bearer sk-unsloth-...). The key lives in
UNSLOTH_API_KEY (loaded from a .env file by prestartup_script.py) and is
never sent to the frontend — the frontend calls this proxy with the target
path/method/payload, and the server attaches the Authorization header before
relaying to Unsloth's OpenAI-compatible API.
relaying to Unsloth's OpenAI-compatible API — and, via the same relay, to its
Decision API (/v1/systemone, TypeSafe-compatible Laya decision models; see
static/js/decision-client.js).
The key is optional: when UNSLOTH_API_KEY is unset the request is relayed
without an Authorization header, which works when Unsloth Desktop has
Keyless API access → "Chat and inference" turned on (localhost / private LAN).
"""
import json
@@ -20,7 +26,7 @@ from aiohttp import web
logger = logging.getLogger(__name__)
UNSLOTH_DEFAULT_URL = "http://localhost:8888"
_ALLOWED_PATHS = {"/v1/models", "/v1/chat/completions"}
_ALLOWED_PATHS = {"/v1/models", "/v1/chat/completions", "/v1/systemone"}
# baseUrl is client-supplied (so a custom Unsloth port works), but the
# Authorization header carries a real secret — restrict the host to loopback
# so this proxy can't be used to exfiltrate UNSLOTH_API_KEY to an arbitrary
@@ -33,6 +39,14 @@ def _get_api_key():
return os.environ.get("UNSLOTH_API_KEY", "").strip() or None
# Shown when a keyless request is rejected — also used by the Tagger's Unsloth VLM path.
KEYLESS_REJECTED_MESSAGE = (
"Unsloth rejected the request without an API key (HTTP 401). Either set UNSLOTH_API_KEY "
"in the plugin's .env (copy .env.example) and restart ComfyUI, or turn on Keyless API "
"access -> \"Chat and inference\" in Unsloth Desktop's Settings -> API."
)
def _is_allowed_base_url(base_url):
"""Only relay (and attach the API key) to a loopback host."""
try:
@@ -48,9 +62,10 @@ def setup_routes(app: web.Application):
async def handle_proxy(request: web.Request) -> web.Response:
"""POST /api/wfm/unsloth/proxy - Relay a request to Unsloth's OpenAI-compatible API.
"""POST /api/wfm/unsloth/proxy - Relay a request to Unsloth's OpenAI-compatible / Decision API.
Body: { baseUrl, path: "/v1/models" | "/v1/chat/completions", method: "GET" | "POST", payload }
Body: { baseUrl, path: "/v1/models" | "/v1/chat/completions" | "/v1/systemone",
method: "GET" | "POST", payload }
"""
import asyncio
try:
@@ -68,16 +83,13 @@ async def handle_proxy(request: web.Request) -> web.Response:
"message": "Unsloth backend URL must point to localhost/127.0.0.1/::1",
}, status=400)
# No key → relay without Authorization (Unsloth's Keyless API access); if Unsloth
# still demands one, the 401 below explains both ways to fix it.
api_key = _get_api_key()
if not api_key:
return web.json_response({
"message": "UNSLOTH_API_KEY is not set. Copy .env.example to .env in the "
"plugin folder, fill in the key, and restart ComfyUI.",
}, status=401)
def _fetch():
data = json.dumps(payload).encode("utf-8") if payload is not None else None
headers = {"Authorization": f"Bearer {api_key}"}
headers = {"Authorization": f"Bearer {api_key}"} if api_key else {}
if data is not None:
headers["Content-Type"] = "application/json"
req = urllib.request.Request(f"{base_url}{path}", data=data, headers=headers, method=method)
@@ -90,7 +102,11 @@ async def handle_proxy(request: web.Request) -> web.Response:
except HTTPError as e:
detail = e.read().decode("utf-8", errors="replace") if e.fp else str(e)
logger.warning("Unsloth proxy HTTP error: %s %s", e.code, detail)
return web.json_response({"message": f"Unsloth API error: HTTP {e.code}"}, status=e.code)
if e.code == 401 and not _get_api_key():
return web.json_response({"message": KEYLESS_REJECTED_MESSAGE}, status=401)
# Include a short excerpt of Unsloth's own error body — Decision API schema errors
# (e.g. a malformed question) are otherwise impossible to diagnose from the frontend.
return web.json_response({"message": f"Unsloth API error: HTTP {e.code} {detail[:300]}".strip()}, status=e.code)
except URLError as e:
logger.warning("Unsloth proxy connection error: %s", e)
return web.json_response({"message": f"Could not reach Unsloth: {e.reason}"}, status=502)
+90 -3
View File
@@ -1,25 +1,28 @@
"""Video tab API routes: last-frame capture, animated GIF conversion, and
Plan (batch timeline) file management."""
"""Video tab API routes: last-frame capture, animated GIF conversion, Edit
tab probe/text-overlay burn-in, and Plan/Edit project file management."""
import asyncio
import logging
from aiohttp import web
from ..config import VIDEO_PLAN_DIR
from ..config import VIDEO_PLAN_DIR, VIDEO_EDIT_PROJECT_DIR
from ..services.video_service import VideoService
from ..services.video_plan_service import VideoPlanService
from ..services.video_edit_project_service import VideoEditProjectService
logger = logging.getLogger(__name__)
_service = VideoService()
_plan_service = VideoPlanService(VIDEO_PLAN_DIR)
_edit_project_service = VideoEditProjectService(VIDEO_EDIT_PROJECT_DIR)
def setup_routes(app: web.Application):
app.router.add_post("/api/wfm/video/frame/save-to-output", handle_save_frame)
app.router.add_post("/api/wfm/video/to-gif", handle_to_gif)
app.router.add_get("/api/wfm/video/edit/probe", handle_probe_video)
app.router.add_post("/api/wfm/video/edit/overlay-text", handle_overlay_text)
app.router.add_get("/api/wfm/video/plans", handle_list_plans)
app.router.add_get("/api/wfm/video/plans/content", handle_get_plan_content)
@@ -27,6 +30,11 @@ def setup_routes(app: web.Application):
app.router.add_post("/api/wfm/video/plans/delete", handle_delete_plan)
app.router.add_post("/api/wfm/video/index-image/save-to-output", handle_save_index_to_output)
app.router.add_get("/api/wfm/video/edit/projects", handle_list_edit_projects)
app.router.add_get("/api/wfm/video/edit/projects/content", handle_get_edit_project_content)
app.router.add_post("/api/wfm/video/edit/projects/save", handle_save_edit_project)
app.router.add_post("/api/wfm/video/edit/projects/delete", handle_delete_edit_project)
async def handle_save_frame(request: web.Request) -> web.Response:
try:
@@ -88,6 +96,35 @@ async def handle_probe_video(request: web.Request) -> web.Response:
return web.json_response({"error": str(e)}, status=500)
async def handle_overlay_text(request: web.Request) -> web.Response:
try:
body = await request.json()
filename = body.get("filename", "")
subfolder = body.get("subfolder", "")
type_ = body.get("type", "output")
overlays = body.get("overlays") or []
delete_source = bool(body.get("delete_source"))
pips = body.get("pips") or []
if not filename:
return web.json_response({"error": "filename required"}, status=400)
if not isinstance(overlays, list) or not isinstance(pips, list):
return web.json_response({"error": "overlays and pips must be lists"}, status=400)
# Decode+re-encode of every frame — run off the event loop so other
# requests aren't stalled for the duration of the burn-in.
result = await asyncio.to_thread(
_service.overlay_text_on_video, filename, subfolder, type_, overlays, "video/wfm_edit", delete_source, pips
)
return web.json_response({"status": "ok", **result})
except FileNotFoundError as e:
return web.json_response({"error": str(e)}, status=404)
except ValueError as e:
return web.json_response({"error": str(e)}, status=400)
except Exception as e:
logger.error("Error burning text overlay into video: %s", e)
return web.json_response({"error": str(e)}, status=500)
async def handle_list_plans(request: web.Request) -> web.Response:
try:
result = await asyncio.to_thread(_plan_service.list_plans)
@@ -139,6 +176,56 @@ async def handle_delete_plan(request: web.Request) -> web.Response:
return web.json_response({"error": str(e)}, status=500)
async def handle_list_edit_projects(request: web.Request) -> web.Response:
try:
result = await asyncio.to_thread(_edit_project_service.list_projects)
return web.json_response(result)
except Exception as e:
logger.error("Error listing video edit projects: %s", e)
return web.json_response({"error": str(e)}, status=500)
async def handle_get_edit_project_content(request: web.Request) -> web.Response:
filename = request.rel_url.query.get("filename", "")
try:
data = await asyncio.to_thread(_edit_project_service.get_project, filename)
return web.json_response({"data": data})
except FileNotFoundError:
return web.json_response({"error": "not found"}, status=404)
except ValueError as e:
return web.json_response({"error": str(e)}, status=400)
except Exception as e:
logger.error("Error getting video edit project content: %s", e)
return web.json_response({"error": str(e)}, status=500)
async def handle_save_edit_project(request: web.Request) -> web.Response:
try:
body = await request.json()
filename = body.get("filename", "")
data = body.get("data", {})
result = await asyncio.to_thread(_edit_project_service.save_project, filename, data)
return web.json_response({"status": "ok", **result})
except ValueError as e:
return web.json_response({"error": str(e)}, status=400)
except Exception as e:
logger.error("Error saving video edit project: %s", e)
return web.json_response({"error": str(e)}, status=500)
async def handle_delete_edit_project(request: web.Request) -> web.Response:
try:
body = await request.json()
filename = body.get("filename", "")
await asyncio.to_thread(_edit_project_service.delete_project, filename)
return web.json_response({"status": "ok"})
except ValueError as e:
return web.json_response({"error": str(e)}, status=400)
except Exception as e:
logger.error("Error deleting video edit project: %s", e)
return web.json_response({"error": str(e)}, status=500)
async def handle_save_index_to_output(request: web.Request) -> web.Response:
try:
body = await request.json()
+41 -9
View File
@@ -9,9 +9,11 @@ import os
import re
import tempfile
import threading
import urllib.error
import urllib.request
from pathlib import Path
from typing import Optional
from urllib.parse import urlparse
import numpy as np
from PIL import Image, ImageOps, PngImagePlugin
@@ -20,6 +22,20 @@ logger = logging.getLogger(__name__)
_model_lock = threading.Lock()
# Unsloth requires an Authorization: Bearer <UNSLOTH_API_KEY> header even for
# local access. api_url is client-supplied per request, so without a host
# check a client could point it at an arbitrary server and exfiltrate the key
# (SSRF). Mirrors unsloth_routes.py's _is_allowed_base_url/_ALLOWED_HOSTS.
_UNSLOTH_ALLOWED_HOSTS = {"localhost", "127.0.0.1", "::1"}
def _is_allowed_unsloth_url(api_url: str) -> bool:
try:
parsed = urlparse(api_url)
return parsed.scheme in ("http", "https") and parsed.hostname in _UNSLOTH_ALLOWED_HOSTS
except Exception:
return False
class TaggerService:
def __init__(self, models_dir: Path, settings_file: Path):
@@ -241,9 +257,17 @@ class TaggerService:
# ── VLM Tagging (Ollama / LM Studio / Lemonade / Unsloth) ──
# キー未設定でUnslothに拒否された場合の案内(py/routes/unsloth_routes.pyと同文)
_UNSLOTH_KEYLESS_REJECTED = (
"Unsloth rejected the request without an API key (HTTP 401). Either set UNSLOTH_API_KEY "
"in the plugin's .env (copy .env.example) and restart ComfyUI, or turn on Keyless API "
"access -> \"Chat and inference\" in Unsloth Desktop's Settings -> API."
)
@staticmethod
def _unsloth_api_key() -> Optional[str]:
"""UNSLOTH_API_KEY を環境変数(.env)から取得。Unslothはローカルでも常に必須。"""
"""UNSLOTH_API_KEY を環境変数(.env)から取得。未設定ならNone — その場合はAuthorization無しで
送る(Unsloth DesktopのKeyless API access → "Chat and inference" がオンなら通る)。"""
return os.environ.get("UNSLOTH_API_KEY", "").strip() or None
@staticmethod
@@ -263,16 +287,21 @@ class TaggerService:
headers = {}
if backend == "unsloth":
key = self._unsloth_api_key()
if not key:
logger.error("vlm_models: UNSLOTH_API_KEY is not set")
if not _is_allowed_unsloth_url(api_url):
logger.error("vlm_models: Unsloth backend URL must point to localhost/127.0.0.1/::1")
return []
headers["Authorization"] = f"Bearer {key}"
key = self._unsloth_api_key()
if key:
headers["Authorization"] = f"Bearer {key}"
req = urllib.request.Request(api_url.rstrip("/") + "/v1/models", headers=headers)
with urllib.request.urlopen(req, timeout=5) as resp:
data = json.loads(resp.read().decode("utf-8"))
return sorted(m["id"] for m in data.get("data", []))
except Exception as e:
if (backend == "unsloth" and isinstance(e, urllib.error.HTTPError) and e.code == 401
and not self._unsloth_api_key()):
logger.error("vlm_models: %s", self._UNSLOTH_KEYLESS_REJECTED)
return []
logger.error("vlm_models: %s", e)
return []
@@ -303,11 +332,11 @@ class TaggerService:
else:
headers = {"Content-Type": "application/json"}
if backend == "unsloth":
if not _is_allowed_unsloth_url(api_url):
return {"error": "Unsloth backend URL must point to localhost/127.0.0.1/::1"}
key = self._unsloth_api_key()
if not key:
return {"error": "UNSLOTH_API_KEY is not set. Copy .env.example to .env in the "
"plugin folder, fill in the key, and restart ComfyUI."}
headers["Authorization"] = f"Bearer {key}"
if key:
headers["Authorization"] = f"Bearer {key}"
body = {
"model": model,
"messages": [{"role": "user", "content": [
@@ -340,6 +369,9 @@ class TaggerService:
return {"tags": ", ".join(tags), "count": len(tags)}
except Exception as e:
logger.error("vlm_predict: %s", e)
if (backend == "unsloth" and isinstance(e, urllib.error.HTTPError) and e.code == 401
and not self._unsloth_api_key()):
return {"error": self._UNSLOTH_KEYLESS_REJECTED}
return {"error": str(e)}
# ── ファイルメタデータ書込 ────────────────────────────────
+98
View File
@@ -0,0 +1,98 @@
"""Video tab Edit subtab project file management (JSON timeline persistence).
Same CRUD shape as VideoPlanService (list/get/save/delete with a safe-path
helper), kept as its own class rather than sharing a base because the two
JSON schemas are unrelated (batch keyframe blocks vs. an ordered clip
timeline) — see VideoPlanService's own docstring for the same reasoning.
No index-image thumbnail support (unlike VideoPlanService) since the Edit
project list is plain text/JSON only for now.
"""
import json
import logging
from datetime import datetime, timezone
from pathlib import Path
logger = logging.getLogger(__name__)
class VideoEditProjectService:
def __init__(self, project_dir: Path):
self.project_dir = project_dir
self.project_dir.mkdir(parents=True, exist_ok=True)
# ------------------------------------------------------------------
# Path safety
# ------------------------------------------------------------------
def _safe_path(self, filename: str, ext: str = ".json") -> Path | None:
if not filename or not filename.strip():
return None
name = filename.strip()
if not name.endswith(ext):
name = name + ext
if "/" in name or "\\" in name or name in (".", "..") or "\x00" in name:
return None
resolved = (self.project_dir / name).resolve()
project_dir_resolved = self.project_dir.resolve()
if resolved != project_dir_resolved and not str(resolved).startswith(str(project_dir_resolved) + "\\") and not str(resolved).startswith(str(project_dir_resolved) + "/"):
return None
return resolved
def _now_iso(self) -> str:
return datetime.now(timezone.utc).isoformat().replace("+00:00", "Z")
# ------------------------------------------------------------------
# CRUD
# ------------------------------------------------------------------
def list_projects(self) -> list[dict]:
if not self.project_dir.is_dir():
return []
result = []
for path in sorted(self.project_dir.glob("*.json")):
try:
with open(path, "r", encoding="utf-8") as f:
data = json.load(f)
except Exception as e:
logger.warning("Skipping unreadable video edit project %s: %s", path.name, e)
continue
result.append({
"filename": path.name,
"name": data.get("name", path.stem),
"clip_count": len(data.get("clips", [])),
"updated_at": data.get("updated_at", ""),
})
result.sort(key=lambda p: p.get("updated_at", ""), reverse=True)
return result
def get_project(self, filename: str) -> dict:
path = self._safe_path(filename)
if path is None:
raise ValueError(f"Invalid filename: {filename}")
if not path.is_file():
raise FileNotFoundError(f"Project not found: {filename}")
with open(path, "r", encoding="utf-8") as f:
return json.load(f)
def save_project(self, filename: str, data: dict) -> dict:
path = self._safe_path(filename)
if path is None:
raise ValueError(f"Invalid filename: {filename}")
data = dict(data)
data["updated_at"] = self._now_iso()
path.parent.mkdir(parents=True, exist_ok=True)
with open(path, "w", encoding="utf-8") as f:
json.dump(data, f, ensure_ascii=False, indent=2)
return {"filename": path.name, "updated_at": data["updated_at"]}
def delete_project(self, filename: str) -> None:
path = self._safe_path(filename)
if path is None:
raise ValueError(f"Invalid filename: {filename}")
if path.is_file():
path.unlink()
+321
View File
@@ -8,6 +8,8 @@ implementation (e.g. Eagle's video2gif/video-to-frame plugins).
import base64
import logging
import os
import sys
from pathlib import Path
logger = logging.getLogger(__name__)
@@ -18,6 +20,184 @@ try:
except Exception: # pragma: no cover - Pillow is a hard ComfyUI dependency
_RESAMPLE = None
# Text overlay anchors: 9-grid "<vertical>-<horizontal>" (e.g. "bottom-center").
_ANCHOR_V = ("top", "middle", "bottom")
_ANCHOR_H = ("left", "center", "right")
# Fonts tried in order for text overlays. Pillow's built-in default font has no
# CJK glyphs (Japanese/Chinese text would render as boxes), so a system font
# with CJK coverage is preferred; load_default() is only the last resort.
_FONT_CANDIDATES = {
"win32": ["meiryo.ttc", "YuGothM.ttc", "NotoSansJP-Regular.ttf", "msgothic.ttc", "arial.ttf"],
"darwin": [
"/System/Library/Fonts/ヒラギノ角ゴシック W4.ttc",
"/System/Library/Fonts/Hiragino Sans GB.ttc",
"/Library/Fonts/Arial Unicode.ttf",
],
"linux": [
"/usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc",
"/usr/share/fonts/noto-cjk/NotoSansCJK-Regular.ttc",
"/usr/share/fonts/truetype/dejavu/DejaVuSans.ttf",
],
}
def _load_overlay_font(size: int):
from PIL import ImageFont
platform = "win32" if sys.platform.startswith("win") else ("darwin" if sys.platform == "darwin" else "linux")
for name in _FONT_CANDIDATES[platform]:
path = name
if platform == "win32" and not os.path.isabs(name):
path = os.path.join(os.environ.get("WINDIR", r"C:\Windows"), "Fonts", name)
if os.path.isfile(path):
try:
return ImageFont.truetype(path, size)
except Exception:
continue
return ImageFont.load_default(size=size)
def _render_text_layer(width: int, height: int, ov: dict):
"""Renders one overlay's text onto a transparent full-frame RGBA layer, so
it can be alpha-composited over every frame in its time range without
re-rendering the text per frame (same idea as ComfyUI core's TextOverlay)."""
from PIL import ImageColor, ImageDraw
text = str(ov.get("text") or "").replace("\\n", "\n")
layer = Image.new("RGBA", (width, height), (0, 0, 0, 0))
if not text.strip():
return layer
size = max(8, round(float(ov.get("font_size") or 6.0) / 100.0 * height))
font = _load_overlay_font(size)
stroke = max(1, round(size * 0.06)) if ov.get("outline", True) else 0
spacing = round(size * 0.2)
try:
color = ImageColor.getrgb(str(ov.get("color") or "#ffffff"))
except ValueError:
color = (255, 255, 255)
fill = (*color[:3], 255)
anchor = str(ov.get("anchor") or "bottom-center").split("-")
v = anchor[0] if anchor and anchor[0] in _ANCHOR_V else "bottom"
h = anchor[1] if len(anchor) > 1 and anchor[1] in _ANCHOR_H else "center"
draw = ImageDraw.Draw(layer)
box = draw.multiline_textbbox((0, 0), text, font=font, spacing=spacing, stroke_width=stroke, align=h)
tw, th = box[2] - box[0], box[3] - box[1]
margin = round(0.04 * min(width, height))
x = {"left": margin, "center": (width - tw) / 2, "right": width - margin - tw}[h] - box[0]
y = {"top": margin, "middle": (height - th) / 2, "bottom": height - margin - th}[v] - box[1]
if ov.get("background"):
pad = round(size * 0.3)
draw.rounded_rectangle(
(x + box[0] - pad, y + box[1] - pad, x + box[2] + pad, y + box[3] + pad),
radius=pad, fill=(0, 0, 0, 140),
)
draw.multiline_text((x, y), text, font=font, fill=fill, spacing=spacing, align=h,
stroke_width=stroke, stroke_fill=(0, 0, 0, 255))
return layer
def _fit_layer(img, base_w: int, base_h: int, pip: dict):
"""Scales a picture-in-picture frame to its target width (a fraction of the
base frame's width, aspect preserved), applies opacity, and returns
(layer, left, top) with the position of its top-left corner on the base
frame (pip["x"]/["y"] are the layer's centre as fractions of the frame)."""
layer = img.convert("RGBA")
pw = max(2, int(round(float(pip["scale"]) * base_w)))
ph = max(2, int(round(pw * layer.height / max(1, layer.width))))
layer = layer.resize((pw, ph), _RESAMPLE)
opacity = float(pip.get("opacity", 1.0))
if opacity < 0.999:
layer.putalpha(layer.getchannel("A").point(lambda a: int(a * opacity)))
left = int(round(float(pip["x"]) * base_w - pw / 2))
top = int(round(float(pip["y"]) * base_h - ph / 2))
return layer, left, top
class _PipSource:
"""One overlay clip's frame source. Images are decoded once; videos are
decoded sequentially (seek once to the in-file start, then only forward),
since the base video is also processed strictly in time order. After a
video's last frame it holds that frame until the overlay's end."""
def __init__(self, path: Path, pip: dict, base_w: int, base_h: int):
import av # type: ignore
self.pip = pip
self.base_w, self.base_h = base_w, base_h
self.start = float(pip["start"])
self.end = self.start + float(pip["length"])
self.src_start = max(0.0, float(pip.get("src_start") or 0.0))
self.container = None
self._cache_key = None
self._cache = None
if pip.get("kind") == "image":
with Image.open(path) as im:
im.load()
self.static = _fit_layer(im, base_w, base_h, pip)
else:
self.static = None
self.container = av.open(str(path))
self.stream = self.container.streams.video[0]
if self.src_start > 0.05:
self.container.seek(int(self.src_start * 1_000_000))
self.gen = self.container.decode(self.stream)
self.cur = None
self.nxt = None
self.done = False
def _time(self, frame) -> float:
return float(frame.pts * self.stream.time_base) if frame.pts is not None else 0.0
def layer_at(self, t: float):
"""(layer, left, top) for timeline time t, or None when inactive."""
if not (self.start <= t < self.end):
return None
if self.static is not None:
return self.static
target = self.src_start + (t - self.start)
while True:
if self.nxt is None and not self.done:
try:
self.nxt = next(self.gen)
except StopIteration:
self.done = True
if self.nxt is not None and self._time(self.nxt) <= target + 1e-3:
self.cur, self.nxt = self.nxt, None
continue
break
frame = self.cur or self.nxt
if frame is None:
return None
key = id(frame)
if key != self._cache_key:
self._cache = _fit_layer(frame.to_image(), self.base_w, self.base_h, self.pip)
self._cache_key = key
return self._cache
def close(self):
if self.container is not None:
self.container.close()
self.container = None
def _paste_layer(base, layer, left: int, top: int):
"""Alpha-composites `layer` onto the RGBA `base` at (left, top), clipping
whatever falls outside the frame (a plain alpha_composite() dest can't be
negative)."""
x0, y0 = max(0, left), max(0, top)
x1, y1 = min(base.width, left + layer.width), min(base.height, top + layer.height)
if x1 <= x0 or y1 <= y0:
return
piece = layer.crop((x0 - left, y0 - top, x1 - left, y1 - top))
region = base.crop((x0, y0, x1, y1))
region.alpha_composite(piece)
base.paste(region, (x0, y0))
class VideoService:
def _resolve_media_path(self, filename: str, subfolder: str, type_: str) -> Path:
@@ -157,3 +337,144 @@ class VideoService:
optimize=True,
)
return {"filename": save_name, "subfolder": out_subfolder, "frame_count": len(pil_frames)}
def overlay_text_on_video(
self,
filename: str,
subfolder: str,
type_: str,
overlays: list,
filename_prefix: str = "video/wfm_edit",
delete_source: bool = False,
pips: list = None,
) -> dict:
"""Burns timed text overlays - and picture-in-picture overlay clips
(video or image, placed/scaled/faded on the frame) - into a video
(Video Edit tab, Phase 3 + overlay track).
ComfyUI core has no time-ranged video text node (core TextOverlay draws
on every frame of an IMAGE batch, top/bottom only), and routing the
whole timeline through IMAGE tensors would hold every decoded frame in
memory at once — so this streams instead: decode one frame, composite
any overlay whose [start, end) covers it, encode, repeat. Audio packets
are remuxed untouched (no audio re-encode), so the soundtrack built by
the export graph (original audio / BGM) survives this pass as-is.
overlays: [{text, start, end, font_size (% of frame height), color,
anchor ("<top|middle|bottom>-<left|center|right>"), outline, background}]
with start/end in seconds from the start of the video.
pips: [{filename, subfolder, type (input), kind ("video"|"image"),
src_start (in-file start, s), start (timeline s), length (s),
x, y (centre, fractions of the frame), scale (width as a fraction of
the frame width), opacity (0..1)}]. Overlay audio is not mixed.
Pips are drawn first (in list order), then text on top.
"""
import av # type: ignore
import folder_paths # type: ignore
src_path = self._resolve_media_path(filename, subfolder, type_)
items = []
for ov in overlays or []:
try:
start = max(0.0, float(ov.get("start") or 0.0))
end = float(ov.get("end") or 0.0)
except (TypeError, ValueError):
continue
if end > start and str(ov.get("text") or "").strip():
items.append((start, end, ov))
valid_pips = []
for pip in pips or []:
try:
if float(pip["length"]) > 0 and float(pip["scale"]) > 0 and pip.get("filename"):
valid_pips.append(pip)
except (KeyError, TypeError, ValueError):
continue
if not items and not valid_pips:
raise ValueError("No valid text or overlay clips")
# Resolve overlay files up front so a missing one fails before any encoding.
pip_paths = [
self._resolve_media_path(p["filename"], p.get("subfolder", ""), p.get("type", "input"))
for p in valid_pips
]
output_dir = folder_paths.get_output_directory()
full_output_folder, out_filename, counter, out_subfolder, _ = folder_paths.get_save_image_path(filename_prefix, output_dir)
save_name = f"{out_filename}_{counter:05}_.mp4"
save_path = Path(full_output_folder) / save_name
in_c = av.open(str(src_path))
out_c = None
pip_sources = []
try:
in_v = in_c.streams.video[0]
in_a = in_c.streams.audio[0] if in_c.streams.audio else None
width, height = in_v.codec_context.width, in_v.codec_context.height
rate = in_v.average_rate or in_v.guessed_rate or 24
pip_sources = [_PipSource(path, pip, width, height) for path, pip in zip(pip_paths, valid_pips)]
layers = [(s, e, _render_text_layer(width, height, ov)) for s, e, ov in items]
out_c = av.open(str(save_path), mode="w")
out_v = out_c.add_stream("libx264", rate=rate)
out_v.width = width
out_v.height = height
out_v.pix_fmt = "yuv420p"
out_v.options = {"crf": "18", "preset": "medium"}
out_a = out_c.add_stream_from_template(in_a) if in_a is not None else None
streams = [in_v] + ([in_a] if in_a is not None else [])
first_pts = None
index = 0
for packet in in_c.demux(*streams):
if packet.stream.type == "audio":
if packet.dts is None:
continue
packet.stream = out_a
out_c.mux(packet)
continue
for frame in packet.decode():
if frame.pts is not None and first_pts is None:
first_pts = frame.pts
t = float((frame.pts - first_pts) * in_v.time_base) if frame.pts is not None else index / float(rate)
active = [layer for s, e, layer in layers if s <= t < e]
pip_layers = [pl for pl in (src.layer_at(t) for src in pip_sources) if pl is not None]
if active or pip_layers:
img = frame.to_image().convert("RGBA")
for layer, left, top in pip_layers:
_paste_layer(img, layer, left, top)
for layer in active:
img.alpha_composite(layer)
out_frame = av.VideoFrame.from_image(img.convert("RGB"))
else:
out_frame = frame
out_frame.pts = index
out_frame.time_base = out_v.codec_context.time_base
index += 1
for out_packet in out_v.encode(out_frame):
out_c.mux(out_packet)
for out_packet in out_v.encode(None):
out_c.mux(out_packet)
except BaseException:
if out_c is not None:
out_c.close()
out_c = None
save_path.unlink(missing_ok=True)
raise
finally:
if out_c is not None:
out_c.close()
for src in pip_sources:
src.close()
in_c.close()
# The export graph's intermediate file is only deleted when the caller
# explicitly asks and it's one of this tab's own "_pre" intermediates in
# output — never an arbitrary user file.
if delete_source and type_ == "output" and Path(filename).name.startswith("wfm_edit_pre"):
try:
src_path.unlink()
except OSError as e:
logger.warning("Could not delete intermediate %s: %s", src_path, e)
return {"filename": save_name, "subfolder": out_subfolder, "frame_count": index}
+1 -1
View File
@@ -1,7 +1,7 @@
[project]
name = "comfyui-workflow-studio"
description = "A comprehensive workflow, asset management, and generation UI plugin for ComfyUI. Manage workflows, models, images, and prompts; batch generation and Image Feeder in the GenerateUI tab; library side panel with canvas drag & drop and AI tools."
version = "0.7.0"
version = "0.7.8"
license = { file = "LICENSE" }
requires-python = ">= 3.10"
dependencies = ["jinja2"]
+373 -3
View File
@@ -21,7 +21,7 @@
/* ── 左ペイン: フォーム ── */
.wfm-video-form-panel {
width: 380px;
width: 253px;
flex: none;
display: flex;
flex-direction: column;
@@ -409,6 +409,78 @@
flex: none; /* stay a fixed-height full-width bar; never shrink/stretch with clip content */
}
/* ── Edit: トラック切替(ビデオ=青/テキスト=緑/オーディオ=赤)──
--wfm-track-color は表示中トラックの色。トラックバーの枠線・ブロックの帯色に使う。
ビデオ色はテーマ可変の--wfm-primaryではなく固定の青にして、他トラックと並べても色が変わらないようにする。 */
.wfm-video-edit-track-tabs {
display: flex;
gap: 4px;
margin-bottom: 4px;
}
.wfm-video-edit-track-tab {
--tab-color: var(--wfm-track-video);
border-bottom: 2px solid var(--tab-color);
}
.wfm-video-edit-track-tab[data-track="video"] { --tab-color: var(--wfm-track-video); }
.wfm-video-edit-track-tab[data-track="pip"] { --tab-color: var(--wfm-track-video); }
.wfm-video-edit-track-tab[data-track="text"] { --tab-color: var(--wfm-track-text); }
.wfm-video-edit-track-tab[data-track="audio"] { --tab-color: var(--wfm-track-audio); }
.wfm-video-edit-track-tab.active {
background: var(--tab-color);
border-color: var(--tab-color);
color: #fff;
}
.wfm-video-edit-timeline-track {
--wfm-track-video: #4a9eff;
--wfm-track-text: #3fb950;
--wfm-track-audio: #f85149;
--wfm-track-color: var(--wfm-track-video);
}
.wfm-video-edit-track-tabs { --wfm-track-video: #4a9eff; --wfm-track-text: #3fb950; --wfm-track-audio: #f85149; }
.wfm-video-edit-timeline-track[data-track="pip"] { --wfm-track-color: var(--wfm-track-video); }
.wfm-video-edit-timeline-track[data-track="text"] { --wfm-track-color: var(--wfm-track-text); }
.wfm-video-edit-timeline-track[data-track="audio"] { --wfm-track-color: var(--wfm-track-audio); }
.wfm-video-edit-timeline-track[data-track="pip"],
.wfm-video-edit-timeline-track[data-track="text"],
.wfm-video-edit-timeline-track[data-track="audio"] { border-color: var(--wfm-track-color); }
.wfm-video-edit-timeline-track[data-track="video"] .wfm-video-edit-timeline-block {
border-left: 3px solid var(--wfm-track-color);
}
/* テキスト/オーディオ表示: 絶対時間(秒×px/秒)で配置するレーン */
.wfm-video-edit-lane {
position: relative;
flex: none;
min-height: 100%;
}
.wfm-video-edit-lane-clipband {
position: absolute;
top: 0;
bottom: 0;
border-left: 1px dashed var(--wfm-border);
box-sizing: border-box;
cursor: pointer;
}
.wfm-video-edit-lane-clipband.selected { background: rgba(255, 255, 255, 0.06); }
.wfm-video-edit-lane-item {
position: absolute;
height: 20px;
box-sizing: border-box;
padding: 0 6px;
border-radius: 3px;
background: color-mix(in srgb, var(--wfm-track-color) 35%, transparent);
border: 1px solid var(--wfm-track-color);
font-size: 11px;
line-height: 18px;
overflow: hidden;
text-overflow: ellipsis;
white-space: nowrap;
cursor: pointer;
}
.wfm-video-edit-lane-item.selected { background: var(--wfm-track-color); color: #fff; }
.wfm-video-edit-lane-item.dim { opacity: 0.55; }
.wfm-video-edit-timeline-placeholder {
display: flex;
align-items: center;
@@ -494,6 +566,12 @@
すべて%位置指定(clip.duration基準)にすることでpx/秒換算を持たずに済ませている。 */
.wfm-video-trim-scrubber {
margin-top: 10px;
/* start/end/playheadのバッジ(track上端から浮く)が上のクリップ名や
目盛りと重ならないよう、あらかじめ専用の余白を確保しておく。
playheadバッジはstart/endバッジより高い位置に2段目として出すため
(再生位置がトリム開始/終了に近いとき同じ高さだと文字が重なるため)、
その分も含めた高さを確保する。 */
padding-top: 44px;
user-select: none;
}
@@ -513,7 +591,7 @@
.wfm-video-trim-track {
position: relative;
height: 36px;
height: 52px;
margin-top: 4px;
background: var(--wfm-bg-hover, #111);
border: 1px solid var(--wfm-border);
@@ -571,7 +649,7 @@
.wfm-video-trim-badge {
position: absolute;
top: -22px;
top: -24px;
left: 50%;
transform: translateX(-50%);
background: #111;
@@ -585,6 +663,10 @@
.wfm-video-trim-badge-playhead {
background: #000;
/* start/endバッジ(-24px)より上の2段目に出し、再生位置がトリム範囲の
端に重なっても文字同士がぶつからないようにする */
top: -42px;
border: 1px solid var(--wfm-primary);
}
.wfm-video-edit-export-panel {
@@ -592,6 +674,237 @@
flex: none;
}
/* ---- Edit: テキストオーバーレイ(Phase 3) / オーディオ(Phase 4) ---- */
.wfm-video-edit-section-head {
display: flex;
align-items: center;
justify-content: space-between;
gap: 8px;
font-size: 12px;
font-weight: 600;
color: var(--wfm-text-secondary);
margin-bottom: 6px;
}
.wfm-video-edit-text-section {
margin-top: 16px;
padding-top: 10px;
border-top: 1px solid var(--wfm-border);
}
.wfm-video-edit-text-list {
display: flex;
flex-direction: column;
gap: 8px;
}
.wfm-video-edit-text-row {
border: 1px solid var(--wfm-border);
border-radius: 6px;
padding: 6px 8px;
}
.wfm-video-edit-text-row-head {
display: flex;
gap: 6px;
margin-bottom: 6px;
}
.wfm-video-edit-text-row-head input {
flex: 1;
min-width: 0;
}
.wfm-video-edit-text-grid {
display: grid;
grid-template-columns: repeat(auto-fill, minmax(92px, 1fr));
gap: 6px 8px;
align-items: end;
}
.wfm-video-edit-text-grid > label {
display: flex;
flex-direction: column;
gap: 2px;
font-size: 11px;
color: var(--wfm-text-secondary);
margin: 0;
}
.wfm-video-edit-text-grid > label.wfm-video-checkbox-inline {
flex-direction: row;
}
.wfm-video-edit-text-grid input[type="color"] {
width: 100%;
height: 28px;
padding: 0;
border: 1px solid var(--wfm-border);
border-radius: 4px;
background: none;
}
.wfm-video-edit-audio-panel {
margin-top: 10px;
padding-top: 8px;
border-top: 1px solid var(--wfm-border);
}
.wfm-video-edit-audio-row {
display: grid;
grid-template-columns: 1fr auto;
align-items: center;
gap: 2px 6px;
margin-top: 4px;
font-size: 11px;
color: var(--wfm-text-secondary);
}
.wfm-video-edit-audio-row > label {
grid-column: 1 / -1;
margin: 0;
}
.wfm-video-edit-audio-row input[type="range"] {
width: 100%;
}
.wfm-video-edit-audio-row input[type="number"] {
grid-column: 1 / -1;
}
.wfm-video-edit-audio-val {
min-width: 44px;
text-align: right;
font-variant-numeric: tabular-nums;
}
.wfm-video-edit-bgm-file {
display: flex;
align-items: center;
gap: 6px;
margin-top: 6px;
}
.wfm-video-edit-audio-panel.drag-over {
outline: 2px dashed var(--wfm-primary);
outline-offset: 2px;
border-radius: 4px;
}
.wfm-video-edit-bgm-hint {
display: block;
font-size: 10px;
margin-top: 2px;
}
/* <label>で包んだファイル選択を.wfm-btnと同じ見た目にする */
.wfm-video-edit-file-btn {
display: inline-flex;
align-items: center;
justify-content: center;
margin: 0;
user-select: none;
}
.wfm-video-edit-bgm-name {
flex: 1;
min-width: 0;
overflow: hidden;
text-overflow: ellipsis;
white-space: nowrap;
}
.wfm-video-edit-crop-section {
margin-top: 16px;
padding-top: 10px;
border-top: 1px solid var(--wfm-border);
}
.wfm-video-edit-crop-row {
display: flex;
align-items: end;
gap: 12px;
}
.wfm-video-edit-crop-row > label {
display: flex;
flex-direction: column;
gap: 2px;
font-size: 11px;
color: var(--wfm-text-secondary);
margin: 0;
width: 110px;
}
#wfm-video-edit-crop-toggle.active {
background: var(--wfm-primary);
color: #fff;
}
/* Sourceプレビュー上のクロップ矩形。外側はbox-shadowで暗転、
.interactive時のみドラッグ(移動/四隅リサイズ)を受け付ける */
.wfm-video-edit-crop-layer {
position: absolute;
overflow: hidden;
pointer-events: none;
}
.wfm-video-edit-crop-rect {
position: absolute;
box-sizing: border-box;
border: 1px dashed rgba(255, 255, 255, 0.8);
box-shadow: 0 0 0 9999px rgba(0, 0, 0, 0.55);
}
.wfm-video-edit-crop-layer.interactive .wfm-video-edit-crop-rect {
pointer-events: auto;
cursor: move;
border: 2px solid var(--wfm-primary);
touch-action: none;
}
.wfm-video-edit-crop-handle {
display: none;
position: absolute;
width: 12px;
height: 12px;
background: var(--wfm-primary);
border: 1px solid #fff;
border-radius: 2px;
}
.wfm-video-edit-crop-layer.interactive .wfm-video-edit-crop-handle { display: block; }
.wfm-video-edit-crop-handle[data-h="nw"] { left: -7px; top: -7px; cursor: nwse-resize; }
.wfm-video-edit-crop-handle[data-h="ne"] { right: -7px; top: -7px; cursor: nesw-resize; }
.wfm-video-edit-crop-handle[data-h="sw"] { left: -7px; bottom: -7px; cursor: nesw-resize; }
.wfm-video-edit-crop-handle[data-h="se"] { right: -7px; bottom: -7px; cursor: nwse-resize; }
/* プレビュー枠上のテキスト近似表示レイヤー(実際の焼き込みはサーバー側)。
left/top/width/heightはJSが表示中の<video>/<img>の実寸に合わせて設定する */
.wfm-video-edit-text-layer {
position: absolute;
pointer-events: none;
overflow: hidden;
}
.wfm-video-edit-text-item {
position: absolute;
white-space: pre;
line-height: 1.2;
font-family: "Meiryo", "Yu Gothic", "Noto Sans JP", sans-serif;
}
.wfm-video-edit-text-item.outline {
text-shadow: -1px -1px 0 #000, 1px -1px 0 #000, -1px 1px 0 #000, 1px 1px 0 #000, 0 0 2px #000;
}
.wfm-video-edit-text-item.bg {
background: rgba(0, 0, 0, 0.55);
padding: 0.15em 0.3em;
border-radius: 0.3em;
}
.wfm-video-asset-detail label {
font-size: 12px;
color: var(--wfm-text-secondary);
@@ -654,6 +967,7 @@
}
.wfm-video-preview-frame {
position: relative;
flex: 1;
min-width: 0;
height: 260px;
@@ -799,3 +1113,59 @@
}
.wfm-video-project-item-delete:hover { color: var(--wfm-danger); }
/* ── Edit: 追加サウンド(オーディオトラックに配置する効果音など)のリスト ── */
.wfm-video-edit-sound-head { margin-top: 8px; }
.wfm-video-edit-sound-list { display: flex; flex-direction: column; gap: 6px; margin-top: 6px; }
.wfm-video-edit-sound-row {
padding: 4px 6px;
border: 1px solid var(--wfm-border);
border-left: 3px solid #f85149;
border-radius: 3px;
}
.wfm-video-edit-sound-row-head { display: flex; align-items: center; gap: 6px; }
.wfm-video-edit-sound-name { flex: 1; min-width: 0; font-size: 11px; overflow: hidden; text-overflow: ellipsis; white-space: nowrap; }
.wfm-video-edit-sound-grid { display: grid; grid-template-columns: repeat(3, minmax(0, 1fr)); gap: 4px; margin-top: 4px; }
.wfm-video-edit-sound-grid label { display: flex; flex-direction: column; font-size: 10px; color: var(--wfm-text-secondary); }
.wfm-video-edit-sound-grid input { min-width: 0; }
/* ── Edit: オーバーレイクリップ(PinP)パネル・プレビュー枠 ── */
.wfm-video-edit-pip-panel { margin-bottom: 10px; }
.wfm-video-edit-pip-row { border-left-color: #4a9eff; }
.wfm-video-edit-pip-preset { width: auto; max-width: 96px; padding: 0 2px; font-size: 10px; }
.wfm-video-edit-pip-box {
position: absolute;
box-sizing: border-box;
border: 1px dashed #4a9eff;
background: rgba(74, 158, 255, 0.15);
overflow: hidden;
}
.wfm-video-edit-pip-box img { width: 100%; height: 100%; object-fit: fill; display: block; pointer-events: none; }
/* ── Edit: ツールメニューはトラック表示(data-view)に連動 ──
video=トリム+クロップ / text=テキストオーバーレイ / pip=オーバーレイクリップ / audio=オーディオ。
書き出し(右の固定パネル)は常に表示。 */
.wfm-video-edit-tools { flex: 1; min-width: 0; }
.wfm-video-edit-tools .wfm-video-edit-pip-panel,
.wfm-video-edit-tools .wfm-video-edit-audio-panel { display: none; max-width: 480px; margin-top: 0; padding-top: 0; border-top: none; }
.wfm-video-edit-tools[data-view="pip"] .wfm-video-edit-pip-panel,
.wfm-video-edit-tools[data-view="audio"] .wfm-video-edit-audio-panel { display: block; }
.wfm-video-edit-tools[data-view="pip"] .wfm-video-edit-trim-panel,
.wfm-video-edit-tools[data-view="audio"] .wfm-video-edit-trim-panel { display: none; }
.wfm-video-edit-tools[data-view="video"] .wfm-video-edit-tool-text,
.wfm-video-edit-tools[data-view="text"] .wfm-video-edit-tool-trim { display: none; }
.wfm-video-edit-tools[data-view="text"] .wfm-video-edit-text-section { margin-top: 0; }
/* 透明な本物の<input type=file>をボタンに重ねる方式(label+display:none経由に頼らない) */
.wfm-video-edit-file-overlay { position: relative; overflow: hidden; }
.wfm-video-edit-file-overlay > input[type="file"] {
position: absolute;
inset: 0;
width: 100%;
height: 100%;
margin: 0;
padding: 0;
opacity: 0;
cursor: pointer;
font-size: 0;
}
+4
View File
@@ -553,6 +553,10 @@ function applyI18nToHtml() {
"wfm-help-settings-11": "helpSettings11", "wfm-help-settings-12": "helpSettings12",
"wfm-help-settings-13": "helpSettings13", "wfm-help-settings-14": "helpSettings14",
"wfm-help-settings-15": "helpSettings15", "wfm-help-settings-16": "helpSettings16",
"wfm-help-settings-17": "helpSettings17",
"wfm-help-settings-18": "helpSettings18", "wfm-help-settings-19": "helpSettings19",
"wfm-help-settings-20": "helpSettings20", "wfm-help-settings-21": "helpSettings21",
"wfm-help-settings-22": "helpSettings22",
"wfm-help-nodes-1": "helpNodes1", "wfm-help-nodes-2": "helpNodes2",
"wfm-help-nodes-3": "helpNodes3", "wfm-help-nodes-4": "helpNodes4",
"wfm-help-nodes-5": "helpNodes5", "wfm-help-nodes-6": "helpNodes6",
+9 -4
View File
@@ -1382,6 +1382,9 @@ export const comfyEditor = {
// (e.g. Flux2Scheduler has no named "scheduler" combo) so the field is disabled here.
const schedulerAvailable = !!sampler && sampler.schedulerNodeId != null;
const denoiseAvailable = !!sampler && sampler.denoiseNodeId != null;
// Advanced samplers fed by a dedicated sampler node without a sampler_name combo
// (e.g. Ming Image's SamplerLCM) have nothing for the Sampler dropdown to write to.
const samplerNameAvailable = !!sampler && (!sampler.advanced || sampler.samplerNodeId != null);
el.innerHTML = `
<div style="display:flex;flex-direction:row;gap:0;align-items:flex-start;">
@@ -1394,7 +1397,7 @@ export const comfyEditor = {
data-steps-node-id="${sampler.stepsNodeId ?? sampler.id}"
data-cfg-key="${sampler.cfgKey || "cfg"}"
data-cfg-node-id="${sampler.cfgNodeId ?? sampler.id}"
data-sampler-node-id="${sampler.samplerNodeId ?? sampler.id}"
data-sampler-node-id="${samplerNameAvailable ? (sampler.samplerNodeId ?? sampler.id) : ""}"
data-scheduler-node-id="${sampler.schedulerNodeId ?? ""}"
data-denoise-node-id="${sampler.denoiseNodeId ?? ""}">
<div class="wfm-form-group">
@@ -1411,8 +1414,10 @@ export const comfyEditor = {
</div>
<div class="wfm-form-group">
<label>Sampler</label>
<select class="wfm-select" id="wfm-settings-sampler-name">
${this.models.samplers.map((s) => `<option value="${s}" ${s === sampler.sampler_name ? "selected" : ""}>${s}</option>`).join("")}
<select class="wfm-select" id="wfm-settings-sampler-name" ${samplerNameAvailable ? "" : "disabled"}>
${samplerNameAvailable
? this.models.samplers.map((s) => `<option value="${s}" ${s === sampler.sampler_name ? "selected" : ""}>${s}</option>`).join("")
: `<option value="">N/A</option>`}
</select>
</div>
<div class="wfm-form-group">
@@ -1490,7 +1495,7 @@ export const comfyEditor = {
if (stepsEl?.value !== "") write(ds.stepsNodeId, "steps", parseInt(stepsEl.value) || 20);
const cfgEl = document.getElementById("wfm-settings-cfg");
if (cfgEl?.value !== "") write(ds.cfgNodeId, ds.cfgKey || "cfg", parseFloat(cfgEl.value) || 7);
write(ds.samplerNodeId, "sampler_name", document.getElementById("wfm-settings-sampler-name")?.value);
if (ds.samplerNodeId) write(ds.samplerNodeId, "sampler_name", document.getElementById("wfm-settings-sampler-name")?.value);
if (ds.schedulerNodeId) write(ds.schedulerNodeId, "scheduler", document.getElementById("wfm-settings-scheduler")?.value);
const denoiseEl = document.getElementById("wfm-settings-denoise");
if (ds.denoiseNodeId && denoiseEl?.value !== "") write(ds.denoiseNodeId, "denoise", parseFloat(denoiseEl.value) || 1.0);
+64 -12
View File
@@ -291,15 +291,26 @@ function _stripLegacyLinkedWidgetValues(objectInfo, remappedNode, sgDef, origInt
const allWidgetInputs = (remappedNode.inputs || []).filter((i) => i.widget);
if (!widgetsValues || allWidgetInputs.length === 0) return;
const widgetNames = _getWidgetInputNames(objectInfo, remappedNode.type);
const widgetTypes = _getWidgetInputTypes(objectInfo, remappedNode.type);
const isLinkedName = (name) => _isLinkedWidgetName(remappedNode, sgDef, origInternalId, redirectedTargets, name);
const comboExpander = (name, selectedKey) => _getDynamicComboSubNames(objectInfo, remappedNode.type, name, selectedKey);
remappedNode.widgets_values = _normalizeLinkedWidgetValues(objectInfo, remappedNode.type, widgetsValues, isLinkedName);
}
/**
* Return widgets_values with the entries belonging to linked widgets removed when the array is in
* the "legacy full" format (every widget present, linked ones included — what the current ComfyUI
* frontend actually saves for a widget converted to a wired input, e.g. EmptyLatentImage
* [1024, 2048, 1] with width/height fed by GetImageSize/PrimitiveInt). Returns the array unchanged
* when it's already in the modern format (linked widgets contribute zero entries).
*/
function _normalizeLinkedWidgetValues(objectInfo, nodeType, widgetsValues, isLinkedName) {
const widgetNames = _getWidgetInputNames(objectInfo, nodeType);
const widgetTypes = _getWidgetInputTypes(objectInfo, nodeType);
const comboExpander = (name, selectedKey) => _getDynamicComboSubNames(objectInfo, nodeType, name, selectedKey);
// If skipping linked widgets already accounts for every entry, widgets_values is already in
// the modern (no dangling linked entries) format — nothing to strip.
const skipSim = _simulateWidgetValues(widgetNames, widgetTypes, widgetsValues, isLinkedName, true, comboExpander);
if (skipSim.consumed === widgetsValues.length) return;
if (skipSim.consumed === widgetsValues.length) return widgetsValues;
// Otherwise it's "legacy full": recompute with every widget present to find exactly which
// indices the linked ones occupy — including any control_after_generate extra a linked
@@ -311,9 +322,7 @@ function _stripLegacyLinkedWidgetValues(objectInfo, remappedNode, sgDef, origInt
for (const i of fullSim.consumedIndices[name] || []) linkedIdx.add(i);
}
}
if (linkedIdx.size > 0) {
remappedNode.widgets_values = widgetsValues.filter((_, i) => !linkedIdx.has(i));
}
return linkedIdx.size > 0 ? widgetsValues.filter((_, i) => !linkedIdx.has(i)) : widgetsValues;
}
/**
@@ -692,7 +701,14 @@ export const comfyWorkflow = {
});
// 2. Map widgets_values to widget input names using object_info
const widgets = node.widgets_values || [];
let widgets = node.widgets_values || [];
// Widgets converted to wired inputs (e.g. EmptyLatentImage width/height fed by
// GetImageSize) usually still keep their value in widgets_values — strip those so the
// loop below, which assumes linked widgets contribute zero entries, doesn't shift every
// later widget (otherwise batch_size silently becomes the stale width value).
if (Array.isArray(widgets) && widgets.length > 0 && linkedSlotNames.size > 0 && !node.properties?.__lm_widget_ids) {
widgets = _normalizeLinkedWidgetValues(objectInfo, node.type, widgets, (name) => linkedSlotNames.has(name));
}
if (widgets.length > 0) {
// Lora Loader (LoraManager): use __lm_widget_ids from node properties
// widgets_values: [autocomplete_meta_obj, text_str, loras_array]
@@ -1085,7 +1101,7 @@ export const comfyWorkflow = {
// TextEncodeQwenImageEditPlus/TextEncodeQwenImageEdit — propagate role through its
// linked "prompt" input when prompt-enhancement wiring feeds it via a switch chain
// instead of a literal string (e.g. Krea-2's image-reference workflow).
if (ct === "TextEncodeQwenImageEditPlus" || ct === "TextEncodeQwenImageEdit") {
if (ct === "TextEncodeQwenImageEditPlus" || ct === "TextEncodeQwenImageEdit" || ct === "TextEncodeMingImageEdit") {
const tv = inputs.prompt;
if (Array.isArray(tv)) {
if (isPos) samplerPositiveRef[tv[0]] = true;
@@ -1167,7 +1183,11 @@ export const comfyWorkflow = {
cfg: typeof guiderInputs[guiderCfgKey] === "number" ? guiderInputs[guiderCfgKey] : undefined,
cfgNodeId: guiderCfgKey in guiderInputs ? guiderId : null,
cfgKey: guiderCfgKey,
sampler_name: samplerSelInputs.sampler_name, samplerNodeId: samplerSelId,
// samplerNodeId is null when the SAMPLER source has no sampler_name combo at all
// (e.g. Ming Image's SamplerLCM, a dedicated sampler node with its own
// s_noise knobs instead of KSamplerSelect) — the Settings UI disables the field.
sampler_name: samplerSelInputs.sampler_name,
samplerNodeId: "sampler_name" in samplerSelInputs ? samplerSelId : null,
scheduler: undefined, schedulerNodeId: "scheduler" in schedulerInputs ? schedulerId : null,
denoise: typeof schedulerInputs.denoise === "number" ? schedulerInputs.denoise : undefined,
denoiseNodeId: "denoise" in schedulerInputs ? schedulerId : null,
@@ -1270,7 +1290,11 @@ export const comfyWorkflow = {
// the base variant takes one — both share the same "prompt" widget). Only add when
// "prompt" is a direct string; if linked (e.g. Krea-2's prompt-enhancement wiring),
// the upstream literal node is resolved instead via the role propagation above.
if (ct === "TextEncodeQwenImageEditPlus" || ct === "TextEncodeQwenImageEdit") {
// TextEncodeMingImageEdit (Ming Image) has the same single "prompt" widget plus up to
// 8 optional images.image_N reference inputs (none wired = pure T2I); its role comes
// from the sampler/guider wiring — Ming's layer-decomposition workflows use a second,
// empty-prompt instance of it as the KSampler negative.
if (ct === "TextEncodeQwenImageEditPlus" || ct === "TextEncodeQwenImageEdit" || ct === "TextEncodeMingImageEdit") {
const textVal = inputs.prompt;
if (typeof textVal === "string") {
result.prompt_nodes.push({
@@ -1296,6 +1320,28 @@ export const comfyWorkflow = {
}
}
// TextEncodeQwenImage21 (Qwen Image 2.1 unified T2I/Edit encoder) — prompt +
// negative_prompt in one node (fixed roles, same shape as TextEncodeBooguEdit).
// Also carries a "resolution" pixel-budget int (not width/height) and up to 10
// optional images.image_N reference inputs (image_1 is the edit target when wired;
// with no images connected the node behaves as pure T2I). The reference images
// themselves need no special handling here — they arrive as ordinary LoadImage
// nodes already picked up generically by the load_image_nodes pass below.
if (ct === "TextEncodeQwenImage21") {
if (typeof inputs.prompt === "string") {
result.prompt_nodes.push({
id, type: ct, title: `${title} [positive]`, role: "positive",
text: inputs.prompt, textKey: "prompt",
});
}
if (typeof inputs.negative_prompt === "string") {
result.prompt_nodes.push({
id, type: ct, title: `${title} [negative]`, role: "negative",
text: inputs.negative_prompt, textKey: "negative_prompt",
});
}
}
// Mage-Flow text encoder — prompt + negative_prompt in one node (fixed roles,
// unlike KSampler-derived getRole() since both wires originate from this node)
if (ct === "TextEncodeMageFlowEdit") {
@@ -1383,7 +1429,10 @@ export const comfyWorkflow = {
// GetImageSize node (auto-follows the reference image) rather than a direct number —
// leave those as undefined, same treatment as TextEncodeMageFlowEdit below, so the
// settings-tab UI shows "linked" instead of a stale default and Apply doesn't clobber it.
if (ct === "EmptyLatentImage" || ct === "EmptySD3LatentImage" || ct === "EmptyFlux2LatentImage") {
// EmptyQwenImageLayeredLatentImage (Qwen-Image-Layered / Ming Image layer decomposition)
// has the same width/height/batch_size shape plus a "layers" count, left as-is.
if (ct === "EmptyLatentImage" || ct === "EmptySD3LatentImage" || ct === "EmptyFlux2LatentImage"
|| ct === "EmptyQwenImageLayeredLatentImage") {
result.latent_nodes.push({
id, type: ct, title,
width: typeof inputs.width === "number" ? inputs.width : undefined,
@@ -1651,6 +1700,9 @@ function _getWidgetMapping(nodeType) {
ImpactWildcardProcessor: ["wildcard_text"],
ImpactWildcardEncode: ["wildcard_text"],
WFS_PromptText: ["positive", "negative"],
TextEncodeQwenImage21: ["prompt", "negative_prompt", "resolution"],
TextEncodeMingImageEdit: ["prompt"],
EmptyQwenImageLayeredLatentImage: ["width", "height", "layers", "batch_size"],
};
return mappings[nodeType] || null;
}
+252
View File
@@ -0,0 +1,252 @@
/**
* Decision model client (Unsloth Decision API / Laya, Ollama 0.35+ / tev1・nimble).
*
* Laya is a *decision* model, not a generator: it takes a state (text or any JSON) plus typed
* questions and returns calibrated probabilities in one forward pass — no free-form output, so no
* format hallucination, and results can be thresholded directly. Text only (no image input):
* image-based judgments must first be turned into text (Tagger tags / VLM caption).
*
* Both backends speak the same TypeSafe-compatible POST /v1/systemone. Unsloth needs an API key
* even on localhost (unless Keyless API access is on), so its requests go through the same
* server-side proxy as the Unsloth chat backend (py/routes/unsloth_routes.py, key from .env).
* Ollama needs no key and allows CORS, so it's called directly from the browser like the existing
* Ollama LLM backend. Backend/URL/model/threshold come from the Settings tab's own
* "Decision Model" section (wfm_decision_settings), independent of the AI TOOL / Tagger backends so
* a decision model can run alongside whichever LLM/VLM those use.
* API reference: https://unsloth.ai/docs/models/decision-laya,
* https://github.com/ollama/ollama/releases/tag/v0.35.0
*
* Usage (threshold defaults to the Settings tab value when omitted):
* import { decide, noul, choice, score, isYes, pickChoice } from "./decision-client.js";
* const answers = await decide(promptText, {
* genre: choice("Which genre fits best?", { portrait: "a person is the main subject", landscape: "scenery" }),
* text: noul("Does the image contain rendered text?"),
* nsfw: score("How sexually explicit is this?", ["none", "suggestive", "explicit"]),
* });
* const genre = pickChoice(answers.genre, 0.8); // { value, probability, confident }
*/
import { unslothProxy, readJsonStorage } from "./util.js";
// Limits documented by Unsloth's Decision API.
export const DECISION_LIMITS = { maxQuestions: 64, maxChoiceOptions: 255, maxScoreLevels: 10 };
// Unsloth: "laya" = the model picked in Unsloth's settings. Explicit variants: "laya-multilingual"
// (default download, 100+ languages), "laya-english", "laya-typed-decisions" (structured data such
// as JSON records — e.g. workflow node summaries).
// Ollama: decision models are ordinary pulled models whose /api/tags capabilities include
// "decision" — listed live by listDecisionModels(); `models` below are only pull suggestions
// (tev1 = 4B / 4.5 GB, tev1:0.8b = 812 MB, nimble = 9B / 9.5 GB).
export const DECISION_BACKENDS = {
unsloth: {
label: "Unsloth",
defaultUrl: "http://localhost:8888",
models: ["laya", "laya-multilingual", "laya-english", "laya-typed-decisions"],
defaultModel: "laya",
},
ollama: {
label: "Ollama",
defaultUrl: "http://localhost:11434",
models: ["tev1", "tev1:0.8b", "nimble"],
defaultModel: "tev1",
},
};
export const DECISION_MODELS = DECISION_BACKENDS.unsloth.models;
export const DEFAULT_DECISION_MODEL = DECISION_BACKENDS.unsloth.defaultModel;
export const DECISION_SETTINGS_KEY = "wfm_decision_settings";
const DEFAULT_SETTINGS = {
backend: "unsloth",
baseUrl: DECISION_BACKENDS.unsloth.defaultUrl,
model: DEFAULT_DECISION_MODEL,
threshold: 0.8,
};
/** Saved Decision Model settings merged over the defaults. */
export function getDecisionSettings() {
const saved = readJsonStorage(DECISION_SETTINGS_KEY);
const merged = { ...DEFAULT_SETTINGS, ...saved };
const th = Number(merged.threshold);
merged.threshold = th > 0 && th <= 1 ? th : DEFAULT_SETTINGS.threshold;
if (!DECISION_BACKENDS[merged.backend]) merged.backend = DEFAULT_SETTINGS.backend;
const backend = DECISION_BACKENDS[merged.backend];
if (!merged.baseUrl) merged.baseUrl = backend.defaultUrl;
// A model name from the other backend (e.g. "laya" after switching to Ollama) can't work.
const isLaya = /^laya/.test(merged.model || "");
if (!merged.model || (merged.backend === "ollama" && isLaya) || (merged.backend === "unsloth" && !isLaya)) {
merged.model = backend.defaultModel;
}
return merged;
}
/**
* Model choices for the Settings dropdown. Unsloth: its fixed Laya names. Ollama: installed models
* whose /api/tags capabilities include "decision" (throws if Ollama can't be reached). Returns
* { models, installed } — installed is false for Unsloth (names aren't checked against the server).
*/
export async function listDecisionModels(backend, baseUrl) {
if (backend !== "ollama") return { models: [...DECISION_BACKENDS.unsloth.models], installed: false };
const res = await fetch(`${(baseUrl || DECISION_BACKENDS.ollama.defaultUrl).replace(/\/+$/, "")}/api/tags`);
if (!res.ok) throw new Error(`HTTP ${res.status}`);
const data = await res.json();
const models = (data.models || [])
.filter((m) => Array.isArray(m.capabilities) && m.capabilities.includes("decision"))
.map((m) => m.name)
.sort();
return { models, installed: true };
}
export function saveDecisionSettings(patch) {
const data = { ...getDecisionSettings(), ...patch };
localStorage.setItem(DECISION_SETTINGS_KEY, JSON.stringify(data));
return data;
}
// ---- Question builders ----
/** Yes/no question — answer.noul is the probability of "yes" (0..1). */
export function noul(instructions) {
return { type: "noul", instructions };
}
/**
* Pick-one question. criteria: an array of option names, or { option: description } — descriptions
* noticeably improve accuracy (options share a token budget, so past ~20 described options the
* descriptions get trimmed).
*/
export function choice(instructions, criteria) {
return { type: "choice", instructions, criteria };
}
/** Rating question. levels: ordered labels from lowest (0) to highest, 2..10 entries. */
export function score(instructions, levels) {
return { type: "score", instructions, criteria: levels };
}
// ---- Request ----
function _validateQuestions(questions) {
const entries = Object.entries(questions || {});
if (entries.length === 0) throw new Error("decide(): no questions given");
if (entries.length > DECISION_LIMITS.maxQuestions) {
throw new Error(`decide(): ${entries.length} questions exceeds the limit of ${DECISION_LIMITS.maxQuestions}`);
}
for (const [key, q] of entries) {
if (!q || !["noul", "choice", "score"].includes(q.type)) {
throw new Error(`decide(): question "${key}" has an unknown type`);
}
const n = Array.isArray(q.criteria) ? q.criteria.length : Object.keys(q.criteria || {}).length;
if (q.type === "choice" && (n < 2 || n > DECISION_LIMITS.maxChoiceOptions)) {
throw new Error(`decide(): choice "${key}" needs 2-${DECISION_LIMITS.maxChoiceOptions} options (got ${n})`);
}
if (q.type === "score" && (n < 2 || n > DECISION_LIMITS.maxScoreLevels)) {
throw new Error(`decide(): score "${key}" needs 2-${DECISION_LIMITS.maxScoreLevels} levels (got ${n})`);
}
}
}
/**
* Ask typed questions about one state. Returns the raw `answers` object keyed like `questions`.
* The first call after Unsloth starts loads the model (10-20 s); later calls are sub-second on CPU.
*
* @param {string|object} state Text or any JSON (e.g. { prompt, tags, model }).
* @param {object} questions { key: noul(...) | choice(...) | score(...) }, max 64.
* @param {object} [opts] { backend, model, baseUrl } — override the saved Decision Model settings.
*/
export async function decide(state, questions, opts = {}) {
_validateQuestions(questions);
const settings = getDecisionSettings();
const backend = opts.backend || settings.backend;
const baseUrl = (opts.baseUrl || settings.baseUrl).replace(/\/+$/, "");
const payload = { model: opts.model || settings.model, state, questions };
let data;
if (backend === "ollama") {
const res = await fetch(`${baseUrl}/v1/systemone`, {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify(payload),
});
data = await res.json().catch(() => ({}));
// Ollama reports failures as { error } (e.g. 'model "tev1" not found, try pulling it first').
if (!res.ok) throw new Error(data.error || `HTTP ${res.status}`);
} else {
data = await unslothProxy(baseUrl, "/v1/systemone", "POST", payload);
}
if (!data || typeof data.answers !== "object") throw new Error(data?.error || "Decision API returned no answers");
return data.answers;
}
/**
* Run decide() over many states with a small concurrency cap (the model runs locally, so flooding
* it only queues requests). Per-item failures are returned as { error } instead of rejecting all.
*/
export async function decideMany(states, questions, opts = {}) {
const concurrency = Math.max(1, opts.concurrency || 2);
const results = new Array(states.length);
let next = 0;
const worker = async () => {
while (next < states.length) {
const i = next++;
try {
results[i] = { answers: await decide(states[i], questions, opts) };
} catch (e) {
results[i] = { error: e.message };
}
opts.onProgress?.(i, results[i]);
}
};
await Promise.all(Array.from({ length: Math.min(concurrency, states.length) }, worker));
return results;
}
/**
* Connection check for the Settings tab: one yes/no question, timed. The first request after
* Unsloth starts also loads the model (10-20 s), so callers should say that a slow first test is
* normal.
*/
export async function testDecisionConnection(opts = {}) {
const started = performance.now();
const answers = await decide("A cat is sitting on a sofa.", {
test: noul("Is there an animal in the text?"),
}, opts);
return { ms: Math.round(performance.now() - started), yes: answers.test?.noul };
}
// ---- Answer helpers ----
// Threshold on `probabilities` (or noul's value), not `confidence` — per Unsloth's docs, confidence
// only says how peaked the distribution is and its formula differs from Jev's.
/** True when the yes-probability of a noul answer reaches `threshold`. */
export function isYes(answer, threshold = getDecisionSettings().threshold) {
return typeof answer?.noul === "number" && answer.noul >= threshold;
}
/**
* Most likely option of a choice answer. `confident` is false below `threshold` — callers should
* then show the value as a suggestion for the user to confirm rather than apply it automatically.
*/
export function pickChoice(answer, threshold = getDecisionSettings().threshold) {
const value = answer?.choice ?? null;
const probability = value != null ? (answer.probabilities?.[value] ?? 0) : 0;
return { value, probability, confident: value != null && probability >= threshold };
}
/**
* Most likely level of a score answer: { level (index from 0), label, value (expected score,
* fractional), probability, confident }.
*/
export function pickScore(answer, threshold = getDecisionSettings().threshold) {
const probs = answer?.probabilities || {};
let level = null, probability = 0;
for (const [k, p] of Object.entries(probs)) {
if (p > probability) { level = Number(k); probability = p; }
}
return {
level,
label: level != null ? (answer.legend?.[String(level)] ?? null) : null,
value: typeof answer?.score === "number" ? answer.score : null,
probability,
confident: level != null && probability >= threshold,
};
}
+312 -33
View File
File diff suppressed because one or more lines are too long
+20 -14
View File
@@ -359,18 +359,16 @@ function extractPromptsFromNodeSet(nodes, links) {
continue;
}
if (!isTextEncoderNode(type)) continue;
const text = n.widgets_values?.[0];
if (text && typeof text === "string") {
textMap.set(n.id, text);
} else if (Array.isArray(n.inputs)) {
const textInput = n.inputs.find(inp => inp.name === "text" || inp.name === "text_g" || inp.name === "prompt");
if (textInput?.link != null) {
const originId = linkOrigin.get(textInput.link);
const originSlot = linkSlot.get(textInput.link) ?? 0;
const text2 = resolveLinkedTextInNodeSet(nodeMap, linkOrigin, linkSlot, originId, originSlot);
if (text2) textMap.set(n.id, text2);
}
}
// A text widget converted to a wired input keeps its last typed value in widgets_values[0]
// (stale — never sent to the backend), so the linked source must win over it.
const textInput = Array.isArray(n.inputs)
? n.inputs.find(inp => inp.name === "text" || inp.name === "text_g" || inp.name === "prompt")
: null;
const linkedText = textInput?.link != null && linkOrigin.has(textInput.link)
? resolveLinkedTextInNodeSet(nodeMap, linkOrigin, linkSlot, linkOrigin.get(textInput.link), linkSlot.get(textInput.link) ?? 0)
: null;
const text = linkedText || n.widgets_values?.[0];
if (text && typeof text === "string") textMap.set(n.id, text);
}
const pos = new Set(), neg = new Set();
let foundSampler = false;
@@ -381,11 +379,13 @@ function extractPromptsFromNodeSet(nodes, links) {
// Guider node (CFGGuider/DualCFGGuider/BasicGuider) via its "guider" input. Scan that
// node's inputs instead so the loop below can find the positive/negative-role slots.
let inputsToScan = n.inputs;
let viaBasicGuider = false;
const guiderInput = n.inputs.find(inp => inp.name === "guider");
if (guiderInput?.link != null) {
const guiderId = linkOrigin.get(guiderInput.link);
const guiderNode = guiderId != null ? nodeMap.get(guiderId) : null;
if (Array.isArray(guiderNode?.inputs)) inputsToScan = guiderNode.inputs;
viaBasicGuider = guiderNode?.type === "BasicGuider";
}
for (const inp of inputsToScan) {
if (!inp || inp.link == null) continue;
@@ -393,7 +393,9 @@ function extractPromptsFromNodeSet(nodes, links) {
if (originId == null) continue;
const name = inp.name ?? "";
// DualCFGGuider (HiDream E1): cond1 carries the positive-derived conditioning.
const isPos = name === "positive" || name === "cond1" || name.startsWith("positive");
// BasicGuider (Flux/Ming Image etc., no negative): its single "conditioning" input is positive.
const isPos = name === "positive" || name === "cond1" || name.startsWith("positive")
|| (viaBasicGuider && name === "conditioning");
const isNeg = name === "negative" || name.startsWith("negative");
if (!isPos && !isNeg) continue;
// TextEncodeMageFlowEdit / TextEncodeBooguEdit — one node carries both prompt &
@@ -562,14 +564,18 @@ function extractPromptsAPI(wf) {
// Guider node (CFGGuider/DualCFGGuider/BasicGuider) via its "guider" input. Scan that
// node's inputs instead so the loop below can find the positive/negative-role keys.
let inputsToScan = n.inputs ?? {};
let viaBasicGuider = false;
if (Array.isArray(n.inputs?.guider)) {
const guiderNode = wf[String(n.inputs.guider[0])];
if (guiderNode?.inputs) inputsToScan = guiderNode.inputs;
viaBasicGuider = guiderNode?.class_type === "BasicGuider";
}
for (const [key, val] of Object.entries(inputsToScan)) {
if (!Array.isArray(val)) continue;
// DualCFGGuider (HiDream E1): cond1 carries the positive-derived conditioning.
const isPos = key === "positive" || key === "cond1" || key.startsWith("positive");
// BasicGuider (Flux/Ming Image etc., no negative): its single "conditioning" input is positive.
const isPos = key === "positive" || key === "cond1" || key.startsWith("positive")
|| (viaBasicGuider && key === "conditioning");
const isNeg = key === "negative" || key.startsWith("negative");
if (!isPos && !isNeg) continue;
// TextEncodeMageFlowEdit / TextEncodeBooguEdit — one node carries both prompt &
+135 -3
View File
@@ -6,7 +6,8 @@ import { showToast } from "./app.js";
import { comfyUI } from "./comfyui-client.js";
import { t, getLang, getSummaryLang, setLang, setSummaryLang, getLanguageOptions, getSummaryLanguageOptions } from "./i18n.js";
import { getSettings, readJsonStorage } from "./util.js";
import { getSettings, readJsonStorage, escapeHtml } from "./util.js";
import { DECISION_BACKENDS, getDecisionSettings, saveDecisionSettings, testDecisionConnection, listDecisionModels } from "./decision-client.js";
const SETTINGS_KEY = "wfm_settings";
@@ -455,6 +456,7 @@ export async function initSettingsTab() {
const uiLang = getLang();
const summaryLang = getSummaryLang();
const decisionSettings = getDecisionSettings();
container.innerHTML = `
<h2 style="font-size:18px;margin-bottom:20px;">${t("settingsTitle")}</h2>
@@ -803,6 +805,49 @@ export async function initSettingsTab() {
</div>
</details>
<!-- Decision Model (Laya) — independent of the AI TOOL / Tagger LLM/VLM backends -->
<details class="wfm-settings-section">
<summary class="wfm-settings-summary">${t("decisionSection")}</summary>
<small style="color:var(--wfm-text-secondary);font-size:11px;display:block;margin-bottom:8px;">
${t("decisionHint")}
</small>
<div class="wfm-form-group">
<label>${t("decisionBackend")}</label>
<select class="wfm-select" id="wfm-settings-decision-backend">
${Object.entries(DECISION_BACKENDS).map(([b, def]) => `<option value="${b}" ${decisionSettings.backend === b ? "selected" : ""}>${def.label}</option>`).join("")}
</select>
</div>
<div class="wfm-form-group">
<label>${t("decisionUrl")}</label>
<div style="display:flex;gap:8px;">
<input type="text" class="wfm-input" id="wfm-settings-decision-url"
value="${decisionSettings.baseUrl}"
placeholder="${DECISION_BACKENDS[decisionSettings.backend].defaultUrl}">
<button class="wfm-btn" id="wfm-settings-decision-test">${t("test")}</button>
</div>
<div id="wfm-settings-decision-status" style="font-size:12px;margin-top:4px;"></div>
</div>
<div class="wfm-form-group">
<label>${t("decisionModel")}</label>
<div style="display:flex;gap:8px;">
<select class="wfm-select" id="wfm-settings-decision-model" style="flex:1;">
<option value="${escapeHtml(decisionSettings.model)}" selected>${escapeHtml(decisionSettings.model)}</option>
</select>
<button class="wfm-btn" id="wfm-settings-decision-refresh" title="${t("decisionRefreshModels")}">&#8635;</button>
</div>
<div id="wfm-settings-decision-model-hint" style="font-size:11px;color:var(--wfm-text-secondary);margin-top:4px;"></div>
</div>
<div class="wfm-form-group">
<label>${t("decisionThreshold")}</label>
<input type="number" class="wfm-input" id="wfm-settings-decision-threshold"
value="${decisionSettings.threshold}" min="0.5" max="0.99" step="0.05" style="width:100px;">
<small style="color:var(--wfm-text-secondary);font-size:11px;display:block;margin-top:4px;">
${t("decisionThresholdHint")}
</small>
</div>
<button class="wfm-btn wfm-btn-primary wfm-btn-sm" id="wfm-settings-decision-save">${t("save")}</button>
</details>
<!-- G'MIC Integration -->
<details class="wfm-settings-section">
<summary class="wfm-settings-summary">G'MIC-Qt Integration</summary>
@@ -842,6 +887,10 @@ export async function initSettingsTab() {
<input type="checkbox" id="wfm-settings-backup-include-wildcard">
${t("fullBackupIncludeWildcard")}
</label>
<label class="wfm-lab-checkbox-label" style="font-size:12px;">
<input type="checkbox" id="wfm-settings-backup-include-video-media">
${t("fullBackupIncludeVideoMedia")}
</label>
<span style="font-size:11px;color:var(--wfm-text-secondary);">${t("fullBackupExternalHint")}</span>
</div>
<div style="display:flex;gap:8px;flex-wrap:wrap;">
@@ -1237,6 +1286,82 @@ export async function initSettingsTab() {
}
});
// --- Decision Model (Laya) ---
const readDecisionForm = () => {
const baseUrl = document.getElementById("wfm-settings-decision-url")?.value.trim() || "";
const threshold = parseFloat(document.getElementById("wfm-settings-decision-threshold")?.value);
let urlOk = false;
try { urlOk = ["http:", "https:"].includes(new URL(baseUrl).protocol); } catch {}
if (!urlOk) throw new Error(t("decisionInvalidUrl"));
if (!(threshold >= 0.5 && threshold <= 0.99)) throw new Error(t("decisionInvalidThreshold"));
return {
backend: document.getElementById("wfm-settings-decision-backend")?.value || "unsloth",
baseUrl,
model: document.getElementById("wfm-settings-decision-model")?.value || "",
threshold,
};
};
// Unsloth: fixed Laya names. Ollama: installed models whose capabilities include "decision";
// none installed (or Ollama unreachable) → keep the preferred name selectable and show why.
const refreshDecisionModels = async (preferred) => {
const backend = document.getElementById("wfm-settings-decision-backend")?.value || "unsloth";
const baseUrl = document.getElementById("wfm-settings-decision-url")?.value.trim() || "";
const select = document.getElementById("wfm-settings-decision-model");
const hint = document.getElementById("wfm-settings-decision-model-hint");
if (!select) return;
const def = DECISION_BACKENDS[backend];
const current = preferred ?? select.value;
let models = [];
let hintText = "";
try {
({ models } = await listDecisionModels(backend, baseUrl));
if (backend === "ollama" && models.length === 0) hintText = t("decisionNoOllamaModels");
} catch (err) {
hintText = `${t("failedConnect")}: ${err.message}`;
}
const list = models.length ? [...models] : [...def.models];
if (current && !list.includes(current) && (backend === "ollama") === !/^laya/.test(current)) list.unshift(current);
const selected = list.includes(current) ? current : (list.includes(def.defaultModel) ? def.defaultModel : list[0]);
select.innerHTML = list.map((m) => `<option value="${escapeHtml(m)}" ${m === selected ? "selected" : ""}>${m === "laya" ? t("decisionModelLaya") : escapeHtml(m)}</option>`).join("");
if (hint) hint.textContent = hintText;
};
refreshDecisionModels(decisionSettings.model);
document.getElementById("wfm-settings-decision-refresh")?.addEventListener("click", () => refreshDecisionModels());
document.getElementById("wfm-settings-decision-backend")?.addEventListener("change", (e) => {
const urlInput = document.getElementById("wfm-settings-decision-url");
const def = DECISION_BACKENDS[e.target.value]?.defaultUrl;
if (urlInput && def) { urlInput.value = def; urlInput.placeholder = def; }
refreshDecisionModels(DECISION_BACKENDS[e.target.value]?.defaultModel);
});
document.getElementById("wfm-settings-decision-save")?.addEventListener("click", () => {
try {
saveDecisionSettings(readDecisionForm());
showToast(t("settingsSaved"), "success");
} catch (err) {
showToast(err.message, "error");
}
});
// Tests the values currently in the form (saved or not), same as the Eagle test button.
document.getElementById("wfm-settings-decision-test")?.addEventListener("click", async () => {
const statusEl = document.getElementById("wfm-settings-decision-status");
let form;
try { form = readDecisionForm(); } catch (err) {
statusEl.textContent = err.message;
statusEl.style.color = "var(--wfm-danger)";
return;
}
statusEl.textContent = t("decisionTesting");
statusEl.style.color = "var(--wfm-text-secondary)";
try {
const { ms, yes } = await testDecisionConnection({ backend: form.backend, baseUrl: form.baseUrl, model: form.model });
statusEl.textContent = `${t("connectedCheck")} ${t("decisionTestOk").replace("{ms}", ms).replace("{yes}", typeof yes === "number" ? yes.toFixed(3) : "?")}`;
statusEl.style.color = "var(--wfm-success)";
} catch (err) {
statusEl.textContent = `${t("failedConnect")}: ${err.message}`;
statusEl.style.color = "var(--wfm-danger)";
}
});
// Test Eagle URL (via server proxy to avoid CORS)
document.getElementById("wfm-settings-test-eagle")?.addEventListener("click", async () => {
const urlInput = document.getElementById("wfm-settings-eagle-url");
@@ -1491,7 +1616,8 @@ export async function initSettingsTab() {
try {
const includeWorkflows = document.getElementById("wfm-settings-backup-include-workflows")?.checked ? "1" : "0";
const includeWildcard = document.getElementById("wfm-settings-backup-include-wildcard")?.checked ? "1" : "0";
const res = await fetch(`/api/wfm/settings/export-full?include_workflows=${includeWorkflows}&include_wildcard=${includeWildcard}`);
const includeVideoMedia = document.getElementById("wfm-settings-backup-include-video-media")?.checked ? "1" : "0";
const res = await fetch(`/api/wfm/settings/export-full?include_workflows=${includeWorkflows}&include_wildcard=${includeWildcard}&include_video_media=${includeVideoMedia}`);
if (!res.ok) throw new Error(await res.text());
const blob = await res.blob();
const url = URL.createObjectURL(blob);
@@ -1522,7 +1648,13 @@ export async function initSettingsTab() {
});
const result = await res.json();
if (!res.ok) throw new Error(result.error || res.statusText);
statusEl.textContent = `${t("importSuccess")}: ${result.extracted?.length ?? 0} ${t("fullBackupFilesUnit")}`;
let msg = `${t("importSuccess")}: ${result.extracted?.length ?? 0} ${t("fullBackupFilesUnit")}`;
const restoredMedia = result.media_restored?.length ?? 0;
const existingMedia = result.media_existing?.length ?? 0;
if (restoredMedia || existingMedia) {
msg += ` / ${t("fullBackupMediaResult").replace("{restored}", restoredMedia).replace("{existing}", existingMedia)}`;
}
statusEl.textContent = msg;
statusEl.style.color = "var(--wfm-success, #4caf50)";
} catch (e) {
statusEl.textContent = t("importError") + ": " + e.message;
+48 -3
View File
@@ -12,7 +12,7 @@ import { VIDEO_GROUP, VTEMP_GROUP, ensureVideoGroup, isVideoFile } from "./galle
import { setSourcePreview } from "./video-preview.js";
import { showToast } from "./app.js";
import { t } from "./i18n.js";
import { addClipFromFile } from "./video-edit-tab.js";
import { addClipFromFile, setBgmFromFile, addPipFromFile } from "./video-edit-tab.js";
import { setBlockImageFromFile } from "./video-plan-tab.js";
// Sentinel for the "All Video Assets" option — not a real backend group, since
@@ -33,6 +33,7 @@ const _s = {
loaded: false, // becomes true once the Asset subtab has been shown at least once
searchQuery: "",
viewMode: "grid", // "grid" | "table"
kindFilter: "all", // "all" | "video" | "image"
};
function _formatDate(mtime) {
@@ -41,8 +42,11 @@ function _formatDate(mtime) {
function _filteredImages() {
const q = _s.searchQuery.trim().toLowerCase();
if (!q) return _s.images;
return _s.images.filter((img) => img.filename.toLowerCase().includes(q));
let list = _s.images;
if (_s.kindFilter === "video") list = list.filter((img) => isVideoFile(img));
else if (_s.kindFilter === "image") list = list.filter((img) => !isVideoFile(img));
if (q) list = list.filter((img) => img.filename.toLowerCase().includes(q));
return list;
}
async function _fetchOutputDir() {
@@ -238,6 +242,8 @@ function _renderDetail(img) {
<textarea id="wfm-video-asset-memo" class="wfm-textarea" rows="3"></textarea>
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-memo-save" style="margin-top:6px;">Save Memo</button>
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-send-to-edit" style="width:100%;margin-top:12px;">${t("videoEditSendToEdit")}</button>
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-add-overlay" style="width:100%;margin-top:6px;">${t("videoAssetAddAsOverlay")}</button>
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-set-bgm" style="width:100%;margin-top:6px;display:${isVideoFile(img) ? "block" : "none"};">${t("videoAssetSetAsBgm")}</button>
<div id="wfm-video-asset-set-plan-image-row" style="display:${isVideoFile(img) ? "none" : "flex"};gap:6px;margin-top:6px;">
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-set-first" style="flex:1;">${t("videoAssetSetAsFirst")}</button>
<button type="button" class="wfm-btn wfm-btn-sm" id="wfm-video-asset-set-last" style="flex:1;">${t("videoAssetSetAsLast")}</button>
@@ -283,6 +289,41 @@ function _renderDetail(img) {
}
});
// Overlay clip (picture-in-picture): works for both videos and images, and
// jumps to the Edit subtab's Overlay track so the new clip is visible.
panel.querySelector("#wfm-video-asset-add-overlay")?.addEventListener("click", async () => {
try {
const res = await fetch(`/wfm/gallery/image/serve?path=${encodeURIComponent(img.path)}`);
if (!res.ok) throw new Error(String(res.status));
const blob = await res.blob();
const file = new File([blob], img.filename, { type: blob.type || (isVideoFile(img) ? "video/mp4" : "image/png") });
if (await addPipFromFile(file, img.filename)) {
document.querySelector('.wfm-video-center-panel .wfm-video-subtab-btn[data-video-subtab="edit"]')?.click();
document.getElementById("wfm-video-edit-track-pip")?.click();
showToast(t("videoAssetAddAsOverlayDone", img.filename), "success");
}
} catch (err) {
showToast(t("errorWithMsg", err.message), "error");
}
});
// Gallery lists no audio files, so a video asset's own audio track is the
// Asset-side way to pick a BGM (LoadAudio decodes audio from video files).
panel.querySelector("#wfm-video-asset-set-bgm")?.addEventListener("click", async () => {
try {
const res = await fetch(`/wfm/gallery/image/serve?path=${encodeURIComponent(img.path)}`);
if (!res.ok) throw new Error(String(res.status));
const blob = await res.blob();
const file = new File([blob], img.filename, { type: blob.type || "video/mp4" });
if (await setBgmFromFile(file, img.filename)) {
document.querySelector('.wfm-video-center-panel .wfm-video-subtab-btn[data-video-subtab="edit"]')?.click();
showToast(t("videoAssetSetAsBgmDone", img.filename), "success");
}
} catch (err) {
showToast(t("errorWithMsg", err.message), "error");
}
});
const setAsPlanImage = async (which) => {
try {
const res = await fetch(`/wfm/gallery/image/serve?path=${encodeURIComponent(img.path)}`);
@@ -389,6 +430,10 @@ export function initVideoAssetTab() {
_loadImages();
});
document.getElementById("wfm-video-asset-refresh")?.addEventListener("click", () => _loadImages());
document.getElementById("wfm-video-asset-kind")?.addEventListener("change", (e) => {
_s.kindFilter = e.target.value;
_renderList();
});
document.getElementById("wfm-video-asset-search")?.addEventListener("input", (e) => {
_s.searchQuery = e.target.value;
_renderList();
File diff suppressed because it is too large Load Diff
+15 -2
View File
@@ -18,8 +18,8 @@
*/
const _PANES = {
source: { video: "wfm-video-source-preview-video", img: "wfm-video-source-preview-img", placeholder: "wfm-video-source-preview-placeholder" },
result: { video: "wfm-video-preview-video", img: "wfm-video-preview-img", placeholder: "wfm-video-preview-placeholder" },
source: { frame: "wfm-video-source-preview-frame", video: "wfm-video-source-preview-video", img: "wfm-video-source-preview-img", placeholder: "wfm-video-source-preview-placeholder" },
result: { frame: "wfm-video-preview-frame", video: "wfm-video-preview-video", img: "wfm-video-preview-img", placeholder: "wfm-video-preview-placeholder" },
};
const _objectUrls = { source: null, result: null };
@@ -111,3 +111,16 @@ export function getAllPreviewVideoElements() {
export function getResultPreviewVideoElement() {
return document.getElementById(_PANES.result.video);
}
// The frame/<video>/<img> elements of one pane ("source" | "result") — used by
// video-edit-tab.js to position its text-overlay preview layer over whichever
// media element is currently showing in that pane.
export function getPreviewPaneElements(pane) {
const ids = _PANES[pane];
if (!ids) return null;
return {
frame: document.getElementById(ids.frame),
video: document.getElementById(ids.video),
img: document.getElementById(ids.img),
};
}
+67 -18
View File
@@ -1,19 +1,57 @@
/**
* Video Tab - Sidebar "Project" subtab (next to Asset): browses saved Video
* Plan files (ws_videoplan_*.json in video_plan/), independent of which plan
* (if any) is currently loaded in the Plan editor.
* Plan files (ws_videoplan_*.json in video_plan/) OR saved Video Edit
* projects (ws_videoeditproj_*.json in video_edit_project/), depending on
* which center subtab (Plan/Edit) is currently active — video-tab.js passes
* that mode in on every refresh (Asset stays on whichever of the two was
* last active, since it has no saved-list concept of its own).
*
* Deliberately thin, mirroring video-asset-tab.js's own scope — clicking an
* item hands off to video-plan-tab.js's openSavedVideoPlan() rather than
* re-implementing plan loading here.
* item hands off to video-plan-tab.js's openSavedVideoPlan() or
* video-edit-tab.js's openSavedVideoEditProject() rather than
* re-implementing plan/project loading here.
*/
import { showToast } from "./app.js";
import { t } from "./i18n.js";
import { escapeHtml } from "./util.js";
import { openSavedVideoPlan } from "./video-plan-tab.js";
import { openSavedVideoEditProject } from "./video-edit-tab.js";
// Per-mode config: which endpoints to hit, which loader/toast strings to use,
// and how to read each item's count field — keeps _renderList/_makeItem/etc.
// mode-agnostic instead of branching throughout.
const _MODES = {
plan: {
listUrl: "/api/wfm/video/plans",
deleteUrl: "/api/wfm/video/plans/delete",
open: (filename) => openSavedVideoPlan(filename),
countOf: (item) => item.block_count ?? 0,
countLabel: (n) => t("videoProjectBlockCount", n),
hintKey: "videoProjectHint",
emptyKey: "videoProjectEmpty",
deleteConfirmKey: "videoProjectDeleteConfirm",
deletedKey: "videoProjectDeleted",
deleteFailedKey: "videoProjectDeleteFailed",
loadListFailedKey: "videoProjectLoadListFailed",
},
edit: {
listUrl: "/api/wfm/video/edit/projects",
deleteUrl: "/api/wfm/video/edit/projects/delete",
open: (filename) => openSavedVideoEditProject(filename),
countOf: (item) => item.clip_count ?? 0,
countLabel: (n) => t("videoEditProjectClipCount", n),
hintKey: "videoEditProjectHint",
emptyKey: "videoEditProjectEmpty",
deleteConfirmKey: "videoEditProjectDeleteConfirm",
deletedKey: "videoEditProjectDeleted",
deleteFailedKey: "videoEditProjectDeleteFailed",
loadListFailedKey: "videoEditProjectLoadListFailed",
},
};
const _s = {
mode: "plan",
plans: [],
activeFilename: null,
loaded: false, // becomes true once the Project subtab has been shown at least once
@@ -29,8 +67,9 @@ function _formatUpdatedAt(iso) {
function _renderList() {
const list = document.getElementById("wfm-video-project-list");
if (!list) return;
const cfg = _MODES[_s.mode];
if (_s.plans.length === 0) {
list.innerHTML = `<span class="wfm-placeholder">${t("videoProjectEmpty")}</span>`;
list.innerHTML = `<span class="wfm-placeholder">${t(cfg.emptyKey)}</span>`;
return;
}
list.innerHTML = "";
@@ -38,6 +77,7 @@ function _renderList() {
}
function _makeItem(plan) {
const cfg = _MODES[_s.mode];
const item = document.createElement("div");
item.className = "wfm-video-project-item" + (plan.filename === _s.activeFilename ? " active" : "");
item.dataset.filename = plan.filename;
@@ -58,9 +98,9 @@ function _makeItem(plan) {
const meta = document.createElement("div");
meta.className = "wfm-video-project-item-meta";
const blockLabel = t("videoProjectBlockCount", plan.block_count ?? 0);
const countLabel = cfg.countLabel(cfg.countOf(plan));
const updated = _formatUpdatedAt(plan.updated_at);
meta.textContent = updated ? `${blockLabel} · ${updated}` : blockLabel;
meta.textContent = updated ? `${countLabel} · ${updated}` : countLabel;
meta.title = plan.note || "";
info.append(name, meta);
@@ -83,13 +123,14 @@ function _makeItem(plan) {
async function _openPlan(plan) {
_s.activeFilename = plan.filename;
_renderList();
await openSavedVideoPlan(plan.filename);
await _MODES[_s.mode].open(plan.filename);
}
async function _deletePlan(plan) {
if (!window.confirm(t("videoProjectDeleteConfirm", plan.name || plan.filename))) return;
const cfg = _MODES[_s.mode];
if (!window.confirm(t(cfg.deleteConfirmKey, plan.name || plan.filename))) return;
try {
const res = await fetch("/api/wfm/video/plans/delete", {
const res = await fetch(cfg.deleteUrl, {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify({ filename: plan.filename }),
@@ -97,26 +138,34 @@ async function _deletePlan(plan) {
const json = await res.json();
if (!res.ok) throw new Error(json.error || `HTTP ${res.status}`);
if (_s.activeFilename === plan.filename) _s.activeFilename = null;
showToast(t("videoProjectDeleted"), "success");
await refreshVideoProjectTab();
showToast(t(cfg.deletedKey), "success");
await refreshVideoProjectTab(_s.mode);
} catch (err) {
showToast(`${t("videoProjectDeleteFailed")}: ${err.message}`, "error");
showToast(`${t(cfg.deleteFailedKey)}: ${err.message}`, "error");
}
}
// Called whenever the Project subtab becomes active (see video-tab.js's prop-tab
// toggle) — always refetches rather than caching, so a plan saved elsewhere
// (Plan pane's Save/Save As) shows up as soon as the user switches over to look.
export async function refreshVideoProjectTab() {
// toggle) — always refetches rather than caching, so a plan/project saved
// elsewhere (Plan pane's Save/Save As, Edit's Save/Save As) shows up as soon
// as the user switches over to look. `mode` ("plan"|"edit") is video-tab.js's
// record of which center subtab is currently active; defaults to "plan" so
// direct calls (e.g. from initVideoProjectTab) keep the original behavior.
export async function refreshVideoProjectTab(mode = "plan") {
const list = document.getElementById("wfm-video-project-list");
if (!list) return;
_s.mode = mode === "edit" ? "edit" : "plan";
_s.activeFilename = null;
const cfg = _MODES[_s.mode];
const hintEl = document.getElementById("wfm-video-project-hint");
if (hintEl) hintEl.textContent = t(cfg.hintKey);
try {
const res = await fetch("/api/wfm/video/plans");
const res = await fetch(cfg.listUrl);
if (!res.ok) throw new Error(String(res.status));
_s.plans = await res.json();
_renderList();
} catch (err) {
list.innerHTML = `<span class="wfm-placeholder" style="color:var(--wfm-danger)">${escapeHtml(t("videoProjectLoadListFailed"))}: ${escapeHtml(err.message)}</span>`;
list.innerHTML = `<span class="wfm-placeholder" style="color:var(--wfm-danger)">${escapeHtml(t(cfg.loadListFailedKey))}: ${escapeHtml(err.message)}</span>`;
}
_s.loaded = true;
}
+35 -1
View File
@@ -36,6 +36,17 @@ export { loadWorkflowIntoVideoEditor };
// what keeps clicking one from affecting the other.
// ============================================
// Which of the center Plan/Edit subtabs was last active — the sidebar
// Project panel uses this to decide whether to list saved Video Plans or
// saved Video Edit projects (Asset has no saved-list concept, so selecting
// it leaves this unchanged rather than resetting to "plan").
let _centerSubtabMode = "plan";
function _isProjectPanelOpen() {
const panel = document.getElementById("wfm-video-subtab-project");
return !!panel && panel.style.display !== "none";
}
function _initCenterSubtabToggle() {
const scope = document.querySelector(".wfm-video-center-panel");
if (!scope) return;
@@ -48,6 +59,12 @@ function _initCenterSubtabToggle() {
p.style.display = p.dataset.videoSubtabPanel === target ? "" : "none";
});
if (target === "asset") refreshVideoAssetTab();
if (target === "plan" || target === "edit") {
_centerSubtabMode = target;
// Project panel may already be open (e.g. switching Plan<->Edit
// while it's pinned) — keep its list in sync with the new mode.
if (_isProjectPanelOpen()) refreshVideoProjectTab(_centerSubtabMode);
}
});
});
}
@@ -69,7 +86,7 @@ function _initSidebarSubtabToggle() {
if (willShow) {
btn.classList.add("active");
panel.style.display = "";
if (target === "project") refreshVideoProjectTab();
if (target === "project") refreshVideoProjectTab(_centerSubtabMode);
}
});
});
@@ -110,11 +127,28 @@ function _applyVideoI18n() {
if (el) el.title = t(key);
};
setText("wfm-video-edit-export-btn", "videoEditExportBtn");
setText("wfm-video-edit-track-video", "videoEditTrackVideo");
setText("wfm-video-edit-track-pip", "videoEditTrackPip");
setText("wfm-video-edit-pip-title", "videoEditPipTitle");
setText("wfm-video-edit-pip-btn", "videoEditPipAdd");
setText("wfm-video-edit-track-text", "videoEditTrackText");
setText("wfm-video-edit-track-audio", "videoEditTrackAudio");
setTitle("wfm-video-edit-move-left-btn", "videoEditMoveLeft");
setTitle("wfm-video-edit-move-right-btn", "videoEditMoveRight");
setText("wfm-video-edit-duplicate-btn", "videoEditDuplicate");
setText("wfm-video-edit-delete-btn", "videoEditDelete");
setText("wfm-video-edit-clear-btn", "videoEditClearBtn");
setTitle("wfm-video-edit-undo-btn", "videoEditUndo");
setTitle("wfm-video-edit-redo-btn", "videoEditRedo");
setText("wfm-video-edit-audio-title", "videoEditAudioTitle");
setText("wfm-video-edit-keep-audio-label", "videoEditKeepAudio");
setText("wfm-video-edit-orig-vol-label", "videoEditOriginalVolume");
setText("wfm-video-edit-bgm-btn", "videoEditBgmSelect");
setTitle("wfm-video-edit-bgm-clear", "videoEditBgmRemove");
setText("wfm-video-edit-bgm-vol-label", "videoEditBgmVolume");
setText("wfm-video-edit-bgm-offset-label", "videoEditBgmOffset");
setText("wfm-video-edit-bgm-hint", "videoEditBgmHint");
setText("wfm-video-edit-sound-btn", "videoEditSoundAdd");
setText("wfm-video-source-add-to-edit", "videoSourceAddToEdit");
setText("wfm-video-source-label", "videoSourceLabel");
setText("wfm-video-source-hint", "videoSourceHint");
+32 -1
View File
@@ -31,6 +31,7 @@ const state = {
groupFilter: "", // empty = all groups
currentPage: 0,
showBatchOnly: false,
sortBy: localStorage.getItem("wfm_workflow_sort") || "date_desc",
};
@@ -449,6 +450,26 @@ function filterWorkflows() {
});
}
function sortWorkflows(list) {
const sorted = [...list];
switch (state.sortBy) {
case "date_asc":
sorted.sort((a, b) => a.mtime - b.mtime);
break;
case "name_asc":
sorted.sort((a, b) => a.filename.localeCompare(b.filename));
break;
case "name_desc":
sorted.sort((a, b) => b.filename.localeCompare(a.filename));
break;
case "date_desc":
default:
sorted.sort((a, b) => b.mtime - a.mtime);
break;
}
return sorted;
}
// ============================================
// Grid Rendering (3 view modes)
// ============================================
@@ -459,7 +480,7 @@ function renderGrid() {
grid.className = `wfm-grid wfm-view-${state.viewMode}`;
const filtered = filterWorkflows();
const filtered = sortWorkflows(filterWorkflows());
if (filtered.length === 0) {
grid.innerHTML =
@@ -1365,6 +1386,16 @@ export function initWorkflowTab() {
renderGrid();
});
// Toolbar: sort dropdown
const sortSel = document.getElementById("wfm-sort");
if (sortSel) sortSel.value = state.sortBy;
sortSel?.addEventListener("change", (e) => {
state.sortBy = e.target.value;
localStorage.setItem("wfm_workflow_sort", state.sortBy);
state.currentPage = 0;
renderGrid();
});
// Toolbar: Load in GenerateUI button
document.getElementById("wfm-list-load-btn")?.addEventListener("click", async () => {
if (!state.selectedWf) return;
+88 -12
View File
@@ -55,6 +55,12 @@
<select id="wfm-group-filter" class="wfm-select wfm-toolbar-select">
<option value="">All Groups</option>
</select>
<select id="wfm-sort" class="wfm-select wfm-toolbar-select">
<option value="date_desc">Date (Newest)</option>
<option value="date_asc">Date (Oldest)</option>
<option value="name_asc">Name A-Z</option>
<option value="name_desc">Name Z-A</option>
</select>
<button id="wfm-list-load-btn" class="wfm-btn wfm-btn-sm wfm-btn-primary" disabled title="Select a card first">Load in GenerateUI</button>
<button id="wfm-list-load-video-btn" class="wfm-btn wfm-btn-sm" disabled title="Select a card first">Load in Video</button>
<button id="wfm-list-open-comfyui-btn" class="wfm-btn wfm-btn-sm" disabled title="Select a card first">Send to Canvas</button>
@@ -1655,7 +1661,7 @@
<h3 id="wfm-help-settings-card-general-title">General</h3>
<ul>
<li id="wfm-help-settings-1">UI language and summary language</li>
<li id="wfm-help-settings-2">Theme selection (13 presets) with customization: color overrides, background patterns (stripes, polka dot, checkerboard, SVG tiling), and font selection (16 Google Fonts including Japanese display fonts)</li>
<li id="wfm-help-settings-2">Theme selection (13 presets) with customization: color overrides, background patterns (stripes, polka dot, checkerboard, SVG tiling), and font selection (15 Google Fonts including Japanese display fonts, plus the system default)</li>
<li id="wfm-help-settings-9">All sections are collapsible accordion panels</li>
</ul>
</div>
@@ -1665,20 +1671,25 @@
<li id="wfm-help-settings-4">ComfyUI connection URL and test</li>
<li id="wfm-help-settings-5">AI Assistant settings have moved out of this tab &mdash; the Prompt tab, Tagger tab, and AI TOOL tab each have their own &#9881; Settings button (backend, URL, model, Thinking mode, Max tokens, unload model), saved independently</li>
<li id="wfm-help-settings-7">Eagle integration URL and auto-save toggle</li>
<li id="wfm-help-settings-22">G'MIC-Qt Integration: path to the G'MIC-Qt executable (gmic_qt.exe) used by the Image Edit tab's G'MIC filter (Edit with G'MIC); Save stores it — see the Image Edit help for installing G'MIC-Qt</li>
<li id="wfm-help-settings-17">Decision Model: its own section, independent of the AI TOOL / Tagger LLM/VLM backends so it can be used alongside them — backend, URL, model and a default probability threshold (answers below it are treated as suggestions to confirm). Unsloth: Laya models (laya / laya-multilingual / laya-english / laya-typed-decisions); requires Settings → API → Decision API → Serve requests in Unsloth Desktop (otherwise HTTP 404 "The Decision API is off") and either UNSLOTH_API_KEY in .env or Keyless API access → "Chat and inference". Ollama (0.35+): lists installed models whose capabilities include "decision" (tev1, tev1:0.8b, nimble — ollama pull first; ↻ refreshes the list); no key needed. Test sends one yes/no question with the unsaved form values; the first request loads the model.</li>
</ul>
</div>
<div class="wfm-help-card">
<h3 id="wfm-help-settings-card-workflow-title">Workflow Defaults</h3>
<ul>
<li id="wfm-help-settings-3">Workflow data folder path</li>
<li id="wfm-help-settings-19">Gallery Output Folder: the ComfyUI output folder the Gallery tab browses — leave blank to use ComfyUI's default output directory; Apply takes effect immediately, Default resets it, and the folder currently in use is shown below the field</li>
<li id="wfm-help-settings-6">Default workflow setting</li>
<li id="wfm-help-settings-10">Wildcard Integration: link WFS wildcard dir to ComfyUI-Impact-Pack wildcards (junction/symlink); existing files migrated automatically</li>
<li id="wfm-help-settings-20">Default Checkpoint: when "Force default checkpoint on workflow load" is on, every checkpoint loader node's model is replaced with the chosen checkpoint whenever a workflow is loaded into GenerateUI (a toast shows when it's applied) — avoids errors or garbled images caused by a model name saved in the workflow that you don't have; Refresh reloads the checkpoint list, Save stores the setting</li>
<li id="wfm-help-settings-10">Wildcard Integration: link WFS wildcard dir to ComfyUI-Impact-Pack wildcards (directory junction on Windows / symlink on other OS); existing files migrated automatically</li>
</ul>
</div>
<div class="wfm-help-card">
<h3 id="wfm-help-settings-card-editor-title">Editor Customization</h3>
<ul>
<li id="wfm-help-settings-11">Text Size: one slider (10–28 px) adjusts font size for all prompt and chat textareas at once — Generate UI positive/negative prompts, AI Assistant chat input, Preset positive/negative, Wildcard prompt and file editor, and Metadata prompt full preview; takes effect immediately and saved with Save Settings</li>
<li id="wfm-help-settings-18">Video Volume: one slider (0–100%) sets the playback volume of the Video tab preview and the Gallery detail / lightbox / compare video players; the level set here (or changed with any video's own controls) carries over to the next video opened anywhere in the app</li>
<li id="wfm-help-settings-12">RAW JSON Colors: customize the 6 syntax highlight colors for the Raw JSON editor in Generate UI — Default Text, Name/Scheduler, Title, Width/Height, Prompt/Text, Image/File; changes apply immediately on color pick; Reset Defaults restores the original color scheme</li>
<li id="wfm-help-settings-14">GenerateUI Model Tab Highlight: pick the color used to mark Checkpoint/VAE/Diffusion Model/Text Encoder/ControlNet/Hypernetwork labels and the LoRA column header in GenerateUI's Model tab when the loaded workflow actually contains that type of node; default bright green; changes apply immediately, Reset Defaults restores it</li>
</ul>
@@ -1686,10 +1697,11 @@
<div class="wfm-help-card">
<h3 id="wfm-help-settings-card-misc-title">Data &amp; Misc</h3>
<ul>
<li id="wfm-help-settings-8">Data Management: export core settings/metadata/prompts to JSON / import to restore</li>
<li id="wfm-help-settings-15">Full Backup (ZIP): unlike the JSON export above, also includes folder-based data (AI Skills, Lab Plans, Style presets) and the Tagger database; Restore overwrites existing files — restart ComfyUI afterward</li>
<li id="wfm-help-settings-16">Two opt-in checkboxes above the Full Backup buttons additionally include ComfyUI's default workflows folder and the Impact Pack's wildcard folder in the export — both export-only, never restored automatically; copy the ZIP's _external/ folder back by hand if you want them</li>
<li id="wfm-help-settings-8">Data Management: export core settings, metadata, and prompts to a JSON file, or import to restore. After importing, restart ComfyUI.</li>
<li id="wfm-help-settings-15">Full Backup (ZIP): unlike the JSON export above, also includes folder-based data (AI Skills, Lab Plans, Video Plans, Video Edit projects, Style presets) and the Tagger database — everything the JSON export can't represent. Restoring overwrites existing files; restart ComfyUI afterward.</li>
<li id="wfm-help-settings-16">Two opt-in checkboxes above the Full Backup buttons additionally include ComfyUI's default workflows folder and the Impact Pack's wildcard folder in the export — both export-only, never restored automatically; copy the ZIP's _external/ folder back by hand if you want them. A third checkbox includes the clips, BGM, sounds and overlay clips referenced by saved Video Edit projects (projects only store references to files in ComfyUI's input folder) — unlike the other two, these are restored into the input folder, skipping any file that already exists there.</li>
<li id="wfm-help-settings-13">CivitAI Host: choose between civitai.com (SFW only) and civitai.red (unrestricted) — determines which site opens when clicking a model link in the Models tab CivitAI panel</li>
<li id="wfm-help-settings-21">CivitAI API Key: optional key for authenticated CivitAI access from the Models tab (get it at civitai.com → Account Settings → API Keys); stored in settings.json but left out of the JSON export and Full Backup, and the CIVITAI_API_KEY environment variable takes priority when set</li>
</ul>
</div>
</div>
@@ -1922,7 +1934,7 @@
</div>
<div class="wfm-help-card">
<h3 id="wfm-help-ai-card-settings-title">Settings pane</h3>
<p id="wfm-help-ai-6">Settings pane: choose backend (Ollama / LM Studio / Lemonade / Unsloth), set API URL, test connection, select model, and use the Unload Model button (next to Test connection) to free the loaded model from VRAM/memory &mdash; Ollama uses keep_alive:0, LM Studio uses /api/v1/models/unload, Lemonade uses /api/v1/unload; Unsloth has no unload API, so this shows an unsupported message for it; Unsloth always requires an API key even for local access — set UNSLOTH_API_KEY in a .env file in the plugin folder (copy .env.example) and restart ComfyUI, the key is read server-side and never sent to the browser; Unsloth also requires "Auto model switching (OpenAI API)" to be turned ON in the Unsloth Desktop app itself (its own Settings screen) — without it, requests fail with HTTP 404 unless a model was already manually loaded in the Unsloth Studio UI; Unsloth reasoning models return their thinking in a separate reasoning_content field rather than inline &lt;think&gt; tags, so a low Max tokens can make the model spend its whole budget reasoning and return an empty reply — increase Max tokens (2048+) if replies come back blank; Generation section — Thinking mode toggle (off by default; Ollama receives a `think` flag, and regardless of backend any &lt;think&gt;...&lt;/think&gt; block is stripped from the output when off, so reasoning models don't clutter Translation/Chat/TOOLS results) and Max tokens (Ollama: num_predict, LM Studio/Lemonade/Unsloth: max_tokens; 0 = unlimited); configure Free language names; Chat Image Generation section lets you enable a dedicated workflow for Chat-triggered text-to-image generation instead of the one currently loaded in GenerateUI; Chat I2I Generation section is the same but for image-to-image generation when an image is attached; settings are shared with the Library panel's A tab via localStorage</p>
<p id="wfm-help-ai-6">Settings pane: choose backend (Ollama / LM Studio / Lemonade / Unsloth), set API URL, test connection, select model, and use the Unload Model button (next to Test connection) to free the loaded model from VRAM/memory &mdash; Ollama uses keep_alive:0, LM Studio uses /api/v1/models/unload, Lemonade uses /api/v1/unload; Unsloth has no unload API, so this shows an unsupported message for it; Unsloth needs either an API key or Keyless API access — set UNSLOTH_API_KEY in a .env file in the plugin folder (copy .env.example) and restart ComfyUI (the key is read server-side and never sent to the browser), or leave it unset and turn on Keyless API access → "Chat and inference" in Unsloth Desktop's Settings → API (requests are then sent without a key; note that setting also opens the API to your private LAN, and keep "Allow tools" off); Unsloth also requires "Auto model switching (OpenAI API)" to be turned ON in the Unsloth Desktop app itself (its own Settings screen) — without it, requests fail with HTTP 404 unless a model was already manually loaded in the Unsloth Studio UI; Unsloth reasoning models return their thinking in a separate reasoning_content field rather than inline &lt;think&gt; tags, so a low Max tokens can make the model spend its whole budget reasoning and return an empty reply — increase Max tokens (2048+) if replies come back blank; Generation section — Thinking mode toggle (off by default; Ollama receives a `think` flag, and regardless of backend any &lt;think&gt;...&lt;/think&gt; block is stripped from the output when off, so reasoning models don't clutter Translation/Chat/TOOLS results) and Max tokens (Ollama: num_predict, LM Studio/Lemonade/Unsloth: max_tokens; 0 = unlimited); configure Free language names; Chat Image Generation section lets you enable a dedicated workflow for Chat-triggered text-to-image generation instead of the one currently loaded in GenerateUI; Chat I2I Generation section is the same but for image-to-image generation when an image is attached; settings are shared with the Library panel's A tab via localStorage</p>
</div>
</div>
@@ -2099,7 +2111,7 @@
<div class="wfm-help-page" id="wfm-help-page-video">
<h2 id="wfm-help-video-title">Video Tab</h2>
<p id="wfm-help-video-desc">A dedicated video generation tab for MiniMax H3 (Image to Video), LTX-2.5 (Text / Image / First & Last Frame to Video), and Wan2.2 (Text to Video) workflows, independent of the GenerateUI tab. The center panel's Plan / Edit / Asset subtabs handle batch generation, clip editing, and browsing generated videos; the sidebar's Project subtab handles saved plans.</p>
<p id="wfm-help-video-desc">A dedicated video generation tab for MiniMax H3 (Image to Video), LTX-2.5 (Text / Image / First &amp; Last Frame to Video), and Wan2.2 (Text to Video) workflows, independent of the GenerateUI tab. The center panel's Plan / Edit / Asset subtabs handle batch generation, clip editing, and browsing generated videos; the sidebar's Project subtab handles saved plans (while Plan is active) or saved Edit projects (while Edit is active).</p>
<div class="wfm-help-card">
<ul>
<li id="wfm-help-video-1">Plan subtab: the topbar's settings row holds Aspect Ratio / Megapixels / Multiple / Duration (seconds) / Noise Seed as this plan's base settings — Duration always reflects the currently selected block (each block keeps its own value), the rest are plan-wide. A second row below adds Width / Height / Turbo Mode / Strength / Steps / Prompt Enhance, each enabled only for workflows that actually support it (see helpVideo2). Split the timeline into blocks with the + Split / + Block / Delete buttons — each block has its own Prompt, Duration, and First/Last Image — First Image can be None, an explicit image, or "use previous block's last frame" (an explicit Last Image on the previous block always wins over extracting one from its generated video). Click Run to generate every block in order; Pause/Cancel work mid-run.</li>
@@ -2110,9 +2122,9 @@
<li id="wfm-help-video-6">Frame tab (right panel): play/seek the preview video to the position you want, click Capture Frame to grab that frame client-side, then Save to Output to write it as a PNG into ComfyUI's output folder — check "Add to Video Assets group" first to also tag the saved frame into Gallery's Video Assets group.</li>
<li id="wfm-help-video-7">GIF tab (right panel): set Start/End (seconds), FPS, and an optional Max Width, then Convert to GIF — the server decodes the video and encodes an animated GIF into ComfyUI's output folder.</li>
<li id="wfm-help-video-8">Chaining: setting a block's First Image to "use previous block's last frame" continues smoothly from the previous clip — if that previous block has its own explicit Last Image, that image is used directly; otherwise the actual last frame of its generated video is extracted automatically.</li>
<li id="wfm-help-video-9">Project tab (sidebar): browse every saved plan file (thumbnail, block count, last updated), click one to load it into the Plan editor, or delete it with the × button; clicking the same tab again collapses the panel.</li>
<li id="wfm-help-video-9">Project tab (sidebar): lists saved Video Plans while the center Plan subtab is active, or saved Edit projects while the center Edit subtab is active (thumbnail/block or clip count, last updated) — click one to load it, or delete it with the × button; clicking the same tab again collapses the panel.</li>
<li id="wfm-help-video-10">Highlight color: the Prompt / Duration / First Image / Last Image / Aspect Ratio / Megapixels / Multiple / Noise Seed / Width / Height / Turbo Mode / Strength / Steps / Prompt Enhance labels turn the same highlight color as the GenerateUI Model tab (customizable in the Settings tab) when the loaded workflow actually supports that field — e.g. for a Wan2.2 workflow (no ResolutionSelector node), the Aspect Ratio / Megapixels / Multiple labels stay unhighlighted while Width / Height light up instead.</li>
<li id="wfm-help-video-11">Edit subtab: a lightweight clip timeline for trimming and concatenating video/image clips outside of generation. Add clips via the Video Source panel's "Add to Edit" button or the Asset subtab's "Send to Edit" button, then drag blocks to reorder (or use the ◀/▶ toolbar buttons), Duplicate/Delete the selected clip, and Clear to empty the timeline. The trim panel for the selected video clip shows a time ruler, a draggable playhead synced to the Source preview, and draggable in/out handles with time badges — image clips instead get a simple hold-duration field. ▶ Preview plays every ready clip back-to-back (trimmed to its in/out points) in the right-hand result preview; Export builds and runs the actual ComfyUI graph (trim → concatenate if more than one clip → save), tagging the result into the Video Temp group automatically. Exporting more than one clip currently drops audio, since ComfyUI's concatenation node requires uniform audio across all inputs.</li>
<li id="wfm-help-video-11">Edit subtab: a lightweight clip timeline for trimming and concatenating video/image clips outside of generation. Add clips via the Video Source panel's "Add to Edit" button or the Asset subtab's "Send to Edit" button, then drag blocks to reorder (or use the ◀/▶ toolbar buttons), Duplicate/Delete the selected clip, and Clear to empty the timeline (this also resets the Audio section). The trim panel for the selected video clip shows a time ruler, a draggable playhead synced to the Source preview, and draggable in/out handles with time badges — image clips instead get a simple hold-duration field. ▶ Preview plays every ready clip back-to-back (trimmed to its in/out points) in the right-hand result preview; Export builds and runs the actual ComfyUI graph (trim → concatenate if more than one clip → save), tagging the result into the Video Temp group automatically. The Audio section of the export panel controls the soundtrack: "Keep original audio" (with its own volume in dB) keeps each clip's audio aligned to its segment even across multiple clips (image clips contribute silence), and "BGM..." lays one audio file over the whole video with its own volume and start offset (a longer BGM is cut to the video length). Each clip can also carry text overlays ("+ Add text" under the trim panel: text, start/end seconds within the clip, size as % of frame height, color, 9-position anchor, outline, background box); they are previewed live over the Source/Result panes and burned in on Export as a final pass. The BGM can be chosen with "BGM...", by dropping an audio/video file onto the Audio section, or with "Set as BGM" on a video in the Asset subtab (its audio track is used). Video clips can also be cropped: "Edit crop" shows a draggable/resizable rectangle over the Source preview (optionally locked to 16:9 / 9:16 / 1:1 / 4:3 / 3:4) — "Done" keeps it, "Cancel" restores the crop from before editing, and switching to another subtab/tab ends editing like Done; the export size becomes the first video clip's cropped size, and other clips of a different size are center-fit to it. ↶/↷ in the timeline toolbar (or Ctrl+Z / Ctrl+Y) undo and redo edits to clips, trims, crops, text and audio settings. The export panel's Save/Save As/Load buttons persist the timeline itself (clip order, trim points, crop, text overlays, audio/BGM settings, and which uploaded file each clip and the BGM refer to) as a JSON project file on the server. The project only stores references to those files in ComfyUI's input folder, so Load re-fetches each clip from its saved server reference and re-probes it — the original files must still exist (Settings → Full Backup can bundle them with "Include media used by Video Edit projects"). These saved projects also show up in the sidebar's Project tab whenever the Edit subtab is active (see the Project tab item).</li>
<li id="wfm-help-video-12">Asset subtab (center panel, next to Plan/Edit): browses every video/image tagged into Video Assets or Video Temp (via the group dropdown, or "All Video Assets" for both). Search filters by filename; the ▦/☰ buttons switch between a thumbnail grid and a table (filename/updated/tags). Selecting an item shows its tags/memo, loads it into the center preview, and offers "Send to Edit" (queues it as a clip in the Edit subtab) plus, for images only, "Set as First Image"/"Set as Last Image" (uploads it straight into the currently-selected Plan block, switching to the Plan subtab).</li>
</ul>
</div>
@@ -2775,6 +2787,11 @@
<div class="wfm-video-asset-list-col">
<div class="wfm-video-asset-toolbar">
<select id="wfm-video-asset-group" class="wfm-input" style="flex:1;"></select>
<select id="wfm-video-asset-kind" class="wfm-input" style="flex:0.5;">
<option value="all">All Types</option>
<option value="video">Video Only</option>
<option value="image">Image Only</option>
</select>
<input type="text" id="wfm-video-asset-search" class="wfm-input" placeholder="Search filename..." style="flex:1;">
<button type="button" id="wfm-video-asset-view-grid" class="wfm-btn wfm-btn-sm wfm-video-asset-view-btn active" title="Thumbnail view">▦</button>
<button type="button" id="wfm-video-asset-view-table" class="wfm-btn wfm-btn-sm wfm-video-asset-view-btn" title="Table view">☰</button>
@@ -2924,23 +2941,82 @@
(個別行ボタンではなく「選択中クリップに対して働く」共通ボタン方式)。 -->
<div id="wfm-video-subtab-edit" class="wfm-video-subtab-panel wfm-video-edit-panel" data-video-subtab-panel="edit" style="display:none;">
<div class="wfm-video-timeline-wrap">
<div class="wfm-video-edit-timeline-track" id="wfm-video-edit-timeline-track"></div>
<div class="wfm-video-edit-track-tabs" id="wfm-video-edit-track-tabs">
<button type="button" class="wfm-btn wfm-btn-xs wfm-video-edit-track-tab active" data-track="video" id="wfm-video-edit-track-video">Video</button>
<button type="button" class="wfm-btn wfm-btn-xs wfm-video-edit-track-tab" data-track="pip" id="wfm-video-edit-track-pip">Overlay</button>
<button type="button" class="wfm-btn wfm-btn-xs wfm-video-edit-track-tab" data-track="text" id="wfm-video-edit-track-text">Text</button>
<button type="button" class="wfm-btn wfm-btn-xs wfm-video-edit-track-tab" data-track="audio" id="wfm-video-edit-track-audio">Audio</button>
</div>
<div class="wfm-video-edit-timeline-track" id="wfm-video-edit-timeline-track" data-track="video"></div>
<div class="wfm-video-timeline-toolbar">
<button type="button" id="wfm-video-edit-move-left-btn" class="wfm-btn wfm-btn-xs" title="Move left">◀</button>
<button type="button" id="wfm-video-edit-move-right-btn" class="wfm-btn wfm-btn-xs" title="Move right">▶</button>
<button type="button" id="wfm-video-edit-duplicate-btn" class="wfm-btn wfm-btn-xs">Duplicate</button>
<button type="button" id="wfm-video-edit-delete-btn" class="wfm-btn wfm-btn-xs">Delete</button>
<button type="button" id="wfm-video-edit-preview-btn" class="wfm-btn wfm-btn-xs">▶ Preview</button>
<button type="button" id="wfm-video-edit-undo-btn" class="wfm-btn wfm-btn-xs" title="Undo (Ctrl+Z)" disabled>↶</button>
<button type="button" id="wfm-video-edit-redo-btn" class="wfm-btn wfm-btn-xs" title="Redo (Ctrl+Y)" disabled>↷</button>
<span class="wfm-i2i-status wfm-video-edit-total-duration" id="wfm-video-edit-total-duration" style="margin-left:auto;"></span>
<button type="button" id="wfm-video-edit-clear-btn" class="wfm-btn wfm-btn-xs wfm-btn-danger">Clear</button>
</div>
</div>
<div class="wfm-video-edit-main-row">
<div class="wfm-video-edit-trim-panel" id="wfm-video-edit-trim-panel"></div>
<!-- Tool menu: its contents follow the timeline's track view (data-view, set by _setTrackView):
video = trim + crop, text = text overlays, pip = overlay clips, audio = audio. Export stays fixed on the right. -->
<div class="wfm-video-edit-tools" id="wfm-video-edit-tools" data-view="video">
<div class="wfm-video-edit-trim-panel" id="wfm-video-edit-trim-panel"></div>
<div class="wfm-video-edit-pip-panel">
<div class="wfm-video-edit-section-head"><span id="wfm-video-edit-pip-title">Overlay clips (PinP)</span></div>
<div class="wfm-video-edit-sound-head">
<!-- The real <input> sits transparently over the button (not display:none behind a <label>), so the click lands on the native file input itself. -->
<label class="wfm-btn wfm-btn-xs wfm-video-edit-file-btn wfm-video-edit-file-overlay" tabindex="0" role="button"><span id="wfm-video-edit-pip-btn">+ Overlay clip...</span><input type="file" id="wfm-video-edit-pip-input" multiple accept="video/*,image/*"></label>
</div>
<div class="wfm-video-edit-sound-list" id="wfm-video-edit-pip-list"></div>
</div>
<div class="wfm-video-edit-audio-panel">
<div class="wfm-video-edit-section-head"><span id="wfm-video-edit-audio-title">Audio</span></div>
<label class="wfm-video-checkbox-inline">
<input type="checkbox" id="wfm-video-edit-keep-audio" checked> <span id="wfm-video-edit-keep-audio-label">Keep original audio</span>
</label>
<div class="wfm-video-edit-audio-row">
<label for="wfm-video-edit-orig-vol" id="wfm-video-edit-orig-vol-label">Original volume</label>
<input type="range" id="wfm-video-edit-orig-vol" min="-30" max="12" step="1" value="0">
<span class="wfm-video-edit-audio-val" id="wfm-video-edit-orig-vol-val">0 dB</span>
</div>
<div class="wfm-video-edit-bgm-file">
<label class="wfm-btn wfm-btn-xs wfm-video-edit-file-btn" tabindex="0" role="button"><span id="wfm-video-edit-bgm-btn">BGM...</span><input type="file" id="wfm-video-edit-bgm-input" accept="audio/*,video/mp4,.mp3,.wav,.m4a,.aac,.flac,.ogg,.opus,.mp4" style="display:none;"></label>
<span class="wfm-i2i-status wfm-video-edit-bgm-name" id="wfm-video-edit-bgm-name"></span>
<button type="button" id="wfm-video-edit-bgm-clear" class="wfm-btn wfm-btn-xs" title="Remove BGM">✕</button>
</div>
<div class="wfm-i2i-status wfm-video-edit-bgm-hint" id="wfm-video-edit-bgm-hint">Drop an audio file here, or use &quot;Set as BGM&quot; on a video in Asset</div>
<div class="wfm-video-edit-audio-row">
<label for="wfm-video-edit-bgm-vol" id="wfm-video-edit-bgm-vol-label">BGM volume</label>
<input type="range" id="wfm-video-edit-bgm-vol" min="-30" max="12" step="1" value="-6">
<span class="wfm-video-edit-audio-val" id="wfm-video-edit-bgm-vol-val">-6 dB</span>
</div>
<div class="wfm-video-edit-audio-row">
<label for="wfm-video-edit-bgm-offset" id="wfm-video-edit-bgm-offset-label">BGM start (s)</label>
<input type="number" id="wfm-video-edit-bgm-offset" class="wfm-input" min="0" step="0.1" value="0">
</div>
<div class="wfm-video-edit-sound-head">
<label class="wfm-btn wfm-btn-xs wfm-video-edit-file-btn wfm-video-edit-file-overlay" tabindex="0" role="button"><span id="wfm-video-edit-sound-btn">+ Sound...</span><input type="file" id="wfm-video-edit-sound-input" multiple accept="audio/*,video/*"></label>
</div>
<div class="wfm-video-edit-sound-list" id="wfm-video-edit-sound-list"></div>
</div>
</div>
<div class="wfm-video-edit-export-panel">
<button type="button" id="wfm-video-edit-export-btn" class="wfm-btn wfm-btn-primary" style="width:100%;">Export</button>
<div id="wfm-video-edit-project-name" class="wfm-i2i-status" style="min-height:14px;margin-bottom:4px;"></div>
<div style="display:flex;gap:6px;">
<button type="button" id="wfm-video-edit-save-btn" class="wfm-btn wfm-btn-sm" style="flex:1;">Save</button>
<button type="button" id="wfm-video-edit-saveas-btn" class="wfm-btn wfm-btn-sm" style="flex:1;">Save As</button>
<!-- File pickers are native <label>-wrapped inputs (same as the Video Source drop zone),
not a button calling input.click() from JS — that programmatic path can be refused
by the browser without any error (confirmed on a user's machine for the BGM picker). -->
<label id="wfm-video-edit-load-btn" class="wfm-btn wfm-btn-sm wfm-video-edit-file-btn" style="flex:1;" tabindex="0" role="button">Load<input type="file" id="wfm-video-edit-load-file-input" accept="application/json,.json" style="display:none;"></label>
</div>
<button type="button" id="wfm-video-edit-export-btn" class="wfm-btn wfm-btn-primary" style="width:100%;margin-top:8px;">Export</button>
<div class="wfm-gen-progress-container" style="margin-top:8px;">
<div class="wfm-gen-progress-track">
<div id="wfm-video-edit-progress-bar" class="wfm-gen-progress-bar"></div>
+20 -13
View File
@@ -3253,17 +3253,16 @@ function _extractPromptsFromNodeSet(nodes, links) {
continue;
}
if (!_isTextEncoderNode(type)) continue;
const text = n.widgets_values?.[0];
if (text && typeof text === "string") { textMap.set(n.id, text); }
else if (Array.isArray(n.inputs)) {
const textInput = n.inputs.find(inp => inp.name === "text" || inp.name === "text_g" || inp.name === "prompt");
if (textInput?.link != null) {
const originId = linkOrigin.get(textInput.link);
const originSlot = linkSlot.get(textInput.link) ?? 0;
const text2 = _resolveLinkedTextInNodeSet(nodeMap, linkOrigin, linkSlot, originId, originSlot);
if (text2) textMap.set(n.id, text2);
}
}
// リンク化されたtextウィジェットはwidgets_values[0]に古い入力値が残る(実行時には使われない)ため、
// リンク先の解決結果を優先する
const textInput = Array.isArray(n.inputs)
? n.inputs.find(inp => inp.name === "text" || inp.name === "text_g" || inp.name === "prompt")
: null;
const linkedText = textInput?.link != null && linkOrigin.has(textInput.link)
? _resolveLinkedTextInNodeSet(nodeMap, linkOrigin, linkSlot, linkOrigin.get(textInput.link), linkSlot.get(textInput.link) ?? 0)
: null;
const text = linkedText || n.widgets_values?.[0];
if (text && typeof text === "string") textMap.set(n.id, text);
}
const pos = new Set(), neg = new Set();
let foundSampler = false;
@@ -3273,11 +3272,13 @@ function _extractPromptsFromNodeSet(nodes, links) {
// SamplerCustomAdvanced doesn't hold positive/negative directly — resolve through its
// "guider" input (CFGGuider/DualCFGGuider/BasicGuider) instead.
let inputsToScan = n.inputs;
let viaBasicGuider = false;
const guiderInput = n.inputs.find(inp => inp.name === "guider");
if (guiderInput?.link != null) {
const guiderId = linkOrigin.get(guiderInput.link);
const guiderNode = guiderId != null ? nodeMap.get(guiderId) : null;
if (Array.isArray(guiderNode?.inputs)) inputsToScan = guiderNode.inputs;
viaBasicGuider = guiderNode?.type === "BasicGuider";
}
for (const inp of inputsToScan) {
if (!inp || inp.link == null) continue;
@@ -3285,7 +3286,9 @@ function _extractPromptsFromNodeSet(nodes, links) {
if (originId == null) continue;
const name = inp.name ?? "";
// DualCFGGuider (HiDream E1): cond1 carries the positive-derived conditioning.
const isPos = name === "positive" || name === "cond1" || name.startsWith("positive");
// BasicGuider (Flux/Ming Image etc., no negative): its single "conditioning" input is positive.
const isPos = name === "positive" || name === "cond1" || name.startsWith("positive")
|| (viaBasicGuider && name === "conditioning");
const isNeg = name === "negative" || name.startsWith("negative");
if (!isPos && !isNeg) continue;
// TextEncodeMageFlowEdit / TextEncodeBooguEdit — 1ノードでprompt/negative_prompt両方を
@@ -3428,14 +3431,18 @@ function _extractPromptsAPI(wf) {
// Guider node (CFGGuider/DualCFGGuider/BasicGuider) via its "guider" input. Scan that
// node's inputs instead so the loop below can find the positive/negative-role keys.
let inputsToScan = n.inputs ?? {};
let viaBasicGuider = false;
if (Array.isArray(n.inputs?.guider)) {
const guiderNode = wf[String(n.inputs.guider[0])];
if (guiderNode?.inputs) inputsToScan = guiderNode.inputs;
viaBasicGuider = guiderNode?.class_type === "BasicGuider";
}
for (const [key, val] of Object.entries(inputsToScan)) {
if (!Array.isArray(val)) continue;
// DualCFGGuider (HiDream E1): cond1 carries the positive-derived conditioning.
const isPos = key === "positive" || key === "cond1" || key.startsWith("positive");
// BasicGuider (Flux/Ming Image etc., no negative): its single "conditioning" input is positive.
const isPos = key === "positive" || key === "cond1" || key.startsWith("positive")
|| (viaBasicGuider && key === "conditioning");
const isNeg = key === "negative" || key.startsWith("negative");
if (!isPos && !isNeg) continue;
// TextEncodeMageFlowEdit / TextEncodeBooguEdit — 1ノードでprompt/negative_prompt両方を