nodes/hao-ai-lab-FastVideo
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
726 Commits 339 Branches 8 Tags
fix/workload-type-from-registration
Commit Graph
726 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
alexzms af01289b30 [bugfix] registry: infer workload_type from model registration instead of defaulting to T2V 
get_model_info() hard-defaulted workload_type to T2V when the caller
didn't pass one. Models registered for a single non-T2V workload (e.g.
Matrix-Game-2.0, registered I2V-only) then failed pipeline resolution:

  ValueError: Pipeline 'MatrixGame2I2VPipeline' is not supported for
  pipeline type 'basic' and workload type 't2v'

This deterministically breaks the Matrix-Game-2.0 SSIM full-suite test.

When workload_type is None, derive it from the model's registered
ConfigInfo.workload_types: use it if the model registers exactly one
workload, otherwise keep the T2V fallback. Behavior is unchanged for
T2V models and for multi/empty registrations; only single-non-T2V
models (the broken case) change. config_info is resolved once, earlier.
 2026-05-17 19:34:52 +00:00
William LinandDavids048 30c45620a2 [infra] [dreamverse]: add instruction to install nasm and update ffmpeg installer to work in plain venv (#1361) 
Co-authored-by: Davids048 <jundasu@ucsd.edu>
 2026-05-17 01:10:55 +00:00
Shao Duanandklhhhhh 6b2c731596 [feat] eval: add audio metrics (#1352) 
Co-authored-by: klhhhhh <1412841649@qq.com>
 2026-05-16 14:47:37 -07:00
William Lin e6022c20b2 [misc]: demote ROCm-unavailable startup message to DEBUG (#1360) 2026-05-15 22:12:16 -07:00
William Linjzhang38RandNMR73
 		460f6e398e [feat]: Add NVFP4QAT linear layer (Attn-QAT 3/12) (#1350) 
Co-authored-by: jzhang38 <42993249+jzhang38@users.noreply.github.com>
Co-authored-by: RandNMR73 <99706358+RandNMR73@users.noreply.github.com>
 2026-05-15 18:42:02 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		d2ffec5cce [perf] Dreamverse 14/14: Add LTX2 profile speedups (#1337) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-15 18:10:47 -07:00
alexzmsandmergify[bot] cb12e88713 [perf] shallow-copy VSA attn_metadata in train model plugins (#1342) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-15 16:10:12 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		0958c344b8 [feat] Dreamverse 13/14: Activate LTX2 integration (#1336) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-15 15:35:05 -07:00
Junda Su 71dc27ea7b [misc]: Add Dreamverse deploy skill frontmatter (#1353) 2026-05-15 15:23:17 -07:00
Junda SuandSolitaryThinker 1263449d2a [docs] Add copy page action (#1351) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
 2026-05-15 14:59:04 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		b4de5a9f1b [feat] Dreamverse 12/14: Add LTX2 refine and upsampler support (#1335) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-15 12:21:40 -07:00
William Linjzhang38RandNMR73
 		8acd8e21f9 [feat]: Add NVFP4QAT quantization config (Attn-QAT 2/12) (#1348) 
Co-authored-by: jzhang38 <42993249+jzhang38@users.noreply.github.com>
Co-authored-by: RandNMR73 <99706358+RandNMR73@users.noreply.github.com>
 2026-05-14 16:53:48 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		d45d82334f [infra] Dreamverse 11/14: Add NVFP4 quantization support (#1334) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-14 16:26:39 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		6392bd40a9 [feat] Dreamverse 10/14: Add serving API contracts (#1333) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-14 10:07:01 -07:00
Shao Duan 17f07bc313 [feat] eval: async VideoPool + metric streamlines (#1320) 2026-05-13 15:57:37 -07:00
William Lin 325861fb99 [misc]: PR-1225 sync — housekeeping (1/12) (#1347) 2026-05-13 15:21:52 -07:00
William Lin c5088670c8 [misc]: empty __init__.py files with no logic (#1346) 2026-05-13 13:09:40 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		0403c6f47e [infra] Dreamverse 09/14: Add Docker and launch scripts (#1332) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 18:01:11 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuangemini-code-assist[bot]
 		a55b1cdde4 [feat] Dreamverse 08/14: Add frontend media and E2E coverage (#1331) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-12 17:45:05 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		aec9a20a16 [feat] Dreamverse 07/14: Add frontend session UI (#1330) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 17:22:45 -07:00
Wenxuan TanClaude Opus 4.6gemini-code-assist[bot]mergify[bot]
 		b4458e5bae feat: FP4 Flash Attention 4 for Blackwell GPUs (#1221) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-12 17:04:39 -07:00
Kaiqin Kongandmergify[bot] a790153705 [bugfix] MatrixGame2 SF distillation under gradient checkpointing (#1340) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-12 17:01:04 -07:00
alexzmsandmergify[bot] 0df1445d0d [ci] add GPU model loading tests for fastvideo.train (PR 4/9) (#1274) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-12 16:54:37 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		038da6e02b [feat] Dreamverse 06/14: Add frontend scaffold (#1329) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 16:44:13 -07:00
William Lin 3fb2fbe1a2 [infra]: MagiHuman checkpoint conversion + push scripts (7/8) (#1301) 2026-05-12 15:45:15 -07:00
William Lin acea9d23e1 [docs]: MagiHuman provenance - AGENTS.md, JOURNAL.md, lessons (6/8) (#1300) 2026-05-12 15:40:47 -07:00
William Lin b7a448cf5b [feat]: MagiHuman pipeline orchestrator + 10-test parity battery (5/8) (#1299) 2026-05-12 15:12:54 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		04e32991c6 [feat] Dreamverse 05/14: Add streaming runtime (#1328) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 15:11:18 -07:00
William Lin 424c643b6e [feat]: MagiHuman pipeline stages (4/8) (#1298) 2026-05-12 14:59:21 -07:00
William Lin de803cb250 [feat]: MagiHuman DiT (transformer) port + parity tests (3/8) (#1297) 2026-05-12 14:49:03 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		effc1d3492 [feat] Dreamverse 04/14: Add session and prompt logic (#1327) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 14:45:56 -07:00
William Lin b1ddb1ba33 [feat]: T5-Gemma encoder for MagiHuman pipeline (2/8) (#1296) 2026-05-12 13:59:55 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		9ff65c83b6 [feat] Dreamverse 03/14: Add backend skeleton (#1326) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 13:58:23 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		15473f3c77 [docs] Dreamverse 02/14: Add app documentation (#1325) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 13:34:42 -07:00
William Lin 490641cf47 [infra]: MagiHuman housekeeping (gitignore, codespell, skills index) (1/8) (#1295) 2026-05-12 12:50:01 -07:00
Junda SuSolitaryThinkerMatthew NotoXOR-opZhang Peiyuan
 		4ad6880ca6 [docs] Dreamverse 01/14: Add integration provenance (#1324) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-12 11:42:42 -07:00
Raghav K 9d0af28307 [feat] Add Cosmos 2.5 T2W training pipeline (LoRA + full fine-tune) (#1227) 2026-05-11 19:15:00 -07:00
Kaiqin Kongmignonjiaalexzmsmergify[bot]
 		d6dfe95466 [feat] FastVideo World Model Training (#1179) 
Co-authored-by: mignonjia <mhuo@ucsd.edu>
Co-authored-by: alexzms <3036648523@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-11 05:13:12 +00:00
alexzmsandmergify[bot] 636d3b743e [misc] attention hot-path cleanup + denoising loop hoists (#1272) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-10 11:51:10 -07:00
William LinandRaghav e3a5c6954f [misc]: import add-model skill stack to .agents/skills/ (#1308) 
Co-authored-by: Raghav <ragg04@gmail.com>
 2026-05-09 13:06:54 -07:00
Aryan KumarAryan Kumaralexzmsmergify[bot]
 		f633e30ebb [feat]: add LongCat bidirectional finetuning support (#1244) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: alexzms <3036648523@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-09 12:20:43 -07:00
William Lin 5ce4947ac2 [ci] mergify: accept [skill]/[skills] and [infra] PR title tags (#1309) 2026-05-08 17:14:21 -07:00
William Lin 323d74c0d2 [skills]: New skill - decompose-pipeline-pr (#1303) 2026-05-08 16:05:58 -07:00
William Lin d98aeafc86 [feat]: Loader umbrella-repo support + optional component dirs (#1294) 2026-05-08 15:24:26 -07:00
Shao Duan f6396fb8c6 [feat] Add fastvideo.eval video evaluation suite (#1305) 2026-05-07 20:31:15 -07:00
William Lin 6300329cd5 [infra]: Add activation trace hooks for pipeline debugging (#1293) 2026-05-07 16:38:13 -07:00
MookandSolitaryThinker c17d33bf33 [ci] Replace flaky LTX-2 pixel SSIM with latent-slice cosine regression (#1253) 
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
 2026-05-05 03:36:58 -07:00
William LinJunda SuMatthew NotoXOR-opZhang Peiyuan
 		2aaeee2ab8 [feat] Improve API: streaming router (multi-replica load balancer + ws proxy) (#1286) 
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-05 03:00:08 -07:00
William LinJunda SuMatthew NotoXOR-opZhang Peiyuan
 		eb3a394224 [feat] Improve API: streaming auxiliaries (safety, rewrite, logger, mock) (#1284) 
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-05 00:14:34 -07:00
William LinJunda SuMatthew NotoXOR-opZhang Peiyuan
 		f673423b51 [feat] Improve API: streaming prompt enhancer with LLMProvider abstraction (#1258) 
Co-authored-by: Junda (David) Su <90978028+Davids048@users.noreply.github.com>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
Co-authored-by: XOR-op <17672363+XOR-op@users.noreply.github.com>
Co-authored-by: Zhang Peiyuan <42993249+jzhang38@users.noreply.github.com>
 2026-05-04 13:44:40 -07:00