shaoxiongduan
f6275f8005
[feat] Port wm-eval into fastvideo as fastvideo.eval
...
Adds an in-process evaluation suite covering native (SSIM/PSNR/LPIPS/
optical_flow), audio, physics_iq, vbench (16 sub-metrics), and
videoscore2. Public API: create_evaluator/evaluate, BaseMetric +
@register, ensure_checkpoint, get_cache_dir. CLI: fastvideo eval
list/run.
VBench upstream pinned as a git submodule at
fastvideo/third_party/eval/vbench (Vchitect/VBench@45e79ec ); modern-dep
compat is achieved via runtime shims in vbench/__init__.py rather than
on-disk patches. CLIP/torch.hub caches are routed through
${FASTVIDEO_EVAL_CACHE}; HF cache stays at the system default.
ensure_checkpoint delegates to fastvideo.utils.get_lock + huggingface_hub
primitives. Evaluator supports release_cuda_memory(), unload(),
reload() for training-time eval that frees GPU between calls.
Verified parity against upstream vbench (5/8 metrics bit-exact, others
within 1% drift driven by transformers/torch version skew) and against
upstream VideoScore2 (regex anchored on the actual model's output
format, soft-score formula matches upstream's argmax*max_prob/total).
Includes docs/contributing/eval-metrics.md as the porting guide.
Out of scope (deferred follow-ups): MIND, VBench-2.0, FVD as a
registered metric, training-time EvalCallback.
2026-05-01 23:17:19 +00:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
William Lin
c591d6d2a6
[feat] [2/n] Improve API: add initial support in video_generator ( #1220 )
2026-04-06 10:33:54 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
Zhang Peiyuan
fea556269b
[Misc] Fix memory leakage in VideoGenerator ( #1132 )
2026-02-26 19:51:32 -08:00
Zhang Peiyuan and Will Lin
fc80d95d7e
[Misc] Remove STA ( #1124 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-23 15:14:42 -08:00
Zhang Peiyuan
128d0b7fc5
[Misc] Remove Teacache ( #1121 )
2026-02-22 16:53:07 -08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
8e39ce38c9
[Feat] Native dit implementation for SD3.5 ( #1093 )
...
Co-authored-by: Ishan Vaish <vaish.ishan@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-02-18 10:19:40 +08:00
Mihir Jagtap
7a83e0e6fc
[feature] Add Hunyuan-GameCraft model support ( #1071 )
2026-02-14 08:07:44 +08:00
Shao Duan and Will Lin
7f795600c8
[bugfix] Fixed ltx2 base cfg guidance ( #1095 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-13 11:53:11 -08:00
Kaiqin Kong
31c0f1b341
[feat] Port LingBot-World-Base (Cam) ( #1081 )
2026-02-10 11:12:33 -08:00
William Lin
4bee0fa199
[misc] cleanup assets/ and demo/ ( #1091 )
2026-02-10 02:26:09 -08:00
530e6b8363
[Model] LTX 2 Base ( #1064 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-10 01:11:17 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Mingjia Huo
aae48a7e90
[feat] HYworld VAE with cache ( #1057 )
2026-02-05 04:18:17 -08:00
KyleShao and Will Lin
e10b26a3d8
[feat] Add Cosmos 2.5 I2W/V2W support (staged pipeline + examples) ( #1021 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-04 14:19:30 -08:00
Kaiqin Kong
0c6862ca55
[feature] Add Matrix Game 2.0 training ( #1017 )
...
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
XOR-op
b7f69c2c1d
[feat!] Disable FSDP inference by default ( #1001 )
2026-01-13 14:20:05 -08:00
f4704847c2
[bugfix] Add configs for TurboDiffusion T2V/I2V models ( #993 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-06 16:36:45 -06:00
Shao Duan
d6651afd2e
[examples] Added longcat-video python api examples ( #994 )
2026-01-06 15:03:42 -06:00
William Lin
2f0a2b3c57
[misc] add pin_cpu_memory false for RTX 4090 ( #990 )
2026-01-05 15:45:35 -06:00
Loay Rashid
e7748d9952
[feat] add Turbodiffusion I2V pipeline ( #984 )
2026-01-05 15:41:23 -06:00
XOR-op
dd91542cd1
[feat] Support text encoder weight override and quantization ( #983 )
2026-01-03 15:33:33 -06:00
Kaiqin Kong
581e8115fe
[feat] support Matrix-Game 2.0 streaming generation ( #957 )
2026-01-02 19:14:38 -06:00
Loay Rashid
dea69cf651
[New Model] Turbodiffusion ( #971 )
2026-01-02 17:55:56 -06:00
Wei Zhou
1f70032af5
[New Model] Hunyuan1.5 ( #943 )
2025-12-21 00:57:52 -06:00
Kaiqin Kong
8fe1689968
[feat] Add Matrix-Game 2.0 ( #938 )
2025-12-20 14:09:12 -06:00
Loay Rashid
e53730f324
[docs] Minor Fixes ( #942 )
2025-12-19 16:48:16 -06:00
Wei Zhou
bef8169bb1
[Feat] [I2V] resize all image sizes to below 480*832 ( #890 )
2025-11-20 00:08:36 -08:00
e3b4564d5a
[feat] Add inference for MoE SF ( #880 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-11-19 13:16:24 -08:00
William Lin
62b95d8287
[feat] prepare for wan2.2 SF ( #861 )
2025-11-04 18:06:48 -08:00
William Lin and ainsley
9370234294
[feat] Add gradio local inference demo ( #847 )
...
Co-authored-by: ainsley <jzhang2765@wisc.edu >
2025-10-26 07:01:33 -07:00
Jinzhe Pan and Xingyu Long
f4c58894d9
[Feat] add ray support ( #838 )
...
Co-authored-by: Xingyu Long <xingyulong97@gmail.com >
2025-10-16 23:17:54 -07:00
Jiali Chen
404314d00f
[Feature]Add video-to-video (V2V) pipeline ( #829 )
2025-10-12 21:53:05 -07:00
Wei Zhou and SolitaryThinker
359151d9a0
[Feature] Add wan2.2 5b i2v ( #760 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-28 18:15:59 -07:00
Wei Zhou and SolitaryThinker
ce67cd3729
[Feat] Support Self-Forcing's Causal Inference for Wan2.1 T2V 1.3B ( #766 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-28 16:47:49 -07:00
William Lin
3ef04f1654
[misc] [docs] Various fixes for logging and docs ( #758 )
2025-08-23 21:13:50 -07:00
Wenxuan Tan
989a03532c
Optionally use unmerged weights for inference ( #745 )
2025-08-22 15:20:31 -07:00
William Lin and RandNMR73
8cae5e4708
[feature] add Gradio live serving demo code ( #727 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
2025-08-10 15:34:03 -07:00
Wenxuan Tan
5357f63327
Fix LoRA load from training checkpoint ( #719 )
2025-08-09 20:46:00 -05:00
Wenxuan Tan
6c6bcd914d
Remove all empty_cache ( #713 )
2025-08-07 22:50:38 -07:00
Wei Zhou and SolitaryThinker
c41305ad18
[Feat] Add Wan2.2 14B MoE ( #688 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-06 20:31:03 -07:00
Wei Zhou
3b1b54a74d
Modify args to make sure the scripts are runnable on 4090 ( #671 )
2025-07-30 14:55:08 -07:00
shaoxiongduan