SolitaryThinker
e7d6c40860
[feat] Port daVinci-MagiHuman base model with AV output
...
Ports GAIR-NLP/daVinci-MagiHuman's 15B-param joint-AV DiT into FastVideo:
text + video + audio joint denoise in one flat token stream, 32-step
FlowUniPC w/ CFG=2, Wan 2.2 TI2V-5B video VAE, Stable Audio Open 1.0
audio VAE (first-class port at fastvideo/models/vaes/oobleck.py, no
runtime diffusers import), T5-Gemma 9B UL2 text encoder, auto-muxed
mp4 with h264 video + aac stereo audio.
Parity tests all pass on converted weights: DiT (diff_median=2.6e-3),
text encoder (exact), video VAE (8e-4), audio VAE (exact), pipeline
latent (5e-2).
See .agents/skills/add-model/REVIEW.md for porting procedure + open
review items.
2026-05-05 10:55:49 -07:00
William Lin
140bd1a6cf
[misc]: standardize install instructions on uv pip install ( #1279 )
2026-05-02 12:45:50 -07:00
William Lin
c77a76c6af
[feat] Stable Audio Open 1.0: T2A + A2A + RePaint inpainting (native) ( #1260 )
2026-05-01 00:07:11 -07:00
William Lin
145a3f166b
[feat] [4/n] Improve API: refactor sampling param and merge with presets ( #1234 )
2026-04-16 14:10:02 -07:00
William Lin
c591d6d2a6
[feat] [2/n] Improve API: add initial support in video_generator ( #1220 )
2026-04-06 10:33:54 -07:00
vishruthb
5789955bbe
[feat] add gen3c (cosmos-7b) model and pipeline support ( #1059 )
2026-04-01 11:42:02 +00:00
Zhang Peiyuan
cd1b7cf139
[Refactor] SP Mask --> original seq len; HunyuanVideo 1.5 does not need mask ( #1142 )
2026-03-04 11:44:47 +08:00
10fc92dba5
Upstream LTX2 Training ( #1116 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Peiyuan Zhang <a1286225768@slurm-h200-204-239.slurm-compute.tenant-slurm.svc.cluster.local >
2026-02-21 16:06:55 -08:00
8e39ce38c9
[Feat] Native dit implementation for SD3.5 ( #1093 )
...
Co-authored-by: Ishan Vaish <vaish.ishan@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-02-18 10:19:40 +08:00
Mihir Jagtap
7a83e0e6fc
[feature] Add Hunyuan-GameCraft model support ( #1071 )
2026-02-14 08:07:44 +08:00
Shao Duan and Will Lin
7f795600c8
[bugfix] Fixed ltx2 base cfg guidance ( #1095 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-13 11:53:11 -08:00
Kaiqin Kong
31c0f1b341
[feat] Port LingBot-World-Base (Cam) ( #1081 )
2026-02-10 11:12:33 -08:00
William Lin
4bee0fa199
[misc] cleanup assets/ and demo/ ( #1091 )
2026-02-10 02:26:09 -08:00
530e6b8363
[Model] LTX 2 Base ( #1064 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-10 01:11:17 -08:00
Ishan and Jinzhe Pan
0aff68f51d
[Feat] Add Stable Diffusion 3.5 ( #1075 )
...
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com >
2026-02-10 14:31:36 +08:00
ad58f802f3
[Feat] Port LTX2 trainer ( #1074 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com >
2026-02-09 17:32:57 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Mingjia Huo
aae48a7e90
[feat] HYworld VAE with cache ( #1057 )
2026-02-05 04:18:17 -08:00
KyleShao and Will Lin
e10b26a3d8
[feat] Add Cosmos 2.5 I2W/V2W support (staged pipeline + examples) ( #1021 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-04 14:19:30 -08:00
Kaiqin Kong
0c6862ca55
[feature] Add Matrix Game 2.0 training ( #1017 )
...
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
XOR-op
b7f69c2c1d
[feat!] Disable FSDP inference by default ( #1001 )
2026-01-13 14:20:05 -08:00
f4704847c2
[bugfix] Add configs for TurboDiffusion T2V/I2V models ( #993 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-06 16:36:45 -06:00
Shao Duan
d6651afd2e
[examples] Added longcat-video python api examples ( #994 )
2026-01-06 15:03:42 -06:00
William Lin
2f0a2b3c57
[misc] add pin_cpu_memory false for RTX 4090 ( #990 )
2026-01-05 15:45:35 -06:00
Loay Rashid
e7748d9952
[feat] add Turbodiffusion I2V pipeline ( #984 )
2026-01-05 15:41:23 -06:00
Kaiqin Kong
581e8115fe
[feat] support Matrix-Game 2.0 streaming generation ( #957 )
2026-01-02 19:14:38 -06:00
Loay Rashid
dea69cf651
[New Model] Turbodiffusion ( #971 )
2026-01-02 17:55:56 -06:00
Wei Zhou
1f70032af5
[New Model] Hunyuan1.5 ( #943 )
2025-12-21 00:57:52 -06:00
Kaiqin Kong
8fe1689968
[feat] Add Matrix-Game 2.0 ( #938 )
2025-12-20 14:09:12 -06:00
Loay Rashid
e53730f324
[docs] Minor Fixes ( #942 )
2025-12-19 16:48:16 -06:00
Wei Zhou
bef8169bb1
[Feat] [I2V] resize all image sizes to below 480*832 ( #890 )
2025-11-20 00:08:36 -08:00
e3b4564d5a
[feat] Add inference for MoE SF ( #880 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-11-19 13:16:24 -08:00
William Lin
62b95d8287
[feat] prepare for wan2.2 SF ( #861 )
2025-11-04 18:06:48 -08:00
Jinzhe Pan and Xingyu Long
f4c58894d9
[Feat] add ray support ( #838 )
...
Co-authored-by: Xingyu Long <xingyulong97@gmail.com >
2025-10-16 23:17:54 -07:00
Jiali Chen
404314d00f
[Feature]Add video-to-video (V2V) pipeline ( #829 )
2025-10-12 21:53:05 -07:00
Wei Zhou and SolitaryThinker
359151d9a0
[Feature] Add wan2.2 5b i2v ( #760 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-28 18:15:59 -07:00
Wei Zhou and SolitaryThinker
ce67cd3729
[Feat] Support Self-Forcing's Causal Inference for Wan2.1 T2V 1.3B ( #766 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-28 16:47:49 -07:00
Wenxuan Tan
5357f63327
Fix LoRA load from training checkpoint ( #719 )
2025-08-09 20:46:00 -05:00
Wei Zhou and SolitaryThinker
c41305ad18
[Feat] Add Wan2.2 14B MoE ( #688 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-08-06 20:31:03 -07:00
Wei Zhou
3b1b54a74d
Modify args to make sure the scripts are runnable on 4090 ( #671 )
2025-07-30 14:55:08 -07:00
Zhang Peiyuan
cbc3a6bb9d
[Feat] Support VSA with any resolution. ( #650 )
2025-07-28 20:14:40 -07:00
William Lin
81c9df629c
[core] Add offloading for vae and image encoder and rename offloading args ( #643 )
2025-07-25 17:55:03 -07:00
William Lin
f572319bd9
[Feature] Remove V1 folder ( #642 )
2025-07-24 22:43:12 -07:00
Yongqi Chen and SolitaryThinker
4264a80ca9
[Feature] Add DMD inference pipeline ( #637 )
...
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-07-24 21:00:47 -07:00
RandNMR73
b79d1fc15b
video gen working on apple silicon (addressed issues from prior pr) ( #595 )
2025-07-15 22:04:27 -07:00
Wenxuan Tan
ed1e8d6bad
[Feature] Offload all text encoders by default ( #594 )
2025-07-03 19:30:14 -05:00
William Lin
5f938b5844
[Revert] "[Feature] Load weights from distributed" ( #571 )
2025-06-28 20:55:14 -05:00