Mihir Jagtap
debaa56f04
update gamecraft
2026-02-06 08:43:08 -08:00
Mihir Jagtap
c6df89a0de
Merge branch 'main' into hunyuan-gamecraft-v2-port
2026-02-06 09:47:33 +05:30
Mihir Jagtap
82f96eeb6b
fix merge conflicts
...
This branch has conflicts that must be resolved
Changes can be cleanly merged.
fastvideo/configs/pipelines/registry.py
fastvideo/pipelines/pipeline_registry.py
fastvideo/pipelines/stages/denoising.py
2026-02-05 20:15:40 -08:00
Mihir Jagtap
aac33e3876
update the denoising scripts
2026-02-05 19:37:20 -08:00
Mihir Jagtap
8ff3ab01a5
Update denoising.py
2026-02-05 19:32:35 -08:00
Mihir Jagtap
62f0866a46
Create gamecraft_denoising.py
2026-02-05 19:32:10 -08:00
MihirJagtap
1194120fd2
[feature] Add Hunyuan-GameCraft model support
...
Add support for Hunyuan-GameCraft video generation model with camera pose
conditioning via Plücker coordinates.
Components added:
- CameraNet module for camera pose encoding (fastvideo/models/cameranet.py)
- HunyuanGameCraftTransformer3DModel extending HunyuanVideo with CameraNet
- Model and pipeline configs with param_names_mapping for weight loading
- Weight conversion script for official PyTorch -> Diffusers safetensors
- Numerical parity test for DiT alignment validation
The implementation reuses existing HunyuanVideo components (VAE, text encoders,
transformer blocks) and adds CameraNet for game-specific camera control.
2026-02-05 19:00:38 -08:00
Wei Zhou
98308db7e0
[Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos ( #1046 )
2026-02-05 16:39:20 -08:00
Hao Zhang
c1e18f6722
Some minor fixes ( #1068 )
2026-02-05 16:28:00 -08:00
William Lin
75e193a2c9
[core] Refactor and centralize our registry for models, pipelines, and sampling params ( #1066 )
2026-02-05 14:40:30 -08:00
XOR-op
d6e0a7d0dd
[refactor] Action module ( #1065 )
2026-02-05 13:56:35 -08:00
William Lin and gemini-code-assist[bot]
7fc5f241da
[misc] Fix naming instruction in runpod.md ( #1067 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-05 13:45:49 -08:00
Mingjia Huo
aae48a7e90
[feat] HYworld VAE with cache ( #1057 )
2026-02-05 04:18:17 -08:00
William Lin
88f38eb0f4
[misc] upgrade torch to 2.10 ( #1048 )
2026-02-05 04:15:22 -08:00
Shao Duan
d750b463dc
Added Sequence Parallelism for LTX-2 Distilled ( #1036 )
2026-02-04 15:25:30 -08:00
KyleShao and Will Lin
e10b26a3d8
[feat] Add Cosmos 2.5 I2W/V2W support (staged pipeline + examples) ( #1021 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-02-04 14:19:30 -08:00
XOR-op
74636ba246
[chore]: use higher precision timestamp in logging ( #1062 )
2026-02-04 13:22:59 -08:00
Wei Zhou
7e2f3f14e7
[Bugfix] [Wan I2V] Fix CLIP Image encoder config ( #1063 )
2026-02-04 13:20:19 -08:00
Kaiqin Kong
caa1c402ba
[bugfix] Double Normalization in Preprocessing Dataset ( #1055 )
2026-01-31 11:11:59 -08:00
XOR-op
38a6bd93d3
[chore]: update sageattn3 installation instructions ( #1050 )
2026-01-29 15:45:52 -08:00
alexzms
b867ef7e7c
[SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests ( #1045 )
...
Fixes the sequence parallel sharding on t, now SP shards on t*h*w
2026-01-27 22:53:04 -08:00
William Lin
3ae58c277a
[docs] Update design overview and add agents tutorial ( #1044 )
2026-01-27 15:56:58 -08:00
Kaiqin Kong
0c6862ca55
[feature] Add Matrix Game 2.0 training ( #1017 )
...
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
2026-01-26 19:21:43 -08:00
XOR-op and Will Lin
e8c854bcf1
[docs] Offloading instruction ( #1022 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-26 13:40:28 -08:00
William Lin
06860e96fe
[docs] Update runpod instructions ( #1043 )
2026-01-26 13:13:54 -08:00
Matthew Noto
1b503554d1
[bugfix] fix torchvision import ( #1039 )
2026-01-24 22:37:14 -08:00
Shreejith SG and gemini-code-assist[bot]
351ceb7c59
[bugfix]: handle architectural differences while lora extraction ( #1035 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-24 15:42:28 -08:00
KyleShao
10875e0d7b
[bugfix] Fix NCCL all_gather contiguity + correct ParallelTiledVAE decode tiling threshold ( #1037 )
2026-01-24 15:37:35 -08:00
alexzms
1eaae8a10b
[ci] Increase ci test error threshold ( #1038 )
2026-01-24 15:36:10 -08:00
Mingjia Huo
59e00f6164
[feat] Add HY-World1.5-Bidirectional-480P-I2V ( #1027 )
...
VAE requires further improvement, will raise PR in near future.
2026-01-23 14:18:04 -08:00
745cc05b10
[bugfix] Allow update timesteps for hy1.5 model. ( #1033 )
...
Co-authored-by: Davids048 <jundasu@ucsd.edu >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-22 22:04:53 -08:00
William Lin
c5dc244871
[bugfix] add omegaconf as dep. ( #1032 )
2026-01-22 11:59:28 -08:00
alexzms
dbf3917bf4
[fastvideo-kernel] replace map to index with Triton implementation + add vsa benchmark ( #1029 )
2026-01-22 11:35:02 -08:00
XOR-op
050f189c95
fix: SP for hunyuanvideo 1.5 ( #1026 )
2026-01-21 14:40:06 -08:00
Shao Duan and Will Lin
029216029f
Added LTX-2 Distilled T2V Generation ( #1016 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-21 14:11:39 -08:00
alexzms and William Lin
31f44110b5
[kernel] [bugfix] [ci] bump v0.2.4. Fix STA output handling, TurboDiffusion CUDA norm dtypes for fastvideo-kernel unit tests. ( #1020 )
...
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
2026-01-19 17:42:42 -08:00
William Lin
21f3ce6577
[kernel] Fix fastvideo-kernel release workflow ( #1019 )
2026-01-17 15:57:46 -08:00
XOR-op
785d123e36
[feat] Hooks API and layerwise offloading for all DiTs ( #1006 )
2026-01-17 11:22:02 -08:00
William Lin
d58c551c11
[chore] release fastvideo-kernel 0.2.3 ( #1018 )
2026-01-17 02:24:23 -08:00
alexzms
560628709c
[Bug Fix] Add autograd wrapper for block-sparse attention in fastvideo-kernel + fix CMake extension linking ( #1015 )
2026-01-16 21:16:43 -08:00
William Lin
0f53b51e6c
[CI] Fix OOM issues in ssim tests ( #1011 )
2026-01-16 21:15:20 -08:00
alexzms and Will Lin
06093a9c4e
[CI] SSIM tests optimization: load all model weights from Modal persistent Volume ( #958 )
...
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-16 11:50:43 -08:00
KyleShao
dbddfab6d2
[feat] Introduce Cosmos 2.5 Text2World pipeline ( #974 )
2026-01-15 15:09:05 -08:00
William Lin
7188170277
[misc] [bugfix] unpin 'av' in pyproject ( #1009 )
2026-01-13 15:40:46 -08:00
XOR-op
b7f69c2c1d
[feat!] Disable FSDP inference by default ( #1001 )
2026-01-13 14:20:05 -08:00
Loay Rashid
23a4531491
[CI] Fixed Turbodiffusion I2V CI ( #1002 )
2026-01-13 01:08:58 -08:00
William Lin and gemini-code-assist[bot]
7d52ad0118
[ci] temporarily disable turbodiffusion ssim test ( #1000 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-08 15:43:50 -08:00
Will Lin
4d7bf35fa3
Revert "dit"
...
This reverts commit a6a9c9ca07
2026-01-07 03:22:48 -08:00
Will Lin
a6a9c9ca07
dit
2026-01-07 03:18:48 -08:00
f4704847c2
[bugfix] Add configs for TurboDiffusion T2V/I2V models ( #993 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com >
2026-01-06 16:36:45 -06:00
Mihir Jagtap