nodes/hao-ai-lab-FastVideo
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
555 Commits 351 Branches 8 Tags
debaa56f04f48c8a24d85f66acfaad45a809daa0
Commit Graph
376 Commits
Author SHA1 Message Date
Mihir Jagtap debaa56f04 update gamecraft 2026-02-06 08:43:08 -08:00
Mihir Jagtap c6df89a0de Merge branch 'main' into hunyuan-gamecraft-v2-port 2026-02-06 09:47:33 +05:30
Mihir Jagtap 82f96eeb6b fix merge conflicts 
This branch has conflicts that must be resolved
Changes can be cleanly merged.

fastvideo/configs/pipelines/registry.py
fastvideo/pipelines/pipeline_registry.py
fastvideo/pipelines/stages/denoising.py
 2026-02-05 20:15:40 -08:00
Mihir Jagtap aac33e3876 update the denoising scripts 2026-02-05 19:37:20 -08:00
Mihir Jagtap 8ff3ab01a5 Update denoising.py 2026-02-05 19:32:35 -08:00
Mihir Jagtap 62f0866a46 Create gamecraft_denoising.py 2026-02-05 19:32:10 -08:00
MihirJagtap 1194120fd2 [feature] Add Hunyuan-GameCraft model support 
Add support for Hunyuan-GameCraft video generation model with camera pose
conditioning via Plücker coordinates.

Components added:
- CameraNet module for camera pose encoding (fastvideo/models/cameranet.py)
- HunyuanGameCraftTransformer3DModel extending HunyuanVideo with CameraNet
- Model and pipeline configs with param_names_mapping for weight loading
- Weight conversion script for official PyTorch -> Diffusers safetensors
- Numerical parity test for DiT alignment validation

The implementation reuses existing HunyuanVideo components (VAE, text encoders,
transformer blocks) and adds CameraNet for game-specific camera control.
 2026-02-05 19:00:38 -08:00
Wei Zhou 98308db7e0 [Feature] [Hy1.5] Support HY1.5 super-resolution pipeline for 1080p videos (#1046) 2026-02-05 16:39:20 -08:00
Hao Zhang c1e18f6722 Some minor fixes (#1068) 2026-02-05 16:28:00 -08:00
William Lin 75e193a2c9 [core] Refactor and centralize our registry for models, pipelines, and sampling params (#1066) 2026-02-05 14:40:30 -08:00
XOR-op d6e0a7d0dd [refactor] Action module (#1065) 2026-02-05 13:56:35 -08:00
Mingjia Huo aae48a7e90 [feat] HYworld VAE with cache (#1057) 2026-02-05 04:18:17 -08:00
William Lin 88f38eb0f4 [misc] upgrade torch to 2.10 (#1048) 2026-02-05 04:15:22 -08:00
Shao Duan d750b463dc Added Sequence Parallelism for LTX-2 Distilled (#1036) 2026-02-04 15:25:30 -08:00
KyleShaoandWill Lin e10b26a3d8 [feat] Add Cosmos 2.5 I2W/V2W support (staged pipeline + examples) (#1021) 
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
 2026-02-04 14:19:30 -08:00
XOR-op 74636ba246 [chore]: use higher precision timestamp in logging (#1062) 2026-02-04 13:22:59 -08:00
Wei Zhou 7e2f3f14e7 [Bugfix] [Wan I2V] Fix CLIP Image encoder config (#1063) 2026-02-04 13:20:19 -08:00
Kaiqin Kong caa1c402ba [bugfix] Double Normalization in Preprocessing Dataset (#1055) 2026-01-31 11:11:59 -08:00
XOR-op 38a6bd93d3 [chore]: update sageattn3 installation instructions (#1050) 2026-01-29 15:45:52 -08:00
alexzms b867ef7e7c [SP Sharding] Fix SP loss sharding on token axis (thw) with padding; add distributed correctness tests (#1045) 
Fixes the sequence parallel sharding on t, now SP shards on t*h*w
 2026-01-27 22:53:04 -08:00
Kaiqin Kong 0c6862ca55 [feature] Add Matrix Game 2.0 training (#1017) 
The CI tests are quite unstable, but since multiple CI tests indicates that each individual tests are passed, I think we can merge this.
 2026-01-26 19:21:43 -08:00
Matthew Noto 1b503554d1 [bugfix] fix torchvision import (#1039) 2026-01-24 22:37:14 -08:00
KyleShao 10875e0d7b [bugfix] Fix NCCL all_gather contiguity + correct ParallelTiledVAE decode tiling threshold (#1037) 2026-01-24 15:37:35 -08:00
alexzms 1eaae8a10b [ci] Increase ci test error threshold (#1038) 2026-01-24 15:36:10 -08:00
Mingjia Huo 59e00f6164 [feat] Add HY-World1.5-Bidirectional-480P-I2V (#1027) 
VAE requires further improvement, will raise PR in near future.
 2026-01-23 14:18:04 -08:00
Junda (David) SuDavids048gemini-code-assist[bot]
 		745cc05b10 [bugfix] Allow update timesteps for hy1.5 model. (#1033) 
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-22 22:04:53 -08:00
XOR-op 050f189c95 fix: SP for hunyuanvideo 1.5 (#1026) 2026-01-21 14:40:06 -08:00
Shao DuanandWill Lin 029216029f Added LTX-2 Distilled T2V Generation (#1016) 
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
 2026-01-21 14:11:39 -08:00
alexzmsandWilliam Lin 31f44110b5 [kernel] [bugfix] [ci] bump v0.2.4. Fix STA output handling, TurboDiffusion CUDA norm dtypes for fastvideo-kernel unit tests. (#1020) 
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com>
 2026-01-19 17:42:42 -08:00
XOR-op 785d123e36 [feat] Hooks API and layerwise offloading for all DiTs (#1006) 2026-01-17 11:22:02 -08:00
alexzms 560628709c [Bug Fix] Add autograd wrapper for block-sparse attention in fastvideo-kernel + fix CMake extension linking (#1015) 2026-01-16 21:16:43 -08:00
William Lin 0f53b51e6c [CI] Fix OOM issues in ssim tests (#1011) 2026-01-16 21:15:20 -08:00
alexzmsandWill Lin 06093a9c4e [CI] SSIM tests optimization: load all model weights from Modal persistent Volume (#958) 
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
 2026-01-16 11:50:43 -08:00
KyleShao dbddfab6d2 [feat] Introduce Cosmos 2.5 Text2World pipeline (#974) 2026-01-15 15:09:05 -08:00
XOR-op b7f69c2c1d [feat!] Disable FSDP inference by default (#1001) 2026-01-13 14:20:05 -08:00
Loay Rashid 23a4531491 [CI] Fixed Turbodiffusion I2V CI (#1002) 2026-01-13 01:08:58 -08:00
William Linandgemini-code-assist[bot] 7d52ad0118 [ci] temporarily disable turbodiffusion ssim test (#1000) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-08 15:43:50 -08:00
Will Lin 4d7bf35fa3 Revert "dit" 
This reverts commit a6a9c9ca07.
 2026-01-07 03:22:48 -08:00
Will Lin a6a9c9ca07 dit 2026-01-07 03:18:48 -08:00
Loay Rashidgemini-code-assist[bot]Will Lin
 		f4704847c2 [bugfix] Add configs for TurboDiffusion T2V/I2V models (#993) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
 2026-01-06 16:36:45 -06:00
William Lin cf67618cad [chore] release 0.1.7 (real) (#980) 2026-01-05 15:47:05 -06:00
Loay Rashid e7748d9952 [feat] add Turbodiffusion I2V pipeline (#984) 2026-01-05 15:41:23 -06:00
Shao Duan d6ddcea682 Add LongCat-Video I2V and Video Continuation (Base, Distillation and Refinement) Support to FastVideo (#953) 2026-01-04 22:20:09 -06:00
William Lin 4ce4ac4734 [ci] increase ssim and lora inference test timeout (#985) 2026-01-04 15:08:20 -06:00
Ohm-Rishabh d83f45a6a0 Layer offloading (#966) 2026-01-03 21:46:00 -08:00
XOR-op dd91542cd1 [feat] Support text encoder weight override and quantization (#983) 2026-01-03 15:33:33 -06:00
Kaiqin Kong 581e8115fe [feat] support Matrix-Game 2.0 streaming generation (#957) 2026-01-02 19:14:38 -06:00
Loay Rashid dea69cf651 [New Model] Turbodiffusion (#971) 2026-01-02 17:55:56 -06:00
XOR-op 60ac6537df [feat] Support absmax style quantization for FP8 (#981) 2026-01-02 16:00:18 -06:00
William Lin 40ce2d72f5 [kernel] add turbodiffusion kernels (#972) 2025-12-30 04:23:10 -06:00