Commit Graph
600 Commits
Author SHA1 Message Date
Mihir Jagtap d63cd5f845 Update __init__.py
removed redundant code
2026-02-12 13:11:47 -08:00
Mihir Jagtap 29eec9da97 Merge branch 'hunyuan-gamecraft-v2-port' of https://github.com/MihirJagtap/FastVideo into pr/1071 2026-02-12 13:09:40 -08:00
Mihir Jagtap 2dbeb378e9 Delete cameranet.py 2026-02-12 13:09:37 -08:00
Mihir Jagtap 2c663c761b Merge branch 'main' into hunyuan-gamecraft-v2-port 2026-02-10 13:49:18 -08:00
Kaiqin Kong 31c0f1b341 [feat] Port LingBot-World-Base (Cam) (#1081) 2026-02-10 11:12:33 -08:00
Mihir Jagtap 6610d13704 Merge branch 'main' into hunyuan-gamecraft-v2-port 2026-02-10 08:14:08 -08:00
William Lin 4bee0fa199 [misc] cleanup assets/ and demo/ (#1091) 2026-02-10 02:26:09 -08:00
530e6b8363 [Model] LTX 2 Base (#1064)
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: Will Lin <wlsaidhi@gmail.com>
2026-02-10 01:11:17 -08:00
Jinzhe Pan 9ab2725db1 [ci] CI Transformer Tests (#1089) 2026-02-10 01:08:59 -08:00
IshanandJinzhe Pan 0aff68f51d [Feat] Add Stable Diffusion 3.5 (#1075)
Co-authored-by: Jinzhe Pan <eigensystem1318@gmail.com>
2026-02-10 14:31:36 +08:00
Mihir Jagtap a905576f53 Create test_gamecraft_similarity.py 2026-02-09 20:33:14 -08:00
Mihir Jagtap 79461d58e0 Update gamecraft_denoising.py
fix i2v
2026-02-09 17:57:06 -08:00
ad58f802f3 [Feat] Port LTX2 trainer (#1074)
Co-authored-by: Davids048 <jundasu@ucsd.edu>
Co-authored-by: Matthew Noto <99706358+RandNMR73@users.noreply.github.com>
2026-02-09 17:32:57 -08:00
Wei Zhou 04fa356ee3 [Misc] [Training] Fixed a bunch of bugs in current training pipeline (#1084) 2026-02-09 16:01:05 -08:00
Mihir Jagtap 66dc833e3d add config, pipeline, basic example files 2026-02-09 15:55:28 -08:00
Matthew Notoandgemini-code-assist[bot] f9c076fe2b [misc] add AGENTS.md file (#1085)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-09 01:03:49 -08:00
Mihir Jagtap df2cfbeefc Update rotary_embedding.py
# For rotate_half style RoPE (used by HunyuanVideo, GameCraft),
        # we need to expand cos/sin to full head_dim using repeat_interleave.
        # The rotate_half operation works on consecutive PAIRS: (x0,x1), (x2,x3)...
        # so cos/sin must be interleaved: [c0,c0,c1,c1,...] to match the pairing.
        # Using torch.cat would produce [c0,c1,...,c0,c1,...] which is WRONG.
2026-02-08 21:23:13 -08:00
Mihir Jagtap 423a10afcc Add GameCraft VAE (AutoencoderKLCausal3D) for Hunyuan-GameCraft port
- Add GameCraftVAE and EncoderCausal3D/DecoderCausal3D in gamecraftvae.py
- Add gamecraftvae_blocks.py with DownEncoderBlockCausal3D, UpDecoderBlockCausal3D,
  and GameCraftVAEAttention (softmax upcast to float32 for bf16/fp16 stability)
- Add GameCraftVAEConfig with scaling_factor, temporal_compression_ratio=4,
  mid_block_causal_attn=True, and block_out_channels layout
- Register AutoencoderKLCausal3D -> GameCraftVAE in models registry for checkpoint loading
2026-02-08 12:24:36 -08:00
Mihir Jagtap db92ff7ba8 add the stages scripts [denoising and image encoding] 2026-02-08 12:20:45 -08:00
Mihir Jagtap 820cde2667 Update pipeline_batch_info.py
Camera/action control inputs (GameCraft)
2026-02-08 12:19:22 -08:00
Mihir Jagtap 5b196efb87 Update registry.py
Hunyuan (excludes gamecraft, hyworld, and versioned models)
2026-02-08 12:18:34 -08:00
Mihir Jagtap 938374a2e5 add conversion files full and text encoder 2026-02-08 12:16:12 -08:00
Mihir Jagtap 2285728de4 debug the vae and encoder tests 2026-02-08 12:13:41 -08:00
Mihir Jagtap b7b11f2b4e Create test_gamecraft_pipeline_parity.py 2026-02-07 14:11:35 -08:00
Mihir Jagtap 8efeee8da2 update rotary embedding and registry for gamecraft 2026-02-07 14:04:26 -08:00
Mihir Jagtap 66679d8ab3 add tests for text_encoders and vae 2026-02-07 13:59:47 -08:00
Mihir Jagtap 5744a23087 Create convert_gamecraft_vae.py 2026-02-07 13:53:35 -08:00
Mihir Jagtap 5e7caa8cb2 update the denoising stage 2026-02-07 13:52:17 -08:00
Mihir Jagtap 0c41d1dab5 update pipeline files 2026-02-07 13:50:38 -08:00
Mihir Jagtap 59e75f81d3 update sample files 2026-02-07 13:48:12 -08:00
Mihir Jagtap cf452eea54 add config and pipeline code for gamecraft 2026-02-07 13:46:49 -08:00
Mihir Jagtap ffc54c962f add gamecraft vae blocks and script 2026-02-07 13:44:58 -08:00
Mihir Jagtap 2979b4681d update the files (will be skipped) 2026-02-07 12:58:28 -08:00
Mihir Jagtap 2b4f3a231e update the conversion script 2026-02-07 12:57:18 -08:00
Mihir Jagtap b5f375faf6 Update registry.py 2026-02-07 12:56:03 -08:00
Mihir Jagtap 1b119943cd fix(gamecraft): correct the parity test 2026-02-07 12:55:15 -08:00
Mihir Jagtap 3f30a69cce fix(gamecraft): add GameCraftFinalLayer with correct shift/scale order
Introduce GameCraftFinalLayer to match official implementation (shift, scale)
2026-02-07 12:53:51 -08:00
Mihir Jagtap 0f3ff22190 Merge branch 'hao-ai-lab:main' into hunyuan-gamecraft-v2-port 2026-02-06 19:17:21 -08:00
XOR-op f76efe798e [bugfix]: _compile_conditions regression (#1077) 2026-02-06 18:57:43 -08:00
Zhang Peiyuan 09f455233e [misc] readme small fix (#1076) 2026-02-06 16:57:48 -08:00
XOR-op aea300f690 [perf]: use CUDA IPC in multiproc executor to avoid serialization overhead (#1061) 2026-02-06 19:43:18 -05:00
Hao Zhang b92219f6a6 more fix and relocate STA arguments to pipeline config (#1073) 2026-02-06 13:38:35 -08:00
Mihir Jagtap 8b09b3de74 update the tests and add checkpoint conversion code 2026-02-06 08:54:18 -08:00
Mihir Jagtap d0c6073074 update gamecraft pipeline code 2026-02-06 08:50:12 -08:00
Mihir Jagtap debaa56f04 update gamecraft 2026-02-06 08:43:08 -08:00
Jinzhe Pan a321b95a8a [Fix] remove video ratio limitation (#1069) 2026-02-05 20:33:08 -08:00
Mihir Jagtap c6df89a0de Merge branch 'main' into hunyuan-gamecraft-v2-port 2026-02-06 09:47:33 +05:30
Mihir Jagtap 82f96eeb6b fix merge conflicts
This branch has conflicts that must be resolved
Changes can be cleanly merged.

fastvideo/configs/pipelines/registry.py
fastvideo/pipelines/pipeline_registry.py
fastvideo/pipelines/stages/denoising.py
2026-02-05 20:15:40 -08:00
Mihir Jagtap aac33e3876 update the denoising scripts 2026-02-05 19:37:20 -08:00
Mihir Jagtap 8ff3ab01a5 Update denoising.py 2026-02-05 19:32:35 -08:00