nodes/hao-ai-lab-FastVideo
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,178 Commits 344 Branches 8 Tags
01be8e707ad50cdbef0f67c112fcf6a6bc9a37ea
Commit Graph
1178 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Aryan Kumar 01be8e707a [misc]: serve the Regenerate-2K examples on TORCH_SDPA and drop narrating comments 
FLASH_ATTN bypassed the cuDNN attention the refine stage selects; TORCH_SDPA keeps it.
 2026-10-30 11:35:48 -07:00
Aryan Kumar 39a5679885 [docs]: Open-H3-Regenerate-2K cookbook entry and a v2v cookbook workload 2026-10-30 11:35:48 -07:00
Aryan Kumar a3675a440f [misc]: classify the Regenerate-2K pipeline config fields in the schema inventory 2026-10-30 11:35:48 -07:00
Aryan Kumar 32c7a18fb1 [bugfix]: merge a wider-than-base LoRA at its own precision under FSDP too 
The FSDP (DTensor) merge path still cast the adapter to the BF16 base before multiplying, so an FP32 adapter merged
differently with FSDP on. Both paths now share one helper, which also moves the factors to the weight's device.
 2026-10-30 11:35:48 -07:00
Aryan Kumar 0268b98d41 [bugfix]: re-attach the Sharp curve branches to every loaded transformer instance 
attach() remembered the lazy proxy's id, so after the transformer was released and loaded again the new instance
never got its 50 curve hooks and later requests ran without them. The branches now attach to the materialized
module and mark that module, so each loaded instance gets its own hooks.
 2026-10-30 11:35:48 -07:00
Aryan Kumar e435382959 Merge remote-tracking branch 'origin/main' into aryan/open-h3-regenerate-2k 2026-10-30 11:35:48 -07:00
Lifa Ha d9e6c3eb82 [bugfix] Fix extra work in VSA64 layout benchmark (#2027) 2026-10-30 02:30:07 +00:00
Aryan Kumar 63ef3435d4 [docs]: Open-H3-Regenerate-2K guide and support matrix entry 2026-10-29 00:27:33 -07:00
Aryan Kumar 4519f8c488 [feat]: serve Open-H3-Regenerate-2K through the OpenAI video routes, with example and serving YAML 2026-10-29 00:27:33 -07:00
Aryan Kumar c168d3f31f [new-model]: Open-H3-Regenerate-2K pipeline (latent upscaler, Sharp curve branches, refine sampler) 2026-10-29 00:27:33 -07:00
Aryan Kumar 29372dc5e8 [fix]: merge a wider-than-base LoRA at its own precision and round once 2026-10-29 00:27:33 -07:00
Aryan Kumar 7203b4976e [bugfix]: compile only the LoRA delta, not the wrapped base layer 
BaseLayerWithLoRA.forward was decorated with torch.compile, so wrapping a linear also compiled its base layer.
Compiling a packed NVFP4/FP8 linear on its own changes its numerics, so a wrapped layer at strength 0 could differ
from the unwrapped layer. forward now adds no compiled region: the base layer runs exactly as it would unwrapped
(eagerly, or traced with a caller's compiled block), and only the adapter delta is compiled.
 2026-10-28 14:49:15 -07:00
Aryan Kumar 6bb444eef1 [bugfix]: run the base layer while a LoRA wrapper has no adapter 2026-10-28 14:49:15 -07:00
Aryan Kumar 6743f4b4b7 Revert "[new-model] Add PAN2 text-to-video and image-to-video" (#2025) 2026-10-27 18:03:59 -07:00
zoechen281WeiersAryan Kumararyan5v
 		465654d900 [bugfix] Reject missing CFG negative conditioning during input validation (#2011) 
Co-authored-by: Weiers <16632241+zoechen1212@user.noreply.gitee.com>
Co-authored-by: Aryan Kumar <156166681+aryan5v@users.noreply.github.com>
Co-authored-by: aryan5v <aryan5v@users.noreply.github.com>
 2026-10-27 08:45:21 +00:00
Jack LiangClaude Opus 5.5Aryan Kumar
 		69b3829293 [bugfix] Normalize local and HF-cache model paths before registry lookup (#1997) 
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Aryan Kumar <156166681+aryan5v@users.noreply.github.com>
 2026-10-27 07:47:20 +00:00
William Linandaryan5v a0e6cf1f50 [new-model] Add PAN2 text-to-video and image-to-video (#1961) 
Co-authored-by: aryan5v <email.aryan1005@gmail.com>
 2026-10-25 20:20:00 -07:00
Loay RashidandAryan Kumar 0d05b09c57 [new-model] Add initial Qwen-Image-2.1 inference (#1918) 
Co-authored-by: Aryan Kumar <156166681+aryan5v@users.noreply.github.com>
 2026-10-25 17:28:49 +00:00
Kyle HuandAryan Kumar a92c5c1578 [docs]: add spark4 CI backend routing (#2014) 
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local>
 2026-10-24 16:29:44 -07:00
Aryan KumarandAryan Kumar dfc5550c35 [ci] Add FA2-enabled Spark CI image and GB10 reference setup (#2017) 
Co-authored-by: Aryan Kumar <aryank@Aryans-Mac-Studio.local>
 2026-10-24 16:16:25 -07:00
posiposi443-opsandAryan Kumar 8db2d71ef2 [perf] Cache MLX H3 text refinement and speed up attention (#2002) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-23 12:40:47 -07:00
Aryan Kumar 1a1e7216d2 [ci]: Run macOS MLX smoke when a draft PR is marked ready 2026-10-23 12:01:17 -07:00
Aryan Kumar 33bdd2528b [ci]: Require macOS MLX smoke for PRs that touch MLX code 2026-10-23 12:01:17 -07:00
Aryan Kumar 9bbdd18548 [ci]: Fix env-policy and schema-parity contract tests 
The unit lane fails on main in two contract tests. All three failures are
bookkeeping that drifted from the code, not runtime bugs:

- `test_env_policy.py::test_env_doc_table_matches_registry`: the generated
  table in docs/contributing/env_vars.md is stale for
  FASTVIDEO_MLX_QUANT_GEMM. Regenerated with the documented command
  (`python fastvideo/tests/contract/test_env_policy.py`).
- `test_env_policy.py::test_env_access_follows_policy`: two new violations.
  - fastvideo/tests/mlx/test_mlx_affine_dq_gemm.py wrote
    FASTVIDEO_MLX_QUANT_GEMM through monkeypatch.setenv; now uses the
    registered field's override() through the env_overrides fixture.
  - fastvideo/tests/train/models/test_load_kandinsky5.py read
    FASTVIDEO_ATTENTION_BACKEND with `not in os.environ`; now uses
    envs.FASTVIDEO_ATTENTION_BACKEND.is_set() and override(). Its entry in
    KNOWN_VIOLATIONS is deleted, as the shrinking-list rule requires.
- `test_schema_parity_inventory.py::..._extension_fields_are_classified`:
  MiniMaxH3PipelineConfig declares video_scheduler_shift and
  audio_scheduler_shift (training-time noise clocks rejected by
  check_pipeline_config at inference); both are added to
  pipeline_config_extensions.internal_only.

Test plan (CPU, no GPU required):

  python -m pytest fastvideo/tests/contract/test_env_policy.py \
      fastvideo/tests/api/test_schema_parity_inventory.py \
      fastvideo/tests/mlx/test_mlx_affine_dq_gemm.py -q
  # 45 passed

  python -m pytest fastvideo/tests/contract/ fastvideo/tests/api/ -q -m "not gpu"
  # 501 passed
 2026-10-23 11:08:37 -07:00
Aryan KumarandAryan Kumar 7c2b447264 [ci] Run single-GPU CI lanes on a DGX Spark runner; weekly full suite on main (#2007) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-22 13:44:55 -07:00
William Lin e136c2b7f8 [infra]: fix the DGX Spark (GB10) Docker image: importable flashinfer, sm_121a kernels, native-matching output (#1986) 2026-10-22 11:59:31 -07:00
Aryan KumarandAryan Kumar fa2d1324c6 [feat]: FastH3 Omni (Ref2VA) on Apple Silicon MLX (#2000) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-21 12:01:54 -07:00
William Lin cdda1b7535 [feat] Add H3 PDD/DMPDD training and packed Ref2VA preprocessing (#1984) 2026-10-20 11:15:57 -07:00
Aryan KumarandAryan Kumar 089a5a55a0 [feat] Cookbook serving, hardware catalog, and landing page (#1999) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-20 09:10:29 -07:00
Aryan Kumar 137d9110ca [docs] Make cookbook copy actions explicit and hardware opt-in (#1992) 2026-10-20 09:00:56 -07:00
Yixing Wangleoaryan5vAryan Kumar
 		d4f144581d [feat] Add capacity metadata to existing cookbook model manifests (#1983) 
Co-authored-by: leo <yixingwang@YIXINGs-MacBook-Pro.local>
Co-authored-by: aryan5v <email.aryan1005@gmail.com>
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-20 08:24:19 +00:00
Ishan 5f96664abf [feat] Added a single-GPU VRAM calculator for cookbook deployments (#1978) 2026-10-20 08:12:06 +00:00
Aryan KumarAryan KumarClaude Opus 5.5
 		376e445f0e [feat]: FastH3 OmniRef inference on consumer devices (RTX 5090 / PRO 6000 / DGX Spark / 4090) (#1980) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-19 14:57:36 -07:00
Aryan KumarAryan KumarSolitaryThinker
 		2099dd5533 [feat]: Community MiniMax-H3 LoRA loading with quantized side branch (#1973) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
 2026-10-19 14:29:23 -07:00
Aryan KumarAryan Kumargreptile-apps[bot]
 		0033a9b11d [bugfix] Fix FastH3 regional compile recompiling for every prompt length (#1942) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 2026-10-18 18:22:06 -07:00
Aryan Kumargemini-code-assist[bot]SolitaryThinker
 		91a1c50909 [fix] Fix latent handoff and FastWan-QAD example path (#1557) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
 2026-10-18 17:36:40 -07:00
lpc0220rootClaude Opus 5.5root
 		3658b120da [bugfix] Fix tests that fail on main: FastH3 Trim Spark audio, test isolation (#1957) 
Co-authored-by: root <root@ptyche0124.ptyche.clusters.nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: root <root@ptyche0040.ptyche.clusters.nvidia.com>
 2026-10-18 16:07:59 -07:00
William Lin 81b73f6b88 [bugfix] Fix cookbook clipboard test blocking docs deployment (#1979) 2026-10-17 23:08:49 -07:00
lpc0220androot d4ed61cc7c [refactor] VSA: rename the sm100a block-sparse kernel to ptx_blackwell (#1956) 
Co-authored-by: root <root@ptyche0124.ptyche.clusters.nvidia.com>
 2026-10-17 21:10:19 -07:00
William Lin 377c79fa7e [docs] Add William Lin to the contact page (#1977) 2026-10-17 20:52:55 -07:00
Aryan KumarandAryan Kumar 25940a7e86 [docs] Unify cookbook model editors and launch commands (#1970) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-16 17:26:51 -07:00
Aryan Kumarsy3535Aryan Kumar
 		3f45f2da21 [bugfix] Repair DreamVerse and failing CI gates (#1958) 
Co-authored-by: sy3535 <sy3535@maxwell.poly.edu>
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-16 17:15:38 -07:00
Aryan KumarandAryan Kumar 6212e7262e [docs] Migrate documentation and cookbook to Blume (#1969) 
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-16 16:09:04 -07:00
William Lin ba371e33ed [ci] Stop automatically marking issues and PRs stale (#1964) 2026-10-15 01:05:48 -07:00
William Lin 06c8c5f4b8 [docs] Add public contact page (#1959) 2026-10-15 00:26:44 -07:00
William Lin c535797e3d [skill] Remove the add-model and decompose-pipeline-pr agent skills (#1963) 2026-10-15 00:10:49 -07:00
William Lin 59fddb00f2 [ci] Remove automated community comments (#1962) 2026-10-14 23:40:45 -07:00
William Lin 9f59519959 [misc] Remove DreamX World, HunyuanGameCraft, GLM-Image, LongCat, TurboDiffusion, and Z-Image (#1926) 2026-10-14 23:16:32 -07:00
Yixing WangleoAryan Kumar
 		d5253fd710 [feat] Add serving cookbook recipes and configuration API (#1941) 
Co-authored-by: leo <yixingwang@YIXINGs-MacBook-Pro.local>
Co-authored-by: Aryan Kumar <aryan5v@users.noreply.github.com>
 2026-10-09 15:49:08 -07:00
William Lin 2b164405c3 [bugfix] Accept log_queue in StreamingVideoGenerator.from_fastvideo_args (#1937) 
VideoGenerator.from_config calls from_fastvideo_args with a log_queue keyword
argument. The StreamingVideoGenerator override did not accept it, so
StreamingVideoGenerator.from_pretrained raised TypeError. The override now
accepts log_queue and passes it to the executor through VideoGenerator.__init__.
A new test covers the call.
 2026-10-07 15:58:03 -07:00