FA2 gives no measured speedup on GB10, and with it installed FastH3 V2
on a Spark produces different audio and frames than a native Spark
install (which has no FA2). Without it the image matches the native
install bit for bit at the same speed. Add INSTALL_FLASH_ATTN (default
1), set it to 0 for the CUDA 13 arm64 leg, and document the first-run
FlashInfer compile (persist the cache, cap MAX_JOBS).
FA4 cute supports SM 9/10/11 only, and the pinned revision forces
nvidia-cutlass-dsl==4.6.0.dev0 over the 4.8.x that flashinfer 0.7.2
needs, so import flashinfer fails in the image. GB10 FP4 attention runs
on fastvideo-kernel. Add INSTALL_FA4_CUTE (default 1), set it to 0 for
the CUDA 13 arm64 leg, still remove the wheel's stale cute files, and
check that flashinfer imports when the overlay is skipped.
The CUDA 13 arm64 image targets DGX Spark but compiled fastvideo-kernel
for 12.1, which drops the arch-specific attn_qat_infer FP4 kernels
(FASTVIDEO_H3_VSA_FP4). Build for 12.1a, as a native Spark build does,
and update the Dockerfile and Docker guide examples.
SolitaryThinker