25 Commits
Author SHA1 Message Date
huchukato 9e6d4c195d Fix CUDA graph exec handle released with wrong cudart call
cuda_graph_instance is a cudaGraphExec_t from cudaGraphInstantiate()
and must be released with cudaGraphExecDestroy(), not cudaGraphDestroy().
The handle-type mismatch corrupted the CUDA context on CUDA 13, causing
a silent process death after the node finished (keep_model_loaded=False)
or cudaErrorInvalidValue on the next run (keep_model_loaded=True).
2026-10-01 22:08:17 +02:00
huchukatoandDevin 51d88c0c0d Add tiling, batch inference, interpolation states and multiplier schedule
Ported and adapted from Fannovel16/ComfyUI-Frame-Interpolation:

- gc.collect() after soft_empty_cache() to reduce RAM fragmentation
- Explicit float32 cast in postprocess_frames for fp16 engine safety
- InterpolationStateList class + MakeInterpolationStateList node to
  skip/keep specific frame pairs during interpolation
- Per-pair multiplier schedule (comma-separated list) overriding uniform
  multiplier, with automatic padding to match the number of pairs
- Automatic tiling with cosine feathering when frame dimensions exceed
  the TensorRT engine optimization profile (fixes 1440x2560 with max=1920)
- Padding with replicate mode when frame dimensions are below profile min
- get_input_profile_bounds() on Engine to retrieve min/opt/max shapes
- Batch inference: process multiple (pair, timestep) tasks per GPU call
  with dynamic batch axis in ONNX export and engine profile
- Backward compatible: all new features are opt-in via optional inputs

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-05 10:32:06 +02:00
huchukato d6b9d191f1 Add simple progress feedback during TensorRT engine build with threading 2026-03-04 04:47:54 +01:00
huchukato 355387ddbd Remove TQDMProgressMonitor from RIFE node too - eliminate interface issues completely 2026-03-04 04:45:56 +01:00
huchukato 70183e0df6 Fix use_cuda_graph parameter error - remove from _do_inference call 2026-02-28 07:44:02 +01:00
huchukato 447ab309d1 Fix missing diagnose_cuda_environment function call - remove from build method 2026-02-27 10:17:35 +01:00
huchukato a3c80fdb1a Remove complex dummy module system - return to simple working logic 2026-02-27 10:14:50 +01:00
huchukato e8c3bc331a Fix TQDMProgressMonitor interface - properly implement IProgressMonitor for both real and dummy TensorRT 2026-02-27 10:12:42 +01:00
huchukato 2fc12ad257 Fix TQDMProgressMonitor completely - avoid inheritance issues with dummy module 2026-02-27 10:07:11 +01:00
huchukato dd958b4000 Fix TQDMProgressMonitor logic - use is_trt_available() instead of hasattr check 2026-02-27 09:58:41 +01:00
huchukato facd447f95 Fix DummyIProgressMonitor scope issue - move dummy classes to global scope 2026-02-27 09:54:50 +01:00
huchukato 6d0abbd47a Fix dummy IProgressMonitor class - proper inheritance handling for TQDMProgressMonitor 2026-02-27 09:52:18 +01:00
huchukato 31bef5af8b Fix dummy module classes - make Logger, BuilderFlag, etc. callable instead of ModuleType 2026-02-27 09:21:44 +01:00
huchukato b1f6cec3a3 Improve TensorRT lazy loading with dummy fallback module and availability checks for better compatibility 2026-02-27 09:10:08 +01:00
huchukato 5e8d947c93 Fix TensorRT import conflicts - use lazy loading to avoid conflicts with other TensorRT nodes 2026-02-27 09:09:01 +01:00
huchukato ccd3f3bf9c Add CUDA graph fallback for persistent ERROR 35 in cloud environments - disable graph optimization and retry 2026-02-27 02:35:08 +01:00
huchukato 0c0f4b2d10 Fix TensorRT tensor address binding - add explicit set_tensor_address for all tensors before inference 2026-02-27 02:32:38 +01:00
huchukato c19731ec58 Fix AttributeError by initializing inputs and outputs attributes in Engine constructor 2026-02-27 02:30:44 +01:00
huchukato 5ab7eedbb9 Add CUDA ERROR 35 recovery mechanism with retry and context reset for inference failures 2026-02-27 02:29:00 +01:00
huchukato 5aec40e052 Add comprehensive CUDA diagnostics and troubleshooting for TensorRT build failures 2026-02-27 02:15:50 +01:00
reaperhammer 6cd119d9e5 fix memory issues with graphs when keep_model_loaded = true 2025-09-25 08:16:02 +12:00
reaperhammer 3e898b65f7 fix engine reload on batch jobs when keep_model_loaded = false 2025-09-25 07:54:13 +12:00
RioShiina47 e971cfb71a fix cudart 2025-09-16 20:44:51 +08:00
yuvraj108c 7491b548d1 cuda grapsh 2024-10-04 13:30:05 +04:00
yuvraj108c 4952023d35 v1 2024-10-03 07:14:29 +00:00