 huchukato
|
31bef5af8b
|
Fix dummy module classes - make Logger, BuilderFlag, etc. callable instead of ModuleType
|
2026-02-27 09:21:44 +01:00 |
|
|
huchukato
|
b1f6cec3a3
|
Improve TensorRT lazy loading with dummy fallback module and availability checks for better compatibility
|
2026-02-27 09:10:08 +01:00 |
|
|
huchukato
|
5e8d947c93
|
Fix TensorRT import conflicts - use lazy loading to avoid conflicts with other TensorRT nodes
|
2026-02-27 09:09:01 +01:00 |
|
|
huchukato
|
ccd3f3bf9c
|
Add CUDA graph fallback for persistent ERROR 35 in cloud environments - disable graph optimization and retry
|
2026-02-27 02:35:08 +01:00 |
|
|
huchukato
|
0c0f4b2d10
|
Fix TensorRT tensor address binding - add explicit set_tensor_address for all tensors before inference
|
2026-02-27 02:32:38 +01:00 |
|
|
huchukato
|
c19731ec58
|
Fix AttributeError by initializing inputs and outputs attributes in Engine constructor
|
2026-02-27 02:30:44 +01:00 |
|
|
huchukato
|
5ab7eedbb9
|
Add CUDA ERROR 35 recovery mechanism with retry and context reset for inference failures
|
2026-02-27 02:29:00 +01:00 |
|
|
huchukato
|
5aec40e052
|
Add comprehensive CUDA diagnostics and troubleshooting for TensorRT build failures
|
2026-02-27 02:15:50 +01:00 |
|
|
reaperhammer
|
6cd119d9e5
|
fix memory issues with graphs when keep_model_loaded = true
|
2025-09-25 08:16:02 +12:00 |
|
|
reaperhammer
|
3e898b65f7
|
fix engine reload on batch jobs when keep_model_loaded = false
|
2025-09-25 07:54:13 +12:00 |
|
|
RioShiina47
|
e971cfb71a
|
fix cudart
|
2025-09-16 20:44:51 +08:00 |
|
|
yuvraj108c
|
7491b548d1
|
cuda grapsh
|
2024-10-04 13:30:05 +04:00 |
|
|
yuvraj108c
|
4952023d35
|
v1
|
2024-10-03 07:14:29 +00:00 |
|