9 Commits
Author SHA1 Message Date
yuvraj108c b1293bf089 model resetting 2026-06-08 05:50:42 +00:00
yuvraj108c 38cd1fe2fd refactor + auto engine building + remove cuda 2026-06-08 05:04:45 +00:00
reaperhammerandClaude Opus 4.7 eedc0938f9 Fix bare exceptions, silent HTTP failures, and resolution display
- Replace bare except: with except Exception: in __del__ and reset() to avoid
  catching KeyboardInterrupt/SystemExit
- Add response.raise_for_status() to fail clearly on HTTP errors
- Fix resolution log output to show HxW instead of CHW shape

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-09 19:04:41 +12:00
reaperhammerandClaude Opus 4.7 203afb5f2a Improve CUDA graph memory cleanup in Engine class
- __del__: Add hasattr checks before del, iterate tensors dict to delete
  each tensor individually, also clean up inputs/outputs
- reset: Same improvements plus reset cuda_graph_instance and graph
  to None to prevent stale state on reuse

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-09 15:40:57 +12:00
reaperhammer 6cd119d9e5 fix memory issues with graphs when keep_model_loaded = true 2025-09-25 08:16:02 +12:00
reaperhammer 3e898b65f7 fix engine reload on batch jobs when keep_model_loaded = false 2025-09-25 07:54:13 +12:00
RioShiina47 e971cfb71a fix cudart 2025-09-16 20:44:51 +08:00
yuvraj108c 7491b548d1 cuda grapsh 2024-10-04 13:30:05 +04:00
yuvraj108c 4952023d35 v1 2024-10-03 07:14:29 +00:00