Commit Graph
27 Commits
Author SHA1 Message Date
Ken Simpson 2784f89205 Harden standalone Vast development tools 2026-08-23 09:02:00 -07:00
Ken Simpson 82fb495905 Recover LLM VRAM after vLLM eviction 2026-08-21 13:47:52 -07:00
Ken Simpson 8e4ee37fab Accelerate Modal model startup 2026-08-20 16:17:37 -07:00
Ken Simpson c92af6a8c2 Retain remote workers across local workflow gaps 2026-08-19 20:06:58 -07:00
Ken Simpson d20773d338 Add automatic vLLM mode promotion 2026-08-19 11:48:57 -07:00
Ken Simpson 0abf4d36fd Add cached vLLM throughput benchmarking 2026-08-19 11:20:00 -07:00
Ken Simpson 9a4fd944ac Add resident multimodal Modal LLM node 2026-08-18 21:22:08 -07:00
Ken Simpson f9f3bca2fe Inject named Modal secrets into remote workers 2026-08-18 14:20:09 -07:00
Ken Simpson fc03dafcb7 Default Modal workflows to RTX Pro 6000 2026-08-09 10:08:09 -07:00
Ken Simpson 3da4d3727b Fix workflow GPU deployment selection 2026-08-08 22:28:33 -07:00
Ken Simpson 242e61b945 Add workflow GPU selection 2026-08-07 12:42:21 -07:00
Ken Simpson c6ef1c6682 feat: namespace Modal apps per ComfyUI instance 2026-08-04 14:08:34 -07:00
Ken Simpson 1e77b38c77 feat: make remote invocations durable 2026-07-14 20:21:00 -07:00
Ken Simpson c6af844b19 perf: streamline modal transport and sync 2026-07-14 19:53:08 -07:00
Ken Simpson cb7d74640a feat: harden remote invocation controls 2026-07-14 18:16:50 -07:00
Ken Simpson 569e8ee399 fix: restart remote worker after stuck cancellation 2026-06-21 12:51:57 -07:00
Ken Simpson b6121854d7 fix: release local prompt after modal cancel 2026-05-15 16:16:12 -07:00
Ken Simpson 599d8bfa44 fix: keep remote sync backend consistent 2026-05-11 16:13:44 -07:00
Ken Simpson 8aa0861ff3 perf: skip generic gpu warmups by default 2026-04-23 11:40:53 -07:00
Ken Simpson f6c63f5801 feat: durably replay session-backed split proxies 2026-04-20 17:01:03 -07:00
Ken Simpson 76fb6ec6b4 tune: reduce default node cache size cap 2026-04-19 22:21:44 -07:00
Ken Simpson b32323dc46 feat: persist transport-safe node outputs 2026-04-19 20:06:22 -07:00
Ken Simpson c9326b7b61 feat: proactively warm Modal capacity 2026-04-19 14:11:20 -07:00
Ken Simpson 67f33f0bcd fix: retire crashed modal containers 2026-04-19 11:28:08 -07:00
Ken Simpson 43ce2e815f feat: scale modal components across containers 2026-04-18 14:19:27 -07:00
Ken Simpson cd4465dfa4 feat: configure modal gpu type via env 2026-04-17 16:31:42 -07:00
Ken Simpson 4d8cbf41f3 fix: infer comfyui root from install path 2026-04-17 15:56:10 -07:00