Commit Graph
28 Commits
Author SHA1 Message Date
Ken Simpson 5d6c13abe2 Add SSH GGUF LLM backend 2026-08-22 18:45:06 -07:00
Ken Simpson 0dfa1cf3a7 Harden SSH worker bootstrap 2026-08-22 15:49:03 -07:00
Ken Simpson 82fb495905 Recover LLM VRAM after vLLM eviction 2026-08-21 13:47:52 -07:00
Ken Simpson 8e4ee37fab Accelerate Modal model startup 2026-08-20 16:17:37 -07:00
Ken Simpson d20773d338 Add automatic vLLM mode promotion 2026-08-19 11:48:57 -07:00
Ken Simpson 0abf4d36fd Add cached vLLM throughput benchmarking 2026-08-19 11:20:00 -07:00
Ken Simpson dc0d21737f Accelerate Hugging Face downloads with Xet 2026-08-19 11:02:22 -07:00
Ken Simpson c631996ca8 Reconcile runtime pins before vLLM install 2026-08-19 08:10:08 -07:00
Ken Simpson 7a2028eecd Install vLLM on every Modal GPU image 2026-08-19 08:05:38 -07:00
Ken Simpson b0678d9593 Run Modal workers on Python 3.13 2026-08-18 23:31:04 -07:00
Ken Simpson cfc54f14ce Align B300 runtime with resolved CUDA stack 2026-08-18 22:43:23 -07:00
Ken Simpson e98d28151a Align safetensors with Transformers 5.15 2026-08-18 22:38:17 -07:00
Ken Simpson cb8f816963 Add co-resident vLLM backend for B300 2026-08-18 22:36:19 -07:00
Ken Simpson 2eac47f4f7 Install SmolVLM processor dependency 2026-08-18 21:33:39 -07:00
Ken Simpson 9a4fd944ac Add resident multimodal Modal LLM node 2026-08-18 21:22:08 -07:00
Ken Simpson f9f3bca2fe Inject named Modal secrets into remote workers 2026-08-18 14:20:09 -07:00
Ken Simpson 7f6775e5b4 Align ComfyUI support package pins 2026-08-17 20:56:16 -07:00
Ken Simpson d86bc9963f Install current ComfyUI core dependencies remotely 2026-08-13 21:23:01 -07:00
Ken Simpson fc03dafcb7 Default Modal workflows to RTX Pro 6000 2026-08-09 10:08:09 -07:00
Ken Simpson 1118def393 Fix B300 TorchAudio image layering 2026-08-05 11:19:59 -07:00
Ken Simpson 01cff3e8da Download remote ComfyUI output artifacts 2026-08-05 09:53:50 -07:00
Ken Simpson 5a277db71f Select CUDA wheels for Modal GPU type 2026-08-05 09:12:07 -07:00
Ken Simpson c581623bef fix: include current ComfyUI core runtime packages 2026-08-04 14:22:11 -07:00
Ken Simpson 5249dc5fbb Fix OpenCV imports in Modal workers 2026-07-15 12:48:59 -07:00
Ken Simpson 2f6594bd09 Optimize Modal build and persistence 2026-07-14 22:12:29 -07:00
Ken Simpson 1e77b38c77 feat: make remote invocations durable 2026-07-14 20:21:00 -07:00
Ken Simpson c6af844b19 perf: streamline modal transport and sync 2026-07-14 19:53:08 -07:00
Ken Simpson 5a587d4ef3 feat: fingerprint modal runtime deployments 2026-07-14 18:28:49 -07:00