Commit Graph
162 Commits
Author SHA1 Message Date
Ken Simpson 96f594a6ec Fetch registered Hugging Face assets on Vast 2026-08-24 12:26:52 -07:00
Ken Simpson 7b6a9df4b7 Refactor remote execution capacity configuration 2026-08-23 20:04:03 -07:00
Ken Simpson 6895b644f0 Render execution locations in Nodes 2.0 2026-08-23 09:33:08 -07:00
Ken Simpson 9472483742 Add managed Vast.ai execution backend 2026-08-23 08:59:44 -07:00
Ken Simpson e554ab136a Show multi-environment execution locations 2026-08-23 08:31:34 -07:00
Ken Simpson 9a92fe2ecb Add provider-aware workflow partitioning 2026-08-22 20:10:22 -07:00
Ken Simpson df5d7aa574 Stage LLM profiles on SSH workers 2026-08-22 17:20:16 -07:00
Ken Simpson 8c2911e2f8 Fix top-level SSH worker startup 2026-08-22 16:00:37 -07:00
Ken Simpson 42cae2378d Add SSH Docker remote execution 2026-08-22 15:19:12 -07:00
Ken Simpson 7bb2509903 Merge remote main and bump version to 0.3.5 2026-08-21 15:36:53 -07:00
Ken Simpson 82fb495905 Recover LLM VRAM after vLLM eviction 2026-08-21 13:47:52 -07:00
Ken Simpson 492fcfa60b Fix LLM prewarm scope and Triton child telemetry 2026-08-20 19:52:41 -07:00
Ken Simpson 8e4ee37fab Accelerate Modal model startup 2026-08-20 16:17:37 -07:00
Ken Simpson 186d98ea3f Keep Modal protocol validation off GPU 2026-08-20 16:17:37 -07:00
Ken Simpson c524109d13 Speculatively prewarm next Modal worker 2026-08-20 16:17:37 -07:00
Ken Simpson f9d85c19f3 Rebind affinity after Modal protocol probes 2026-08-19 22:49:16 -07:00
Ken Simpson 6fcafdec05 Preserve remote phases across local preview fanout 2026-08-19 22:36:18 -07:00
Ken Simpson f43cd37c79 Split remote continuations from local previews 2026-08-19 21:45:11 -07:00
Ken Simpson c92af6a8c2 Retain remote workers across local workflow gaps 2026-08-19 20:06:58 -07:00
Ken Simpson 6a2cbbf191 Instrument remote result publication stalls 2026-08-19 16:07:21 -07:00
Ken Simpson a1f4cac7c1 Prevent sampler replay across local phase splits 2026-08-19 13:07:36 -07:00
Ken Simpson 936c97b1f1 Silence successful Modal billing refreshes 2026-08-19 12:34:24 -07:00
Ken Simpson f3cc47f987 Fix Modal billing across app redeployments 2026-08-19 09:26:21 -07:00
Ken Simpson 082909062b Stream Modal LLM progress and vLLM tokens 2026-08-19 09:09:12 -07:00
Ken Simpson 03a08e00ec Show hourly Modal app billing in status pill 2026-08-19 08:26:43 -07:00
Ken Simpson d5186873d9 Rewrite generated LLM profile in direct inputs 2026-08-18 23:04:59 -07:00
Ken Simpson cb8f816963 Add co-resident vLLM backend for B300 2026-08-18 22:36:19 -07:00
Ken Simpson c1e29e13c4 Resolve LLM model IDs before GPU dispatch 2026-08-18 22:32:52 -07:00
Ken Simpson 54aeabd6e0 Preserve isolated live Modal canary settings 2026-08-18 21:25:39 -07:00
Ken Simpson 9a4fd944ac Add resident multimodal Modal LLM node 2026-08-18 21:22:08 -07:00
Ken Simpson f9f3bca2fe Inject named Modal secrets into remote workers 2026-08-18 14:20:09 -07:00
Ken Simpson 9ba54bcc4c Fix heterogeneous mapped latent outputs 2026-08-14 10:23:43 -07:00
Ken Simpson b9d25ec3d4 Show estimated Modal GPU cost during execution 2026-08-13 20:22:36 -07:00
Ken Simpson 67179df97f Fix Modal status polling across event loops 2026-08-13 19:58:39 -07:00
Ken Simpson 9f18670773 Support V3 Autogrow inputs in remote validation 2026-08-13 18:29:22 -07:00
Ken Simpson 7d8cb15ac9 Show Modal container status in workflow UI 2026-08-13 18:18:06 -07:00
Ken Simpson d9c31e693b Show selected GPU in Modal status 2026-08-09 08:20:43 -07:00
Ken Simpson 3da4d3727b Fix workflow GPU deployment selection 2026-08-08 22:28:33 -07:00
Ken Simpson 242e61b945 Add workflow GPU selection 2026-08-07 12:42:21 -07:00
Ken Simpson 01cff3e8da Download remote ComfyUI output artifacts 2026-08-05 09:53:50 -07:00
Ken Simpson 11c29af8dd Avoid persisting unnecessary bridge inputs 2026-08-04 20:40:21 -07:00
Ken Simpson edec9bf978 Keep remote component tensors in Modal storage 2026-08-04 18:14:44 -07:00
Ken Simpson 25fea62356 fix: preserve video frame batches 2026-08-04 16:50:14 -07:00
Ken Simpson 69f356b021 fix: stop stale Modal apps noninteractively 2026-08-04 14:42:59 -07:00
Ken Simpson deb11df309 fix: hydrate stale Modal volume assets 2026-07-31 21:32:17 -07:00
Ken Simpson 43deb2db7e Avoid volume reloads for durable reads 2026-07-15 09:35:39 -07:00
Ken Simpson 2f6594bd09 Optimize Modal build and persistence 2026-07-14 22:12:29 -07:00
Ken Simpson 4d1673f51e feat: show Modal app rebuild status 2026-07-14 21:22:10 -07:00
Ken Simpson 1e77b38c77 feat: make remote invocations durable 2026-07-14 20:21:00 -07:00
Ken Simpson 5a587d4ef3 feat: fingerprint modal runtime deployments 2026-07-14 18:28:49 -07:00