Commit Graph
250 Commits
Author SHA1 Message Date
Ken Simpson b7a1535586 Extract durable cloud session bridge 2026-08-29 11:47:18 -07:00
Ken Simpson c8611475ca Extract Modal app collision guard 2026-08-29 11:35:12 -07:00
Ken Simpson 4b9ed092bd Introduce cloud runtime store registry 2026-08-29 11:33:24 -07:00
Ken Simpson 30b07d37cd Extract Modal LLM profile staging 2026-08-29 11:29:36 -07:00
Ken Simpson 261decfae1 Extract mapped remote execution 2026-08-29 11:26:52 -07:00
Ken Simpson 9d51d372bc Extract Modal warmup orchestration 2026-08-29 11:23:15 -07:00
Ken Simpson 8ff2d409bb Extract Modal deployment lifecycle 2026-08-29 11:17:53 -07:00
Ken Simpson 33fc89a63b Extract local remote UI events 2026-08-29 11:11:27 -07:00
Ken Simpson eec70689c6 Extract local fallback execution 2026-08-29 11:09:12 -07:00
Ken Simpson eefd73061a Extract durable host session bridge 2026-08-29 11:07:05 -07:00
Ken Simpson 08243d091f Extract Modal container administration 2026-08-29 11:02:54 -07:00
Ken Simpson 80feb0314f Extract Modal billing operations 2026-08-29 10:59:32 -07:00
Ken Simpson 1a06ca0f9e Extract prompt payload rewriting 2026-08-29 10:43:09 -07:00
Ken Simpson ff8fb7f387 Extract remote component planning 2026-08-29 10:37:00 -07:00
Ken Simpson 4410e7852e Extract remote graph analysis 2026-08-29 10:35:06 -07:00
Ken Simpson a02fcd8ce6 Add managed capacity kill controls 2026-08-28 12:39:35 -07:00
Ken Simpson e679d068a6 Report accurate LLM staging progress 2026-08-25 16:30:14 -07:00
Ken Simpson 242782d82e Include Triton compiler in remote workers 2026-08-25 08:27:13 -07:00
Ken Simpson 7b6a9df4b7 Refactor remote execution capacity configuration 2026-08-23 20:04:03 -07:00
Ken Simpson 64c0a5e4b5 Preserve transportable list boundary semantics 2026-08-23 18:19:27 -07:00
Ken Simpson 9a92fe2ecb Add provider-aware workflow partitioning 2026-08-22 20:10:22 -07:00
Ken Simpson 7bb2509903 Merge remote main and bump version to 0.3.5 2026-08-21 15:36:53 -07:00
Ken Simpson 82fb495905 Recover LLM VRAM after vLLM eviction 2026-08-21 13:47:52 -07:00
Ken Simpson 492fcfa60b Fix LLM prewarm scope and Triton child telemetry 2026-08-20 19:52:41 -07:00
Ken Simpson 8b0dc851ef Track genuine Triton compile cache misses 2026-08-20 18:05:16 -07:00
Ken Simpson db3bf46b5a Avoid reloading mapped compile cache volumes 2026-08-20 17:12:18 -07:00
Ken Simpson e72d3a9eaa Read proxy metadata from V3 hidden context 2026-08-20 16:17:37 -07:00
Ken Simpson a6ce43eaa9 Fix queued prompt proxy isolation 2026-08-20 16:17:37 -07:00
Ken Simpson 4b387239b4 Fix overlapping Modal warmup contexts 2026-08-20 16:17:37 -07:00
Ken Simpson 8e4ee37fab Accelerate Modal model startup 2026-08-20 16:17:37 -07:00
Ken Simpson 186d98ea3f Keep Modal protocol validation off GPU 2026-08-20 16:17:37 -07:00
Ken Simpson c524109d13 Speculatively prewarm next Modal worker 2026-08-20 16:17:37 -07:00
Ken Simpson f9d85c19f3 Rebind affinity after Modal protocol probes 2026-08-19 22:49:16 -07:00
Ken Simpson cd4791431e Fix runtime Modal node module metadata 2026-08-19 22:30:03 -07:00
Ken Simpson f43cd37c79 Split remote continuations from local previews 2026-08-19 21:45:11 -07:00
Ken Simpson 093b2bdeec Run local previews alongside remote continuations 2026-08-19 20:48:18 -07:00
Ken Simpson c92af6a8c2 Retain remote workers across local workflow gaps 2026-08-19 20:06:58 -07:00
Ken Simpson 6a2cbbf191 Instrument remote result publication stalls 2026-08-19 16:07:21 -07:00
Ken Simpson a1f4cac7c1 Prevent sampler replay across local phase splits 2026-08-19 13:07:36 -07:00
Ken Simpson 936c97b1f1 Silence successful Modal billing refreshes 2026-08-19 12:34:24 -07:00
Ken Simpson 39701644fe Fix async Modal cache writes 2026-08-19 12:18:02 -07:00
Ken Simpson d20773d338 Add automatic vLLM mode promotion 2026-08-19 11:48:57 -07:00
Ken Simpson 0abf4d36fd Add cached vLLM throughput benchmarking 2026-08-19 11:20:00 -07:00
Ken Simpson dc0d21737f Accelerate Hugging Face downloads with Xet 2026-08-19 11:02:22 -07:00
Ken Simpson f3cc47f987 Fix Modal billing across app redeployments 2026-08-19 09:26:21 -07:00
Ken Simpson 082909062b Stream Modal LLM progress and vLLM tokens 2026-08-19 09:09:12 -07:00
Ken Simpson 03a08e00ec Show hourly Modal app billing in status pill 2026-08-19 08:26:43 -07:00
Ken Simpson c631996ca8 Reconcile runtime pins before vLLM install 2026-08-19 08:10:08 -07:00
Ken Simpson 7a2028eecd Install vLLM on every Modal GPU image 2026-08-19 08:05:38 -07:00
Ken Simpson 28c4b42076 Avoid FlashInfer sampler JIT on Modal workers 2026-08-18 23:22:37 -07:00