Ken Simpson and Claude Opus 5.5
01cefd2cc5
Keep deployment settings on hybrid mapped phase payloads
...
Hybrid mapped execution rebuilt its static, mapped, and cleanup phase payloads
from a fixed field list that dropped modal_gpu and modal_max_containers. Those
payloads resolved default settings and expected a different runtime fingerprint
for the same Modal app, so the sibling-validation guard refused them with
ModalRemoteAppOutOfDateError.
Define the fingerprint-shaping payload fields once in settings and copy them at
every derived-payload site (mapped phases, warmup requests, speculative
prewarm targets).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-11-05 10:15:57 -08:00
Ken Simpson and Claude Opus 5.5
2188acfe3b
Stop warmups from replacing a freshly deployed Modal app
...
Warmup requests and speculative prewarm targets dropped modal_max_containers,
so they computed a different runtime fingerprint than the dispatch payload for
the same app name. The warmup then stopped and redeployed the app the dispatch
had just deployed, killing in-flight mapped generations with RemoteError.
Carry modal_max_containers into derived warmup payloads, and refuse to stop an
app whose fingerprint this process already deployed or validated.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-11-05 09:01:20 -08:00
Ken Simpson
b320605dc3
Surface Vast worker failure diagnostics
2026-08-29 22:39:12 -07:00
Ken Simpson
5a2c95acf5
Decompose remote payload stream handling
2026-08-29 13:33:57 -07:00
Ken Simpson
e36b448034
Split Modal stream and interrupt handling
2026-08-29 13:04:46 -07:00
Ken Simpson
30b07d37cd
Extract Modal LLM profile staging
2026-08-29 11:29:36 -07:00
Ken Simpson
261decfae1
Extract mapped remote execution
2026-08-29 11:26:52 -07:00
Ken Simpson
9d51d372bc
Extract Modal warmup orchestration
2026-08-29 11:23:15 -07:00
Ken Simpson
8ff2d409bb
Extract Modal deployment lifecycle
2026-08-29 11:17:53 -07:00
Ken Simpson
33fc89a63b
Extract local remote UI events
2026-08-29 11:11:27 -07:00
Ken Simpson
eec70689c6
Extract local fallback execution
2026-08-29 11:09:12 -07:00
Ken Simpson
eefd73061a
Extract durable host session bridge
2026-08-29 11:07:05 -07:00
Ken Simpson
08243d091f
Extract Modal container administration
2026-08-29 11:02:54 -07:00
Ken Simpson
80feb0314f
Extract Modal billing operations
2026-08-29 10:59:32 -07:00
Ken Simpson
830a9e52cc
Share remote prompt boundary constants
2026-08-29 10:20:12 -07:00
Ken Simpson
ac50e8f773
Consolidate remote runtime module state
2026-08-29 10:18:31 -07:00
Ken Simpson
4323b555d2
Preflight worker access to R2
2026-08-28 15:34:35 -07:00
Ken Simpson
28a5288000
Expose safe R2 rejection codes
2026-08-28 15:23:00 -07:00
Ken Simpson
7b80c26883
Backfill R2 cache and secure transfer error reporting
2026-08-28 14:10:39 -07:00
Ken Simpson
a02fcd8ce6
Add managed capacity kill controls
2026-08-28 12:39:35 -07:00
Ken Simpson
e597b9ffae
Harden remote LLM staging lifecycle
2026-08-25 17:22:18 -07:00
Ken Simpson
e679d068a6
Report accurate LLM staging progress
2026-08-25 16:30:14 -07:00
Ken Simpson
8b4ea060a2
Package ComfyUI runtime data in worker images
2026-08-24 21:03:45 -07:00
Ken Simpson
96f594a6ec
Fetch registered Hugging Face assets on Vast
2026-08-24 12:26:52 -07:00
Ken Simpson
7b6a9df4b7
Refactor remote execution capacity configuration
2026-08-23 20:04:03 -07:00
Ken Simpson
6895b644f0
Render execution locations in Nodes 2.0
2026-08-23 09:33:08 -07:00
Ken Simpson
9472483742
Add managed Vast.ai execution backend
2026-08-23 08:59:44 -07:00
Ken Simpson
e554ab136a
Show multi-environment execution locations
2026-08-23 08:31:34 -07:00
Ken Simpson
9a92fe2ecb
Add provider-aware workflow partitioning
2026-08-22 20:10:22 -07:00
Ken Simpson
df5d7aa574
Stage LLM profiles on SSH workers
2026-08-22 17:20:16 -07:00
Ken Simpson
8c2911e2f8
Fix top-level SSH worker startup
2026-08-22 16:00:37 -07:00
Ken Simpson
42cae2378d
Add SSH Docker remote execution
2026-08-22 15:19:12 -07:00
Ken Simpson
7bb2509903
Merge remote main and bump version to 0.3.5
2026-08-21 15:36:53 -07:00
Ken Simpson
82fb495905
Recover LLM VRAM after vLLM eviction
2026-08-21 13:47:52 -07:00
Ken Simpson
492fcfa60b
Fix LLM prewarm scope and Triton child telemetry
2026-08-20 19:52:41 -07:00
Ken Simpson
8e4ee37fab
Accelerate Modal model startup
2026-08-20 16:17:37 -07:00
Ken Simpson
186d98ea3f
Keep Modal protocol validation off GPU
2026-08-20 16:17:37 -07:00
Ken Simpson
c524109d13
Speculatively prewarm next Modal worker
2026-08-20 16:17:37 -07:00
Ken Simpson
f9d85c19f3
Rebind affinity after Modal protocol probes
2026-08-19 22:49:16 -07:00
Ken Simpson
6fcafdec05
Preserve remote phases across local preview fanout
2026-08-19 22:36:18 -07:00
Ken Simpson
f43cd37c79
Split remote continuations from local previews
2026-08-19 21:45:11 -07:00
Ken Simpson
c92af6a8c2
Retain remote workers across local workflow gaps
2026-08-19 20:06:58 -07:00
Ken Simpson
6a2cbbf191
Instrument remote result publication stalls
2026-08-19 16:07:21 -07:00
Ken Simpson
a1f4cac7c1
Prevent sampler replay across local phase splits
2026-08-19 13:07:36 -07:00
Ken Simpson
936c97b1f1
Silence successful Modal billing refreshes
2026-08-19 12:34:24 -07:00
Ken Simpson
f3cc47f987
Fix Modal billing across app redeployments
2026-08-19 09:26:21 -07:00
Ken Simpson
082909062b
Stream Modal LLM progress and vLLM tokens
2026-08-19 09:09:12 -07:00
Ken Simpson
03a08e00ec
Show hourly Modal app billing in status pill
2026-08-19 08:26:43 -07:00
Ken Simpson
d5186873d9
Rewrite generated LLM profile in direct inputs
2026-08-18 23:04:59 -07:00
Ken Simpson
cb8f816963
Add co-resident vLLM backend for B300
2026-08-18 22:36:19 -07:00
