Commit Graph
4 Commits
Author SHA1 Message Date
Ken SimpsonandClaude Opus 5.5 25426e2ef6 Reserve Modal cooldown for exactly one worker pool per prompt
Worker slots live in separate namespaces (mapped lanes use
worker-pool:slot:N, ordinary components worker-pool:comfy|llm:slot:N),
each its own Modal container. Matching only the trailing slot:N gave the
reserve cooldown to both the static comfy:slot:0 worker and mapped lane
slot:0 in hybrid prompts, so reserve_cooldown_count=1 kept two idle GPUs.

The planner now stamps one modal_reserve_cooldown_pool per Modal
environment (mapped lanes when the prompt has mapped work, else comfy,
else llm), and the lookup grants the reserve cooldown only to leading
slots of that pool; every other worker uses the global cooldown.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-05 13:44:06 -07:00
Ken Simpson b1bc6b28ed Fix Vast worker fingerprint drift 2026-08-29 13:51:06 -07:00
Ken Simpson 0049e9dd14 Decompose prompt payload orchestration 2026-08-29 13:33:54 -07:00
Ken Simpson d8dee4d1bc Extract prompt interception orchestration 2026-08-29 12:58:35 -07:00