Commit Graph
23 Commits
Author SHA1 Message Date
Robert Wojciechowski 9739f432a5 Refactor: reduce duplication and simplify arg passing across USDU modules
- Pass UpscaleCoreArgs through static mode instead of 11 individual args
- Extract _post_with_retry helper from duplicate retry loops in worker_comms
- Remove 4 passthrough wrapper pairs in job_store
- Extract _process_image_tiles from duplicate master/worker tile loops
- Merge 4 override functions into 2 in prompt_transform (seed+value, collector+upscale)
- Split _async_collect_results into focused static/dynamic methods

Net reduction of ~256 lines across 10 files.
2026-03-08 22:05:29 +00:00
Robert Wojciechowski 5e724665a1 Add USDU delegate-only master mode support
When master is in delegate-only mode, USDU nodes are swapped to a
lightweight USDUDelegateCollector that skips model loading and only
collects results from workers. Workers initialize the dynamic job
queue on the master via a new /distributed/init_dynamic_job endpoint
since the delegate master doesn't know the batch size.
2026-03-08 03:34:17 +00:00
Robert Wojciechowski ce3b2c63f3 Fix DistributedSeed and DistributedValue not receiving enabled_worker_ids
The orchestration layer never injected enabled_worker_ids into seed and
value nodes, so workers could not resolve their index and fell back to
returning the original seed unchanged.
2026-03-07 05:33:49 +00:00
Robert Wojciechowski 3058b11ff2 Remove list splitter/collector feature and refactor distributed modules
- Remove DistributedListSplitter and DistributedListCollector nodes
- Remove /distributed/init_list_queue and /distributed/request_list_item endpoints
- Clean up all references from prompt_transform, queue_orchestration, constants, and tests
- Refactor and reorganize distributed modules for quality improvements
2026-03-07 05:22:09 +00:00
Robert Wojciechowski 684b276619 refactor distributed modules and reorganize tests for quality improvements 2026-03-03 20:50:40 +00:00
Robert Wojciechowski 5e8c35b913 guard worker prompts from branch-collector downstream outputs 2026-03-02 08:01:16 +00:00
Robert Wojciechowski 8241bb9585 prune worker nodes downstream of branch collector 2026-03-02 07:54:44 +00:00
Robert Wojciechowski 0e7690b3a8 replace DistributedJoin with branch collector node 2026-03-02 07:35:11 +00:00
Robert Wojciechowski 2d5a56a95e Prevent prompt_no_outputs on pruned worker branch prompts 2026-03-02 07:06:17 +00:00
Robert Wojciechowski dd3fbfadbe Fix branch join convergence and remote log visibility gating 2026-03-02 06:57:41 +00:00
Robert Wojciechowski 34123a0d30 Add DistributedJoin and dynamic list-queue splitter mode 2026-03-01 23:29:50 +00:00
Robert Wojciechowski e37a001d59 Rank branch participants by worker queue depth 2026-03-01 23:22:55 +00:00
Robert Wojciechowski 910c260857 Add distributed list splitting/collection and branch routing 2026-03-01 22:48:08 +00:00
Robert Wojciechowski c297b34b94 Add DistributedValue node with per-worker overrides 2026-02-28 04:53:20 +00:00
Robert Wojciechowski b95675d1ff Move load balancing to collector/orchestrator and remove queue node 2026-02-28 04:53:20 +00:00
Robert Wojciechowski 0dae73ec7d fix: rewrite synced media inputs to worker-local paths 2026-02-28 04:53:20 +00:00
Robert Wojciechowski df606af80e fix: sync LoadVideo 'file' media refs for remote workers 2026-02-28 04:53:20 +00:00
Robert Wojciechowski 9058cf061d fix: sync audio media refs for worker prompt validation 2026-02-28 04:53:20 +00:00
Robert Wojciechowski 04169ac651 fix: correct divider chunking and improve distributed validation/audio transport 2026-02-28 04:53:20 +00:00
Robert Wojciechowski e4c945e536 chore: commit all pending distributed changes 2026-02-28 04:53:20 +00:00
Robert Wojciechowski 6de2050b3f fix(tests): restore config error contract and stub compatibility 2026-02-28 04:53:20 +00:00
Robert Wojciechowski 5eacd17aeb refactor: implement REFACTOR_PLAN_2 across distributed stack 2026-02-24 01:38:41 +00:00
Robert Wojciechowski f0fe702f80 Commit all current refactor changes 2026-02-23 23:47:23 +00:00