Sebastian Monroy
51777e3462
feat(workers): include required fields in status updates; honor optional status_policy
...
- copy content_id, venue, canvas, scene from job payload into status updates
- use running_status for first progress; fail_status on execution errors (fallbacks preserved)
- manage per-content context lifecycles
2025-09-26 16:06:33 +01:00
Sebastian Monroy
7806a92772
logging improvements for worker_consumer.py
2025-09-25 16:59:38 +01:00
Sebastian Monroy
a42221565d
refactor(nilor-nodes): adopt content_id in worker_consumer and MediaStreamOutput
...
- read `content_id` from job payloads in `worker_consumer.py` (replace `client_id`)
- rename internal mappings (e.g., `prompt_id_to_content_id_map`)
- MediaStreamOutput: require `content_id` input (replace `job_id`)
- completion messages: `{ "content_id": <uuid>, "status": "completed", "outputs": { ... } }`
- web widget: hide `content_id` instead of `job_id`
- BREAKING CHANGE: older payloads with `job_id`/`client_id` are no longer accepted
2025-09-25 16:10:06 +01:00
Sebastian Monroy
75a45c6c34
further improve logging everywhere, using thinspace instead of brackets to fix terminal rendering, including all raised errors
2025-09-25 11:50:16 +01:00
Sebastian Monroy
414679c676
simplified the logging when worker_consumer.py fails to initialize SQS, improved logging everywhere
2025-09-25 11:30:25 +01:00
Sebastian Monroy
5af42118fe
add SQS_ENABLED flag to .env to toggle SQS functionality related to worker_consumer.py
2025-09-25 11:02:48 +01:00
Sebastian Monroy
35428a8287
black formatter pass on all python scripts
2025-09-10 14:47:43 +01:00
Sebastian Monroy
04ac2b655a
set up websocket connection with ComfyUI so that it can report whether it has started a ComfyUI job, and then set job status to "running" via the queue
2025-09-08 14:33:55 +01:00
Sebastian Monroy
cc9056e11c
implement status update publishing to SQS
...
- Adds configuration for the new `job_status_updates` queue in the worker consumer.
- After successfully submitting a job to the local ComfyUI instance, the worker publishes a message with `{"status": "running"}`.
- Includes a critical check for `client_id` in the workflow data to ensure a job ID is present before publishing.
- Logs a warning and skips the update if `client_id` is missing, preventing silent failures.
- Errors during the status update publication are logged but do not interrupt the primary job, maintaining system resilience.
- Update .env.example
2025-09-08 12:16:57 +01:00
Sebastian Monroy
2387d0e0ad
update worker_consumer.py to work with new SQS requirements and update .env.example
2025-08-08 16:54:09 +01:00
Sebastian Monroy
9e5ccb8bb7
added support for video to MediaStreamInput and MediaStreamOutput nodes
2025-08-04 14:25:03 +01:00
Sebastian Monroy
8f355e360c
3.3: successful end-to-end test of client initiating comfyui job, brain api creating the job, worker consuming the job, and comfui running the job and outputting to minio
2025-08-04 13:32:35 +01:00
Sebastian Monroy
e8c5c449ac
3.2: full test of ComfyUI MediaStream nodes successful. got nodes to show up in ComfyUI properly.
2025-08-04 12:33:14 +01:00
Sebastian Monroy
2c7edfc535
added worker_consumer.py script which is responsible for connecting to ElasticMQ to poll for new comfyui jobs
2025-07-30 15:02:41 +01:00
Sebastian Monroy