Bare bones changes to make individual node caching work post execution
inversion. This is likely non-viable moving forward information is
pushed into the output cache too late to block prior steps.
I plan a more correct implementation that instead wraps the cache. This
would mean that no changes to the actual execution pathing are required,
but prevents making things forward and backwards compatible
Error responses are now always part of a dict with lowercase error as
key.
Files are cached across restarts by url. Likely needs additional
testing for checkpoints.
Fixed an error where booleans could not be eserialized as part of the
change to sign file uploads.
Responses to orchestration are now wrapped and contain always contain a
message id to keep requests syncronized.
On connection failure, a reconnection is attempted.
Execution time is tracked and included in response data.
Response urls are now signed
Orchestration code (mostly endpoints for probes) was intended as a
seperate plugin, but given the tight tying of asynchronous dependency
code, it has been included in this history and will likely be branched
off as a dedicated repo not available for non client/server
architectures.
much of the execution wrapping code has been moved into a wrapper on
execute instead of recursive executed. This cleans up logic and fixes
issues with collecting all outputs when multiple output nodes exist
Rather than requesting as chunks, the stream is kept open and re-added
to the queue every 32MB. This removes the need for the server to report
ranges, or content length, or to recombine chunks, which greatly
simplifies logic.
Added an environment variable to dump a prompt request and exit, for
easier testing.
Code for big files is executing, but I'm noticing but it produces
output files that are not correct and has incorrectly inserted bytes.
Will either disable or swap to different method of keeping the request
but re-acquiring the connection semaphore
The implementation requires modifying frozen parameters, but I still
consider it by far preferable to needing the logic to select the
modified endpoint.
Added LICENSE and brief readme
Updated network checking with more specifics to Salad Simple Storage.
The access token is now fetched, checkpoint size is checked before
uploading and checkpoints are read from the inputs folder to ease file
management on workflow dispatch
Austin Mroz