4 Commits
Author SHA1 Message Date
Austin Mroz 76d4d8e91e WIP cache rewrite
A more correct implementation that instead extends the caching subsystem
of execution should be used, but is still work in progress
2024-10-17 14:09:22 -05:00
Austin Mroz 0b3f5fca9d Include orchestration, rework execution wrapping
Orchestration code (mostly endpoints for probes) was intended as a
seperate plugin, but given the tight tying of asynchronous dependency
code, it has been included in this history and will likely be branched
off as a dedicated repo not available for non client/server
architectures.

much of the execution wrapping code has been moved into a wrapper on
execute instead of recursive executed. This cleans up logic and fixes
issues with collecting all outputs when multiple output nodes exist
2024-06-25 15:49:21 -05:00
Austin Mroz 2d61e214b3 LICENSE, README, net fixes, SSS Specifics
Added LICENSE and brief readme

Updated network checking with more specifics to Salad Simple Storage.
The access token is now fetched, checkpoint size is checked before
uploading and checkpoints are read from the inputs folder to ease file
management on workflow dispatch
2024-06-15 15:31:16 -05:00
Austin Mroz 531fa3f9f2 Base checkpointing implementation
When sampling occurs, intermediate steps are cached to disk.
If at any point execution is halted, interrupted, or crashes, these
checkpoints are loaded from to restore execution from the previous step

Currently largely proof of concept. All samplers will cache, but
restoring is only applied to CustomSampler. Boilerplate is largely in
place to allow for caching output of other non-sampling nodes and will
be investigated later.
2024-06-14 02:40:50 -05:00