 Ken Simpson
|
5e910ef272
|
Prevent disabled LLM nodes from launching Modal
|
2026-08-19 10:33:32 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
f3cc47f987
|
Fix Modal billing across app redeployments
|
2026-08-19 09:26:21 -07:00 |
|
|
Ken Simpson
|
97b337aca1
|
Strengthen live vLLM telemetry canary
|
2026-08-19 09:17:33 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
03a08e00ec
|
Show hourly Modal app billing in status pill
|
2026-08-19 08:26:43 -07:00 |
|
|
Ken Simpson
|
f2a23b2570
|
Record RTX PRO vLLM inference validation
|
2026-08-19 08:17:08 -07:00 |
|
|
Ken Simpson
|
c631996ca8
|
Reconcile runtime pins before vLLM install
|
2026-08-19 08:10:08 -07:00 |
|
|
Ken Simpson
|
7a2028eecd
|
Install vLLM on every Modal GPU image
|
2026-08-19 08:05:38 -07:00 |
|
|
Ken Simpson
|
fce72a3e1f
|
Record live LLM and VAE co-residency
|
2026-08-19 00:11:07 -07:00 |
|
|
Ken Simpson
|
a544cfa62c
|
Document live generated-profile validation
|
2026-08-19 00:09:31 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|
|
Ken Simpson
|
bfb2343553
|
Use FlashAttention for B300 vLLM inference
|
2026-08-18 23:44:07 -07:00 |
|
|
Ken Simpson
|
b0678d9593
|
Run Modal workers on Python 3.13
|
2026-08-18 23:31:04 -07:00 |
|
|
Ken Simpson
|
28c4b42076
|
Avoid FlashInfer sampler JIT on Modal workers
|
2026-08-18 23:22:37 -07:00 |
|
|
Ken Simpson
|
64aad817d1
|
Cache Modal dependencies across source deploys
|
2026-08-18 23:15:38 -07:00 |
|
|
Ken Simpson
|
d5186873d9
|
Rewrite generated LLM profile in direct inputs
|
2026-08-18 23:04:59 -07:00 |
|
|
Ken Simpson
|
cfc54f14ce
|
Align B300 runtime with resolved CUDA stack
|
2026-08-18 22:43:23 -07:00 |
|
|
Ken Simpson
|
e98d28151a
|
Align safetensors with Transformers 5.15
|
2026-08-18 22:38:17 -07:00 |
|
|
Ken Simpson
|
cb8f816963
|
Add co-resident vLLM backend for B300
|
2026-08-18 22:36:19 -07:00 |
|
|
Ken Simpson
|
090231001b
|
Resolve Hugging Face LLM profiles on CPU
|
2026-08-18 22:29:44 -07:00 |
|
|
Ken Simpson
|
3c36f00d19
|
Add immutable generated LLM profile schema
|
2026-08-18 22:26:37 -07:00 |
|
|
Ken Simpson
|
1a60539df6
|
Make LLM co-residency canary deterministic
|
2026-08-18 21:51:46 -07:00 |
|
|
Ken Simpson
|
034fa77da2
|
Pass SmolVLM video sampling flag directly
|
2026-08-18 21:45:49 -07:00 |
|
|
Ken Simpson
|
f21effae4e
|
Handle predecoded video in Modal LLM
|
2026-08-18 21:40:27 -07:00 |
|
|
Ken Simpson
|
2eac47f4f7
|
Install SmolVLM processor dependency
|
2026-08-18 21:33:39 -07:00 |
|
|
Ken Simpson
|
54aeabd6e0
|
Preserve isolated live Modal canary settings
|
2026-08-18 21:25:39 -07:00 |
|
|
Ken Simpson
|
9a4fd944ac
|
Add resident multimodal Modal LLM node
|
2026-08-18 21:22:08 -07:00 |
|
|
Ken Simpson
|
16a6f6c084
|
Default blank endpoint environment to main
|
2026-08-18 20:36:51 -07:00 |
|
|
Ken Simpson
|
a79a1086a6
|
Retry Modal endpoint cold starts
|
2026-08-18 20:29:45 -07:00 |
|
|
Ken Simpson
|
2eb299b906
|
Authorize scoped endpoint proxy tokens
|
2026-08-18 18:57:13 -07:00 |
|
|
Ken Simpson
|
bac22e8537
|
Add Modal hosted endpoint chat node
|
2026-08-18 17:01:33 -07:00 |
|
|
Ken Simpson
|
f9f3bca2fe
|
Inject named Modal secrets into remote workers
|
2026-08-18 14:20:09 -07:00 |
|
|
Ken Simpson
|
0cdec8be5a
|
Support ComfyUI node replacements remotely
|
2026-08-17 21:53:29 -07:00 |
|
|
Ken Simpson
|
7f6775e5b4
|
Align ComfyUI support package pins
|
2026-08-17 20:56:16 -07:00 |
|
|
Ken Simpson
|
f0a341ea07
|
Preserve singleton mapped image batches
|
2026-08-15 09:09:29 -07:00 |
|
|
Ken Simpson
|
1894a600b6
|
Warn about local Modal re-entry bottlenecks
|
2026-08-14 23:22:04 -07:00 |
|
|
Ken Simpson
|
728a56e337
|
Propagate mapped list metadata across components
|
2026-08-14 14:26:31 -07:00 |
|
|
Ken Simpson
|
9ba54bcc4c
|
Fix heterogeneous mapped latent outputs
|
2026-08-14 10:23:43 -07:00 |
|
|
Ken Simpson
|
d86bc9963f
|
Install current ComfyUI core dependencies remotely
|
2026-08-13 21:23:01 -07:00 |
|
|
Ken Simpson
|
98878c0e83
|
Overlay iteration rate on progress bars
|
2026-08-13 21:02:44 -07:00 |
|
|
Ken Simpson
|
b9d25ec3d4
|
Show estimated Modal GPU cost during execution
|
2026-08-13 20:22:36 -07:00 |
|
|
Ken Simpson
|
67179df97f
|
Fix Modal status polling across event loops
|
2026-08-13 19:58:39 -07:00 |
|
|
Ken Simpson
|
9f18670773
|
Support V3 Autogrow inputs in remote validation
|
2026-08-13 18:29:22 -07:00 |
|
|
Ken Simpson
|
7d8cb15ac9
|
Show Modal container status in workflow UI
|
2026-08-13 18:18:06 -07:00 |
|
|
Ken Simpson
|
365d6861a7
|
Fix artifact finalizer input namespace
|
2026-08-13 15:50:44 -07:00 |
|