 Ken Simpson
|
492fcfa60b
|
Fix LLM prewarm scope and Triton child telemetry
|
2026-08-20 19:52:41 -07:00 |
|
|
Ken Simpson
|
8b0dc851ef
|
Track genuine Triton compile cache misses
|
2026-08-20 18:05:16 -07:00 |
|
|
Ken Simpson
|
db3bf46b5a
|
Avoid reloading mapped compile cache volumes
|
2026-08-20 17:12:18 -07:00 |
|
|
Ken Simpson
|
e72d3a9eaa
|
Read proxy metadata from V3 hidden context
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
a6ce43eaa9
|
Fix queued prompt proxy isolation
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
4b387239b4
|
Fix overlapping Modal warmup contexts
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
6d524ae885
|
Document loader prewarm lookup race
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
8e4ee37fab
|
Accelerate Modal model startup
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
186d98ea3f
|
Keep Modal protocol validation off GPU
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
c524109d13
|
Speculatively prewarm next Modal worker
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
2373d9d16d
|
Bump version to 0.3.3
|
2026-08-20 07:11:18 -07:00 |
|
|
Ken Simpson
|
54afff864a
|
Avoid raw video transfer for terminal saves
|
2026-08-20 00:25:27 -07:00 |
|
|
Ken Simpson
|
f070b310f1
|
Keep Comfy snapshots out of LLM phases
|
2026-08-19 23:29:54 -07:00 |
|
|
Ken Simpson
|
f9d85c19f3
|
Rebind affinity after Modal protocol probes
|
2026-08-19 22:49:16 -07:00 |
|
|
Ken Simpson
|
4f5aeb1c98
|
Fix Modal progress panel palette reference
|
2026-08-19 22:40:40 -07:00 |
|
|
Ken Simpson
|
6fcafdec05
|
Preserve remote phases across local preview fanout
|
2026-08-19 22:36:18 -07:00 |
|
|
Ken Simpson
|
cd4791431e
|
Fix runtime Modal node module metadata
|
2026-08-19 22:30:03 -07:00 |
|
|
Ken Simpson
|
f43cd37c79
|
Split remote continuations from local previews
|
2026-08-19 21:45:11 -07:00 |
|
|
Ken Simpson
|
093b2bdeec
|
Run local previews alongside remote continuations
|
2026-08-19 20:48:18 -07:00 |
|
|
Ken Simpson
|
c92af6a8c2
|
Retain remote workers across local workflow gaps
|
2026-08-19 20:06:58 -07:00 |
|
|
Ken Simpson
|
6a2cbbf191
|
Instrument remote result publication stalls
|
2026-08-19 16:07:21 -07:00 |
|
|
Ken Simpson
|
a1f4cac7c1
|
Prevent sampler replay across local phase splits
|
2026-08-19 13:07:36 -07:00 |
|
|
Ken Simpson
|
936c97b1f1
|
Silence successful Modal billing refreshes
|
2026-08-19 12:34:24 -07:00 |
|
|
Ken Simpson
|
e9948b2e37
|
Merge local Modal placement warning styling
|
2026-08-19 12:30:27 -07:00 |
|
|
Ken Simpson
|
e18ddc81ba
|
Clarify local Modal placement warning
|
2026-08-19 12:24:09 -07:00 |
|
|
Ken Simpson
|
39701644fe
|
Fix async Modal cache writes
|
2026-08-19 12:18:02 -07:00 |
|
|
Ken Simpson
|
66d9ffaa2b
|
Bump version to 0.3.2
|
2026-08-19 11:56:01 -07:00 |
|
|
Ken Simpson
|
d20773d338
|
Add automatic vLLM mode promotion
|
2026-08-19 11:48:57 -07:00 |
|
|
Ken Simpson
|
0abf4d36fd
|
Add cached vLLM throughput benchmarking
|
2026-08-19 11:20:00 -07:00 |
|
|
Ken Simpson
|
663cf029b4
|
Bump version to 0.3.1
|
2026-08-19 11:02:58 -07:00 |
|
|
Ken Simpson
|
dc0d21737f
|
Accelerate Hugging Face downloads with Xet
|
2026-08-19 11:02:22 -07:00 |
|
|
Ken Simpson
|
5b70c91621
|
Add mlx-dspark local LLM acceleration
|
2026-08-19 10:55:53 -07:00 |
|
|
Ken Simpson
|
5e910ef272
|
Prevent disabled LLM nodes from launching Modal
|
2026-08-19 10:33:32 -07:00 |
|
|
Ken Simpson
|
bd3893d53a
|
Bump version to 0.2.2
|
2026-08-19 10:09:31 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
f3cc47f987
|
Fix Modal billing across app redeployments
|
2026-08-19 09:26:21 -07:00 |
|
|
Ken Simpson
|
eb8124ec65
|
Bump version to 0.2.1
|
2026-08-19 09:20:07 -07:00 |
|
|
Ken Simpson
|
97b337aca1
|
Strengthen live vLLM telemetry canary
|
2026-08-19 09:17:33 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
03a08e00ec
|
Show hourly Modal app billing in status pill
|
2026-08-19 08:26:43 -07:00 |
|
|
Ken Simpson
|
f2a23b2570
|
Record RTX PRO vLLM inference validation
|
2026-08-19 08:17:08 -07:00 |
|
|
Ken Simpson
|
c631996ca8
|
Reconcile runtime pins before vLLM install
|
2026-08-19 08:10:08 -07:00 |
|
|
Ken Simpson
|
7a2028eecd
|
Install vLLM on every Modal GPU image
|
2026-08-19 08:05:38 -07:00 |
|
|
Ken Simpson
|
fce72a3e1f
|
Record live LLM and VAE co-residency
|
2026-08-19 00:11:07 -07:00 |
|
|
Ken Simpson
|
a544cfa62c
|
Document live generated-profile validation
|
2026-08-19 00:09:31 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|