 Ken Simpson
|
e9948b2e37
|
Merge local Modal placement warning styling
|
2026-08-19 12:30:27 -07:00 |
|
|
Ken Simpson
|
e18ddc81ba
|
Clarify local Modal placement warning
|
2026-08-19 12:24:09 -07:00 |
|
|
Ken Simpson
|
39701644fe
|
Fix async Modal cache writes
|
2026-08-19 12:18:02 -07:00 |
|
|
Ken Simpson
|
d20773d338
|
Add automatic vLLM mode promotion
|
2026-08-19 11:48:57 -07:00 |
|
|
Ken Simpson
|
0abf4d36fd
|
Add cached vLLM throughput benchmarking
|
2026-08-19 11:20:00 -07:00 |
|
|
Ken Simpson
|
dc0d21737f
|
Accelerate Hugging Face downloads with Xet
|
2026-08-19 11:02:22 -07:00 |
|
|
Ken Simpson
|
5b70c91621
|
Add mlx-dspark local LLM acceleration
|
2026-08-19 10:55:53 -07:00 |
|
|
Ken Simpson
|
5e910ef272
|
Prevent disabled LLM nodes from launching Modal
|
2026-08-19 10:33:32 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
f3cc47f987
|
Fix Modal billing across app redeployments
|
2026-08-19 09:26:21 -07:00 |
|
|
Ken Simpson
|
97b337aca1
|
Strengthen live vLLM telemetry canary
|
2026-08-19 09:17:33 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
03a08e00ec
|
Show hourly Modal app billing in status pill
|
2026-08-19 08:26:43 -07:00 |
|
|
Ken Simpson
|
c631996ca8
|
Reconcile runtime pins before vLLM install
|
2026-08-19 08:10:08 -07:00 |
|
|
Ken Simpson
|
7a2028eecd
|
Install vLLM on every Modal GPU image
|
2026-08-19 08:05:38 -07:00 |
|
|
Ken Simpson
|
a544cfa62c
|
Document live generated-profile validation
|
2026-08-19 00:09:31 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|
|
Ken Simpson
|
bfb2343553
|
Use FlashAttention for B300 vLLM inference
|
2026-08-18 23:44:07 -07:00 |
|
|
Ken Simpson
|
b0678d9593
|
Run Modal workers on Python 3.13
|
2026-08-18 23:31:04 -07:00 |
|
|
Ken Simpson
|
28c4b42076
|
Avoid FlashInfer sampler JIT on Modal workers
|
2026-08-18 23:22:37 -07:00 |
|
|
Ken Simpson
|
d5186873d9
|
Rewrite generated LLM profile in direct inputs
|
2026-08-18 23:04:59 -07:00 |
|
|
Ken Simpson
|
cfc54f14ce
|
Align B300 runtime with resolved CUDA stack
|
2026-08-18 22:43:23 -07:00 |
|
|
Ken Simpson
|
e98d28151a
|
Align safetensors with Transformers 5.15
|
2026-08-18 22:38:17 -07:00 |
|
|
Ken Simpson
|
d9e74bdc8e
|
Add live generated-profile LLM canaries
|
2026-08-18 22:37:08 -07:00 |
|
|
Ken Simpson
|
cb8f816963
|
Add co-resident vLLM backend for B300
|
2026-08-18 22:36:19 -07:00 |
|
|
Ken Simpson
|
c1e29e13c4
|
Resolve LLM model IDs before GPU dispatch
|
2026-08-18 22:32:52 -07:00 |
|
|
Ken Simpson
|
090231001b
|
Resolve Hugging Face LLM profiles on CPU
|
2026-08-18 22:29:44 -07:00 |
|
|
Ken Simpson
|
3c36f00d19
|
Add immutable generated LLM profile schema
|
2026-08-18 22:26:37 -07:00 |
|
|
Ken Simpson
|
1a60539df6
|
Make LLM co-residency canary deterministic
|
2026-08-18 21:51:46 -07:00 |
|
|
Ken Simpson
|
034fa77da2
|
Pass SmolVLM video sampling flag directly
|
2026-08-18 21:45:49 -07:00 |
|
|
Ken Simpson
|
f21effae4e
|
Handle predecoded video in Modal LLM
|
2026-08-18 21:40:27 -07:00 |
|
|
Ken Simpson
|
5df3788ae5
|
Exercise LLM staging in live canary
|
2026-08-18 21:29:31 -07:00 |
|
|
Ken Simpson
|
54aeabd6e0
|
Preserve isolated live Modal canary settings
|
2026-08-18 21:25:39 -07:00 |
|
|
Ken Simpson
|
9a4fd944ac
|
Add resident multimodal Modal LLM node
|
2026-08-18 21:22:08 -07:00 |
|
|
Ken Simpson
|
16a6f6c084
|
Default blank endpoint environment to main
|
2026-08-18 20:36:51 -07:00 |
|
|
Ken Simpson
|
a79a1086a6
|
Retry Modal endpoint cold starts
|
2026-08-18 20:29:45 -07:00 |
|
|
Ken Simpson
|
2eb299b906
|
Authorize scoped endpoint proxy tokens
|
2026-08-18 18:57:13 -07:00 |
|
|
Ken Simpson
|
bac22e8537
|
Add Modal hosted endpoint chat node
|
2026-08-18 17:01:33 -07:00 |
|
|
Ken Simpson
|
f9f3bca2fe
|
Inject named Modal secrets into remote workers
|
2026-08-18 14:20:09 -07:00 |
|
|
Ken Simpson
|
0cdec8be5a
|
Support ComfyUI node replacements remotely
|
2026-08-17 21:53:29 -07:00 |
|
|
Ken Simpson
|
7f6775e5b4
|
Align ComfyUI support package pins
|
2026-08-17 20:56:16 -07:00 |
|
|
Ken Simpson
|
f0a341ea07
|
Preserve singleton mapped image batches
|
2026-08-15 09:09:29 -07:00 |
|
|
Ken Simpson
|
1894a600b6
|
Warn about local Modal re-entry bottlenecks
|
2026-08-14 23:22:04 -07:00 |
|
|
Ken Simpson
|
728a56e337
|
Propagate mapped list metadata across components
|
2026-08-14 14:26:31 -07:00 |
|
|
Ken Simpson
|
9ba54bcc4c
|
Fix heterogeneous mapped latent outputs
|
2026-08-14 10:23:43 -07:00 |
|
|
Ken Simpson
|
d86bc9963f
|
Install current ComfyUI core dependencies remotely
|
2026-08-13 21:23:01 -07:00 |
|