 Ken Simpson
|
f9d85c19f3
|
Rebind affinity after Modal protocol probes
|
2026-08-19 22:49:16 -07:00 |
|
|
Ken Simpson
|
4f5aeb1c98
|
Fix Modal progress panel palette reference
|
2026-08-19 22:40:40 -07:00 |
|
|
Ken Simpson
|
6fcafdec05
|
Preserve remote phases across local preview fanout
|
2026-08-19 22:36:18 -07:00 |
|
|
Ken Simpson
|
cd4791431e
|
Fix runtime Modal node module metadata
|
2026-08-19 22:30:03 -07:00 |
|
|
Ken Simpson
|
f43cd37c79
|
Split remote continuations from local previews
|
2026-08-19 21:45:11 -07:00 |
|
|
Ken Simpson
|
093b2bdeec
|
Run local previews alongside remote continuations
|
2026-08-19 20:48:18 -07:00 |
|
|
Ken Simpson
|
c92af6a8c2
|
Retain remote workers across local workflow gaps
|
2026-08-19 20:06:58 -07:00 |
|
|
Ken Simpson
|
6a2cbbf191
|
Instrument remote result publication stalls
|
2026-08-19 16:07:21 -07:00 |
|
|
Ken Simpson
|
a1f4cac7c1
|
Prevent sampler replay across local phase splits
|
2026-08-19 13:07:36 -07:00 |
|
|
Ken Simpson
|
e9948b2e37
|
Merge local Modal placement warning styling
|
2026-08-19 12:30:27 -07:00 |
|
|
Ken Simpson
|
e18ddc81ba
|
Clarify local Modal placement warning
|
2026-08-19 12:24:09 -07:00 |
|
|
Ken Simpson
|
39701644fe
|
Fix async Modal cache writes
|
2026-08-19 12:18:02 -07:00 |
|
|
Ken Simpson
|
d20773d338
|
Add automatic vLLM mode promotion
|
2026-08-19 11:48:57 -07:00 |
|
|
Ken Simpson
|
0abf4d36fd
|
Add cached vLLM throughput benchmarking
|
2026-08-19 11:20:00 -07:00 |
|
|
Ken Simpson
|
dc0d21737f
|
Accelerate Hugging Face downloads with Xet
|
2026-08-19 11:02:22 -07:00 |
|
|
Ken Simpson
|
5b70c91621
|
Add mlx-dspark local LLM acceleration
|
2026-08-19 10:55:53 -07:00 |
|
|
Ken Simpson
|
5e910ef272
|
Prevent disabled LLM nodes from launching Modal
|
2026-08-19 10:33:32 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
f3cc47f987
|
Fix Modal billing across app redeployments
|
2026-08-19 09:26:21 -07:00 |
|
|
Ken Simpson
|
97b337aca1
|
Strengthen live vLLM telemetry canary
|
2026-08-19 09:17:33 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
03a08e00ec
|
Show hourly Modal app billing in status pill
|
2026-08-19 08:26:43 -07:00 |
|
|
Ken Simpson
|
f2a23b2570
|
Record RTX PRO vLLM inference validation
|
2026-08-19 08:17:08 -07:00 |
|
|
Ken Simpson
|
c631996ca8
|
Reconcile runtime pins before vLLM install
|
2026-08-19 08:10:08 -07:00 |
|
|
Ken Simpson
|
7a2028eecd
|
Install vLLM on every Modal GPU image
|
2026-08-19 08:05:38 -07:00 |
|
|
Ken Simpson
|
fce72a3e1f
|
Record live LLM and VAE co-residency
|
2026-08-19 00:11:07 -07:00 |
|
|
Ken Simpson
|
a544cfa62c
|
Document live generated-profile validation
|
2026-08-19 00:09:31 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|
|
Ken Simpson
|
bfb2343553
|
Use FlashAttention for B300 vLLM inference
|
2026-08-18 23:44:07 -07:00 |
|
|
Ken Simpson
|
b0678d9593
|
Run Modal workers on Python 3.13
|
2026-08-18 23:31:04 -07:00 |
|
|
Ken Simpson
|
28c4b42076
|
Avoid FlashInfer sampler JIT on Modal workers
|
2026-08-18 23:22:37 -07:00 |
|
|
Ken Simpson
|
64aad817d1
|
Cache Modal dependencies across source deploys
|
2026-08-18 23:15:38 -07:00 |
|
|
Ken Simpson
|
d5186873d9
|
Rewrite generated LLM profile in direct inputs
|
2026-08-18 23:04:59 -07:00 |
|
|
Ken Simpson
|
cfc54f14ce
|
Align B300 runtime with resolved CUDA stack
|
2026-08-18 22:43:23 -07:00 |
|
|
Ken Simpson
|
e98d28151a
|
Align safetensors with Transformers 5.15
|
2026-08-18 22:38:17 -07:00 |
|
|
Ken Simpson
|
cb8f816963
|
Add co-resident vLLM backend for B300
|
2026-08-18 22:36:19 -07:00 |
|
|
Ken Simpson
|
090231001b
|
Resolve Hugging Face LLM profiles on CPU
|
2026-08-18 22:29:44 -07:00 |
|
|
Ken Simpson
|
3c36f00d19
|
Add immutable generated LLM profile schema
|
2026-08-18 22:26:37 -07:00 |
|
|
Ken Simpson
|
1a60539df6
|
Make LLM co-residency canary deterministic
|
2026-08-18 21:51:46 -07:00 |
|
|
Ken Simpson
|
034fa77da2
|
Pass SmolVLM video sampling flag directly
|
2026-08-18 21:45:49 -07:00 |
|
|
Ken Simpson
|
f21effae4e
|
Handle predecoded video in Modal LLM
|
2026-08-18 21:40:27 -07:00 |
|
|
Ken Simpson
|
2eac47f4f7
|
Install SmolVLM processor dependency
|
2026-08-18 21:33:39 -07:00 |
|
|
Ken Simpson
|
54aeabd6e0
|
Preserve isolated live Modal canary settings
|
2026-08-18 21:25:39 -07:00 |
|
|
Ken Simpson
|
9a4fd944ac
|
Add resident multimodal Modal LLM node
|
2026-08-18 21:22:08 -07:00 |
|
|
Ken Simpson
|
16a6f6c084
|
Default blank endpoint environment to main
|
2026-08-18 20:36:51 -07:00 |
|
|
Ken Simpson
|
a79a1086a6
|
Retry Modal endpoint cold starts
|
2026-08-18 20:29:45 -07:00 |
|