 Ken Simpson
|
30b07d37cd
|
Extract Modal LLM profile staging
|
2026-08-29 11:29:36 -07:00 |
|
|
Ken Simpson
|
e597b9ffae
|
Harden remote LLM staging lifecycle
|
2026-08-25 17:22:18 -07:00 |
|
|
Ken Simpson
|
e679d068a6
|
Report accurate LLM staging progress
|
2026-08-25 16:30:14 -07:00 |
|
|
Ken Simpson
|
9a92fe2ecb
|
Add provider-aware workflow partitioning
|
2026-08-22 20:10:22 -07:00 |
|
|
Ken Simpson
|
3d067372c5
|
Fix llama.cpp shared library discovery on SSH
|
2026-08-22 19:34:49 -07:00 |
|
|
Ken Simpson
|
86c132798b
|
Add multimodal GGUF execution on SSH
|
2026-08-22 19:18:42 -07:00 |
|
|
Ken Simpson
|
5d6c13abe2
|
Add SSH GGUF LLM backend
|
2026-08-22 18:45:06 -07:00 |
|
|
Ken Simpson
|
df5d7aa574
|
Stage LLM profiles on SSH workers
|
2026-08-22 17:20:16 -07:00 |
|
|
Ken Simpson
|
7bb2509903
|
Merge remote main and bump version to 0.3.5
|
2026-08-21 15:36:53 -07:00 |
|
|
Ken Simpson
|
82fb495905
|
Recover LLM VRAM after vLLM eviction
|
2026-08-21 13:47:52 -07:00 |
|
|
Ken Simpson
|
492fcfa60b
|
Fix LLM prewarm scope and Triton child telemetry
|
2026-08-20 19:52:41 -07:00 |
|
|
Ken Simpson
|
8b0dc851ef
|
Track genuine Triton compile cache misses
|
2026-08-20 18:05:16 -07:00 |
|
|
Ken Simpson
|
8e4ee37fab
|
Accelerate Modal model startup
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
d20773d338
|
Add automatic vLLM mode promotion
|
2026-08-19 11:48:57 -07:00 |
|
|
Ken Simpson
|
0abf4d36fd
|
Add cached vLLM throughput benchmarking
|
2026-08-19 11:20:00 -07:00 |
|
|
Ken Simpson
|
dc0d21737f
|
Accelerate Hugging Face downloads with Xet
|
2026-08-19 11:02:22 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|
|
Ken Simpson
|
bfb2343553
|
Use FlashAttention for B300 vLLM inference
|
2026-08-18 23:44:07 -07:00 |
|
|
Ken Simpson
|
d5186873d9
|
Rewrite generated LLM profile in direct inputs
|
2026-08-18 23:04:59 -07:00 |
|
|
Ken Simpson
|
cb8f816963
|
Add co-resident vLLM backend for B300
|
2026-08-18 22:36:19 -07:00 |
|
|
Ken Simpson
|
c1e29e13c4
|
Resolve LLM model IDs before GPU dispatch
|
2026-08-18 22:32:52 -07:00 |
|
|
Ken Simpson
|
090231001b
|
Resolve Hugging Face LLM profiles on CPU
|
2026-08-18 22:29:44 -07:00 |
|
|
Ken Simpson
|
3c36f00d19
|
Add immutable generated LLM profile schema
|
2026-08-18 22:26:37 -07:00 |
|
|
Ken Simpson
|
034fa77da2
|
Pass SmolVLM video sampling flag directly
|
2026-08-18 21:45:49 -07:00 |
|
|
Ken Simpson
|
f21effae4e
|
Handle predecoded video in Modal LLM
|
2026-08-18 21:40:27 -07:00 |
|
|
Ken Simpson
|
9a4fd944ac
|
Add resident multimodal Modal LLM node
|
2026-08-18 21:22:08 -07:00 |
|