 Ken Simpson
|
9a92fe2ecb
|
Add provider-aware workflow partitioning
|
2026-08-22 20:10:22 -07:00 |
|
|
Ken Simpson
|
3d067372c5
|
Fix llama.cpp shared library discovery on SSH
|
2026-08-22 19:34:49 -07:00 |
|
|
Ken Simpson
|
86c132798b
|
Add multimodal GGUF execution on SSH
|
2026-08-22 19:18:42 -07:00 |
|
|
Ken Simpson
|
5d6c13abe2
|
Add SSH GGUF LLM backend
|
2026-08-22 18:45:06 -07:00 |
|
|
Ken Simpson
|
7bb2509903
|
Merge remote main and bump version to 0.3.5
|
2026-08-21 15:36:53 -07:00 |
|
|
Ken Simpson
|
82fb495905
|
Recover LLM VRAM after vLLM eviction
|
2026-08-21 13:47:52 -07:00 |
|
|
Ken Simpson
|
492fcfa60b
|
Fix LLM prewarm scope and Triton child telemetry
|
2026-08-20 19:52:41 -07:00 |
|
|
Ken Simpson
|
8b0dc851ef
|
Track genuine Triton compile cache misses
|
2026-08-20 18:05:16 -07:00 |
|
|
Ken Simpson
|
8e4ee37fab
|
Accelerate Modal model startup
|
2026-08-20 16:17:37 -07:00 |
|
|
Ken Simpson
|
d20773d338
|
Add automatic vLLM mode promotion
|
2026-08-19 11:48:57 -07:00 |
|
|
Ken Simpson
|
0abf4d36fd
|
Add cached vLLM throughput benchmarking
|
2026-08-19 11:20:00 -07:00 |
|
|
Ken Simpson
|
5b70c91621
|
Add mlx-dspark local LLM acceleration
|
2026-08-19 10:55:53 -07:00 |
|
|
Ken Simpson
|
255e17a861
|
Merge Apple Silicon local LLM inference
# Conflicts:
# README.md
# tests/test_modal_llm.py
|
2026-08-19 10:06:17 -07:00 |
|
|
Ken Simpson
|
77c253f547
|
Add Apple Silicon local LLM inference
|
2026-08-19 09:58:50 -07:00 |
|
|
Ken Simpson
|
a7ff12f72e
|
Add Modal LLM reasoning toggle
|
2026-08-19 09:41:32 -07:00 |
|
|
Ken Simpson
|
082909062b
|
Stream Modal LLM progress and vLLM tokens
|
2026-08-19 09:09:12 -07:00 |
|
|
Ken Simpson
|
240e188147
|
Separate Modal LLM reasoning output
|
2026-08-19 08:55:55 -07:00 |
|
|
Ken Simpson
|
3ccd08c506
|
Use Triton attention for B300 Qwen inference
|
2026-08-18 23:57:54 -07:00 |
|
|
Ken Simpson
|
0978444a28
|
Pin FlashAttention 3 for Qwen on B300
|
2026-08-18 23:49:05 -07:00 |
|
|
Ken Simpson
|
bfb2343553
|
Use FlashAttention for B300 vLLM inference
|
2026-08-18 23:44:07 -07:00 |
|
|
Ken Simpson
|
cb8f816963
|
Add co-resident vLLM backend for B300
|
2026-08-18 22:36:19 -07:00 |
|
|
Ken Simpson
|
034fa77da2
|
Pass SmolVLM video sampling flag directly
|
2026-08-18 21:45:49 -07:00 |
|
|
Ken Simpson
|
f21effae4e
|
Handle predecoded video in Modal LLM
|
2026-08-18 21:40:27 -07:00 |
|
|
Ken Simpson
|
9a4fd944ac
|
Add resident multimodal Modal LLM node
|
2026-08-18 21:22:08 -07:00 |
|