Commit Graph
7 Commits
Author SHA1 Message Date
Ken Simpson 255e17a861 Merge Apple Silicon local LLM inference
# Conflicts:
#	README.md
#	tests/test_modal_llm.py
2026-08-19 10:06:17 -07:00
Ken Simpson 77c253f547 Add Apple Silicon local LLM inference 2026-08-19 09:58:50 -07:00
Ken Simpson a7ff12f72e Add Modal LLM reasoning toggle 2026-08-19 09:41:32 -07:00
Ken Simpson 082909062b Stream Modal LLM progress and vLLM tokens 2026-08-19 09:09:12 -07:00
Ken Simpson 240e188147 Separate Modal LLM reasoning output 2026-08-19 08:55:55 -07:00
Ken Simpson c1e29e13c4 Resolve LLM model IDs before GPU dispatch 2026-08-18 22:32:52 -07:00
Ken Simpson 9a4fd944ac Add resident multimodal Modal LLM node 2026-08-18 21:22:08 -07:00