#local-llm
1 note or post, 2 links.
Notes and posts
Local LLM
Local Coding How to Setup a Local Coding Agent on macOS - Kyle Howells running Gemma 4 26B-A4B and Qwen3.6 35B-A3B locally with llama.cpp, MTP speculative decoding, multimodal support, and PI as a coding agent. Local…
Links Open in the Archive
TensorFold | Run LLMs, Fast.
Run open models on the GPUs you own, with native Metal and CUDA inference.
JITEngine
LLM serving, synthesized for your Mac. Up to 2.7× as fast as the best other server we measured on the same Mac. We used SkyDiscover to build specialized…