Choose a model
coder downloaded, recommended
full 105 GB
27b-turbo 20 GB
27b-4bit 16 GB
Choose a coding agent
> Claude Code installed
One command to start
saetta shows the models that fit, downloads the one you pick, finds your agent or installs it, and starts it pointed at the local server.
this Mac: 36 GB
ok 27b-4bit needs 32 GB
ok 27b-turbo needs 36 GB
-- 27b-8bit needs 48 GB
-- coder needs 96 GB
context: 37,888 tokens
Fits the Mac you have
Packs that cannot run are refused before they load, and the context is sized to the memory left. The M5's neural accelerators read prompts fastest; earlier chips run the same kernels.
turn 1 15,867 tokens 8.7 s
reply saved as a restore point
turn 2 +84 new tokens 0.2 s
the rest comes from the cache
new session, same system prompt:
shared prefix reused
Reads only what is new
Follow-up turns and new sessions reuse what the server already read, so agents answer in a fraction of a second instead of re-reading the conversation.
POST /v1/chat/completions OpenAI
POST /v1/messages Anthropic
GET /v1/models
streaming, tool_calls,
reasoning_content, LoRA per request
Speaks both APIs
OpenAI chat completions and Anthropic Messages with streaming, tool calls and reasoning. Point any agent or SDK at 127.0.0.1:8080.
draft head proposes the next tokens
trunk checks them in one pass
27B TURBO 85% of drafts accepted
code edit 142 tokens/s
27B TURBO 19 ms/token
Guesses ahead
Speculative decoding with each model's own draft head, plus prompt lookup for code that repeats what is already in context. Same output as plain decoding.
kernels C host + hand-written Metal
binary one, no Python
verify 7/7 reference tests per commit
layers numpy oracle, every layer
logits max rel err 6.7e-7
Checked, layer by layer
Every model is verified against a numpy reference at every layer before a change lands, and every speed number comes from a recorded benchmark.