overview
Overview
oMLX is a native macOS LLM inference server built on Apple's MLX framework, offering continuous batching and a two-tier (unified-memory + SSD) KV cache with an OpenAI/Anthropic-compatible API. It runs local models on Apple Silicon as a drop-in backend for Claude Code, Cursor, and Codex, and is managed from the macOS menu bar.
