Mac Code Local Ai Agent
This is a complete local AI coding agent that runs 35B parameter models on a 16GB Mac at 30 tokens per second, using llama.cpp or MLX to stay entirely offline. It routes your prompts to web search, shell commands, or chat automatically, and includes persistent KV cache that can sync across machines via R2. The MLX backend is the real hook here: you can save context from a 50K line codebase, kill the process, reload it in 0.0003 seconds, and pick up exactly where you left off. If you're tired of paying for cloud inference or want to experiment with out-of-core streaming that loads only the active MoE experts from SSD, this is a solid starting point with actual working code for quantized cache and direct I/O on macOS.
- skills.sh installs
- 800
- GitHub stars
- 61
- last updated
- Jul 14, 2026
Install
$ npx -y skills add aradotso/trending-skills --skill mac-code-local-ai-agent --agent claude-codeInstalls into .claude/skills of the current project.
Files
mac-code — Free Local AI Agent on Apple Silicon
Skill by ara.so — Daily 2026 Skills collection.
Run a 35B reasoning model locally on your Mac for $0/month. mac-code is a CLI AI coding agent (Claude Code alternative) that routes tasks — web search, shell commands, file edits, chat — through a local LLM. Supports llama.cpp (30 tok/s) and MLX (64K context, persistent KV cache) backends on Apple Silicon.
What It Does
- LLM-as-router: The model classifies every prompt as
search,shell, orchatand routes accordingly - 35B MoE at 30 tok/s via llama.cpp + IQ2_M quantization (fits in 16 GB RAM)
- 35B full Q4 on 16 GB via custom MoE Expert Sniper (1.54 tok/s, only 1.42 GB RAM used)
- 9B at 64K context via quantized KV cache (
q4_0keys/values) - MLX backend adds persistent KV cache save/load, context compression, R2 sync
- Tools: DuckDuckGo search, shell execution, file read/write
Installation
Prerequisites
brew install llama.cpp
pip3 install rich ddgs huggingface-hub mlx-lm --break-system-packages
Clone the repo
git clone https://github.com/walter-grace/mac-code
cd mac-code
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/aradotso/trending-skills
- Category
- AI & Agent Building
- First seen
- May 16, 2026
More from aradotso/trending-skills
All 251- K Skill Korean Ai Tools799
- Codex Plugin Cc787
- Pump Analyzer Solana786
- Turboquant Pytorch772
- App Store Screenshots Generator769
- Caveman Token Optimizer768
- Open Pencil Design Editor766
- Pgmicro Postgres Sqlite764
- Tribev2 Brain Encoding764
- Polymarket Arbitrage Bot762
- Polymarket Copy Trading Bot757
- Taiwan Equity Research Coverage755
- Torchcode Pytorch Interview Practice753
- Codex Session Patcher750
- Learn Docker K8s Game746
- Claude Better Cli744
- Ministack Aws Emulator743
- Wildworld Dataset739
- Phantom Ai Coworker729
- Kordoc Korean Document Parser727
- Claw Code Harness721
- Clawd Code Python Port714
- See Through Anime Layer Decomposition706
- Open Agent Sdk701
Recommended
More AI & Agent Building
open-multi-agent-orchestrationaradotso/trending-skillsopen multi agent orchestration665skills.sh installs
agent-memoryyamadashy/repomixUse this skill when the user asks to save, remember, recall, or organize memories. Triggers on: 'remember this', 'save this', 'note this', 'what did we discuss 465skills.sh installs
llm-application-dev-prompt-optimizesickn33/antigravity-awesome-skillsllm application dev prompt optimize357skills.sh installs