If you're running language models on hardware without NVIDIA GPUs, this is your go-to. It's a pure C/C++ implementation optimized for CPU inference and non-CUDA setups, which means it shines on Apple Silicon, AMD or Intel GPUs, and even edge devices like Raspberry Pis. The appeal is minimal dependencies and straightforward deployment without needing Docker or Python environments. With nearly 28K GitHub stars, llama.cpp has proven itself in production. The skill documentation is clear about the tradeoffs: use this for CPU-first deployments, but if you've got NVIDIA datacenter GPUs and need maximum throughput, you'll want TensorRT-LLM instead.

skills.sh installs
475
GitHub stars
33.2K
last updated
Aug 21, 2026

Install

$ npx -y skills add davila7/claude-code-templates --skill llama-cpp --agent claude-code

Installs into .claude/skills of the current project.

Files

If you're running language models on hardware without NVIDIA GPUs, this is your go-to. It's a pure C/C++ implementation optimized for CPU inference and non-CUDA setups, which means it shines on Apple Silicon, AMD or Intel GPUs, and even edge devices like Raspberry Pis. The appeal is minimal dependencies and straightforward deployment without needing Docker or Python environments. With nearly 28K GitHub stars, llama.cpp has proven itself in production. The skill documentation is clear about the tradeoffs: use this for CPU-first deployments, but if you've got NVIDIA datacenter GPUs and need maximum throughput, you'll want TensorRT-LLM instead.

Browse the repository on GitHub

Sponsors

Details

Repository
github.com/davila7/claude-code-templates
Categories
Backend & APIs, AI & Agent Building, Data Science & ML
First seen
Jun 3, 2026

More from davila7/claude-code-templates

All 618
1bobmatnyc avatarthreat-modelingbobmatnyc/claude-mpm-skillsThreat modeling workflow for software systems: scope, data flow diagrams, STRIDE analysis, risk scoring, and turning mitigations into backlog and tests. Use whe474skills.sh installs
2pedronauck avatarreactpedronauck/skillsReact 19 development under the React Compiler. Use when writing React components or hooks, deciding whether a useMemo/useCallback/memo belongs in the code, diag473skills.sh installs
3bahayonghang avatarindustrial-ai-researchbahayonghang/academic-writing-skillsIndustrial AI literature research with mandatory intake questions, venue-aware source prioritization, structured report outputs, and survey draft generation. Us469skills.sh installs
4mvanhorn avatarpp-coingeckomvanhorn/printing-press-libraryPrinting Press CLI for Coingecko. CoinGecko public API for cryptocurrency data. Free tier, no API key required for basic endpoints.469skills.sh installs
5nuxt-content avatarcreate-docsnuxt-content/docusCreate complete documentation sites for projects. Use when asked to: "create docs", "add documentation", "setup docs site", "generate docs", "document my projec469skills.sh installs
6useai-pro avatarconfig-hardeneruseai-pro/openclaw-skills-securityAudit and harden your OpenClaw configuration. Checks AGENTS.md, gateway settings, sandbox config, and permission policies for security weaknesses.469skills.sh installs