Gguf Quantization
This gets you GGUF quantization working with llama.cpp for running models on consumer hardware without needing a GPU. It's the go-to format if you're deploying on Apple Silicon with Metal acceleration or just want CPU inference on a laptop. The skill covers quantization options from Q2_K to Q8_0, plus imatrix support for better quality at lower bit depths. Originally from zechenzhangagi's AI research skills collection, now maintained in davila7's template repo with 27.7K stars. The practical angle here is clear: this is for local inference with tools like LM Studio and Ollama, not cloud deployment. If you're running models locally, you're probably already using GGUF whether you knew it or not.
- skills.sh installs
- 378
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill gguf-quantization --agent claude-codeInstalls into .claude/skills of the current project.
Files
This gets you GGUF quantization working with llama.cpp for running models on consumer hardware without needing a GPU. It's the go-to format if you're deploying on Apple Silicon with Metal acceleration or just want CPU inference on a laptop. The skill covers quantization options from Q2_K to Q8_0, plus imatrix support for better quality at lower bit depths. Originally from zechenzhangagi's AI research skills collection, now maintained in davila7's template repo with 27.7K stars. The practical angle here is clear: this is for local inference with tools like LM Studio and Ollama, not cloud deployment. If you're running models locally, you're probably already using GGUF whether you knew it or not.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- Category
- Code Review & Quality
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Peft Fine Tuning378
- Dspy376
- Sentence Transformers376
- Vercel React Best Practices376
- Fine Tuning With Trl375
- Image Enhancer375
- Competitive Ads Extractor373
- Linear373
- Shap373
- Drugbank Database372
- Page Cro372
- Github Workflow Automation371
- Schema Markup371
- Webapp Testing370
- Bun Development369
- Tensorboard369
- Pymatgen368
- Deepspeed367
- Figma Implement Design367
- Copy Editing366
- Codex Review365
- Instructor365
- Notebooklm365
- Behavioral Modes364
Recommended
More Code Review & Quality
resume-design-generationeachlabs/skillsGenerate professional resume and CV designs using each::sense AI. Create modern, creative, minimalist, executive, tech, academic, infographic, two-column, ATS-f378skills.sh installs
cross-evalalirezarezvani/claude-skills/cs:cross-eval <memo> — Multi-model consensus on a board memo or strategy brief. Claude + Codex + Gemini cross-review with graceful degradation. Use when a high376skills.sh installs
ln-722-backend-generatorlevnikolaevich/claude-code-skillsGenerates .NET Clean Architecture backend structure from entity definitions. Use when bootstrapping .NET backend projects.376skills.sh installsln-400-story-executorlevnikolaevich/claude-code-skillsExecutes Story tasks in priority order (To Review, To Rework, Todo). Use when Story has planned tasks ready for implementation.372skills.sh installs
pma-rustzzci/skillsProduction-grade Rust acceptance baseline for PMA-managed Rust services and CLIs. Use with /pma when creating, reviewing, or upgrading Rust workspaces, Axum/Tok372skills.sh installs
schema-markupdavila7/claude-code-templatesWhen the user wants to add, fix, or optimize schema markup and structured data on their site. Also use when the user mentions "schema markup," "structured data,371skills.sh installs