This is a practical skill for running quantized LLMs when you're hitting memory limits. It covers GPTQ, a post-training quantization method that compresses models down to 4-bit precision with minimal accuracy loss. The guidance is useful: it tells you when to use GPTQ versus AWQ, with specific hardware examples like fitting 70B+ models on consumer GPUs like the RTX 4090. You get about 4× memory reduction and 3-4× inference speedup compared to FP16. The skill has solid traction with 282 installs and comes from a well-starred template repository. Good reference if you're optimizing deployment costs or working with limited hardware.
- skills.sh installs
- 279
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill gptq --agent claude-codeInstalls into .claude/skills of the current project.
Files
This is a practical skill for running quantized LLMs when you're hitting memory limits. It covers GPTQ, a post-training quantization method that compresses models down to 4-bit precision with minimal accuracy loss. The guidance is useful: it tells you when to use GPTQ versus AWQ, with specific hardware examples like fitting 70B+ models on consumer GPUs like the RTX 4090. You get about 4× memory reduction and 3-4× inference speedup compared to FP16. The skill has solid traction with 282 installs and comes from a well-starred template repository. Good reference if you're optimizing deployment costs or working with limited hardware.
Browse the repository on GitHubSponsors
Details
- Repository
- github.com/davila7/claude-code-templates
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Chembl Database278
- Deepchem278
- Rwkv Architecture277
- Sentencepiece277
- Using Git Worktrees277
- Free Tool Strategy276
- Qms Audit Expert276
- Railway Metrics276
- Nnsight Remote Interpretability275
- Pytdc275
- Railway Domain275
- Firecrawl Scraper274
- Simpo Training273
- Gene Database272
- Uniprot Database269
- File Uploads268
- Simpy265
- Meme Factory264
- Metabolomics Workbench Database264
- Slack Gif Creator264
- Concise Planning263
- Diffdock262
- Clinpgx Database261
- Tavily Web260
