
Awq Quantization
This gives Claude the ability to apply AWQ quantization, a 4-bit compression technique that preserves important weights based on activation patterns. You're looking at roughly 3x speedup over FP16 with minimal accuracy loss, which makes it solid for deploying instruction-tuned models in production. The skill documentation is clear about when to use it: if you're running vLLM on Ampere or newer GPUs and want better generalization than GPTQ offers. Worth noting it originally came from zechenzhangagi's AI research skills collection before being templated here. The tradeoff is ecosystem compatibility, GPTQ still has broader tool support if that matters for your stack.
- skills.sh installs
- 303
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill awq-quantization --agent claude-codeInstalls into .claude/skills of the current project.
Files
This gives Claude the ability to apply AWQ quantization, a 4-bit compression technique that preserves important weights based on activation patterns. You're looking at roughly 3x speedup over FP16 with minimal accuracy loss, which makes it solid for deploying instruction-tuned models in production. The skill documentation is clear about when to use it: if you're running vLLM on Ampere or newer GPUs and want better generalization than GPTQ offers. Worth noting it originally came from zechenzhangagi's AI research skills collection before being templated here. The tradeoff is ecosystem compatibility, GPTQ still has broader tool support if that matters for your stack.
Browse the repository on GitHubSponsors
Details
- Repository
- github.com/davila7/claude-code-templates
- Category
- AI & Agent Building
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Implementing Llms Litgpt303
- Verification Before Completion302
- Fluidsim301
- Gh Address Comments301
- Invoice Organizer300
- Pymoo300
- Domain Name Brainstormer299
- Neurokit2299
- Regulatory Affairs Head299
- Openrlhf Training298
- Sparse Autoencoder Training298
- Mamba Architecture297
- Rdkit297
- Scikit Bio297
- Agent Management296
- Kegg Database295
- Torch Geometric294
- Langfuse291
- Commit Work290
- Quality Manager Qmr290
- Tdd Workflow290
- Get Available Resources289
- Gwas Database289
- Pubchem Database288