Speculative Decoding
This is a template for implementing speculative decoding techniques to speed up LLM inference by 1.5 to 3.6 times without losing quality. It covers the main approaches like draft model speculation, Medusa's multiple head method, and Lookahead Decoding based on Jacobi iteration. The skill references recent papers from 2024 and gives you a starting point if you're trying to reduce latency in chatbots or code generation tools, or squeeze better throughput from limited hardware. Worth noting it's ported from ovachiever/droid-tings and sits in a template collection with 27.7K stars, so there's likely other inference optimization patterns in there too. The practical speedup range makes this relevant if you're actually serving models at scale.
- skills.sh installs
- 334
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill speculative-decoding --agent claude-codeInstalls into .claude/skills of the current project.
Files
This is a template for implementing speculative decoding techniques to speed up LLM inference by 1.5 to 3.6 times without losing quality. It covers the main approaches like draft model speculation, Medusa's multiple head method, and Lookahead Decoding based on Jacobi iteration. The skill references recent papers from 2024 and gives you a starting point if you're trying to reduce latency in chatbots or code generation tools, or squeeze better throughput from limited hardware. Worth noting it's ported from ovachiever/droid-tings and sits in a template collection with 27.7K stars, so there's likely other inference optimization patterns in there too. The practical speedup range makes this relevant if you're actually serving models at scale.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- Categories
- AI & Agent Building, Automation & Workflows
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Web Artifacts Builder334
- Move Code Quality333
- Email Sequence332
- Nemo Guardrails332
- Optimizing Attention Flash332
- Figma331
- Zapier Workflows330
- Scikit Survival329
- Axolotl328
- Developer Growth Analysis328
- Alphafold Database326
- Llm App Patterns326
- Gh Fix Ci325
- Pyhealth325
- Scanpy325
- Aeon324
- Web To Markdown322
- Biomni321
- Constitutional Ai321
- Nanogpt320
- Sglang320
- Uspto Database318
- Receiving Code Review317
- Transformer Lens Interpretability317
Recommended
More AI & Agent Building
consulting-frameworksaznatkoiny/zai-skillsCore consulting thinking frameworks and methodologies for structuring business problems, communicating findings, analyzing strategy, building financial models, 333skills.sh installs
figmadavila7/claude-code-templatesUse the Figma MCP server to fetch design context, screenshots, variables, and assets from Figma, and to translate Figma nodes into production code. Trigger when331skills.sh installs
nocobase-ui-buildernocobase/skillsINTERNAL CONTINUATION ONLY. Never select this skill from a raw user UI request. Use it only after nocobase-portal-manage has already resolved exactly one enable331skills.sh installszapier-workflowsdavila7/claude-code-templatesManage and trigger pre-built Zapier workflows and MCP tool orchestration. Use when user mentions workflows, Zaps, automations, daily digest, research, search, l330skills.sh installsalphafold-databasedavila7/claude-code-templatesAccess AlphaFold's 200M+ AI-predicted protein structures. Retrieve structures by UniProt ID, download PDB/mmCIF files, analyze confidence metrics (pLDDT, PAE), 326skills.sh installs
shorts-script-personalityoutscal/video-generatorGenerates hyper-optimized YouTube Shorts/Instagram Reels scripts with personality-specific styles while enforcing strict anti-AI-slop writing rules325skills.sh installs