Long Context
This pulls together the main techniques for extending transformer context windows beyond their default limits. You get implementations of RoPE, YaRN, ALiBi, and position interpolation, which are the go-to methods when you need to push models like LLaMA or Mistral from their standard 4k-8k token limits up to 32k, 64k, or beyond. It's aimed at the fine-tuning and deployment stage rather than training from scratch. The approach here is practical: minimal compute overhead while maintaining model quality across longer sequences. If you're hitting context limits on a pre-trained model and don't want to retrain, this gives you the cookbook of what actually works in production.
- skills.sh installs
- 465
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill long-context --agent claude-codeInstalls into .claude/skills of the current project.
Files
This pulls together the main techniques for extending transformer context windows beyond their default limits. You get implementations of RoPE, YaRN, ALiBi, and position interpolation, which are the go-to methods when you need to push models like LLaMA or Mistral from their standard 4k-8k token limits up to 32k, 64k, or beyond. It's aimed at the fine-tuning and deployment stage rather than training from scratch. The approach here is practical: minimal compute overhead while maintaining model quality across longer sequences. If you're hitting context limits on a pre-trained model and don't want to retrain, this gives you the cookbook of what actually works in production.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Autogpt Agents464
- Parallel Agents463
- Serving Llms Vllm461
- Llamaindex460
- Code Review457
- Computer Use Agents455
- Powershell Windows454
- React Useeffect454
- Backend Patterns452
- Find Bugs447
- Langgraph447
- Agent Md Refactor446
- Autonomous Agent Patterns446
- D3 Viz445
- Manim444
- Marketing Psychology443
- Requirements Clarity442
- Frontend To Backend Requirements441
- Canvas Design439
- Nowait Reasoning Optimizer438
- Code Review Checklist437
- Prompt Caching437
- Commit435
- Vercel Deployment433
Recommended
cavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
improveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
karpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
find-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs