
Model Merging
If you want to combine multiple fine-tuned models without spinning up GPUs or retraining from scratch, this gets you there. It's built around mergekit and lets you blend domain expertise from different models (say, a math specialist with a coding specialist) to create something new in minutes instead of days. The approach has real track record: Marcoro14-7B-slerp topped the Open LLM Leaderboard in early 2024 using these techniques. Expect 5-10% benchmark improvements in many cases, and you avoid the catastrophic forgetting problem that kills multi-task fine-tuning. Runs entirely on CPU, which means you can experiment with model variants without burning cloud credits on compute.
- skills.sh installs
- 356
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill model-merging --agent claude-codeInstalls into .claude/skills of the current project.
Files
If you want to combine multiple fine-tuned models without spinning up GPUs or retraining from scratch, this gets you there. It's built around mergekit and lets you blend domain expertise from different models (say, a math specialist with a coding specialist) to create something new in minutes instead of days. The approach has real track record: Marcoro14-7B-slerp topped the Open LLM Leaderboard in early 2024 using these techniques. Expect 5-10% benchmark improvements in many cases, and you avoid the catastrophic forgetting problem that kills multi-task fine-tuning. Runs entirely on CPU, which means you can experiment with model variants without burning cloud credits on compute.
Browse the repository on GitHubSponsors
Details
- Repository
- github.com/davila7/claude-code-templates
- Categories
- Git & Pull Requests, Debugging
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Artifacts Builder355
- Blip 2 Vision Language355
- Programmatic Seo355
- Biopython354
- Production Code Audit354
- Model Pruning353
- Fda Consultant Specialist352
- Voice Ai Development351
- Evaluating Code Models350
- Geo Database350
- Notion Spec To Implementation350
- Training Llms Megatron350
- Changelog Generator349
- Performance Profiling349
- Server Management349
- Tensorrt Llm349
- Deslop348
- Algorithmic Art347
- Email Systems347
- Faiss347
- Voice Agents347
- Git Pushing346
- Brand Guidelines344
- Paid Ads344