davila7 avatar

Training Llms Megatron

If you're training large language models at scale, this gives you access to NVIDIA's Megatron-Core framework right from Claude. It handles everything from 2B to 462B parameter models and claims up to 47% MFU on H100s, which is legitimately impressive if you're burning that kind of compute. The setup is straightforward with Docker or pip, and it includes distributed training examples to get you started with multi-GPU setups. Honestly, this is overkill unless you're actually training foundation models, but if you are, having the boilerplate and parallelism strategies templated out saves you from reinventing NVIDIA's wheel. The skill wraps their official tooling, so you're getting battle-tested infrastructure rather than someone's weekend project.

skills.sh installs
350
GitHub stars
33.2K
last updated
Aug 21, 2026

Install

$ npx -y skills add davila7/claude-code-templates --skill training-llms-megatron --agent claude-code

Installs into .claude/skills of the current project.

Files

If you're training large language models at scale, this gives you access to NVIDIA's Megatron-Core framework right from Claude. It handles everything from 2B to 462B parameter models and claims up to 47% MFU on H100s, which is legitimately impressive if you're burning that kind of compute. The setup is straightforward with Docker or pip, and it includes distributed training examples to get you started with multi-GPU setups. Honestly, this is overkill unless you're actually training foundation models, but if you are, having the boilerplate and parallelism strategies templated out saves you from reinventing NVIDIA's wheel. The skill wraps their official tooling, so you're getting battle-tested infrastructure rather than someone's weekend project.

Browse the repository on GitHub

Sponsors

Details

Repository
github.com/davila7/claude-code-templates
Categories
DevOps & CI/CD, Automation & Workflows, Sales & Marketing
First seen
Jun 3, 2026

More from davila7/claude-code-templates

All 618
1jamditis avatarsocial-media-intelligencejamditis/claude-skills-journalismSocial media monitoring, narrative tracking, and open-source intelligence for journalists. Use when tracking viral content spread, analyzing coordinated campaig348skills.sh installs
2bobmatnyc avatarphoenix-opsbobmatnyc/claude-mpm-skillsPhoenix operations and deployment: releases, runtime configuration, clustering, libcluster, telemetry/logging, secrets, assets, background jobs, and production 341skills.sh installs
3dhruvanbhalara avatarflutter-debuggingdhruvanbhalara/skillsDebug and profile Flutter applications using DevTools, structured logging, and memory analysis. Use when diagnosing layout issues, tracking performance bottlene338skills.sh installs
4manojbajaj95 avatarlead-generation-and-demandmanojbajaj95/claude-gtm-pluginComprehensive B2B demand generation and lead acquisition skill. Use when building lead generation systems, creating demand acquisition campaigns, optimizing CAC336skills.sh installs
5davila7 avatardatadog-clidavila7/claude-code-templatesDatadog CLI for searching logs, querying metrics, tracing requests, and managing dashboards. Use this when debugging production issues or working with Datadog o334skills.sh installs
6ncklrs avatarsales-leaderncklrs/startup-os-skillsStrategic sales leadership guidance for B2B SaaS and enterprise software companies. Covers sales strategy, team building, pipeline management, enterprise sellin333skills.sh installs