Tensorrt Llm
This is NVIDIA's optimization library for squeezing maximum performance out of LLMs on their GPUs. If you're deploying on A100s or H100s and need serious throughput (the docs claim 24,000+ tokens per second on Llama 3), this is the toolkit. It handles quantization down to FP4 and scales across multiple GPUs, but you're trading setup simplicity for raw speed. The skill points out that vLLM might be better if you want something more straightforward or aren't locked into NVIDIA hardware. With 27.7K GitHub stars and 353 installs, it's clearly production-grade stuff, though you'll need to be comfortable with TensorRT compilation and GPU-specific optimization work.
- skills.sh installs
- 349
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill tensorrt-llm --agent claude-codeInstalls into .claude/skills of the current project.
Files
This is NVIDIA's optimization library for squeezing maximum performance out of LLMs on their GPUs. If you're deploying on A100s or H100s and need serious throughput (the docs claim 24,000+ tokens per second on Llama 3), this is the toolkit. It handles quantization down to FP4 and scales across multiple GPUs, but you're trading setup simplicity for raw speed. The skill points out that vLLM might be better if you want something more straightforward or aren't locked into NVIDIA hardware. With 27.7K GitHub stars and 353 installs, it's clearly production-grade stuff, though you'll need to be comfortable with TensorRT compilation and GPU-specific optimization work.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- Categories
- AI & Agent Building, Data Science & ML
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Deslop348
- Algorithmic Art347
- Email Systems347
- Faiss347
- Voice Agents347
- Git Pushing346
- Brand Guidelines344
- Paid Ads344
- Guidance343
- Executing Plans342
- Launch Strategy342
- Marp Slide342
- Writing Clearly And Concisely342
- Browser Extension Builder341
- Huggingface Tokenizers340
- Llama Factory339
- Stable Baselines3338
- Bullmq Specialist337
- Crewai337
- Quantizing Models Bitsandbytes337
- Nemo Curator336
- Discord Bot Architect335
- Railway Deploy335
- Aws Serverless334
Recommended
More AI & Agent Building
crypto-agent-tradingcrypto-com/crypto-agent-tradingExecute crypto trades (buy, sell, swap, exchange) and query account balances, market prices, and transaction history via the Crypto.com API. View weekly trading337skills.sh installs
alicloud-ai-image-qwen-image-editcinience/alicloud-skillsEdit images with Alibaba Cloud Model Studio Qwen Image Edit models (qwen-image-edit, qwen-image-edit-plus, qwen-image-edit-max, qwen-image-2.0 series and snapsh335skills.sh installs
typescript-mcpjezweb/claude-skillsBuild MCP servers with TypeScript on Cloudflare Workers. Covers tools, resources, prompts, tasks, authentication (API keys, OAuth, Zero Trust), and Cloudflare s335skills.sh installs
ai-writing-detoxjamditis/claude-skills-journalismEliminate AI-generated writing patterns that erode reader trust. Activate when writing articles, documentation, press releases, or any content where AI patterns333skills.sh installs