If you're building agents or chat systems with LLMs, this wrapper gives you structured outputs and automatic prefix caching through SGLang's RadixAttention. The real win is when you have repeated prefixes like system prompts or tool definitions. It'll cache them automatically and reportedly decode JSON about 3× faster than standard approaches. It's overkill if you just need basic text generation, but for agentic workflows with function calling or multi-turn conversations where context gets reused, the performance gains are tangible. The skill has passed security audits from Gen Agent Trust Hub, Socket, and Snyk.

skills.sh installs
320
GitHub stars
33.2K
last updated
Aug 21, 2026

Install

$ npx -y skills add davila7/claude-code-templates --skill sglang --agent claude-code

Installs into .claude/skills of the current project.

Files

If you're building agents or chat systems with LLMs, this wrapper gives you structured outputs and automatic prefix caching through SGLang's RadixAttention. The real win is when you have repeated prefixes like system prompts or tool definitions. It'll cache them automatically and reportedly decode JSON about 3× faster than standard approaches. It's overkill if you just need basic text generation, but for agentic workflows with function calling or multi-turn conversations where context gets reused, the performance gains are tangible. The skill has passed security audits from Gen Agent Trust Hub, Socket, and Snyk.

Browse the repository on GitHub

Sponsors

Details

Repository
github.com/davila7/claude-code-templates
Category
AI & Agent Building
First seen
Jun 3, 2026

More from davila7/claude-code-templates

All 618
1patricio0312rev avatarstructured-output-extractorpatricio0312rev/skillsExtracts structured data from LLM responses using JSON schemas, Zod validation, and function calling for reliable parsing. Use when users request "structured ou320skills.sh installs
2davila7 avatarphoenix-observabilitydavila7/claude-code-templatesOpen-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations309skills.sh installs
3onewave-ai avatarscoutonewave-ai/claude-skillsAnalyzes current conversation context to recommend the best skills and subagents for the task at hand. Use proactively when unsure which tool, skill, or agent t309skills.sh installs
4davila7 avatarclaude-opus-4-5-migrationdavila7/claude-code-templatesMigrate prompts and code from Claude Sonnet 4.0, Sonnet 4.5, or Opus 4.1 to Opus 4.5. Use when the user wants to update their codebase, prompts, or API calls to308skills.sh installs
5bytedance avatarbyted-seedream-image-generatebytedance/agentkit-samplesGenerate high-quality images from text prompts using Volcano Engine Seedream models. Supports multiple artistic styles and aspect ratios. Use this skill when us303skills.sh installs
6patricio0312rev avatarguardrails-safety-filter-builderpatricio0312rev/skillsImplements content safety filters with PII redaction, policy constraints, prompt injection detection, and safe refusal templates. Use when adding "content moder295skills.sh installs