awslabs avatar

Hyperpod Cluster Debugger

If you're running SageMaker HyperPod clusters on EKS or Slurm and hit creation failures, node replacement issues, or the dreaded "EFA health checks did not run successfully" error, this walks you through the entire diagnostic tree. It maps CloudFormation nested stack failures, capacity problems, lifecycle script timeouts, kubectl auth gaps, and autoscaler conflicts to specific remediation steps. The diagnostic script is read-only and surfaces findings with priority tags and direct pointers to runbook sections. The workflow is sensible: it asks whether your infrastructure is IaC-managed before suggesting any state-changing commands, which saves you from drifting your Terraform stack. Includes a pre-flight validation mode that catches subnet and security group misconfigurations before you create the cluster.

GitHub stars
783
last updated
Jun 11, 2026

Install

$ npx -y skills add awslabs/agent-plugins --skill hyperpod-cluster-debugger --agent claude-code

Installs into .claude/skills of the current project.

Files

HyperPod Cluster Debugger

Operating policy. Run read-only diagnostics yourself. Never run a command that changes cluster, node, or workload state — present each one as a Suggested command (run this yourself) block and wait for the customer to run it. Destructive order: investigate → reboot → replace (replace destroys root + secondary volumes; not supported on Slurm controller nodes).

Before any state-changing CLI: ask if it's IaC-managed. HyperPod clusters, SGs, EKS access entries, and IAM are usually provisioned via CloudFormation / CDK / Terraform. If yes, the fix belongs in IaC — running the CLI will drift and the next deploy reverts it. Use the CLI only when IaC is unavailable (locked out, predates IaC, mid-review).

scripts/diagnose-cluster.sh is read-only: it collects state via AWS APIs (and SSM for Slurm controller health) and prints each issue as [FAIL] ... → references/<file>.md § <section>.

Sponsors

Details

Repository
github.com/awslabs/agent-plugins
Categories
DevOps & CI/CD, AI & Agent Building, Debugging, Cloud & Infrastructure
License
Apache-2.0
First seen
Jun 11, 2026

More from awslabs/agent-plugins

All 32
1bankrbot avatarBankr Dev - Project Templatesbankrbot/claude-pluginsThis skill should be used when the user asks to "scaffold a Bankr project", "create new Bankr bot", "build a Bankr web service", "create Bankr dashboard", "buil0skills.sh installs
2bankrbot avatarBankr x402 SDK - Project Templatesbankrbot/claude-pluginsThis skill should be used when the user asks to "scaffold a Bankr SDK project", "create new SDK bot", "build a Bankr web service", "create Bankr dashboard", "bu0skills.sh installs
3breaking-brake avatarpr-to-mainbreaking-brake/cc-wf-studioCreate a PR to the main branch for feature/fix changes in this pnpm + Changesets monorepo. Use when the user says "PRを作成", "mainにPR", or wants to submit changes0skills.sh installs
4butterbase-ai avatarjourneybutterbase-ai/butterbase-skillsThis is the top-level orchestrator that walks you from "I want to build X" all the way to a deployed Butterbase app, and if you're in a...0skills.sh installs
5butterbase-ai avatarjourney-agentsbutterbase-ai/butterbase-skillsUse as the agents build stage of the Butterbase journey. Implements the Agents section of 02-plan.md by delegating to the `agents` skill for each agent. Registe0skills.sh installs
6butterbase-ai avatarjourney-rlsbutterbase-ai/butterbase-skillsUse as the RLS build stage of the Butterbase journey, after journey-schema. Implements the RLS section of 02-plan.md by delegating to debug-rls policy patterns 0skills.sh installs