
Hyperpod Cluster Debugger
If you're running SageMaker HyperPod clusters on EKS or Slurm and hit creation failures, node replacement issues, or the dreaded "EFA health checks did not run successfully" error, this walks you through the entire diagnostic tree. It maps CloudFormation nested stack failures, capacity problems, lifecycle script timeouts, kubectl auth gaps, and autoscaler conflicts to specific remediation steps. The diagnostic script is read-only and surfaces findings with priority tags and direct pointers to runbook sections. The workflow is sensible: it asks whether your infrastructure is IaC-managed before suggesting any state-changing commands, which saves you from drifting your Terraform stack. Includes a pre-flight validation mode that catches subnet and security group misconfigurations before you create the cluster.
- GitHub stars
- 783
- last updated
- Jun 11, 2026
Install
$ npx -y skills add awslabs/agent-plugins --skill hyperpod-cluster-debugger --agent claude-codeInstalls into .claude/skills of the current project.
Files
HyperPod Cluster Debugger
Operating policy. Run read-only diagnostics yourself. Never run a command that changes cluster, node, or workload state — present each one as a Suggested command (run this yourself) block and wait for the customer to run it. Destructive order: investigate → reboot → replace (replace destroys root + secondary volumes; not supported on Slurm controller nodes).
Before any state-changing CLI: ask if it's IaC-managed. HyperPod clusters, SGs, EKS access entries, and IAM are usually provisioned via CloudFormation / CDK / Terraform. If yes, the fix belongs in IaC — running the CLI will drift and the next deploy reverts it. Use the CLI only when IaC is unavailable (locked out, predates IaC, mid-review).
scripts/diagnose-cluster.sh is read-only: it collects state via AWS APIs (and SSM for Slurm controller health) and prints each issue as [FAIL] ... → references/<file>.md § <section>.
Sponsors
Details
- Repository
- github.com/awslabs/agent-plugins
- Categories
- DevOps & CI/CD, AI & Agent Building, Debugging, Cloud & Infrastructure
- License
- Apache-2.0
- First seen
- Jun 11, 2026
More from awslabs/agent-plugins
All 32- Hyperpod Nccl
- Hyperpod Node Debugger
- Hyperpod Performance Debugger
- Hyperpod Slurm Debugger
- Model Selection
- Sdk Getting Started
- Aws Architecture Diagram358
- Aws Lambda260
- Deploy240
- Directory Management183
- Use Case Specification183
- Planning168
- Dataset Evaluation156
- Aws Serverless Deployment154
- Finetuning154
- Model Deployment154
- Dataset Transformation153
- Hyperpod Ssm150
- Hyperpod Version Checker149
- Hyperpod Issue Report147
- Model Evaluation140
- Amplify Workflow101
- Amazon Location Service
- Api Gateway