
Dataset Transformation
When you're prepping datasets for ML training or evaluation and need to convert between formats like OpenAI chat, SageMaker SFT/DPO, HuggingFace preference, or Bedrock Nova, this generates the transformation code for you instead of making you write it inline. It walks through an 11-step workflow that determines whether you're doing training or eval data (this matters because the schema resolution is different), figures out your source and target formats, examines samples, then generates and refines a Python transformation function before running it. Works with local files or S3. The workflow is thorough but rigid: you go step by step, confirm at each stage, and it won't let you skip around.
- skills.sh installs
- 153
- GitHub stars
- 938
- last updated
- Jun 11, 2026
Install
$ npx -y skills add awslabs/agent-plugins --skill dataset-transformation --agent claude-codeInstalls into .claude/skills of the current project.
Files
Dataset Transformation Agent
Transforms a data set provided by the user into their desired format.
When to Use
- User needs to generate code for transforming datasets for SageMaker model training or model evaluation.
- A dataset requires processing, cleaning, or formatting before training or evaluation.
- Workflow requires a formal review and approval cycle before execution.
Prerequisites
- The SDK environment has been verified (SDK version, region, execution role). If not done, activate the
sdk-getting-startedskill first.
Principles
Sponsors
Details
- Repository
- github.com/awslabs/agent-plugins
- Categories
- Documentation, Code Review & Quality, AI & Agent Building, Data Science & ML, Cloud & Infrastructure
- License
- Apache-2.0
- First seen
- Jun 11, 2026
More from awslabs/agent-plugins
All 32- Hyperpod Ssm150
- Hyperpod Version Checker149
- Hyperpod Issue Report147
- Model Evaluation140
- Amplify Workflow101
- Amazon Location Service
- Api Gateway
- Aws Lambda Durable Functions
- Aws Lambda Managed Instances
- Aws Transform
- Document Service
- Dsql
- Elastic Beanstalk
- Finetuning Technique
- Hyperpod Cluster Debugger
- Hyperpod Nccl
- Hyperpod Node Debugger
- Hyperpod Performance Debugger
- Hyperpod Slurm Debugger
- Model Selection
- Sdk Getting Started
- Aws Architecture Diagram358
- Aws Lambda260
- Deploy240