awslabs avatar

Dataset Transformation

When you're prepping datasets for ML training or evaluation and need to convert between formats like OpenAI chat, SageMaker SFT/DPO, HuggingFace preference, or Bedrock Nova, this generates the transformation code for you instead of making you write it inline. It walks through an 11-step workflow that determines whether you're doing training or eval data (this matters because the schema resolution is different), figures out your source and target formats, examines samples, then generates and refines a Python transformation function before running it. Works with local files or S3. The workflow is thorough but rigid: you go step by step, confirm at each stage, and it won't let you skip around.

skills.sh installs
153
GitHub stars
938
last updated
Jun 11, 2026

Install

$ npx -y skills add awslabs/agent-plugins --skill dataset-transformation --agent claude-code

Installs into .claude/skills of the current project.

Files

Dataset Transformation Agent

Transforms a data set provided by the user into their desired format.

When to Use

  • User needs to generate code for transforming datasets for SageMaker model training or model evaluation.
  • A dataset requires processing, cleaning, or formatting before training or evaluation.
  • Workflow requires a formal review and approval cycle before execution.

Prerequisites

  • The SDK environment has been verified (SDK version, region, execution role). If not done, activate the sdk-getting-started skill first.

Principles

Sponsors

Details

Repository
github.com/awslabs/agent-plugins
Categories
Documentation, Code Review & Quality, AI & Agent Building, Data Science & ML, Cloud & Infrastructure
License
Apache-2.0
First seen
Jun 11, 2026

More from awslabs/agent-plugins

All 32
1aviz85 avatarwordpress-publisheraviz85/claude-skills-libraryPublish posts to WordPress. Use for: publish blog post, upload to WordPress, פרסם בבלוג.152skills.sh installs
2oguzhan18 avatarshadcn-ngoguzhan18/angular-ecosystem-skillsALWAYS use when writing code importing shadcn-ng (shadcn/angular). Consult for debugging, best practices, or modifying Angular shadcn components.152skills.sh installs
3bobmatnyc avatarespocrm-developmentbobmatnyc/claude-mpm-skillsComprehensive guide for developing on EspoCRM - metadata-driven CRM with service layer architecture151skills.sh installs
4NVIDIA avatardoca-setupNVIDIA/skillsUse this skill when the user is dealing with the DOCA environment around their workload — verifying an install is healthy, preparing the build env (pkg-config, 149skills.sh installs
5borghei avataraws-solution-architectborghei/claude-skillsDesign AWS serverless architectures for startups with IaC. Use when designing serverless architecture, writing CloudFormation, optimizing AWS costs, setting up 148skills.sh installs
6itsmostafa avatardynamodbitsmostafa/aws-agent-skillsAWS DynamoDB NoSQL database for scalable data storage. Use when designing table schemas, writing queries, configuring indexes, managing capacity, implementing s147skills.sh installs