wshobson avatar

Recsys Pipeline Architect

If you've ever built a feed, search ranker, or notification system, you've reinvented this pipeline shape: fetch candidates, hydrate metadata, filter the ineligible, score what's left, pick top K, log impressions async. This skill scaffolds that six-stage pattern (popularized by xAI's open-sourced X algorithm) into working code for your stack. The real value is in the trade-offs it surfaces: single score versus multi-action prediction, online versus batch, filter ordering. It won't write your ML model, but it will wrap it in proper plumbing so you're not debugging why cache writes are blocking user responses at 3am.

skills.sh installs
4.6K
GitHub stars
42.4K
last updated
Aug 21, 2026

Install

$ npx -y skills add wshobson/agents --skill recsys-pipeline-architect --agent claude-code

Installs into .claude/skills of the current project.

Files

Recsys Pipeline Architect

A spec-and-scaffold skill for building composable recommendation, ranking, and feed pipelines. Encodes the six-stage pattern popularized by xAI's open-sourced For You algorithm (Apache 2.0) and applies it to any "top K for (user, context)" problem.

Overview

Most "recommendation systems" in production aren't exotic ML — they're pipelines: fetch candidates from one or more sources, enrich them with metadata, drop the ineligible, score the rest, sort and pick the top K, then fire async side effects. The pattern is universal. The scoring function and the items change; the pipeline shape doesn't.

This skill is an independent reimplementation of the pattern (MIT) — no code copied from the original.

When to Use This Skill

Sponsors

Details

Repository
github.com/wshobson/agents
Categories
DevOps & CI/CD, Code Review & Quality, AI & Agent Building, Automation & Workflows, Marketing & SEO, Sales & Marketing, Design & UI/UX
First seen
Jul 14, 2026

More from wshobson/agents

All 174
1dotnet avatardirectory-build-organizationdotnet/skillsGuide for organizing MSBuild infrastructure with Directory.Build.props, Directory.Build.targets, Directory.Packages.props, and Directory.Build.rsp. USE FOR: str4.5Kskills.sh installs
2clickhouse avatarclickhousectl-cloud-deployclickhouse/agent-skillsUse when a user wants to deploy ClickHouse to the cloud, go to production, use ClickHouse Cloud, host a managed ClickHouse service, or migrate from a local Clic4.3Kskills.sh installs
3dotnet avatarbuild-perf-diagnosticsdotnet/skillsDiagnose MSBuild build performance bottlenecks using binary log analysis. USE FOR: identifying why builds are slow by analyzing binlog performance summaries, de4.2Kskills.sh installs
4dotnet avatarbuild-perf-baselinedotnet/skillsEstablish build performance baselines and apply systematic optimization techniques. USE FOR: diagnosing slow builds, establishing before/after measurements (col4.2Kskills.sh installs
5assistant-ui avatarobservabilityassistant-ui/skillsAdds tracing, telemetry, and observability to an assistant-ui backend. Use when wiring an AI SDK route handler (streamText/generateText, toUIMessageStream, crea4.2Kskills.sh installs
6dotnet avatarbuild-parallelismdotnet/skillsDiagnose and fix under-parallelized MSBuild builds. USE WHEN a multi-project solution build is slower than expected, doesn't speed up when you add cores, pegs a4.2Kskills.sh installs