
Recsys Pipeline Architect
If you've ever built a feed, search ranker, or notification system, you've reinvented this pipeline shape: fetch candidates, hydrate metadata, filter the ineligible, score what's left, pick top K, log impressions async. This skill scaffolds that six-stage pattern (popularized by xAI's open-sourced X algorithm) into working code for your stack. The real value is in the trade-offs it surfaces: single score versus multi-action prediction, online versus batch, filter ordering. It won't write your ML model, but it will wrap it in proper plumbing so you're not debugging why cache writes are blocking user responses at 3am.
- skills.sh installs
- 4.6K
- GitHub stars
- 42.4K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add wshobson/agents --skill recsys-pipeline-architect --agent claude-codeInstalls into .claude/skills of the current project.
Files
Recsys Pipeline Architect
A spec-and-scaffold skill for building composable recommendation, ranking, and feed pipelines. Encodes the six-stage pattern popularized by xAI's open-sourced For You algorithm (Apache 2.0) and applies it to any "top K for (user, context)" problem.
Overview
Most "recommendation systems" in production aren't exotic ML — they're pipelines: fetch candidates from one or more sources, enrich them with metadata, drop the ineligible, score the rest, sort and pick the top K, then fire async side effects. The pattern is universal. The scoring function and the items change; the pipeline shape doesn't.
This skill is an independent reimplementation of the pattern (MIT) — no code copied from the original.
When to Use This Skill
Sponsors
Details
- Repository
- github.com/wshobson/agents
- Categories
- DevOps & CI/CD, Code Review & Quality, AI & Agent Building, Automation & Workflows, Marketing & SEO, Sales & Marketing, Design & UI/UX
- First seen
- Jul 14, 2026
More from wshobson/agents
All 174- Social Publishing4K
- Before You Build3.5K
- File Conversion3.4K
- Ai Debt Detector3.4K
- Session Guard3.2K
- Dataset Curation3K
- Eval Harness First3K
- Lora Qlora Recipes3K
- Finetuning Method Selection3K
- Preference Optimization2.9K
- Quantized Export2.9K
- Pptx Reference Deck Analysis2.9K
- Grpo Rlvr Training2.9K
- Checkpoint Promotion2.9K
- Trace To Training Data2.9K
- Vision Sft2.9K
- Spark Memory Thermal Ops2.9K
- Spark Training Gotchas2.9K
- Spark Environment Setup2.9K
- Typescript Advanced Types98.8K
- Tailwind Design System72.7K
- Nodejs Backend Patterns49.8K
- Python Testing Patterns40K
- Brand Landingpage39.9K