affaan-m avatar

Recsys Pipeline Architect

If you're building any system that picks "top K items for a user," this skill walks you through designing it as a composable six-stage pipeline: Source, Hydrator, Filter, Scorer, Selector, SideEffect. The pattern comes from xAI's open-sourced For You algorithm, and this is a clean independent reimplementation. It works for feeds, RAG rerankers, notification triage, search reranking, anything with a ranking problem. The skill doesn't just give you theory. It generates runnable scaffolds in TypeScript, Go, or Python, forces you to think through trade-offs like multi-action prediction versus single score, and includes reference implementations that actually pass their test suites. Good for when you need the plumbing around your scoring function, not the scoring function itself.

skills.sh installs
1.3K
GitHub stars
229.1K
last updated
Jul 14, 2026

Install

$ npx -y skills add affaan-m/everything-claude-code --skill recsys-pipeline-architect --agent claude-code

Installs into .claude/skills of the current project.

Files

recsys-pipeline-architect

A spec-and-scaffold skill for building composable recommendation, ranking, and feed pipelines. It encodes the six-stage pattern — Source → Hydrator → Filter → Scorer → Selector → SideEffect — popularized by xAI's open-sourced For You algorithm (Apache 2.0). This skill is an independent reimplementation of the pattern (MIT) — no code copied from the original.

Upstream: https://github.com/mturac/recsys-pipeline-architect

When to Use

  • User wants to build any system that picks "the top K items for a user/context"
  • User asks "how should I rank X" or describes a feed/personalization problem
  • User has a scoring function and needs the pipeline plumbing around it
  • User wants to migrate from a single relevance score to multi-action prediction with tunable weights
  • User is wrapping an LLM/ML scorer and needs filters, hydrators, side-effects, and a runnable scaffold in their stack (TypeScript / Go / Python)
  • Triggers: "recommendation system", "feed algorithm", "ranking pipeline", "for you feed", "candidate pipeline", "content recommender", "pipeline architecture for recsys", "RAG retrieval reranker"

Sponsors

Details

Repository
github.com/affaan-m/everything-claude-code
Categories
DevOps & CI/CD, Code Review & Quality, Automation & Workflows, Sales & Marketing
First seen
Jun 3, 2026

More from affaan-m/everything-claude-code

All 256
1anthropics avatarmacro-rates-monitoranthropics/financial-services-pluginsmacro rates monitor1.3Kskills.sh installs
2aradotso avatarharvard-art-museums-etl-pipelinearadotso/data-skillsharvard art museums etl pipeline1.3Kskills.sh installs
3aradotso avatarharvard-artifacts-data-pipelinearadotso/data-skillsharvard artifacts data pipeline1.3Kskills.sh installs
4aradotso avatariac-terraform-data-engineeringaradotso/data-skillsiac terraform data engineering1.3Kskills.sh installs
5aradotso avatarretail-etl-pipeline-medallionaradotso/data-skillsretail etl pipeline medallion1.3Kskills.sh installs
6aradotso avatarterraform-data-engineering-iacaradotso/data-skillsterraform data engineering iac1.3Kskills.sh installs