Kafka Stream Processing
This is a solid reference for working with Kafka in production. It covers the fundamentals you actually need: producers, consumers, Kafka Streams for stateful processing, and schema registry integration. The partition and task model explanations are clear, especially the bit about how your parallelism is bounded by partition count. It walks through the three delivery semantics (at-least-once, at-most-once, exactly-once) with practical tradeoffs instead of just theory. Good for building event-driven systems, real-time pipelines, or when you need guaranteed message delivery across distributed services. The production deployment patterns are here too, which is often where Kafka tutorials fall short.
- skills.sh installs
- 482
- GitHub stars
- 63
- last updated
- Aug 21, 2026
Install
$ npx -y skills add manutej/luxor-claude-marketplace --skill kafka-stream-processing --agent claude-codeInstalls into .claude/skills of the current project.
Files
Kafka Stream Processing
A comprehensive skill for building event-driven applications with Apache Kafka. Master producers, consumers, Kafka Streams, connectors, schema registry, and production deployment patterns for real-time data processing at scale.
When to Use This Skill
Use this skill when:
- Building event-driven microservices architectures
- Processing real-time data streams and event logs
- Implementing publish-subscribe messaging systems
- Creating data pipelines for analytics and ETL
- Building streaming data applications with stateful processing
- Integrating heterogeneous systems with Kafka Connect
- Implementing change data capture (CDC) patterns
- Building real-time dashboards and monitoring systems
- Processing IoT sensor data at scale
- Implementing event sourcing and CQRS patterns
- Building distributed systems requiring guaranteed message delivery
- Creating real-time recommendation engines
- Processing financial transactions with exactly-once semantics
- Building log aggregation and monitoring pipelines
Core Concepts
Apache Kafka Architecture
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/manutej/luxor-claude-marketplace
- Category
- Documentation
- First seen
- Jun 3, 2026
More from manutej/luxor-claude-marketplace
All 66- Apache Spark Data Processing481
- Pydantic476
- Kubernetes Orchestration474
- Nodejs Development474
- Nextjs Development473
- React Patterns473
- Pandas470
- React Development468
- Database Management Patterns467
- Angular Development463
- Tailwind Css463
- Javascript Fundamentals461
- Vector Database Management460
- Performance Benchmark Specialist457
- Pytest457
- Observability Monitoring456
- Terraform Infrastructure As Code454
- Fastapi Development452
- Langchain Orchestration452
- Aws Cloud Services451
- Express Microservices Architecture449
- Graphql Api Development449
- Microservices Patterns447
- Linear Dev Accelerator446
Recommended
More Documentation
supabase-postgres-best-practicesdavila7/claude-code-templatesPostgres performance optimization and best practices from Supabase. Use this skill when writing, reviewing, or optimizing Postgres queries, schema designs, or d481skills.sh installs
apache-spark-data-processingmanutej/luxor-claude-marketplaceComplete guide for Apache Spark data processing including RDDs, DataFrames, Spark SQL, streaming, MLlib, and production deployment481skills.sh installs
agent-package-managerwebmaxru/ai-native-devInstalls, configures, audits, and operates Agent Package Manager (APM) in repositories. Use when initializing apm.yml, installing or updating packages, validati481skills.sh installs
flash-fictionjwynia/agent-skillsDiagnose and fix problems in flash fiction and micro fiction. Use when flash fiction feels weak, when writing stories under 1500 words, when working with micro 479skills.sh installsrevisionjwynia/agent-skillsGuide the edit pass after drafting. Use when revision feels overwhelming, when changes cascade unpredictably, when you can't see problems anymore, or when editi479skills.sh installsagent-package-managerwebmaxru/enonic-agent-skillsInstalls, configures, audits, and operates Agent Package Manager (APM) in repositories. Use when initializing apm.yml, installing or updating packages, validati479skills.sh installs