Claude MarketplacesSubmit
aj-geddes avatar

Background Job Processing

aj-geddes/useful-ai-prompts

If you're dealing with long-running operations that would otherwise block your web requests, this gives you the full async job processing setup with Celery, Bull, or Sidekiq. It covers the essentials: task queues, worker configuration, retry policies with exponential backoff, and monitoring hooks. The guides walk through real implementations for sending emails, generating reports, or churning through large datasets without timing out. One thing I appreciate here is the emphasis on idempotency and dead-letter queues, which saves you from the usual production headaches when jobs inevitably fail. The Python/Celery example is particularly thorough with queue configuration and timeout handling.

skills.sh installs
488
GitHub stars
379
last updated
Aug 21, 2026
View on GitHub

Install

$ npx -y skills add aj-geddes/useful-ai-prompts --skill background-job-processing --agent claude-code

Installs into .claude/skills of the current project.

Files

Background Job Processing

Table of Contents

Overview

Build robust background job processing systems with distributed task queues, worker pools, job scheduling, error handling, retry policies, and monitoring for efficient asynchronous task execution.

When to Use

  • Handling long-running operations asynchronously
  • Sending emails in background
  • Generating reports or exports
  • Processing large datasets
  • Scheduling recurring tasks
  • Distributing compute-intensive operations

Quick Start

Minimal working example:

# celery_app.py
from celery import Celery
from kombu import Exchange, Queue
import os

app = Celery('myapp')
SKILL.md on GitHub

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Repository
github.com/aj-geddes/useful-ai-prompts
Category
AI & Agent Building
First seen
Jun 3, 2026

More from aj-geddes/useful-ai-prompts

All 258

Recommended

More AI & Agent Building
1brianrwagner avatarlast30daysbrianrwagner/ai-marketing-claude-code-skillsResearch any topic across Reddit, X, and web from the last 30 days. Get current trends, real community sentiment, and actionable insights in 7 minutes vs 2 hour488skills.sh installs
2brianrwagner avatarlinkedin-authority-builderbrianrwagner/ai-marketing-claude-code-skillsBuild a LinkedIn content system for thought leadership. Use when someone needs to establish authority, attract inbound leads, or build a consistent content pres488skills.sh installs
3pskoett avatarplan-interviewpskoett/pskoett-ai-skillsEnsures alignment between user and Claude during feature/spec planning through a structured interview process. Use this skill when the user invokes /plan-interv488skills.sh installs
4thedivergentai avatargodot-shaders-basicsthedivergentai/gd-agentic-skillsExpert Godot shader patterns for batch-safe hitflash, alpha-scissor foliage/dissolve, screenspace postFX, depth reconstruction, triplanar, and instance uniforms488skills.sh installs
5tondevrel avatarxgboost-lightgbmtondevrel/scientific-agent-skillsIndustry-standard gradient boosting libraries for tabular data and structured datasets. XGBoost and LightGBM excel at classification and regression tasks on tab488skills.sh installs
6webmaxru avatarenonic-nextxp-integrationwebmaxru/enonic-agent-skillsGuides setup, development, and troubleshooting of the Next.js and Enonic XP headless integration (Next.XP framework). Covers Enonic adapter configuration, conte488skills.sh installs