orchestra-research avatar

orchestra-research/ai-research-skills

skills.sh installs
99.5K
skills
95

Install

$ npx -y skills add orchestra-research/ai-research-skills --agent claude-code

Installs into .claude/skills of the current project.

Skills

1orchestra-research avatarml-paper-writingorchestra-research/ai-research-skillsWrite publication-ready ML/AI papers for NeurIPS, ICML, ICLR, ACL, AAAI, COLM. Use when drafting papers from research repos, structuring arguments, verifying ci2.5Kskills.sh installs
2orchestra-research avatarbrainstorming-research-ideasorchestra-research/ai-research-skillsGuides researchers through structured ideation frameworks to discover high-impact research directions. Use when exploring new problem spaces, pivoting between p1.3Kskills.sh installs
3orchestra-research avataracademic-plottingorchestra-research/ai-research-skillsGenerates publication-quality figures for ML papers from research context. Given a paper section or description, extracts system components and relationships to1.3Kskills.sh installs
4orchestra-research avatarcreative-thinking-for-researchorchestra-research/ai-research-skillsApplies cognitive science frameworks for creative thinking to CS and AI research ideation. Use when seeking genuinely novel research directions by leveraging co1.3Kskills.sh installs
5orchestra-research avatarmlfloworchestra-research/ai-research-skillsTrack ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycl1.1Kskills.sh installs
6orchestra-research avatarserving-llms-vllmorchestra-research/ai-research-skillsServes LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throu1.1Kskills.sh installs
7orchestra-research avatarfaissorchestra-research/ai-research-skillsFacebook's library for efficient similarity search and clustering of dense vectors. Supports billions of vectors, GPU acceleration, and various index types (Fla1.1Kskills.sh installs
8orchestra-research avatarstable-diffusion-image-generationorchestra-research/ai-research-skillsState-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers. Use when generating images from text prompts, performing image1.1Kskills.sh installs
9orchestra-research avatartensorrt-llmorchestra-research/ai-research-skillsOptimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 1.1Kskills.sh installs
10orchestra-research avatarautoresearchorchestra-research/ai-research-skillsOrchestrates end-to-end autonomous AI research projects using a two-loop architecture. The inner loop runs rapid experiment iterations with clear optimization t1.1Kskills.sh installs
11orchestra-research avatarpeft-fine-tuningorchestra-research/ai-research-skillsParameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need t1.1Kskills.sh installs
12orchestra-research avataraudiocraft-audio-generationorchestra-research/ai-research-skillsPyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen). Use when you need to generate music from text descriptions1.1Kskills.sh installs
13orchestra-research avatargguf-quantizationorchestra-research/ai-research-skillsGGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible 1.1Kskills.sh installs
14orchestra-research avatarray-trainorchestra-research/ai-research-skillsDistributed training orchestration across clusters. Scales PyTorch/TensorFlow/HuggingFace from laptop to 1000s of nodes. Built-in hyperparameter tuning with Ray1.1Kskills.sh installs
15orchestra-research avatarweights-and-biasesorchestra-research/ai-research-skillsTrack ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B - collabo1.1Kskills.sh installs
16orchestra-research avatarsegment-anything-modelorchestra-research/ai-research-skillsFoundation model for image segmentation with zero-shot transfer. Use when you need to segment any object in images using points, boxes, or masks as prompts, or 1.1Kskills.sh installs
17orchestra-research avatarunslothorchestra-research/ai-research-skillsExpert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimization1Kskills.sh installs
18orchestra-research avatarcrewai-multi-agentorchestra-research/ai-research-skillsMulti-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agents working together on complex tasks, when you n1Kskills.sh installs
19orchestra-research avatarevaluating-llms-harnessorchestra-research/ai-research-skillsEvaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting 1Kskills.sh installs
20orchestra-research avatarhuggingface-accelerateorchestra-research/ai-research-skillsSimplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device place1Kskills.sh installs
21orchestra-research avatarwhisperorchestra-research/ai-research-skillsOpenAI's general-purpose speech recognition model. Supports 99 languages, transcription, translation to English, and language identification. Six model sizes fr1Kskills.sh installs
22orchestra-research avatarprompt-guardorchestra-research/ai-research-skillsMeta's 86M prompt injection and jailbreak detector. Filters malicious prompts and third-party data for LLM apps. 99%+ TPR, <1% FPR. Fast (<2ms GPU). Multilingua1Kskills.sh installs
23orchestra-research avatarknowledge-distillationorchestra-research/ai-research-skillsCompress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transfe1Kskills.sh installs
24orchestra-research avatarray-dataorchestra-research/ai-research-skillsScalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow.1Kskills.sh installs
25orchestra-research avatarfine-tuning-with-trlorchestra-research/ai-research-skillsFine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward mo1Kskills.sh installs
26orchestra-research avatarllama-cpporchestra-research/ai-research-skillsRuns LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is una1Kskills.sh installs
27orchestra-research avatartensorboardorchestra-research/ai-research-skillsVisualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML vi1Kskills.sh installs
28orchestra-research avatardeepspeedorchestra-research/ai-research-skillsExpert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention1Kskills.sh installs
29orchestra-research avatarqdrant-vector-searchorchestra-research/ai-research-skillsHigh-performance vector similarity search engine for RAG and semantic search. Use when building production RAG systems requiring fast nearest neighbor search, h1Kskills.sh installs
30orchestra-research avatargrpo-rl-trainingorchestra-research/ai-research-skillsExpert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training1Kskills.sh installs
31orchestra-research avataroptimizing-attention-flashorchestra-research/ai-research-skillsOptimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>1Kskills.sh installs
32orchestra-research avatarquantizing-models-bitsandbytesorchestra-research/ai-research-skillsQuantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want fast1Kskills.sh installs
33orchestra-research avatarverl-rl-trainingorchestra-research/ai-research-skillsProvides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL algorithms fo1Kskills.sh installs
34orchestra-research avatardspyorchestra-research/ai-research-skillsBuild complex AI systems with declarative programming, optimize prompts automatically, create modular RAG systems and agents with DSPy - Stanford NLP's framewor1Kskills.sh installs
35orchestra-research avatarlangchainorchestra-research/ai-research-skillsFramework for building LLM-powered applications with agents, chains, and RAG. Supports multiple providers (OpenAI, Anthropic, Google), 500+ integrations, ReAct 1Kskills.sh installs
36orchestra-research avatarpytorch-lightningorchestra-research/ai-research-skillsHigh-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from lap1Kskills.sh installs
37orchestra-research avataraxolotlorchestra-research/ai-research-skillsExpert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal support1Kskills.sh installs
38orchestra-research avatarhqq-quantizationorchestra-research/ai-research-skillsHalf-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast 1Kskills.sh installs
39orchestra-research avatarsentence-transformersorchestra-research/ai-research-skillsFramework for state-of-the-art sentence, text, and image embeddings. Provides 5000+ pre-trained models for semantic similarity, clustering, and retrieval. Suppo1Kskills.sh installs
40orchestra-research avatarcliporchestra-research/ai-research-skillsOpenAI's model connecting vision and language. Enables zero-shot image classification, image-text matching, and cross-modal retrieval. Trained on 400M image-tex1Kskills.sh installs
41orchestra-research avatarhuggingface-tokenizersorchestra-research/ai-research-skillsFast tokenizers optimized for research and production. Rust-based implementation tokenizes 1GB in <20 seconds. Supports BPE, WordPiece, and Unigram algorithms. 1Kskills.sh installs
42orchestra-research avatarlong-contextorchestra-research/ai-research-skillsExtend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ token1Kskills.sh installs
43orchestra-research avatarnanogptorchestra-research/ai-research-skillsEducational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfec1Kskills.sh installs
44orchestra-research avatarpytorch-fsdp2orchestra-research/ai-research-skillsAdds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models1Kskills.sh installs
45orchestra-research avatarawq-quantizationorchestra-research/ai-research-skillsActivation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GP1Kskills.sh installs
46orchestra-research avatarmodal-serverless-gpuorchestra-research/ai-research-skillsServerless GPU cloud platform for running ML workloads. Use when you need on-demand GPU access without infrastructure management, deploying ML models as APIs, o1Kskills.sh installs
47orchestra-research avatarmoe-trainingorchestra-research/ai-research-skillsTrain Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense mode1Kskills.sh installs
48orchestra-research avatarsglangorchestra-research/ai-research-skillsFast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with too1Kskills.sh installs
49orchestra-research avatarchromaorchestra-research/ai-research-skillsOpen-source embedding database for AI applications. Store embeddings and metadata, perform vector and full-text search, filter by metadata. Simple 4-function AP1Kskills.sh installs
50orchestra-research avatarinstructororchestra-research/ai-research-skillsExtract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and stream par1Kskills.sh installs
51orchestra-research avatarspeculative-decodingorchestra-research/ai-research-skillsAccelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× spe1Kskills.sh installs
52orchestra-research avatarllama-factoryorchestra-research/ai-research-skillsExpert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support1Kskills.sh installs
53orchestra-research avatarmodel-mergingorchestra-research/ai-research-skillsMerge multiple fine-tuned models using mergekit to combine capabilities without retraining. Use when creating specialized models by blending domain-specific exp1Kskills.sh installs
54orchestra-research avatarnemo-curatororchestra-research/ai-research-skillsnemo curator1Kskills.sh installs
55orchestra-research avatartransformer-lens-interpretabilityorchestra-research/ai-research-skillsProvides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation 1Kskills.sh installs
56orchestra-research avatardistributed-llm-pretraining-torchtitanorchestra-research/ai-research-skillsProvides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or cu1Kskills.sh installs
57orchestra-research avataropenrlhf-trainingorchestra-research/ai-research-skillsHigh-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× fast1Kskills.sh installs
58orchestra-research avatarevaluating-code-modelsorchestra-research/ai-research-skillsEvaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding 1Kskills.sh installs
59orchestra-research avatargptqorchestra-research/ai-research-skillsPost-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4× memory reduc1Kskills.sh installs
60orchestra-research avatarsentencepieceorchestra-research/ai-research-skillsLanguage-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), determinis1Kskills.sh installs
61orchestra-research avataroutlinesorchestra-research/ai-research-skillsGuarantee valid JSON/XML/code structure during generation, use Pydantic models for type-safe outputs, support local models (Transformers, vLLM), and maximize in1Kskills.sh installs
62orchestra-research avatarllamaindexorchestra-research/ai-research-skillsData framework for building LLM applications with RAG. Specializes in document ingestion (300+ connectors), indexing, and querying. Features vector indices, que1Kskills.sh installs
63orchestra-research avatarpyvene-interventionsorchestra-research/ai-research-skillsProvides guidance for performing causal interventions on PyTorch models using pyvene's declarative intervention framework. Use when conducting causal tracing, a1Kskills.sh installs
64orchestra-research avatarsimpo-trainingorchestra-research/ai-research-skillsSimple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No reference model 1Kskills.sh installs
65orchestra-research avatarslime-rl-trainingorchestra-research/ai-research-skillsProvides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation work1Kskills.sh installs
66orchestra-research avatartraining-llms-megatronorchestra-research/ai-research-skillsTrains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need1Kskills.sh installs
67orchestra-research avatarguidanceorchestra-research/ai-research-skillsControl LLM output with regex and grammars, guarantee valid JSON/XML/code generation, enforce structured formats, and build multi-step workflows with Guidance -1Kskills.sh installs
68orchestra-research avatarmamba-architectureorchestra-research/ai-research-skillsState-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware desi1Kskills.sh installs
69orchestra-research avatarmodel-pruningorchestra-research/ai-research-skillsReduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsi1Kskills.sh installs
70orchestra-research avatarsparse-autoencoder-trainingorchestra-research/ai-research-skillsProvides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use w1Kskills.sh installs
71orchestra-research avatarimplementing-llms-litgptorchestra-research/ai-research-skillsImplements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implement1Kskills.sh installs
72orchestra-research avatarllamaguardorchestra-research/ai-research-skillsMeta's 7-8B specialized moderation model for LLM input/output filtering. 6 safety categories - violence/hate, sexual content, weapons, substances, self-harm, cr1Kskills.sh installs
73orchestra-research avatarmiles-rl-trainingorchestra-research/ai-research-skillsProvides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4, needing trai1Kskills.sh installs
74orchestra-research avatartorchforge-rl-trainingorchestra-research/ai-research-skillsProvides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms. Use when you want clean RL abstractions, easy1Kskills.sh installs
75orchestra-research avatarnemo-guardrailsorchestra-research/ai-research-skillsNVIDIA's runtime safety framework for LLM applications. Features jailbreak detection, input/output validation, fact-checking, hallucination detection, PII filte1Kskills.sh installs
76orchestra-research avatarpineconeorchestra-research/ai-research-skillsManaged vector database for production AI applications. Fully managed, auto-scaling, with hybrid search (dense + sparse), metadata filtering, and namespaces. Lo1Kskills.sh installs
77orchestra-research avatarnnsight-remote-interpretabilityorchestra-research/ai-research-skillsProvides guidance for interpreting and manipulating neural network internals using nnsight with optional NDIF remote execution. Use when needing to run interpre1Kskills.sh installs
78orchestra-research avatarrwkv-architectureorchestra-research/ai-research-skillsRNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation1Kskills.sh installs
79orchestra-research avatarskypilot-multi-cloud-orchestrationorchestra-research/ai-research-skillsMulti-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage sp1Kskills.sh installs
80orchestra-research avatarautogpt-agentsorchestra-research/ai-research-skillsAutonomous AI agent platform for building and deploying continuous agents. Use when creating visual workflow agents, deploying persistent autonomous agents, or 1Kskills.sh installs
81orchestra-research avatarblip-2-vision-languageorchestra-research/ai-research-skillsVision-language pre-training framework bridging frozen image encoders and LLMs. Use when you need image captioning, visual question answering, image-text retrie1Kskills.sh installs
82orchestra-research avatarconstitutional-aiorchestra-research/ai-research-skillsAnthropic's method for training harmless AI through self-improvement. Two-phase approach - supervised learning with self-critique/revision, then RLAIF (RL from 1Kskills.sh installs
83orchestra-research avatarlangsmith-observabilityorchestra-research/ai-research-skillsLLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring p1Kskills.sh installs
84orchestra-research avatarnemo-evaluator-sdkorchestra-research/ai-research-skillsEvaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluatio1Kskills.sh installs
85orchestra-research avatarllavaorchestra-research/ai-research-skillsLarge Language and Vision Assistant. Enables visual instruction tuning and image-based conversations. Combines CLIP vision encoder with Vicuna/LLaMA language mo1Kskills.sh installs
86orchestra-research avatarphoenix-observabilityorchestra-research/ai-research-skillsOpen-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations1Kskills.sh installs
87orchestra-research avatarlambda-labs-gpu-cloudorchestra-research/ai-research-skillsReserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesyste1Kskills.sh installs
88orchestra-research avatarml-training-recipesorchestra-research/ai-research-skillsBattle-tested PyTorch training recipes for all domains — LLMs, vision, diffusion, medical imaging, protein/drug discovery, spatial omics, genomics. Covers train996skills.sh installs
89orchestra-research avatarpresenting-conference-talksorchestra-research/ai-research-skillsGenerates conference presentation slides (Beamer LaTeX PDF and editable PPTX) from a compiled paper with speaker notes and talk script. Use when preparing oral 993skills.sh installs
90orchestra-research avatarsystems-paper-writingorchestra-research/ai-research-skillsComprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns990skills.sh installs
91orchestra-research avatarexperiment-tracking-swanlaborchestra-research/ai-research-skillsProvides guidance for experiment tracking with SwanLab. Use when you need open-source run tracking, local or self-hosted dashboards, and lightweight media loggi961skills.sh installs
92orchestra-research avatarfine-tuning-openvla-oftorchestra-research/ai-research-skillsFine-tunes and evaluates OpenVLA-OFT and OpenVLA-OFT+ policies for robot action generation with continuous action heads, LoRA adaptation, and FiLM conditioning 926skills.sh installs
93orchestra-research avatarfine-tuning-serving-openpiorchestra-research/ai-research-skillsFine-tune and serve Physical Intelligence OpenPI models (pi0, pi0-fast, pi0.5) using JAX or PyTorch backends for robot policy inference across ALOHA, DROID, and925skills.sh installs
94orchestra-research avatarevaluating-cosmos-policyorchestra-research/ai-research-skillsEvaluates NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments. Use when setting up cosmos-policy for robot manipulation evaluation, running head921skills.sh installs
95orchestra-research avatarevolving-ai-agentsorchestra-research/ai-research-skillsProvides guidance for automatically evolving and optimizing AI agents across any domain using LLM-driven evolution algorithms. Use when building self-improving 897skills.sh installs