github avatar

Arize Ai Provider Integration

This handles CRUD operations for LLM provider credentials in Arize AI, so evaluators and other features can call models on your behalf without you hardcoding keys everywhere. It wraps the `ax ai-integrations` CLI and supports the usual suspects: OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM, plus custom OpenAI-compatible endpoints. The integrations are account-scoped, not workspace-scoped, which is worth knowing upfront. You'll want this when setting up judge models for evals or connecting any LLM provider to Arize. The skill is thorough about listing existing integrations before creating new ones, which saves you from credential sprawl.

skills.sh installs
1.1K
GitHub stars
41K
last updated
Aug 21, 2026

Install

$ npx -y skills add github/awesome-copilot --skill arize-ai-provider-integration --agent claude-code

Installs into .claude/skills of the current project.

Files

Arize AI Integration Skill

SPACE — Most --space flags and the ARIZE_SPACE env var accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Find yours with ax spaces list. Note: ai-integrations create does not accept --space — AI integrations are account-scoped. Use --space only with list, get, update, and delete.

Concepts

  • AI Integration = stored LLM provider credentials registered in Arize; used by evaluators to call a judge model and by other Arize features that need to invoke an LLM on your behalf
  • Provider = the LLM service backing the integration (e.g., openAI, anthropic, awsBedrock)
  • Integration ID = a base64-encoded global identifier for an integration (e.g., TGxtSW50ZWdyYXRpb246MTI6YUJjRA==); required for evaluator creation and other downstream operations
  • Scoping = visibility rules controlling which spaces or users can use an integration
  • Auth type = how Arize authenticates with the provider: default (provider API key), proxy_with_headers (proxy via custom headers), or bearer_token (bearer token auth)

Prerequisites

Sponsors

Details

Repository
github.com/github/awesome-copilot
Categories
Git & Pull Requests, AI & Agent Building, Cloud & Infrastructure
First seen
Apr 16, 2026

More from github/awesome-copilot

All 318
1github avatararize-evaluatorgithub/awesome-copilotHandles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-1.1Kskills.sh installs
2github avatarreact19-concurrent-patternsgithub/awesome-copilotPreserve React 18 concurrent patterns and adopt React 19 APIs (useTransition, useDeferredValue, Suspense, use(), useOptimistic, Actions) during migration.1.1Kskills.sh installs
3github avatararize-datasetgithub/awesome-copilotCreates, manages, and queries Arize datasets and examples. Covers dataset CRUD, appending examples, exporting data, and file-based dataset creation using the ax1.1Kskills.sh installs
4github avatararize-instrumentationgithub/awesome-copilotAdds Arize AX tracing to an LLM application for the first time. Follows a two-phase agent-assisted flow to analyze the codebase then implement instrumentation a1.1Kskills.sh installs
5github avatarintegrate-context-maticgithub/awesome-copilotDiscovers and integrates third-party APIs using the context-matic MCP server. Uses `fetch_api` to find available API SDKs, `ask` for integration guidance, `mode1.1Kskills.sh installs
6github avatararize-experimentgithub/awesome-copilotCreates, runs, and analyzes Arize experiments for evaluating and comparing model performance. Covers experiment CRUD, exporting runs, comparing results, and eva1.1Kskills.sh installs