google-gemini avatar

Behavioral Evals

This is for when you need to test whether your AI agent is making the right decisions, not just whether your code works. You'll use evalTest for logic validation and appEvalTest for UI-heavy scenarios. The workflow is structured around a policy system: new tests start as USUALLY_PASSES, then get promoted to ALWAYS_PASSES once stable to lock in regression coverage. What I like here is the pragmatism. It includes specific guides for the three things you actually do: creating tests with workspace seeding and breakpoint assertions, fixing failures with investigation steps, and promoting candidates when they're ready. The decision tree at the top saves you from overthinking which approach to use.

skills.sh installs
294
GitHub stars
108.7K
last updated
Aug 21, 2026

Install

$ npx -y skills add google-gemini/gemini-cli --skill behavioral-evals --agent claude-code

Installs into .claude/skills of the current project.

Files

Behavioral Evals

Overview

Behavioral evaluations (evals) are tests that validate the agent's decision-making (e.g., tool choice) rather than pure functionality. They are critical for verifying prompt changes, debugging steerability, and preventing regressions.

[!NOTE] Single Source of Truth: For core concepts, policies, running tests, and general best practices, always refer to evals/README.md.


🔄 Workflow Decision Tree

  1. Does a prompt/tool change need validation?
    • No -> Normal integration tests.
    • Yes -> Continue below.
  2. Is it UI/Interaction heavy?
  3. Is it a new test?
    • Yes -> Set policy to USUALLY_PASSES.
    • No -> ALWAYS_PASSES (locks in regression).
  4. Are you fixing a failure or promoting a test?

Sponsors

Details

Repository
github.com/google-gemini/gemini-cli
Categories
AI & Agent Building, Debugging, Productivity & Planning, CLI & Terminal
First seen
Jun 3, 2026

More from google-gemini/gemini-cli

All 12
124601 avatardeep-research24601/agent-deep-researchdeep research291skills.sh installs
2davila7 avatarlangfusedavila7/claude-code-templatesExpert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaI291skills.sh installs
3muratcankoylan avatartool-designmuratcankoylan/agent-skills-for-context-engineeringThis is the skill for designing the tool layer between deterministic code and non-deterministic agents.291skills.sh installs
4oimiragieo avatarslack-notificationsoimiragieo/agent-studioSlack messaging, channels, and notifications - send messages, manage channels, interact with users, upload files, and add reactions. Use for team communication,288skills.sh installs
5davila7 avatarloki-modedavila7/claude-code-templatesMulti-agent autonomous startup system for Claude Code. Triggers on "Loki Mode". Orchestrates 100+ specialized agents across engineering, QA, DevOps, security, d284skills.sh installs
6nicepkg avatarremove-old-skills-from-workflownicepkg/ai-workflowGuide for removing skills from an existing workflow and updating all related documentation. Use when user wants to remove skills from a workflow (e.g., "remove 283skills.sh installs