This is a multi-stage academic paper reviewer that runs OpenJudge's pipeline on PDFs or LaTeX sources. It checks for mathematical errors, scores papers 1-6 on quality and novelty, verifies BibTeX entries against CrossRef and arXiv, and outputs a structured markdown report. Covers 10 disciplines from computer science to social sciences. The pipeline uses vision-capable models by default (renders pages as images), so you need something like GPT-4o or Claude Opus, not a text-only model. Works in English or Chinese. The approach is thorough but opinionated: it's designed for formal peer review workflows, not quick skims. If you're evaluating submissions or need reference verification with actual database lookups, this handles the tedious parts.

GitHub stars
657
last updated
Jun 9, 2026

Install

$ npx -y skills add agentscope-ai/openjudge --skill paper-review --agent claude-code

Installs into .claude/skills of the current project.

Files

This is a multi-stage academic paper reviewer that runs OpenJudge's pipeline on PDFs or LaTeX sources. It checks for mathematical errors, scores papers 1-6 on quality and novelty, verifies BibTeX entries against CrossRef and arXiv, and outputs a structured markdown report. Covers 10 disciplines from computer science to social sciences. The pipeline uses vision-capable models by default (renders pages as images), so you need something like GPT-4o or Claude Opus, not a text-only model. Works in English or Chinese. The approach is thorough but opinionated: it's designed for formal peer review workflows, not quick skims. If you're evaluating submissions or need reference verification with actual database lookups, this handles the tedious parts.

Browse the repository on GitHub

Sponsors

Details

Repository
github.com/agentscope-ai/openjudge
Categories
Git & Pull Requests, Code Review & Quality
License
Apache-2.0
First seen
Jun 11, 2026

More from agentscope-ai/openjudge

All 9
1agentworkforce avatargithub-oauth-nango-integrationagentworkforce/relayIf you're building GitHub OAuth where users log in *and* your app needs repo access, you'll hit the reconciliation problem: OAuth gives...0skills.sh installs
2agentworkforce avatarreview-fix-signoff-loopagentworkforce/relayWhen one review pass isn't enough and you need code to meet a spec end to end, this pattern loops fix and review iterations with fresh...0skills.sh installs
3ar9av avatarliterature-review-agentar9av/paperorchestraStep 3 of the PaperOrchestra pipeline (arXiv:2604.05018). Execute the literature search strategy from outline.json — discover candidate papers via web search, v0skills.sh installs
4cherryhq avatardemand-first-reviewcherryhq/cherry-studioThis forces you to ask "should this exist?" before polishing how it exists.0skills.sh installs
5ergrelet avatarwindiff-version-diff-analysisergrelet/windiff>-0skills.sh installs
6gadievron avatargithub-archivegadievron/raptorInvestigate GitHub security incidents using tamper-proof GitHub Archive data via BigQuery. Use when verifying repository activity claims, recovering deleted PRs0skills.sh installs