Can an AI judge a competitive debate round?

DebateIt's AI judge writes a complete ballot with a reason for decision on any pasted round in seconds. Whether it agrees with expert human ballots is exactly what this benchmark exists to measure. The expert-rated set is being built now; the agreement number publishes only when it exists and reconciles to the live database.

How is agreement measured?

A round counts as agreement when the AI ballot's winner matches the winner chosen by the expert rater on the same round. The rater is an APDA Pro-Ams champion (2025) scoring complete rounds, speech by speech, against format-specific judging criteria.

Can I test the AI judge myself?

Yes. Paste any round transcript at debateai.com/judge and the judge returns a full ballot with a reason for decision in seconds, free.

Judge benchmark

Can AI judge a debate round?

It is a live argument on every circuit. We are building the answer in public, starting from a real zero, because a benchmark you can't interrogate is marketing.

rounds and speeches logged to the corpus (signed-in rounds only; guest rounds are never stored)

rounds in the published expert-rated set. The number this page exists to grow.

formats, each with its own encoded judging norms

2,195

published judge paradigms distilled into those criteria

As of July 4, 2026. Every count on this page reconciles to a live database query. It updates as the rated corpus grows.

What is being measured

A round counts as agreement when the AI ballot's winner matches the winner in the expert rating of the same round. Not "did the AI say something plausible": the same transcript, two independent verdicts, do they land on the same side.

The judge does not return a bare verdict. Every ballot is a full reason for decision: which arguments survived, which were dropped, how the weighing resolved, speech-by-speech notes. That is the part debaters actually learn from, and it is also what makes disagreements inspectable: when the AI and the expert split, you can read both rationales and decide who judged the round better.

Methodology

The judge engine. Format-specific adjudication criteria per format (BP, APDA, Policy, LD, PF, WSDC, Asian Parliamentary, Congress, and others), each encoding that format's real judging norms: speaker-scale bands, drop severity, weighing conventions, grounded in 2,195 published judge paradigms from real tournament pools. The engine decides on the flow; instructions that name a winner are dead on arrival.
The expert. Rated rounds are scored by an APDA Pro-Ams champion (2025), speech by speech, against the same format's criteria.
The set. Complete rounds run on the platform (typed and voice) that receive a full expert rating. Today that set is empty. Building it is the current work, and the count above is queryable, not estimated.
The metric. Winner agreement: AI ballot winner = expert-rated winner. The agreement number publishes when the set exists, and not before.

Where this stands, honestly

The rated set is empty today. An earlier version of this page reported estimated figures, including an estimated agreement rate. This version reports only counts that reconcile to a live database query, and there is no agreement number yet.
One rater at first. Panel judging exists precisely because experts disagree; human judge-to-judge agreement in competitive debate is itself well below 100%, which is important context for reading any number that will ever appear on this page. Additional independent raters are part of the plan.
Selection effects. Rated rounds will be platform rounds, not tournament finals. Different distribution of skill and formats than the open circuit.

All three shrink the same way: more rated rounds, more raters. The numbers on this page will move as that happens, in either direction.

Test it yourself

The benchmark you can run right now beats the one you read about. Paste any round transcript and get the full ballot:

Get an AI ballot on any round →

Citing this. "DebateIt AI Judge Benchmark, July 2026: benchmark in progress; 35 rounds and speeches logged, expert-rated set not yet published, no agreement number yet." Link this page. Questions or want the methodology in more depth? Write us.