Skip to main content

Quality Judge Agent

Validates the quality of analyst votes and classifications. Checks for:

  • Minimum confidence thresholds
  • Reasoning quality and specificity
  • Vote completeness
  • Suspicious patterns (all same score, no reasoning, etc.)

File: quality.py

Classes​

QualityJudge​

Judge that validates the quality of analyst votes.

Functions​

evaluate(document, votes)​

Evaluate quality of analyst votes.