Skip to main content

Test script for MoE Judge Agents.

Tests all 3 judges with sample analyst votes to verify:

  1. ConsistencyJudge - agreement validation
  2. QualityJudge - vote quality and confidence
  3. DomainJudge - CODITECT domain compliance

File: test_judges.py

Functions​

create_test_document(doc_type)​

Create a sample document for testing.

create_unanimous_votes(classification, high_confidence)​

Create votes where all analysts agree.

create_split_votes(primary, secondary)​

Create votes with disagreement.

create_low_quality_votes(classification)​

Create low-quality votes.

test_consistency_judge()​

Test ConsistencyJudge with various vote patterns.

test_quality_judge()​

Test QualityJudge with various vote quality levels.

test_domain_judge()​

Test DomainJudge with various document types.

test_all_judges_integration()​

Test all judges together on a sample document.

main()​

Run all judge tests.

Usage​

python test_judges.py