RoPoLL
Robust Panel of LLM-as-Judge
RoPoLL is an AWS/Amazon Science research tool and framework for robust LLM-as-a-judge panels. It preserves the Panel of LLM Evaluators (PoLL) setup but replaces arithmetic-mean score aggregation with a robust mean estimator, instantiated with the geometric median, to reduce bias from corrupted or failing LLM judges.

Recent stories
0 linked stories
No linked stories yet.