RoPoLL
Robust Panel of LLM-as-Judge
RoPoLL is an AWS research tool/method for robust LLM-as-judge panels. It keeps a Panel of LLM Evaluators setup but replaces arithmetic-mean consensus scoring with a robust mean estimator, instantiated with the geometric median, to reduce bias from corrupted or failing judges.

Recent stories
0 linked stories
No linked stories yet.