Medmarks

Open medical LLM evaluation suite

Open medical LLM evaluation suite that provides benchmarks for evaluating and selecting language models on medical tasks.

Recent stories

1 linked story

releasePRIMARY2026-05-12

SophontAI releases Medmarks v1.0 with 30 medical benchmarks and 61 models

SophontAI released Medmarks v1.0, expanding its open medical LLM evaluation suite to 30 benchmarks and 61 models alongside a technical report. It gives teams a larger open baseline for medical post-training and model selection, with more benchmarks and model coverage still planned.