Medmarks

Open medical AI benchmarks

Medmarks is an open-source LLM evaluation and benchmark suite for medical tasks, with runnable benchmark environments and a live leaderboard covering verifiable tasks, open-ended clinical reasoning, and training-capable environments.

Recent stories

1 linked story

releasePRIMARY2026-05-12

SophontAI releases Medmarks v1.0 with 30 medical benchmarks and 61 models

SophontAI released Medmarks v1.0, expanding its open medical LLM evaluation suite to 30 benchmarks and 61 models alongside a technical report. It gives teams a larger open baseline for medical post-training and model selection, with more benchmarks and model coverage still planned.