Skip to content

explore all stories

All Tools›Categories›Evals & Observability

📊

Evals & Observability

86 tools

Evaluation harnesses, LLM tracing, monitoring, and prompt/agent observability. Dashboards, judges, replay tools, and regression suites for LLM apps.

OpenAI Agents SDK

Build agentic workflows with OpenAI.

ARC Prize Foundation

Test today's ARC-AGI puzzle.

Baidu AI Cloud's large-model platform

Braintrust Data, Inc.

The AI observability platform for building quality AI products

Explore Interfaces Inc.

Build, run, and improve AI agents

DFlash software product

HealthBench Professional

Healthcare benchmark from OpenAI

Can language models rebuild programs from scratch?

Benchmark Generative AI for Enterprise Applications.

Weights & Biases

Weights and Biases, LLC

Machine learning platform

Agent installation

Visual feedback for AI coding agents

Outshift by Cisco

Open-source infrastructure for AI agents

Enterprise AI orchestration

Autonomous organizations without humans in the loop

A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

A time series question-answering benchmark based on real incidents.

Artificial Analysis

Artificial Analysis

AI model benchmarks and comparisons

Benchmark for evaluating AI assistants

Attention Heads

Attention-head analysis tool for GPT-2.

Automated hypothesis generation

Build reliable, testable, production-grade AI agents with Better Agents CLI - the reliability layer for agent development

Blueprint Software Systems

Migrate & Improve your RPA Estate

Blueprint-Bench 2

Spatial reasoning benchmark for converting apartment photos into floor plans.

Measures whether models detect nonsense, call it out clearly, and avoid confidently continuing with invalid assumptions.

Claude token counter

Count tokens before you send a message to Claude.

ClawMark by Evolvent AI

Arena Intelligence, Inc.

Build & Test with AI Coding Models

Context Arena software product

Space Telescope Science Institute

Space Telescope Science Institute software

Carnegie Mellon University

Interactive computer-use benchmark

Observability for Delivery Workflows

Cloud observability and security platform

DeepAgents Deploy

Deploy DeepAgents with LangChain

Dogfood your product, the efficient way

Stanford NLP Group

Programming—not prompting—language models.

Software product from Entire.

Manage and run evals in the OpenAI platform.

Benchmarking software engineering skill at the edge of human ability.

AI evaluation and observability platform

Optimize Anything with LLMs

GitHub Repo Stats

Repository analytics for GitHub projects.

Google AI Edge Gallery

Explore, Experience, and Evaluate the Future of On-Device Generative AI with Google AI Edge.

Dashboard anything. Observe everything.

SLO-aware Benchmarking and Evaluation Platform for Optimizing Real-World LLM Inference

Carnegie Mellon University

Turn Any Software into an Agent Environment

Benchmark measuring whether AI coding agents know when to ask for help.

Interfere, Inc.

Build software that never breaks

LLM observability and evaluation platform

LangSmith Fleet

Manage AI application fleets at scale.

Lucent AI, Inc.

AI Bug Detection from Session Replays

Kepler Software Inc.

TypeScript AI Agent Framework & Platform

Stanford IRIS Lab

Framework for automated search over task-specific model harnesses.

Microsoft Agent 365

The Control Plane for Agents

End-to-End LLM Observability, Simplified

Open-source LLM observability and evaluation platform

Opik Test Suites

Straightforward unit & regression testing for AI agents

Overmind Technology Inc.

Prevent your next outage

Parallel Monitor API

Monitor API by Parallel

A research framework for evaluating proactive AI assistants through active user simulation

The document parsing benchmark for AI agents

Open source product analytics.

AI Safety and Alignment Group

Measuring how well AI agents can post-train language models

Benchmark software

Build and manage prompts.

LLM security and testing for teams of all sizes

AI software product

AI debugging agent

Software service named sentrux

Application Performance Monitoring & Error Tracking Software

MCP server for Sentry

Simulate theme changes with human-like AI shoppers

Code benchmark from Sprocket Lab

The Doggie Lift

Vet-Created for Easy Care

Discover and install MCP servers

Monitor your Plex Media Server

Tessl AI Limited

The package manager for agent skills and context

Open Source Agile Planning Poker app

Shopify product called Tinker

Lean output compaction for terminal-heavy agent workflows.

A software product named Tokenspeed.

Build, deploy, and scale machine learning models.

Minecraft Server Benchmark

Weights & Biases

Lightweight Experiment Exploration Tool

AI Force Singapore Pte. Ltd.

AI software platform

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.