Skip to content

explore all stories

All Tools›Categories›Evals & Observability

📊

Evals & Observability

82 tools

Evaluation harnesses, LLM tracing, monitoring, and prompt/agent observability. Dashboards, judges, replay tools, and regression suites for LLM apps.

Deploy application server agents

Visual feedback for AI coding agents

Outshift by Cisco

Open-source infrastructure for AI agents

Enterprise AI orchestration

Agent evals for long-horizon AI tasks

A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

ARC Prize Foundation

The North Star for AGI

A time series question-answering benchmark based on real incidents.

Artificial Analysis

Artificial Analysis

AI model benchmarks and comparisons

Benchmark for evaluating AI assistants

Automated hypothesis generation

以Agent为核心的一站式企业级大模型服务平台

Build reliable, testable, production-grade AI agents with Better Agents CLI - the reliability layer for agent development

Blueprint Software Systems

Migrate & Improve your RPA Estate

Blueprint-Bench 2

Spatial reasoning benchmark for converting apartment photos into floor plans.

Braintrust Data, Inc.

The AI observability platform for building quality AI products

Measures whether models detect nonsense, call it out clearly, and avoid confidently continuing with invalid assumptions.

Claude token counter

Count tokens before you send a message to Claude.

ClawMark by Evolvent AI

Context Arena software product

Explore Interfaces Inc.

Build, run, and improve AI agents

Space Telescope Science Institute

Carnegie Mellon University

Interactive computer-use benchmark

Observability for Delivery Workflows

Cloud Monitoring as a Service

DeepAgents Deploy

Deploy DeepAgents with LangChain

Dogfood your product, the efficient way

Stanford NLP Group

Programming—not prompting—LMs

Software product from Entire.

Manage and run evals in the OpenAI platform.

Benchmarking software engineering skill at the edge of human ability.

AI Agents hallucinate, fix it faster.

Optimize Anything with LLMs

GitHub Repo Stats

Repository analytics for GitHub projects.

Google AI Edge Gallery

Explore, Experience, and Evaluate the Future of On-Device Generative AI with Google AI Edge.

Dashboard anything. Observe everything.

SLO-aware Benchmarking and Evaluation Platform for Optimizing Real-World LLM Inference

Carnegie Mellon University

Turn Any Software into an Agent Environment

HealthBench Professional

Healthcare benchmark from OpenAI

Benchmark measuring whether AI coding agents know when to ask for help.

Interfere, Inc.

Build software that never breaks

LLM observability and evaluation platform

LangSmith Fleet

Agents for the whole company

Lucent AI, Inc.

AI Bug Detection from Session Replays

Kepler Software Inc.

TypeScript AI Agent Framework & Platform

Stanford IRIS Lab

Framework for automated search over task-specific model harnesses.

Microsoft Agent 365

The Control Plane for Agents

End-to-End LLM Observability, Simplified

OpenAI Agents SDK

Build agentic AI apps and multi-agent workflows.

Open-source LLM observability and evaluation platform

Opik Test Suites

Straightforward unit & regression testing for AI agents

Overmind Technology Inc.

Prevent your next outage

Parallel Monitor API

Monitor API by Parallel

A research framework for evaluating proactive AI assistants through active user simulation

Document Parsing Benchmark for AI Agents

Open source product analytics.

AI Safety and Alignment Group

Measuring how well AI agents can post-train language models

Private benchmark for legal research and needle-in-the-haystack search

Can language models rebuild programs from scratch?

Build AI prompts 10x faster with drag-and-drop blocks

LLM security and testing for teams of all sizes

AI software product

AI debugging agent

Software service named sentrux

Application Performance Monitoring & Error Tracking Software

Connect AI coding tools to Sentry via MCP.

Community driven benchmark for measuring code erosion under iterative specification refinement.

The Doggie Lift

Vet-Created for Easy Care

Connect agents to MCPs in minutes

Monitor your Plex Media Server

Tessl AI Limited

The package manager for agent skills and context

Open Source Agile Planning Poker app

Shopify product called Tinker

Lean output compaction for terminal-heavy agent workflows.

A software product named Tokenspeed.

Benchmark Generative AI for Enterprise Applications.

Build, deploy, and scale machine learning models.

Minecraft Server Benchmark

Weights & Biases

Lightweight Experiment Exploration Tool

Weights & Biases

Weights and Biases, LLC

Machine learning platform

AI Force Singapore Pte. Ltd.

AI software platform

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.