Skip to content

explore all stories all tools all skills

All Tools›Categories›Evals & Observability

📊

Evals & Observability

144 tools

Evaluation harnesses, LLM tracing, monitoring, and prompt/agent observability. Dashboards, judges, replay tools, and regression suites for LLM apps.

AI agent evaluation platform

Weights & Biases

Weights & Biases, LLC

The AI Developer Platform

Artificial Analysis

Artificial Analysis

AI model analysis platform

Software product from Z Lab.

Debug, test, and monitor your LLM apps.

OpenAI Agents SDK

Build agents with OpenAI

ARC Prize Foundation

Competition platform for ARC-AGI

Large-model platform for building AI applications

Braintrust Data, Inc.

The AI evaluation platform

Chrome DevTools for agents

Chrome DevTools for agents

Developer console for Claude

Explore Interfaces Inc.

AI product analytics

LangSmith Engine

LLM observability and evaluation platform

LangSmith Sandboxes

Isolated code execution for LangSmith

Kepler Software Inc.

The TypeScript AI framework.

Software product by Medmarks

AI software platform

Benchmark project for program-centric evaluation

Spreadsheet-style finance workflows

Unverified Microsoft software product

Shopify product Tinker

AI token utility

Agent Installer

Splunk agent installer

Kubernetes SIG Apps

Sandbox for experimenting with agents on Kubernetes

Agent Session App

Agent Session App

Trace AI agent runs.

dip Corporation

Unknown tagline

Outshift by Cisco

The Internet of Agents

A unified gateway for AI model providers

AI usage tracking platform

Daily software product

Autonomous software testing platform

Benchmark and environment for app-using agents

Privacy-friendly analytics for your apps.

Benchmark repository

Microsoft software product ASSERT

Benchmark for AI assistants

Attention Head Visualiser

Visualiser for transformer attention heads.

Software product

Hypothesis automation software

Local SEO reporting platform

Build better agents

Blueprint Software Systems

Requirements and product design management platform

Blueprint-Bench 2

Benchmark product

BridgeBench by BridgeMind

Self-hosted error tracking

Benchmark for bullshit-free AI answers

Claude Code usage analytics

Independent benchmark software product

Understand user behavior on your site.

Independent software product.

Claude token counter

Count tokens for Claude prompts

Software product by Evolvent AI.

Arena Intelligence, Inc.

Context handling platform

Space Telescope Science Institute

COSMO software product

Voice AI evaluation platform

Carnegie Mellon University

Benchmark for computer-use agents.

Benchmark/tool for cursor-based coding workflows.

CI/CD observability for Dagger

Observability and security platform for cloud applications

DeepAgents Deploy

Deploy DeepAgents

LangGenius, Inc.

The open-source LLM app development platform.

Turn user feedback into product decisions.

Stanford NLP Group

The framework for programming—not prompting—language models.

EnterpriseRAG-Bench

Open-source community

Benchmark for enterprise RAG evaluation.

Software product named Entire.

Framework for evaluating LLMs and systems

FrontierSWE by Proximal

AI evaluation and observability platform

Prompt optimization for LLM agents

Visualization software product

GitHub Repo Stats

Repository statistics and activity insights for GitHub repositories.

Open source error tracking and monitoring

Agent Development Kit

Google AI Edge Gallery

Explore on-device AI models and demos.

The open and composable observability platform

LLM inference benchmarking and optimization tool

Carnegie Mellon University

Software product

Hermes Agent Control Room

AI agent control room

Benchmark for human-in-the-loop AI evaluation

Evaluation-oriented software product

AGI Context, Inc.

Database product

Interfere, Inc.

Software platform

IT benchmarking software

MIT CSAIL benchmark

LangSmith Fleet

Managed agent fleet operations in LangSmith

Exact target named llm-checker

The frontend monitoring platform

Lucent AI, Inc.

Stanford IRIS Lab

Meta-harness for evaluation

Microsoft Agent 365

Control plane for agents

Software product named minigepa

Build and operate AI applications and agents.

Open-source benchmark software

Monitor logs, metrics, traces, and alerts.

Open-source LLM observability and evaluation platform

Opik Test Suites

Test suites for Opik

Overmind Technology Inc.

Parallel Monitor API

Benchmark for evaluating AI systems

Document parsing benchmark

Open-source LLM observability and evaluation platform.

PhoenixScore software product

The all-in-one product analytics platform

AI Safety and Alignment Group

Benchmark for post-training safety evaluation

Benchmark software from prinz-ai.

Test, eval, and red-team LLM apps.

Multimodal data stack

AI debugging agent

Application monitoring for developers

Connect AI assistants to Sentry through MCP.

Shopify simulation environment for shopping agents

Benchmark suite for model and agent evaluation

The Doggie Lift

Discover and use MCP servers.

Developer tool for code checks

Open benchmark for long-horizon software engineering tasks.

Plex monitoring and tracking

Tessl AI Limited

Build software with AI

Thunderdome platform

Unverified software product under the Tokenspeed name.

Build, deploy, and scale machine learning models and AI applications.

Vitest-based evals

Weights & Biases

W&B software product

AI Force Singapore Pte. Ltd.

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.