Skip to content

explore all stories all tools all skills

All Tools›Categories›Evals & Observability

📊

Evals & Observability

146 tools

Evaluation harnesses, LLM tracing, monitoring, and prompt/agent observability. Dashboards, judges, replay tools, and regression suites for LLM apps.

Local SEO benchmarking and reporting platform

Develop with Claude

Artificial Analysis

Agentic Knowledge Work Benchmark

Applied Theory LLC

AI Agent Compliance, Governance & Control

Arena Intelligence, Inc.

AI Agent Performance Leaderboard

Production AI agents

Kubernetes SIG Apps

Kubernetes SIG Apps project for agent sandboxes.

Session management for AI agents

Agent View software product

Open-source agent tracing

dip Corporation

Software product from dip Corporation

Kenn Software LLC

A local-first desktop and web app for browsing, searching, and analyzing your past AI coding sessions.

Outshift by Cisco

Building the Internet of Agents (IoA)

The AI Gateway for developers

AI workflow orchestration platform

A framework for evaluating multi-turn LLM conversations with support for text, realtime audio, and speech-to-speech models.

AI research lab for agent systems

Bug-free systems, unlimited velocity

ARC Prize Foundation

The first interactive reasoning benchmark designed to measure human-like intelligence in AI agents.

Arena Intelligence, Inc.

Crowdsourced AI Model Evaluation Platform

Artificial Analysis

Artificial Analysis, Inc.

AI model benchmarks and rankings

Generative Artificial Intelligence Research Lab (GAIR)

Let AI Do the Research, You Keep the Insight

Adaptive Spec-driven Scoring for Evaluation and Regression Testing

Attention Head Visualiser

Mapping what each head in GPT-2 actually does

Official repository

AutomationBench-AA

Artificial Analysis

Agentic SaaS Workflow Benchmark

An enterprise-grade, all-in-one large model platform centered on Agent development

AI benchmarking software

Build reliable, testable, production-grade AI agents with Better Agents CLI - the reliability layer for agent development

Block-Sparse Featurizers

Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds

Braintrust Data, Inc.

Build and monitor reliable AI applications.

The World's #1 Vibe Coding Benchmark

BrowseComp-Plus

A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent

Claude Code usage analyzer

Chrome DevTools for agents

Agent-oriented Chrome DevTools

Track Claude usage at a glance

Claude Token Count API

Count the number of tokens in a Message.

Independent software product

Arena Intelligence, Inc.

Build & Test with AI Coding Models

Unverified software product

Explore Interfaces Inc.

AI analytics for conversation data

AI agent testing platform

Make your agents better at computers

Can AI agents find security bugs and patch them?

Deep Agents Deploy

Deploy deep agents with LangChain

Block Diffusion for Flash Speculative Decoding

LangGenius, Inc.

The Platform for Production-Ready Agentic Workflows.

Dogfood software product

Stanford NLP Group

Program, don’t prompt, your LLMs.

An ultra-long-horizon benchmark built to measure learning from environments

EnterpriseRAG-Bench

Enterprise RAG benchmark

The open benchmark for end-of-turn detection

A framework for evaluating language models and LLM-powered systems.

Fullstack Code Arena

Build, Deploy, and Evaluate with Fullstack Code Arena

AI Agents hallucinate, fix it faster.

A research-level benchmark measuring how AI agents navigate ambiguity and make consequential judgments in computational biology.

Optimize Anything with LLMs

Visualization software product

GitHub Repo Signals

Extract and score leads from GitHub repositories using stars, forks, issues, PRs, comments, and contributions.

Agent development kit for building AI agents.

Google AI Edge Gallery

Explore and run AI models on-device.

SLO-aware Benchmarking and Evaluation Platform for Optimizing Real-World LLM Inference

Carnegie Mellon University

Gym-style research software toolkit

Hermes Agent Control Room

Agent control room

Unverified vendor

Unverified software product

AGI Context, Inc.

The Graph AI Runs On.

Interfere, Inc.

Scaling Intelligence Lab at Stanford University

Can LLMs Write Efficient GPU Kernels?

AI Coding Model Benchmark Results

Ship great agents faster with LangSmith

LangSmith Engine

LangSmith platform engine

LangSmith Fleet

Agents for the whole company

LangSmith Sandboxes

Isolated code execution for LangSmith

Latitude Data S.L.

Make your AI agents self-healing

Intelligent Ollama Model Selector

When the Stakes Are Too High for One AI Answer

Elastic Context Orchestration for Long-Horizon Search Agents

Lucent AI, Inc.

AI software product from Lucent AI, Inc.

You ask. It works.

Kepler Software Inc.

Open-source AI agent framework for TypeScript

MCPMark Verified

Stabilized, version-pinned subset of MCPMark's standard tasks for reliable and reproducible MCP evaluation.

Stanford IRIS Lab

Open-source research harness

Data lab to train frontier models & evaluate agents

Microsoft Agent 365

Control plane for AI agents

Mini GEPA implementation

What's the largest software project AI can complete on its own?

Your AI production platform.

A Big-World Benchmark for Continual Reinforcement Learning

Cornell University

Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics

Neo Research Inc.

Autonomous AI Agent to build AI Agents, evaluate AI Agents, Optimize LLM Prompts, Train AI Models and Finetune LLMs

Observability for TrueFoundry applications and infrastructure.

Stanford University

An Agentic Framework with Extensible Tools for Complex Reasoning

AllenAI's post-training codebase

OpenAI Agents SDK

Build sandbox, text, and voice agents with a small set of primitives.

An open framework for background coding agents.

LLM observability and evaluation platform

Overmind Technology Inc.

Software platform

Paper Assistant Tool

Gemini-backed automated feedback for scientific manuscripts

Parallel Monitor API

Parallel Web Systems

Web monitoring API

Expert data for AGI

Open-source AI observability and evaluation.

Unverified software product

AI/LLM evaluation and red-teaming platform

Raindrop Workshop

Debug your AI agent locally

Spreadsheet-oriented finance workflows

Visualize and debug multimodal data

Amazon Web Services

Robust Panel of LLM-as-Judge

Sakana AI Recursive Self-Improvement (RSI) Lab

A dedicated research group within Sakana AI tasked with redesigning the AI development process itself with AI.

Stop guessing on retrieval quality

Ask any question about your application and Seer Agent finds the right telemetry to answer it.

The sensor that helps AI agents close the feedback loop.

Sentry MCP plugs Sentry's API directly into your LLM.

Build AI models the way you write software

Microsoft software product

Connect agents to services in minutes

Open Medical Superintelligence

A skill for removing AI tells from prose.

Evaluating challenging long-horizon software engineering tasks in public open source repositories

10x Faster Bug Detection

Tessl AI Limited

The AI-native software development platform

Thinking Machines Lab

Tinker is a training API for researchers

Lean output compaction for terminal-heavy agent workflows.

Claude Code token cost, in your menu bar

LightSeek Foundation

Speed-of-light LLM inference

Time-Series Metrics Made Simple

Benchmark Generative AI for Enterprise Applications.

Your own, personal intelligence

Build, deploy, and scale AI applications with Vertex AI.

Vitest-based evals tool

Weights & Biases

Explore and compare local W&B runs from the terminal with the LEET TUI.

A benchmark for high-volume, evidence-heavy knowledge work

Zero Trust, run as a service.

Weights & Biases

Weights and Biases, LLC

The AI developer platform

A decision-based fidelity benchmark for world models

AI Force Singapore Pte. Ltd.

Unified API for all models, intelligent routing, and AI Model Insurance.

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.