✅ QA

eval-engineering

Name: eval-engineering
Author: langchain-ai

by langchain-ai16 days ago1.1k

Iteratively inspect an agent repository and optional user-provided traces, interview the user, and create, run, and audit Harbor evals one at a time. Use for agent evals, Harbor tasks, benchmark cases, verifier design, or controlled agent environments.

Install

npx skills add https://github.com/langchain-ai/langchain-skills --skill eval-engineering

Show step-by-step

1
Open your terminal
- Mac: Press ⌘ Space, type "Terminal", press Enter
- Windows: Press Win R, type "cmd", press Enter
2
Paste the command above and press Enter
Use the Copy command button, then paste in your terminal (Mac: ⌘V, Windows: Ctrl V).
3
Restart Claude Code
Close and reopen Claude Code, or start a new session, so it picks up the new skill.

Where it lives

~/.claude/skills/langchain-ai--langchain-skills--config--skills--eval-engineering/
├── SKILL.md
└── ... (skill resource files)

View on GitHub

Comments

X@Vtrivedy10

"there’s a limited amount of work per day where I can dedicate my time to being fully “in the loop” -> choosing to spend it on evals & environments bc imo..."

X@Vtrivedy10

"Synthetic Environment Generation with Human Feedback Agents are poor 1-shot eval/environment generators because they're misaligned with human goals, successful..."

X@Vtrivedy10

"New version of the eval-engineering skill released, thanks for everyone's feedback on the first version. npx skills add --skill eval-engineering updates: - now..."