alexgreensh/eval-genius
Developer tools이 페이지는 AI로 자동 번역되었습니다. 기술적인 세부 사항은 원문을 확인하세요. 원문 보기
Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.
개요
Eval Genius Defensible answers about your AI system, instead of vibes. A skill for any AI coding agent that tells you when you need an eval, where it fits, how to build it, and how to read what comes out. Runs natively in Claude Code , Codex , and Droid — or any agent that loads a SKILL.md . English · 简体中文 · Español · 한국어 · 日本語 Translations track an earlier version of this page. Evals are suddenly everywhere. Every AI talk, every launch post, every hiring thread says you need them. Then you sit down to actually do it, and the questions start. Does a prompt tweak really need an eval, or is that overkill? At which point in the build does the first one go in? What is an "eval harness", concretely, beyond a folder named evals/? Which metric, how many examples, does a judge model even count? And when a number finally comes out, is 34 out of 40 good? Is a 3-point gain real, or noise? Or did the run just crash quietly and report a pass?
README
원문 README의 일부입니다. 원문 보기.
Eval Genius Defensible answers about your AI system, instead of vibes.
A skill for any AI coding agent that tells you when you need an eval, where it fits, how to build it, and how to read what comes out.
Runs natively in Claude Code, Codex, and Droid — or any agent that loads a SKILL.md.
English · 简体中文 · Español · 한국어 · 日本語 Translations track an earlier version of this page.
Everyone says “you need evals.” Almost nobody says when.
Evals are suddenly everywhere. Every AI talk, every launch post, every hiring thread says you need them. Then you sit down to actually do it, and the questions start.
Does a prompt tweak really need an eval, or is that overkill? At which point in the build does the first one go in? What is an “eval harness”, concretely, beyond a folder named evals/? Which metric, how many examples, does a judge model even count? And when a number finally comes out, is 34 out of 40 good? Is a 3-point gain real, or noise? Or did the run just crash quietly and report a pass?
추천 도구
다른 키워드를 입력하거나 필터를 제거해 보세요.
설치
npx skillfish add alexgreensh/eval-genius