remote-controlled-man/skillfit
Developer toolsЭта страница переведена автоматически. Технические детали смотрите в оригинале. Открыть оригинал
Measure whether AI coding agent Skills, rules, and MCP setups actually improve your tasks.
Обзор
Measure whether a skill, rules file, or MCP setup improves your agent on your tasks — then install only what survives the experiment. The agent-config ecosystem has solved (npx skills add, plugin marketplaces, MCP registries) but not . The evidence says unverified configuration can hurt: - Curated skills improve pass rates by on average — but agent-self-generated skills score , and focused skills beat large bundles (SkillsBench, arXiv:2602.12670) - LLM-generated context files scored while raising inference cost by 20%+ (ETH Zurich, arXiv:2602.11988) - 36% of scanned public skills contain prompt injection (Snyk ToxicSkills, 2026-02) skillfit is the missing measurement layer: paired A/B experiments with deterministic verifiers, statistical verdicts, and trigger-rate measurement — packaged as a CLI anyone can run. Build cases around your own tasks: pin the starting files, write the request, and define what a correct result must do.
README
Показан фрагмент оригинального README. Открыть оригинал.
Install
npx [email protected] --help
npx [email protected] doctor
Requires Node.js 22+. Both commands above are offline and make no model calls: --help lists the eight commands, and doctor is a read-only health report that detects which supported agents you have, inspects their rules files, and flags invalid or conflicting Skills. Choose your build owns the package/source boundary, availability checks and older release documentation.
See a real report before you spend
No agent CLI, no login, no model calls. These read the benches shipped inside the package and take a few seconds:
npx [email protected] bench check code-review
npx [email protected] bench self-test code-review --suite existing-mock-arms --runs-root ./runs --run-group controls-001 --yes
npx [email protected] report eval ./runs/controls-001/existing-mock-arms
Рекомендуемые инструменты
Попробуйте другой запрос или уберите фильтр.
Установка
npx skillfish add remote-controlled-man/skillfit