HA

hraness/aicharts

Developer tools

이 페이지는 AI로 자동 번역되었습니다. 기술적인 세부 사항은 원문을 확인하세요. 원문 보기

4 stars 품질 61 트렌드 25MIT

aicharts plots published AI benchmark scores against cost and tokens per task, and a local collector measures your own agents' token use.

개요

📈 aicharts plots published AI benchmark scores against cost and tokens per task on one chart, and marks the best score at every budget. A local collector measures your own agents' token use, so the chart covers your work too. See the charts: https://aicharts.io — Ben Guo aicharts plots published AI benchmark scores against cost and tokens per task, marking the best score at every budget. A local collector measures your own agents' token use. The collector is in development. Linux x86-64 and Apple silicon Mac builds for local reports are on GitHub Releases; the Mac build is signed and notarized. On an Intel Mac, build it from source. Reports you open on the site stay in your browser tab. Account sync needs a collector enrolled on a Mac and works only while the site's account service is enabled. The collector can also keep a daily history of your token use on your computer, and your agents can read it through a read-only MCP server to answer questions or draw charts.

README

원문 README의 일부입니다. 원문 보기.

aicharts

📈 aicharts plots published AI benchmark scores against cost and tokens per task, and marks the best score at every budget. Compare models and coding agents using sourced results, with each benchmark on its own scale.

See the charts: https://aicharts.io

Ben Guo

aicharts plots published AI benchmark scores against cost and tokens per task. Each chart links its source data and methodology.

The homepage leads with an interactive Pareto frontier: compare model capability against output tokens or cost, then inspect the configuration behind each point. The original coding-agent charts have a focused home at /coding. The separate /benchmarks library covers coding, reasoning, research, memory, images, video, audio, and world models. Charted results, source guides, and emerging evaluations are labeled separately, and older research cohorts are labeled with their dates.

The site header links Charts (/), Benchmarks (/benchmarks), and Notes (/blog). Coding comparisons, model pages, the calculator, and source data are linked where relevant. Legacy root chart and atlas links resolve to the matching workspace; new shares use that workspace’s URL. The charts, benchmarks, calculator, data, model, and blog pages also have Markdown representations through Accept: text/markdown.

Compared with

Other places to compare models: Artificial Analysis runs the Intelligence Index and Coding Agent Index charted here, and its own leaderboards cover more than 250 models with speed and latency. Arena (formerly LMArena) ranks models by people’s votes in blind side-by-side chats. Epoch AI runs its own benchmarks and tracks how capabilities change over time. OpenRouter lists live API prices and which models its users send the most tokens to. aicharts puts published scores against cost per task, draws the best score at each budget, and keeps each benchmark on its own scale.

Checked Sep 28, 2026.

Current benchmark portfolio

The site is a static-data Next.js and TypeScript application. Its benchmark snapshots are committed to the repository, validated at build time, and refreshed automatically. Production never depends on an upstream data source being available during a request.

  • Use the official, version-pinned Terminal-Bench 4.0 snapshot as the current coding standard, with exact model, agent, effort, trial, uncertainty, cost, token, duration, and source metadata.
  • Explore native score rankings, cost trade-offs where reported, tables, and up to three selected configurations within one benchmark. Inspect exact values, uncertainty, source dates, and evaluation conditions, then share the configured view.
GitHub에서 전체 README 보기

추천 도구

다른 키워드를 입력하거나 필터를 제거해 보세요.

설치

npx skillfish add hraness/aicharts
MCP 초보자라면? mcpskill.org 가이드부터 시작하세요 →