RA

robot-agent-exploration/skills-lib

Developer tools
16 stars Quality 51 Trend 24

Task skills robot agents learned on real robots, one library per embodiment

Overview

RAX is the general harness: a coding agent (Claude Code or Codex CLI) drives a robot through perception and control tools, with no demonstrations, and compiles what worked into code. Each skill is an executable procedure the agent wrote while it explored a task, stored with its preconditions, checks, failure modes and the evidence of its runs (run records and camera frames). A later session, on a new task or in a new scene, reads the library, runs or composes the skills that match, and merges back what it improves. main holds the protocol. , with one folder per skill. Each library's harness lives in the RAX repository, which also documents the robot's tools: real/rainbow and real/franka. 1. Read INDEX.md and open only the skills that match your task. 2. Check each skill's preconditions against your scene. 3. Run its entry through the robot's harness context (ctx).

README


RAX is the general harness: a coding agent (Claude Code or Codex CLI) drives a robot through perception and control tools, with no demonstrations, and compiles what worked into code. This repository keeps what those agents learned on real robots.

Each skill is an executable procedure the agent wrote while it explored a task, stored with its preconditions, checks, failure modes and the evidence of its runs (run records and camera frames). A later session, on a new task or in a new scene, reads the library, runs or composes the skills that match, and merges back what it improves.

 explore a task ──► write a skill ──► merge into the library
        ▲                                     │
        └──── next session reads, reuses ◄────┘
              and composes the skills

🌿 Libraries

main holds the protocol. Each robot embodiment has its own branch, with one folder per skill.

Branch Robot Skills Status
rby1 Rainbow RB-Y1: wheeled base, 6-joint torso, two 7-DoF arms, grippers, head ZED 2i bimanual box and bucket pick-and-place, office-chair tuck, cup stacking, whole-body hand reach, and a six-step room tidy that composes them ✅ 6 skills
franka Franka FR3: one 7-DoF arm, Franka Hand, two exterior cameras and a wrist camera find the cube, air fryer, wipe the table, peg-in-hole, Bandu tower ✅ 5 skills

Each library’s harness lives in the RAX repository, which also documents the robot’s tools: real/rainbow and real/franka.

🚀 Using a skill

git clone -b rby1 https://github.com/robot-agent-exploration/skills-lib.git skill-library
  1. Read INDEX.md and open only the skills that match your task.
  2. Check each skill’s preconditions against your scene.
  3. Run its entry through the robot’s harness context (ctx).

Inside RAX this happens automatically: the harness clones the robot’s library into each session’s workspace and gives the agent the continual-learning skill to read, run and grow it. RAX’s real-robot adaptation guide sets this up for every new robot; real/rainbow is the reference.

📁 Layout of a library

README.md                    the robot and where its skills came from
INDEX.md                     one row per skill: status, what it does, when to use it
skills//
  SKILL.md                   when to use, preconditions, procedure, code, checks,
                             failure modes, evidence
  code/run.py                the entry: main(ctx, ...) -> {ok, measured, why}
  code//            its modules, a package named after the skill
  evidence/runs.jsonl        one record per run of the code: outcome, unattended, conditions, checks
  evidence/images/           frames of those runs

A skill’s status follows its evidence:

Status Meaning
draft Automated and documented.
verified At least two unattended, successful runs of the committed code.
deprecated Superseded; names what replaces it.

🤝 Contributing

CONTRIBUTING.md covers what to contribute, how to keep skills modular so new tasks can compose them, the format and evidence rules, and how to commit and merge into an embodiment branch. Check a contribution with scripts/check_skills.py before opening a pull request; the embodiment branches run it on every push and pull request. To bring a robot that has no branch yet, follow NEW_ROBOT.md.

📝 Citation

These skills come from sessions of RAX: Scaling Online Exploration for Robot Agents. If you use them, please cite:

@misc{huang2026scaling,
  title        = {Scaling Online Exploration for Robot Agents},
  author       = {Huang, Runhan and Zhang, Xiangcheng and Chen, Haoyu
                  and Li, Yitong and Wang, Yen-Jen and Lyu, Bohan
                  and Ye, Haotian and Hong, Chuye and Wang, Yixuan
                  and Su, Chloe and Xiong, Haoyu and Wu, Yangzhen
                  and Xie, Enze and Manderson, Travis and Ermon, Stefano
                  and Abbeel, Pieter and Torralba, Antonio and Song, Dawn
                  and Ye, Weirui and Du, Yilun},
  year         = {2026},
  howpublished = {Preprint},
  url          = {https://robot-agent-exploration.com/}
}
View the full README on GitHub

Recommended Tools

Try a different keyword or remove a filter.

Install

npx skillfish add robot-agent-exploration/skills-lib
New to MCP? Start with the mcpskill.org guide →