remote-gpu-trainer

Train on rented GPUs with your coding agent, without losing checkpoints or paying for idle machines.

English · 中文简介

Renting a GPU is the easy part. The costly surprises come later: a teardown that deletes the only copy of your checkpoints, a “stopped” machine that keeps billing, a job that looks busy but went wrong hours ago.

remote-gpu-trainer is an Agent Skill for Claude Code, Codex and other coding agents. It lets your agent launch, monitor, resume and stop training on AutoDL, RunPod, vast.ai, Lambda, Paperspace, four other Chinese GPU clouds or any machine you can SSH into, and bring back checkpoints that are verified, not just copied.

What it prevents

• Losing checkpoints at teardown. Releasing an AutoDL instance or terminating a RunPod Pod deletes its disk. The agent releases nothing until every file has been read back somewhere independent, hashed, loaded and re-scored, and you have said yes.
• Paying for idle machines. A stopped RunPod Pod bills its volume at twice the running rate, a stopped vast.ai instance bills its disk indefinitely, and sudo shutdown on Lambda leaves the meter running. The skill knows which action actually stops each meter.
• Silent timers. AutoDL releases a stopped instance after 15 days, data disk included, and RunPod and vast.ai can delete instances and storage when your balance runs out. The agent tells you about these the first time you use a platform.
• Runs that look alive but are not learning. A live process and a scrolling log are not health. Status reports compare the metric with a reference run at the same epoch and say how old the data is.
• OOM, NaN, hangs and all-zero metrics. OOM on step 2, NaN after a precision change, one crashed rank hanging the rest, a resume that restarts at epoch 0, a starved GPU, mAP stuck at zero while the loss falls: each is looked up by symptom, with its root cause and fix.
• Numbers that are not real. Before a result is reported, the agent states the seed, changes one variable at a time, checks for leakage and decides whether a gap is a bug, a real effect or noise.

Install

Let your agent do it. Paste this into Claude Code, Codex, Cursor, Gemini CLI or GitHub Copilot:

Install the remote-gpu-trainer agent skill. Read
https://raw.githubusercontent.com/Hanyuyuan6/remote-gpu-trainer/main/README.md
and follow its "For AI agents" section for this host. Then tell me
where you installed it and how you confirmed it loaded.

Or clone it yourself. For Claude Code:

git clone https://github.com/Hanyuyuan6/remote-gpu-trainer.git \
  ~/.claude/skills/remote-gpu-trainer