Training loops and worked examples for RL (GRPO, IGPO, SAO/PPO), preference optimization (DPO, ORPO), SFT, distillation and embedding fine-tuning on Fireworks. Full docs: Training API.
Overview
Training loops and worked examples for RL (GRPO, IGPO, SAO/PPO), preference optimization (DPO, ORPO), SFT, distillation and embedding fine-tuning on Fireworks. Full docs: Training API.
README
Fireworks AI Cookbook
Training loops and worked examples for RL (GRPO, IGPO, SAO/PPO), preference optimization (DPO, ORPO), SFT, distillation and embedding fine-tuning on Fireworks. Full docs: Training API.
Quick Start
git clone https://github.com/fw-ai-external/cookbook.git
cd cookbook/training
uv venv --python 3.12 && source .venv/bin/activate
uv pip install -e .
See training/README.md for recipes and examples.
For AI Agents
These skills bring Fireworks training know-how into compatible AI agents through progressive disclosure. Each entry point loads only the workflow guidance needed for the task, then follows linked Fireworks documentation and runnable cookbook examples when deeper detail is needed. The skill set provides three task-specific skills: research, configure, and debug.
| Skill | What it does | Try |
|---|---|---|
| Research | Helps decide whether training is the right intervention. It gathers the task, data, evaluation criteria, and constraints, then recommends a method and the closest runnable cookbook entry. It does not launch training. | “Which cookbook entry fits prompt routing to small vs big models?” |
| Configure | Turns a training goal into an executable plan for managed SFT, DPO, ORPO, or RFT, as well as serverless or dedicated Training API setups. It validates inputs, estimates cost, and supports running, monitoring, evaluation, deployment, resume, and teardown. It shows the complete plan and asks for approval before spend or mutation. | “SFT qwen3-8b on my JSONL. Show the plan, but do not start yet.” |
| Debug | Diagnoses stuck, failed, slow, or low-quality training runs. It gathers runtime evidence, classifies the failure, suggests the safest next action, and does not retry or mutate resources without approval. | “My job is stuck RUNNING at 0%.” |
Claude Code
claude plugin marketplace add fw-ai-external/cookbook
claude plugin install fireworks-training@fw-ai-cookbook
Cursor
npx --yes skills add fw-ai-external/cookbook -g \
-s fireworks-training -s research -s configure -s debug -a cursor -y
Codex
npx --yes skills add fw-ai-external/cookbook -g \
-s fireworks-training -s research -s configure -s debug -a codex -y
The repository also includes .codex-plugin/plugin.json
for packaging the skill set as a Codex plugin. The skills use portable Agent
Skills Markdown and can be consumed by other compatible agents. The commands
above cover the three validated installation paths. firectl may still require
mutating commands to be run manually in the user’s terminal when its AI-agent
safety guard is active.
Repository Structure
training/ Training API cookbook (primary surface)
recipes/ One training loop per file; fork to change the algorithm
utils/ Pieces recipes assemble: config, data, losses, rollout, metrics
examples/ Task code + one recipe call (dedicated and serverless twins)
case-studies/ End-to-end notebooks
eval/ Reproducible evaluation packages and benchmark adapters
skills/ Research, configure and debug agent workflows
archived/ Legacy integrations and earlier cookbook content
Evaluations
eval/healthbench_professional/— run OpenAI’s HealthBench Professional through Harbor, preserve exact Fireworks input/output token IDs and behavior-policy logprobs, and export validated trajectories for RL workflows.
Contributing
See the Contribution Guide.
Support
Recommended Tools
Try a different keyword or remove a filter.
Install
npx skillfish add fw-ai/cookbook