
代理技能,用于准备配备NVIDIA GPU的Linux服务器以处理LLM工作负载——驱动程序和CUDA,Docker与NVIDIA Container Toolkit,分阶段验证门,vLLM的组合预设,Infinity,...
概览
这是一项代理技能,可以为神经网络和大型语言模型工作负载做好准备——从裸露的Debian/Ubuntu安装到经过验证的Docker + GPU推理栈。这是一个可移植的技能:安装在Claude Code、Cursor或OpenAI Codex中,或者将文件夹放入任何能读取 SKILL.md 的代理中。 基于作者的两个实地测试来源:Dzen 文章《Как подготовить Linux к запуску и обучению нейросетей?(+ Docker)》以及一份多GPU推理服务器的生产环境运行手册。 - — 来自官方CUDA apt仓库(CUDA-Keyring),包含开放与专有内核模块选择、仅驱动与工具包的选择、通过更新替代方案实现多CUDA以及版本钉钉。- — 精确的运行中内核头部加上跟踪元包(标准Debian为Linux-headers-amd64;与其他内核版本相符),重启前已安装内核的头部和NVIDIA模块经过验证。内核升级不得在下一次启动时无声禁用GPU。
概述(AI 翻译)
一个代理技能,用于准备搭载NVIDIA或Intel Arc GPU的Linux服务器
用于神经网络和大型语言模型工作负载——从裸Debian/Ubuntu安装到一个
验证了Docker + GPU推理栈。这是一个便携技能:安装在
Claude Code、Cursor 或 OpenAI Codex,或者把文件夹放进任何代理
读数为SKILL.md。
基于作者经过实地验证的两个来源:Dzen文章 “Как подготовить Linux к запуску и обучению нейросетей?(+ Docker)” 以及多GPU推理服务器的生产环境运行手册。英特尔弧 部分原因是2026年在Debian 13上搭建了双Arc A770服务器。
它的作用
- NVIDIA 驱动 + CUDA — 来自官方 CUDA apt 仓库(cuda-keyring),
在开放与专有内核模块选择中,仅驱动 VS 工具包
判定、通过
update-alternatives进行多CUDA处理,以及版本钉定。 - 强制内核头 — 精确运行内核头加上跟踪
metapackage(
linux-headers-amd64)在标准Debian上;匹配内核味道 其他地方),并验证了已安装内核的头部和NVIDIA模块 在重启之前。内核升级不能在下一次启动时无声禁用GPU。
本页由 AI 翻译,技术细节请以原文为准。
README
以下为原文 README 节选,完整内容请查看原文。
gpu-server-setup
An agent skill that prepares a Linux server with NVIDIA or Intel Arc GPUs
for neural-network and LLM workloads — from a bare Debian/Ubuntu install to a
verified Docker + GPU inference stack. It is a portable skill: install it in
Claude Code, Cursor, or OpenAI Codex, or drop the folder into any agent that
reads SKILL.md.
Based on two field-tested sources by the author: the Dzen article “Как подготовить Linux к запуску и обучению нейросетей? (+ Docker)” and a production setup runbook for multi-GPU inference servers. The Intel Arc part comes from bringing up a dual Arc A770 server on Debian 13 in 2026.
What it does
- NVIDIA driver + CUDA — from the official CUDA apt repo (cuda-keyring),
with the open-vs-proprietary kernel-module choice, driver-only vs toolkit
decision, multi-CUDA via
update-alternatives, and version pinning. - Mandatory kernel headers — exact running-kernel headers plus the tracking
metapackage (
linux-headers-amd64on standard Debian; match the kernel flavour elsewhere), with headers and NVIDIA modules verified for installed kernels before a reboot. A kernel upgrade must not silently disable GPUs on the next boot. - Intel Arc (Alchemist and Battlemage) — the in-tree i915/xe driver with
distro firmware, Resizable BAR and real PCIe link checks, the
trixie-backports kernel when the host must see GPU temperatures, Docker
access through
/dev/drirender nodes with no toolkit, and a field-tested map of what serves on Arc today: llama.cpp SYCL/Vulkan, Ollama, OpenVINO Model Server, vLLM on Battlemage and a no-build vLLM recipe for the A770, plus measured i915 against xe on a pair of A770: what the force-probed xe driver gives (up to 5x for vLLM, 2x for llama.cpp) and what it costs (a card that can wedge until a reboot, runtime PM to switch off). - Docker + NVIDIA Container Toolkit — official Docker Engine install,
nvidia-ctk runtime configure, and explicit GPU passthrough (--gpus, composedeployblocks, per-servicedevice_idspinning). - Staged verification — hard gates between layers (
lspci→nvidia-smior i915/xe + render nodes + GuC → GPU-in-Docker → service health); the skill never proceeds past a failing gate.scripts/check.shdetects the vendor and runs the gates automatically. - Inference presets (optional) — the mandatory deliverable is the verified Docker + GPU base; serving stacks go on top only when asked for. Ready docker-compose files for vLLM (per-GPU model services), Infinity (embeddings), OpenWebUI (web UI) and Ollama (llama.cpp runs the same way via its official image), with the flags that matter explained.
- GPU power limit — on request: query the card’s allowed range, cap with
nvidia-smi -plor Intel hwmonpower1_max, verify the limit took effect, persist it across reboots with a systemd unit (scripts/arc-power-cap.shfor Intel).
推荐工具
换一个关键词,或者移除筛选条件。
安装
npx skillfish add evilfreelancer/gpu-server-setup