SM

scrapeeverything/mcp

开发工具

本页由 AI 翻译,技术细节请以原文为准。 查看原文

3 stars 0 forks 质量 87 趋势 24MIT

MCP server for Scrape Everything. Public social data as clean JSON from Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch, in Claude, Cursor, VS Code and any MCP client.

概览

An MCP server for Scrape Everything. Public social data as clean JSON. It lets Claude, Cursor, VS Code, Windsurf and any other MCP client fetch public data from Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch. - At startup the server reads the live catalog from GET /v1/scrapers and registers a tool for each scraper (instagram_profile, tiktok_posts, youtube_transcript, ...). New endpoints appear without a package update. - If the catalog can't be fetched, the server starts from a bundled snapshot. - Every tool description lists its credit cost and the fields it returns. Failed calls are refunded. - API errors come back as tool errors that keep the error code and request_id. On RATE_LIMITED the error includes the Retry-After wait. The server never retries on its own. - Results are JSON text, truncated at 100k characters by default, with a note when that happens. - The only network calls go to the Scrape Everything API.

README

以下为原文 README 节选,完整内容请查看原文。

Scrape Everything MCP server

An MCP server for Scrape Everything. Public social data as clean JSON. It lets Claude, Cursor, VS Code, Windsurf and any other MCP client fetch public data from Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch.

  • One tool per API endpoint. At startup the server reads the live catalog from GET /v1/scrapers and registers a tool for each scraper (instagram_profile, tiktok_posts, youtube_transcript, …). New endpoints appear without a package update.
  • Works offline. If the catalog can’t be fetched, the server starts from a bundled snapshot.
  • Shows the cost first. Every tool description lists its credit cost and the fields it returns. Failed calls are refunded.
  • Gives readable errors. API errors come back as tool errors that keep the error code and request_id. On RATE_LIMITED the error includes the Retry-After wait. The server never retries on its own.
  • Keeps results bounded. Results are JSON text, truncated at 100k characters by default, with a note when that happens.
  • Sends no telemetry. The only network calls go to the Scrape Everything API.

Get an API key

Create a key at . Keys look like ssk_live_....

Install

Claude Code

claude mcp add scrapeeverything -e SCRAPEEVERYTHING_API_KEY=ssk_live_... -- npx -y @scrapeeverything/mcp

Claude Desktop

Edit claude_desktop_config.json (Settings, then Developer, then Edit Config):

{
  "mcpServers": {
    "scrapeeverything": {
      "command": "npx",
      "args": ["-y", "@scrapeeverything/mcp"],
      "env": { "SCRAPEEVERYTHING_API_KEY": "ssk_live_..." }
    }
  }
}

On Windows, if npx is not found, use "command": "cmd" and "args": ["/c", "npx", "-y", "@scrapeeverything/mcp"].

Cursor

Add this to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project):

{
  "mcpServers": {
    "scrapeeverything": {
      "command": "npx",
      "args": ["-y", "@scrapeeverything/mcp"],
      "env": { "SCRAPEEVERYTHING_API_KEY": "ssk_live_..." }
    }
  }
}

VS Code (GitHub Copilot agent mode)

Add this to .vscode/mcp.json. VS Code prompts for the key and stores it securely:

{
  "inputs": [
    { "type": "promptString", "id": "scrapeeverything-key", "description": "Scrape Everything API key", "password": true }
  ],
  "servers": {
    "scrapeeverything": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "@scrapeeverything/mcp"],
在 GitHub 查看完整 README

安装

npx -y @scrapeeverything/mcp
新手?先看 mcpskill.org 教程 →

配置

{ "mcpServers": { "scrapeeverything": { "command": "npx", "args": ["-y", "@scrapeeverything/mcp"], "env": { "SCRAPEEVERYTHING_API_KEY": "ssk_live_..." } } } }