ofershap/mcp-server-scraper

Developer tools

이 페이지는 AI로 자동 번역되었습니다. 기술적인 세부 사항은 원문을 확인하세요. 원문 보기

6 stars 3 forks 품질 80 트렌드 22MIT

Repository Install

MCP server for web scraping — extract clean markdown, links, metadata from any URL

개요

Extract clean, readable content from any URL. Returns markdown text, links, and metadata. No API keys, no config. A free alternative to Firecrawl for scraping docs, blogs, and articles. Works with Claude Desktop, Cursor, VS Code Copilot, and any MCP client. No accounts or API keys needed. When you're working with an AI assistant and need to reference a docs page, a blog post, or an API reference, you usually end up copy-pasting content manually. Tools like Firecrawl solve this but require a paid API key. This server does the same thing for free. It fetches a URL, runs it through Mozilla Readability (the same engine behind Firefox Reader View), and returns clean markdown. It works well for server-rendered content like documentation sites, blog posts, and articles. It won't handle JavaScript-heavy SPAs, but for the most common use case of "read this docs page and summarize it," it does the job. Add to your MCP settings (e.g. .vscode/mcp.

README

원문 README의 일부입니다. 원문 보기.

mcp-server-scraper

Extract clean, readable content from any URL. Returns markdown text, links, and metadata. No API keys, no config. A free alternative to Firecrawl for scraping docs, blogs, and articles.

npx mcp-server-scraper

Works with Claude Desktop, Cursor, VS Code Copilot, and any MCP client. No accounts or API keys needed.

Demo built with remotion-readme-kit

Why

When you’re working with an AI assistant and need to reference a docs page, a blog post, or an API reference, you usually end up copy-pasting content manually. Tools like Firecrawl solve this but require a paid API key. This server does the same thing for free. It fetches a URL, runs it through Mozilla Readability (the same engine behind Firefox Reader View), and returns clean markdown. It works well for server-rendered content like documentation sites, blog posts, and articles. It won’t handle JavaScript-heavy SPAs, but for the most common use case of “read this docs page and summarize it,” it does the job.

Tools

Tool	What it does
`scrape_url`	Extract clean text content from a URL (Readability-powered)
`extract_links`	Get all links with href and anchor text
`extract_metadata`	Get title, description, OG tags, canonical, favicon

GitHub에서 전체 README 보기

설치

npx -y mcp-server-scraper

MCP 초보자라면? mcpskill.org 가이드부터 시작하세요 →

설정

{
  "mcpServers": {
    "scraper": {
      "command": "npx",
      "args": ["-y", "mcp-server-scraper"]
    }
  }
}