이 패키지는 강력한 MCP 서버를 제공하여 웹 액세스와 LLM을 장착하고 검색, fetching 및 추출 콘텐츠의 네이티브 방법을 넘어갑니다.

소개

나는 대부분의 MCP 서버가 LLMs에 웹 액세스를 가능하게하는 frustration에서이 패키지를 만들었습니다. 이러한 단점 중 일부는 수정을 원했습니다.:

• [x] API 키 필요 없이 좋은 검색 결과
• [x] 좀 더 복잡한 JavaScript 사이트에 대한 정교한 fetching
• [x] 잘 포맷 된 Markdown에 콘텐츠 추출
• [x] PDF에서 콘텐츠를 추출하는 지원
• [x] 적재 및 표시 이미지 지원
• [x] 웹 스크린 샷 캡처
• [x] Load Raw HTML과 같은 고급 케이스에 대한 사용 옵션

설치

Claude 데스크탑

Claude 코드

또는 Brave Search API 키 설정:

Perplexity Search API key를 제공하여 신선하고 감칠 수 없는 인덱스를 우선적으로 제공합니다.

Perplexity에서 Brave로 다시 떨어지는 환경 변수를 모두 섞을 수 있습니다.

내부

패키지는 hood에서 강력한 라이브러리 및 서비스를 사용하여 Python으로 작성됩니다.

검색

MCP Web Tools

This package provides a powerful MCP server to equip LLMs with web access, going beyond naive methods of searching, fetching and extracting content.

Introduction

I created this package out of the frustration that most MCP servers enabling web access to LLMs, didn’t perform as well as I hoped. Some of these shortcomings I wanted fix, include:

• [x] Good search results without requiring an API key
• [x] Sophisticated fetching for more complex JavaScript sites
• [x] Extracting content in nicely formatted Markdown
• [x] Support for extracting content from PDFs
• [x] Support for loading and displaying images
• [x] Capture rendered webpage screenshots for visual context
• [x] Usage options for advanced cases like loading raw HTML

Installation

Claude Desktop

Claude Code

claude mcp add web-tools uvx mcp-web-tools

Or to also set the Brave Search API key:

claude mcp add web-tools uvx mcp-web-tools -e BRAVE_SEARCH_API_KEY=

Provide a Perplexity Search API key to prioritize their fresh, citation-rich index:

claude mcp add web-tools uvx mcp-web-tools -e PERPLEXITY_API_KEY=

You can mix both environment variables to fall back from Perplexity to Brave seamlessly.

Internals

The package is written in Python using powerful libraries and services under the hood to improve results.

Searching

We use the Perplexity Search API when a PERPLEXITY_API_KEY is configured. It delivers ranked snippets with citations from Perplexity’s continuously refreshed index. If no Perplexity key is available, we fall back to the Brave Search API (via BRAVE_SEARCH_API_KEY), then a lightweight Google workaround, and finally DuckDuckGo. While we recommend adding at least one API key, the chained fallbacks continue working for most workloads.

Fetching

The fetching of web content is based on Zendriver, a fork of nodriver for next level webscraping and performance. It should stay undetected for most anti-bot solutions and fetch content even from complex JS-based sites.

Extracting

For web extraction, we use Trafilatura which consistently outperforms other alternatives for extracting content from HTML pages. For PDFs, we use PyMuPDF4LLM which similarly extracts content in an easy-to-read format for LLMs, with advanced layout support.

Screenshots