KO

karust/openserp

Developer tools
1.5K stars 182 forks Quality 89 Trend 74MIT

Self-hosted web search for AI agents and SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, rendered in a real browser: ranked results and clean page Markdown. API, CLI, MCP 🎉

Overview

OpenSERP is a REST API and CLI for Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia. No API keys, no per-search billing. It loads search results in browser and returns structured JSON with source engines and ranks. Read the linked pages as clean Markdown, or connect an agent through MCP. Works with Claude Code, Cursor, Codex, Claude Desktop and any MCP client, Open WebUI (built-in provider), n8n, and plain HTTP from any language. Prebuilt binaries for Linux, macOS and Windows are on the releases page. Images: karust/openserp. Requires Node.js 18+ and a running OpenSERP server. Add the MCP server to your client: Cursor (~/.cursor/mcp.json), Claude Desktop, Windsurf and other clients: On native Windows, use cmd /c npx -y @openserp/mcp after -- in the CLI commands, or "command": "cmd", "args": ["/c", "npx", "-y", "@openserp/mcp"] in JSON. For a remote server, add "env": { "OPENSERP_BASE_URL": "http://your-host:7000" } to the openserp JSON entry.

README

OpenSERP

OpenSERP is a free self-hosted web search for AI agents and SEO. REST API and CLI for Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia.

No API keys, no per-search billing. It loads search results in browser and returns structured JSON with source engines and ranks. Read the linked pages as clean Markdown, or connect an agent through MCP.

Works with Claude Code, Cursor, Codex, Claude Desktop and any MCP client, Open WebUI (built-in provider), n8n, and plain HTTP from any language.

API examples · CLI · Agent setup · API reference

Quick Start

# Start the API server
docker run --rm -p 127.0.0.1:7000:7000 karust/openserp serve -a 0.0.0.0 -p 7000

# Search Google and read the top result as Markdown
curl "http://127.0.0.1:7000/google/search?text=how+do+mcp+servers+work&extract=1"

Use with AI Agents

MCP: Claude Code, Codex, Cursor, Claude Desktop

Requires Node.js 18+ and a running OpenSERP server. Add the MCP server to your client:

claude mcp add openserp -- npx -y @openserp/mcp
codex mcp add openserp -- npx -y @openserp/mcp

Cursor (~/.cursor/mcp.json), Claude Desktop, Windsurf and other clients:

{
  "mcpServers": {
    "openserp": { "command": "npx", "args": ["-y", "@openserp/mcp"] }
  }
}

On native Windows, use cmd /c npx -y @openserp/mcp after -- in the CLI commands, or "command": "cmd", "args": ["/c", "npx", "-y", "@openserp/mcp"] in JSON.

For a remote server, add "env": { "OPENSERP_BASE_URL": "http://your-host:7000" } to the openserp JSON entry.

Tools: search, mega_search, fast_search, any_search, image_search, mega_image, extract, batch_extract, list_engines. Then just ask: “Search Google for the latest Postgres release, read the top 2 results and answer with links.”

Optional for Claude Code: copy skills/openserp-search to ~/.claude/skills/ so the agent searches, reads and falls back to another engine the same way every time.

Open WebUI

OpenSERP is a built-in web search provider. In Settings > Admin > Web Search pick openserp and set the URL (http://host.docker.internal:7000 if Open WebUI runs in Docker). See the Open WebUI guide.

In your own agent

A search tool for any LLM framework is a few lines with the SDK:

from openserp import OpenSERP

def web_search(query: str) -> list[dict]:
    """Search Google and return ranked results for the model."""
    with OpenSERP(base_url="http://localhost:7000") as client:
        res = client.search(engine="google", text=query, limit=10)
        return [
            {"rank": r.rank, "title": r.title, "url": r.url, "snippet": r.snippet}
            for r in res.results if r.type == "organic"
        ]
import { OpenSERP } from "@openserp/sdk";

const client = new OpenSERP({ baseUrl: "http://localhost:7000" });
const { results } = await client.search({ engine: "google", text: "openserp", limit: 5 });
Package Install Source
@openserp/mcp - MCP server npx -y @openserp/mcp openserpapi/mcp
@openserp/sdk - JS / TS npm install @openserp/sdk openserpapi/sdk-js
openserp - Python pip install openserp openserpapi/sdk-python
@openserp/n8n-nodes-openserp Install via n8n community nodes openserpapi/n8n

More in examples: agent tools, RAG context, SEO rank tracking, extraction and image search.

Response Example

GET /google/search?text=how+do+mcp+servers+work&extract=1 (trimmed):

{
  "query": { "text": "how do mcp servers work", "engines_requested": ["google"] },
  "meta": { "took_ms": 4353, "engines_failed": [], "version": "2.1" },
  "results": [
    {
      "rank": 1,
      "type": "organic",
      "engine": "google",
      "title": "What Is the Model Context Protocol (MCP) and How It Works",
      "url": "https://www.descope.com/learn/post/mcp",
      "domain": "descope.com",
      "snippet": "MCP is an open standard that lets AI applications connect to external tools, data, and services through a client-server protocol built on JSON-…",
      "position": { "absolute": 1 },
      "extracted": {
        "format": "markdown",
        "content": "The Model Context Protocol (MCP) is an open standard that defines how AI applications connect to external tools, data sources, and services. MCP clients inside AI apps send requests to MCP servers, ..."
      }
    },
    {
      "rank": 2,
      "type": "organic",
      "engine": "google",
      "title": "No Dumb Questions: What is an MCP server and why do I ...",
      "url": "https://stackoverflow.blog/2026/05/08/no-dumb-questions-mcp",
      "domain": "stackoverflow.blog"
    }
  ]
}

Results keep their source engine and rank. Ads are typed separately from organic results; extract=N attaches up to N organic pages as Markdown and records per-page failures in extracted.error. Full schema in the OpenAPI spec.

Why OpenSERP

  • Browser-backed search. Chromium loads the rendered SERP, including supported answer boxes, related searches and AI summaries. Raw HTTP mode is also available for Google, Yandex, Baidu and Ecosia.
  • Six engines, one schema. Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia return the same JSON. Engine and rank survive a multi-engine merge, so you can see who ranked what.
  • Search and read in one call. extract=N adds page Markdown under the top organic results, /extract/batch reads up to 20 URLs, and a dead link comes back as an error item instead of failing the batch.
  • Yours to run. One Go binary or Docker image, with HTTP/SOCKS5 proxies, cache, retries, rate limits and circuit breakers. No per-query fees; you cover compute and proxies.

Compared to Paid Search APIs

Feature OpenSERP Cloud Tavily SerpApi Exa
Google results ✅ ✅ 🟨 Undisclosed ✅ ❌
Search engines 6 6 Own retrieval Many Exa index
Original engine ranks ✅ ✅ ❌ ✅ ❌
Page extraction ✅ Markdown, batch ✅ Markdown, batch ✅ ✅ ✅
Self-hosting ✅ ❌ ❌ ❌ ❌
SEO monitoring, rank tracking 🟨 ✅ ❌ 🟨 ❌
PR monitoring, competitor tracking 🟨 ✅ Beta 🟨 🟨 ✅ API
AI reports and alerts 🟨 ✅ 🟨 🟨 🟨
Pricing Free + infrastructure PAYG, $0.0078/credit $30/mo, 4k basic credits $25/mo, 1k searches PAYG, $4/1k Lite searches

✅ Available · 🟨 Partial, unconfirmed or requires integration · ❌ Unavailable

Search Endpoints

Engine names: google, yandex, baidu, bing, duckduckgo (also duck, ddg), ecosia.

Use a dedicated endpoint when the source engine matters, any for ordered fallback, or balanced to compare engines. Search supports JSON, Markdown, text and NDJSON, plus language, region, date, site and file filters.

Dedicated engine endpoints:

curl "http://127.0.0.1:7000/google/search?text=golang&limit=10"

Image search:

curl "http://127.0.0.1:7000/bing/image?text=golang+logo&limit=10"

Megasearch:

curl "http://127.0.0.1:7000/mega/search?text=golang&limit=10"

/mega/search returns the same envelope as engine endpoints plus clusters: results are deduplicated by normalized URL, and clusters keep the per-engine occurrences and ranks.

Mode Best for Behavior
balanced Most multi-engine SERP workflows Queries engines in parallel and merges results
fast One engine selected by latency history Uses one engine; does not fall back on failure
any Ordered fallback Tries engines in order until one succeeds, even with zero results

List engines:

curl "http://127.0.0.1:7000/mega/engines"

URL extraction:

# Extract one URL as JSON
curl "http://127.0.0.1:7000/extract?url=https://example.com&mode=auto"

# Return clean page markdown
curl "http://127.0.0.1:7000/extract?url=https://example.com&format=markdown"

# Extract several URLs at once - returns a bare [{page_content, metadata}] array
# (Open WebUI external loader compatible); failed URLs become items with metadata.error
curl -X POST "http://127.0.0.1:7000/extract/batch" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://example.com","https://go.dev"],"mode":"fast"}'

# Embed extracted content under the top organic results
curl "http://127.0.0.1:7000/google/search?text=llm+observability&extract=2&format=markdown"

No server required - query an engine straight from the terminal. The CLI shares the same engines, formats, and filters as the API.

openserp search ecosia "weather in london" --format markdown

Run openserp search --help for the full flag list. Results go to stdout, logs to stderr. Set verbosity with --log_level error|warn|info|debug|trace or OPENSERP_APP_LOG_LEVEL (CLI default: warn). serve also writes ./logs.txt unless app.save_log: false.

Query Parameters

Bing localizes by exit IP. lang sets its interface language; region sends a country hint except for US, CN and RU, which caused unrelated results in testing. For those locations, use a proxy in the target country.

Proxy Support

OpenSERP supports HTTP and SOCKS5 proxies.

./openserp serve --proxy socks5://127.0.0.1:1080
./openserp search bing "query" --proxy http://user:[email protected]:8080

Engines can return CAPTCHAs, rate limits or unrelated results. Browser mode does not eliminate these; try another engine or a proxy when needed.

Advanced proxy configuration is available in config.yaml. You can enable tagged proxy pools and per-request override via X-Use-Proxy: or X-Use-Proxy: direct.

API Docs

Once the server is running, the interactive docs are available locally:

  • Swagger UI: http://127.0.0.1:7000/docs - full schemas, error shapes, and the /health, /ready, /stats/* endpoints
  • OpenAPI YAML: http://127.0.0.1:7000/openapi.yaml

To browse the spec without running the server, see docs/openapi.yaml. For how OpenSERP works internally, see the architecture docs.

Contributing

Contributions are welcome. See docs/CONTRIBUTING.md.

License

MIT. See LICENSE.

Feedback & Updates

  • GitHub Issues - bugs, feature ideas, and reproducible issues.
  • [email protected] - private notes, longer feedback, or anything that does not fit GitHub Issues.
  • Telegram - OpenSERP news, release notes, and project updates.

OpenSERP is free and open-source. Only links listed in this repository and on openserp.org are associated with the project.

View the full README on GitHub

Install

npx -y @openserp/mcp
New to MCP? Start with the mcpskill.org guide →

Configuration

{ "mcpServers": { "openserp": { "command": "npx", "args": ["-y", "@openserp/mcp"] } } }