MMCPMarkets
GO

greedygains/omniget-mcp-server

开发工具

本页由 AI 翻译，技术细节请以原文为准。 查看原文

6 stars 5 forks 质量 79 趋势 22GPL-3.0
Repository Install

Universal Social Media & Web Extraction MCP Server for AI Agents — 100% Headless Native Rust (Forked & Enhanced by Greedy Gains)

概览

*Originally created by tonhowtf | Re-architected, enhanced & maintained as a standalone headless Rust edition by for non-commercial community benefit.* is an ultra-fast, headless Model Context Protocol (MCP) server and REST API built in . It equips AI Agents (such as Claude Desktop, Cursor, and ChatGPT) with the ability to extract, parse, and ingest rich content from social networks, modern web articles, and documents in real time. Unlike traditional scrapers that rely on heavy browser automation (Chromium / Puppeteer / Playwright), OmniGet MCP operates using asynchronous Rust HTTP engines and embedded state decoders. It responds in , consumes less than , and runs seamlessly in minimal container environments. - : Zero browser overhead. No Chromium, No WebKit, and No X11 libraries required. - : - Extracts without text truncation (...). - Decodes embedded Relay/GraphQL state and Bloks data structures directly from raw HTML.

README

以下为原文 README 节选，完整内容请查看原文。

OmniGet MCP Server (Headless Rust Edition)

Universal Social Media, Web & Document Extraction Engine for AI Agents
Originally created by tonhowtf | Re-architected, enhanced & maintained as a standalone headless Rust edition by Greedy Gains for non-commercial community benefit.

💡 Overview

OmniGet MCP Server is an ultra-fast, headless Model Context Protocol (MCP) server and REST API built in Native Rust. It equips AI Agents (such as Claude Desktop, Cursor, and ChatGPT) with the ability to extract, parse, and ingest rich content from social networks, modern web articles, and documents in real time.

Unlike traditional scrapers that rely on heavy browser automation (Chromium / Puppeteer / Playwright), OmniGet MCP operates 100% headlessly using asynchronous Rust HTTP engines and embedded state decoders. It responds in 1–2 seconds, consumes less than 30 MB of RAM, and runs seamlessly in minimal container environments.

✨ Key Features

  • 🚀 100% Headless Native Rust: Zero browser overhead. No Chromium, No WebKit, and No X11 libraries required.
  • 📱 Facebook Post & Media Extraction (Breakthrough):
    • Extracts 100% complete, untruncated captions without text truncation (...).
    • Decodes embedded Relay/GraphQL state and Bloks data structures directly from raw HTML.
    • Automatically resolves share links and slugged URLs into canonical formats, bypassing cloud datacenter login walls.
    • Retrieves high-resolution photo galleries, video streams, and hashtags.
  • 📸 Instagram Posts, Reels & Carousels:
    • Full caption and hashtag extraction.
    • Multi-image carousel parsing with direct CDN asset URLs.
  • 🐦 X / Twitter Thread Unrolling:
    • Extracts single posts (x_post) with media and metrics.
    • Unrolls full multi-tweet threads (x_thread) into continuous, structured reading material.
  • 🌐 Universal Web-to-Markdown:
    • Strips ads, navigation, scripts, and clutter from any public article.
    • Converts web pages into clean, token-efficient Markdown optimized for LLMs.
  • 📄 PDF Document Extraction:
    • Ingests and extracts clean plain-text from remote URLs or local PDF files.
  • 🎬 Universal Media Info:
    • Powered by yt-dlp integration supporting metadata extraction for 1,800+ media sites.
  • 🔒 Enterprise-Grade Security:
在 GitHub 查看完整 README

安装

docker run -d \
新手？先看 mcpskill.org 教程 →

配置

{ "mcpServers": { "omniget": { "url": "https://<your-domain>.up.railway.app/sse?token=<YOUR_AUTH_TOKEN>" } } }