MCPCorpus 是一个综合数据集，用于分析模型上下文协议（MCP）生态系统，包含约14K MCP服务器和300个MCP客户端，拥有20+个归一化元数据属性。

📊 数据集概述

• 规模：~14K MCP服务器+300个MCP客户端
• 属性：每个工件20+ 归一化元数据
• 来源：GitHub、社区中心、包管理器
• 应用：生态系统分析、安全研究、互操作性研究

📁 结构

🚀 快速启动

探索数据集

程序访问数据

更新数据集（可选）

📚 引用

如果你在研究中使用MCPCorpus，请引用如下：

MCPCorpus: A Large-Scale Evolvable Dataset for Model Context Protocol Ecosystem and Security Analysis

MCPCorpus is a comprehensive dataset for analyzing the Model Context Protocol (MCP) ecosystem, containing ~14K MCP servers and 300 MCP clients with 20+ normalized metadata attributes.

📊 Dataset Overview

• Scale: ~14K MCP servers + 300 MCP clients
• Attributes: 20+ normalized metadata per artifact
• Sources: GitHub, community hubs, package managers
• Applications: Ecosystem analysis, security research, interoperability studies

📁 Structure

MCPCorpus/
├── Crawler/                    # Data collection tools
│   ├── Servers/               # Server data
│   ├── Clients/               # Client data
│   ├── github_info_collector.py  # GitHub metadata collector
|   ├── data_cleaner.py        # Data normalization 
│   └── tool_extractor.py      # mcp tool extract
└── Website/                   # Web search interface
    ├── server.py              # Local web server
    └── index.html             # Search interface
    └── mcpso_servers_cleaned.json
    └── mcpso_clients_cleaned.json

🚀 Quick Start

Explore Dataset

cd Website
python server.py
# Open http://localhost:8000

Access Data Programmatically

import json
import pandas as pd

# Load datasets
with open('Crawler/Servers/mcpso_servers_cleaned.json', 'r') as f:
    servers = json.load(f)
with open('Crawler/Clients/mcpso_clients_cleaned.json', 'r') as f:
    clients = json.load(f)

# Convert to DataFrame
servers_df = pd.DataFrame(servers)
clients_df = pd.DataFrame(clients)

Update Dataset (Optional)

# Collect new data
cd Crawler/Servers && python Server_request.py
cd ../Clients && python Client_request.py

# Add GitHub metadata
cd .. && python github_info_collector.py --token YOUR_GITHUB_TOKEN

📚 Citation

If you use MCPCorpus in your research, please cite it as:

@misc{lin2025largescaleevolvabledatasetmodel,
      title={A Large-Scale Evolvable Dataset for Model Context Protocol Ecosystem and Security Analysis}, 
      author={Zhiwei Lin and Bonan Ruan and Jiahao Liu and Weibo Zhao},
      year={2025},
      eprint={2506.23474},
      archivePrefix={arXiv},
      primaryClass={cs.CR},
      url={https://arxiv.org/abs/2506.23474}, 
}