zai-org/glm-ocr

GLM-OCR

中文阅读

👋 WeChatとDiscordコミュニティに参加しましょう

📖 GLM-OCRの技術レポートをご覧ください

📍 GLM-OCRのAPIをご利用ください

モデル紹介

GLM-OCRは、GLM-Vエンコーダ–デコーダアーキテクチャ上で構築された複雑な文書理解のためのマルチモーダルOCRモデルです。マルチトークン予測(MTP)損失と安定した全タスク強化学習を導入し、訓練効率、認識精度、一般化を向上させます。このモデルは、大規模な画像・テキストデータ上で事前学習されたCogViTビジュアルエンコーダ、効率的なトークンダウンサンプリングを備えた軽量クロスモーダルコネクタ、GLM-0.5B言語デコーダを統合しています。PP-DocLayout-V3に基づくレイアウト解析と並列認識の2段階パイプラインと組み合わせることで、GLM-OCRは多様なドキュメントレイアウトにおいて堅牢かつ高品質なOCR性能を提供します。

主な特徴

• 最先端性能:OmniDocBench V1.5で94.62点を獲得し、総合#1位、公式認識、テーブル認識、情報抽出など主要な文書理解ベンチマークで最先端の成果を提供します。

GLM-OCR

中文阅读

👋 Join our WeChat and Discord community

📖 Check out the GLM-OCR technical report

📍 Use GLM-OCR's API

Model Introduction

GLM-OCR is a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture. It introduces Multi-Token Prediction (MTP) loss and stable full-task reinforcement learning to improve training efficiency, recognition accuracy, and generalization. The model integrates the CogViT visual encoder pre-trained on large-scale image–text data, a lightweight cross-modal connector with efficient token downsampling, and a GLM-0.5B language decoder. Combined with a two-stage pipeline of layout analysis and parallel recognition based on PP-DocLayout-V3, GLM-OCR delivers robust and high-quality OCR performance across diverse document layouts.

Key Features

• State-of-the-Art Performance: Achieves a score of 94.62 on OmniDocBench V1.5, ranking #1 overall, and delivers state-of-the-art results across major document understanding benchmarks, including formula recognition, table recognition, and information extraction.

• Optimized for Real-World Scenarios: Designed and optimized for practical business use cases, maintaining robust performance on complex tables, code-heavy documents, seals, and other challenging real-world layouts.

• Efficient Inference: With only 0.9B parameters, GLM-OCR supports deployment via vLLM, SGLang, and Ollama, significantly reducing inference latency and compute cost, making it ideal for high-concurrency services and edge deployments.

• Easy to Use: Fully open-sourced and equipped with a comprehensive SDK and inference toolchain, offering simple installation, one-line invocation, and smooth integration into existing production pipelines.

News & Updates

• [2026.3.12] GLM-OCR SDK now supports agent-friendly Skill mode — just pip install glmocr + set API key, ready to use via CLI or Python with no GPU or YAML config needed. See: GLM-OCR Skill
• [2026.3.12] GLM-OCR Technical Report is now available. See: GLM-OCR Technical Report
• [2026.2.12] Fine-tuning tutorial based on LLaMA-Factory is now available. See: GLM-OCR Fine-tuning Guide

Download Model

| Model | Download Links | Precision |