AWS Glue 是一款无服务器数据集成服务，使得从多个来源发现、准备、迁移和整合数据变得更容易，用于分析、机器学习（ML）和应用开发。 该仓库包含展示了 AWS Glue 服务的各个方面以及各种 AWS Glue 工具的示例。

你可以在另一个仓库找到AWS Glue开源的Python库：awslabs/aws-glue-libs。

开始

• 入门 AWS Glue

帮助你入门使用 AWS Glue。

• 常见问题解答与操作指南

帮助你入门使用 AWS Glue 的多种 ETL 功能，并解答一些常见问题。

工作坊

• AWS Glue 学习系列

在这个全面的系列中，你将学习从胶水基础到高级优化技巧的方方面面。

教程

将军

• 编写 AWS Glue for Spark 脚本

介绍编写AWS Glue脚本的过程。

• 使用 AWS Glue Studio 检测和处理敏感数据

引导你创建一个AWS Glue作业，在行级识别敏感数据，并创建自定义识别模式以识别案件特定的实体。

AWS Glue Samples

AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources for analytics, machine learning (ML), and application development. This repository has samples that demonstrate various aspects of the AWS Glue service, as well as various AWS Glue utilities.

You can find the AWS Glue open-source Python libraries in a separate repository at: awslabs/aws-glue-libs.

Getting Started

• Getting Started with AWS Glue

  Helps you get started using AWS Glue.

• FAQ and How-to

  Helps you get started using the many ETL capabilities of AWS Glue, and answers some of the more common questions people have.

Workshops

• AWS Glue Learning Series

  In this comprehensive series, you’ll learn everything from the basics of Glue to advanced optimization techniques.

Tutorials

General

• Writing an AWS Glue for Spark script

  Introduces the process of writing AWS Glue scripts.

• Detect and process sensitive data using AWS Glue Studio

  Guides you to create an AWS Glue job that identifies sensitive data at the row level, and create a custom identification pattern to identify case-specific entities.

• Enable self-service visual data integration and analysis for fund performance using AWS Glue Studio and Amazon QuickSight

  Demonstrates how AWS Glue Studio helps you perform near-real-time analytics, and how to build visualizations and quickly get business insights using Amazon QuickSight.

• Stream data from relational databases to Amazon Redshift with upserts using AWS Glue streaming jobs

  Guides you to setup Change data capture (CDC) from relational databases to Amazon Redshift with enriching data using Glue Streaming job.

• AWS Glue streaming application to process Amazon MSK data using AWS Glue Schema Registry

  Shows how to use a combination of Amazon MSK, the AWS Glue Schema Registry, AWS Glue streaming ETL jobs, and Amazon S3 to create a robust and reliable real-time data processing platform.

Data migration