Integration support policy
For production environments, GX recommends using GX Cloud integrations.
GX uses libraries such as Pandas, Spark, and SQLAlchemy to integrate with different Data Sources. This also allows you to deploy GX with community-supported integrations.
Levels of support
The following are the levels of support provided by GX:
-
GX Cloud - GX Cloud supported integrations are available in GX Cloud. They are tested and are actively maintained with new GX Cloud releases.
-
GX Core - GX Core supported integrations are available in GX Core. They are tested and are actively maintained with new GX Core releases.
-
Community - Community supported integrations were initially implemented by GX or the community. It is up to the community for ongoing maintenance
Integrations
The following table defines the GX Cloud, GX Core, and Community Supported integrations.
| Integration Type | GX Cloud | GX Core | Community |
|---|---|---|---|
| Data Sources1 | Snowflake Databricks (SQL) PostgreSQL2 | Snowflake Databricks (SQL) PostgreSQL SQLite BigQuery Spark Pandas | MSSQL MySQL |
| Configuration Stores3 | In-app | File system | None |
| Data Doc Stores | In-app | File system | None |
| Actions | Slack Microsoft Teams Custom4 | None | |
| Credential Stores | Environment variables | Environment variables YAML5 | None |
| Orchestrator | Airflow 6 7 | Airflow 6 7 | None |
1 We've also seen GX work with the following data sources in the past but we can't guarantee ongoing compatibility. These data sources include Clickhouse, Vertica, Dremio, Teradata, Athena, EMR Spark, AWS Glue, Microsoft Fabric, Trino, Pandas on (S3, GCS, Azure), Databricks (Spark), and Spark on (S3, GCS, Azure).
2 Support for BigQuery in GX Cloud will be available in a future release.
3 This includes configuration storage for Expectations, Checkpoints, Validation Definitions, and Validation Results.
4 We support the general workflow for creating custom Actions but cannot help troubleshoot the domain-specific logic within a custom Action.
5 Use config_variables.yml.
6 Although only Airflow is supported, GX Cloud and GX Core should work with any orchestrator that executes Python code.
7 Airflow version 2.9.0+ required.
GX components
The following table defines the GX components supported by GX Cloud and GX Core.
| Component | GX Cloud | GX Core | Community |
|---|---|---|---|
| Expectations | See Available Expectations | See Expectations Gallery | See Legacy Gallery |
| GX Agent | All versions | N/A | N/A |
Operating systems
The following table defines the operating systems supported by GX Cloud and GX Core.
| GX Cloud | GX Core | Community |
|---|---|---|
| Mac/Linux 1 | Mac/Linux | Mac/Linux |
1 GX does not currently support Windows. However, we've seen users successfully deploying GX on Windows.
Python versions
The following table defines the Python versions supported by GX Cloud and GX Core. GX typically follows the Python release cycle.
| GX Cloud | GX Core | Community |
|---|---|---|
| 3.9 to 3.12 | 3.9 to 3.12 | 3.9 to 3.12 |
GX versions
The following table defines the GX versions supported by GX Cloud and GX Core.
| GX Cloud | GX Core | Community |
|---|---|---|
| ≥1.0 | ≥1.0 | ≥1.0 |
Web browsers
The following web browsers are supported by GX Cloud.
-
Google Chrome — the latest version is fully supported
-
Mozilla Firefox — the latest version is fully supported
-
Apple Safari — the latest version is fully supported
-
Microsoft Edge — the latest version is fully supported