Changelog
Deprecation policy
GX Core follows Semantic Versioning 2.0.0, including its guidelines for deprecation.
When we deprecate public functionality, we will
- update our documentation to let you know about the change.
- issue a new minor release with the deprecation in place.
Before we completely remove the functionality in a new major release, there will be at least one minor release that contains the deprecation so that you can smoothly transition.
1.5.7
- [BUGFIX] change pyspark column reference from DataFrame.getitem to F.col() (#11286) (thanks @alansk97)
- [MAINTENANCE] Remove link checker step (temporarily) (#11322)
- [MAINTENANCE] Fix MSSQL compatibility test CI flow (#11320)
- [MAINTENANCE] Bump posthog 6.1.0 (#11303)
- [MAINTENANCE] Improve CI speed for marker tests (#11321)
- [MAINTENANCE] Bump form-data from 4.0.2 to 4.0.4 in /docs/docusaurus (#11310)
- [MAINTENANCE] pre-commit autoupdate (#11287)
- [MAINTENANCE] Bump mypy to 1.16.1 (#11262)
- [MAINTENANCE] Add typing extensions dependency to build (#11323)
- [MAINTENANCE] Update build commands (#11324)
1.5.6
- [BUGFIX] Remove incompatible min/max types for some range expectations (#11305)
- [DOCS] generate SQL (#11289)
- [DOCS] Data Health (#11294)
- [DOCS] Add postgres flavors to expectation docstrings (#11304)
- [DOCS] pipeline architecture diagram (#11298)
- [DOCS] Standardize data source naming in docstrings (#11306)
- [DOCS] new Data Sources (#11293)
- [DOCS] restore link checker (#11308)
- [DOCS] Data Health screenshot (#11307)
- [MAINTENANCE] : Add scripts to clean up databricks and snowflake schemas (#11297)
- [MAINTENANCE] Update docstring for Postgres flavor data sources (#11302)
- [MAINTENANCE] cloud-snippets under test (#11292)
1.5.5
- [FEATURE] Add new Postgres "flavor" Data Source classes (#11290)
- [FEATURE] Add BigQuery data source class (#11296)
- [BUGFIX] Disable init analytics as it was not really getting entirely disabled when specified on data context config (#11276) (thanks @jmcorreia)
- [DOCS] Correct forecasted range caveat (#11295)
- [MAINTENANCE] Bump ruff to 0.12.2 (#11288)
1.5.4
- [BUGFIX] B/gx 1174/generalize schema expectation (#11272)
- [BUGFIX] Fix renderer for ExpectTableColumnsToMatchSet (#11281)
- [DOCS] Anomaly Detection: Expectation drawer and model (#11234)
- [DOCS] Clarify integration support policy page (#11247)
- [MAINTENANCE] Remove TableFactory from cloud e2e (#11274)
- [MAINTENANCE] Bump ruff to 0.12.0 (#11263)
- [MAINTENANCE] convert Snowflake & Databricks integration tests to parameterize_batch_for_data_sources (#11277)
1.5.3
- [BUGFIX] Make ExpectTableColumnsToMatchSet case insensitive (#11266)
- [DOCS] ExpectColumnProportionOfNonNullValuesToBeBetween (#11245) (#11257)
- [MAINTENANCE] Allow posthog v4 and v5 (#11265)
1.5.2
- [FEATURE] Add SuiteParameterDict to all Expectation Kwargs (#11222) (thanks @Pascal06S)
- [BUGFIX] fix
ValidationError
inExpectColumnPairValuesToHaveDifferenceOfCustomPercentage
(#11209) (thanks @sariaslaso) - [BUGFIX]
add_batch_definition_whole_directory
only loading 1 file (#11254) - [BUGFIX] Remove datetime types from proportion
min_value
andmax_value
parameters (#11259) - [DOCS] temporarily remove link checker (#11250)
- [DOCS] Cloud API data source tip (#11248)
- [DOCS] ExpectColumnProportionOfNonNullValuesToBeBetween (#11245) (#11257)
- [MAINTENANCE] Update "fraction" to "proportion" on NonNullProportion renderer (#11253)
- [MAINTENANCE] Bump brace-expansion from 1.1.11 to 1.1.12 in /docs/docusaurus (#11251)
1.5.1
- [FEATURE] Add ColumnAggregateNonNullCount metric (#11229)
- [FEATURE]
ExpectColumnProportionOfUniqueValuesToBeBetween
(#11235) - [DOCS] Revise use of the term "API" (#11196)
- [DOCS] fix link to removed content (#11232)
- [MAINTENANCE] Revert "[MAINTENANCE] Snowflake tests only run with snowflake flag" (#11230)
- [MAINTENANCE] Add session pool to expectation tests (#11228)
- [MAINTENANCE] Remove RuleBasedProfiler (#11231)
1.5.0
- [MINORBUMP] docs for Multi-source Expectations (#11165)
- [DOCS] revise use of the term "Cloud" in the Core docs (#11207)
- [DOCS] restore link checker (#11212)
- [MAINTENANCE] add warning filter (#11217)
- [MAINTENANCE] Update renderer labels (#11216)
- [MAINTENANCE] Improve
ExpectQueryResultsToMatchComparison
docstring (#11221) - [MAINTENANCE] pre-commit autoupdate (#11218)
- [MAINTENANCE] Remove
pkg_resources
dependency (#11213) - [MAINTENANCE] Example suite parameter tests (#11225)
- [CONTRIB] Add type geometry and super into redshift_execution_engine.py (#11194) (thanks @VolkovGeoPhy)
1.4.6
- [BUGFIX] Handle unhashable data types for ExpectQueryResultsToMatchComparison (#11193)
- [BUGFIX] Make type expectation case-insensitive for Databricks, Snowflake an Postgres (#11192)
- [BUGFIX] Handle set rendering cases for
ExpectQueryResultsToMatchComparison
(#11203) - [BUGFIX] Handle UUID in rendered content (#11204)
- [DOCS] Anomaly Detection (#11172)
- [DOCS] Refine use of the term "platform" (#11187)
- [DOCS] Update docs to reflect that views are supported (#11198)
- [DOCS] Revise use of the term "Core" in relation to Cloud (#11205)
- [MAINTENANCE] Add CloudAMQP connection string env variable to ci (#11190)
- [MAINTENANCE] Show gx cloud logs on cloud test failures. (#11188)
- [MAINTENANCE] limit pyspark to <4.0 due to breaking changes in types (#11197)
- [MAINTENANCE] Ignore warnings around pkg_resources (#11201)
- [MAINTENANCE] Update descriptions for multi-source parameter (#11202)
- [MAINTENANCE] Snowflake tests only run with snowflake flag (#10605)
1.4.5
- [DOCS] ExpectAI for all Data Sources (#11178)
- [MAINTENANCE] Fix nightly data source cleanup action setup (#11176)
- [MAINTENANCE] pre-commit autoupdate (#10480)
- [MAINTENANCE] Do not fail tests on snowflake ssl connection warning. (#11180)
- [MAINTENANCE] Upgrade ruff (#11182)
- [MAINTENANCE] Update Posthog analytics events (#11179)
- [MAINTENANCE] Rename multi-source Expectation and parameters (#11185)
- [MAINTENANCE] Add single value rendering path to multi-source Expectation (#11186)
- [CONTRIB] use existing LRU cache for secrets store (#11184) (thanks @ThiloSchneider-fraport)
- [CONTRIB] add GEOMETRY, and SUPER types to REDSHIFT_TYPES (#11183) (thanks @VolkovGeoPhy)
1.4.4
- [FEATURE] Compute missing/unexpected rows for ExpectQueryResultsToMatchSource (#11161)
- [FEATURE] ExpectQueryResultsToMatchSource table diagnostic renderer (#11168)
- [FEATURE] ExpectQueryResultsToMatchSource renderer for single-column … (#11173)
- [DOCS] remove link checker (#11162)
- [MAINTENANCE] Fix dying mssql compatibility tests. (#11153)
- [MAINTENANCE] Bump prismjs from 1.29.0 to 1.30.0 in /docs/docusaurus (#11126)
- [MAINTENANCE] Breakout redshift tests into own job. (#11167)
- [MAINTENANCE] Bring back redshift creds for docs tests (#11169)
- [MAINTENANCE] Improve
ExpectQueryResultsToMatchSource
docstring (#11158) - [MAINTENANCE] Nightly redshift cleanup (#11166)
- [MAINTENANCE] Bump image-size from 1.2.0 to 1.2.1 in /docs/docusaurus (#11125)
- [MAINTENANCE] Add prescriptive atomic renderer to
ExpectQueryResultsToMatchSource
(#11160) - [MAINTENANCE] Resolve datetime deprecation warnings (#11134) (thanks @emmanuel-ferdman)
- [MAINTENANCE] Bump http-proxy-middleware from 2.0.7 to 2.0.9 in /docs/docusaurus (#11120)
- [MAINTENANCE] Bump @babel/runtime from 7.26.9 to 7.27.0 in /docs/docusaurus (#11124)
- [MAINTENANCE] Bump estree-util-value-to-estree from 3.3.2 to 3.3.3 in /docs/docusaurus (#11121)
- [MAINTENANCE] ensure latest docker compose (#11156)
- [MAINTENANCE] Fix flakey test and simplify another assertion (#11163)
- [MAINTENANCE] Update
ExpectQueryResultsToMatchSource
DQI (#11164) - [MAINTENANCE] Bump @babel/helpers from 7.26.9 to 7.27.0 in /docs/docusaurus (#11123)
- [MAINTENANCE] Change DQ issue for
ExpectQueryResultsToMatchSource
(#11174) - [CONTRIB] Update ruff badge (#10905) (thanks @esadek)
1.4.3
- [FEATURE] Test infra to support source to target expectations (#11138)
- [FEATURE] QueryDataSourceTable metric + provider (#11149)
- [DOCS] ExpectAI approval workflow (#11072)
- [DOCS] restore link checker (#11135)
- [DOCS] alerts for ExpectAI (#11154)
- [MAINTENANCE] Temporarily pin gx-redshift for python 3.9 (#11142)
- [MAINTENANCE] Revert "[DOCS] restore link checker" (#11145)
- [MAINTENANCE] Capitalize "Expectation" in mostly description (#11147)
- [MAINTENANCE] Add
SupportedDataSources
enum (#11143) - [MAINTENANCE] Restore link checker (#11146)
- [MAINTENANCE] Remove slow test cases (#11152)
- [MAINTENANCE] Remove test_expectations_v3_api.py (#11098)
- [MAINTENANCE] Revert: "Temporarily pin gx-redshift for python 3.9" (#11151)
1.4.2
- [FEATURE] Changes to Redshift
connection_string
validator to support a dict type (#11119) - [FEATURE] expectations: redshift support (#11128)
- [DOCS] make try gx core code sample match descriptive text (#11129)
- [DOCS] hide broken table of contents (#11130)
- [MAINTENANCE] Add Galina to core devs. Remove others. (#11117)
- [MAINTENANCE] Add metric docstrings and fix import paths (#11118)
- [MAINTENANCE] Update type packaging (#11115)
- [MAINTENANCE] Improve
MetricErrorResult
andBatch.compute_metrics()
API typing (#11127)
1.4.1
- [FEATURE] Allow user to provide connection details to connect to Redshift (#11105)
- [FEATURE] Add
ColumnDescriptiveStats
metric (#11108) - [BUGFIX] MicrosoftTeamsNotificationAction failing with 400 Bad Request (#11106) (thanks @jwalant-dattani)
- [BUGFIX] expect_column_values_to_be_between allows both min/max values to be None or empty strings (#11102)
- [BUGFIX] redshift: prevent runtime TypeError (#11112)
- [MAINTENANCE] Cleanup metrics package (#11109)
1.4.0
- [FEATURE] Add
ColumnSampleValues
metric (#11083) - [FEATURE] Add Redshift to SUPPORTED_DATA_SOURCES where appropriate (#11084)
- [FEATURE] Add gx-redshift extra (#11092)
- [FEATURE] Add
ColumnValuesMatchRegexCount
metric (#11091) - [BUGFIX] Expectations fail validation when using sets/tuples as value_set due to JSON serialization (#11082) (thanks @gyermich)
- [DOCS] update schedule instructions (#11080)
- [DOCS] Fix default gx directory in docstring (#11077)
- [MAINTENANCE] Improve PostHog pageview tracking in docs (#11087)
- [MAINTENANCE] Add ColumnDistinctValues metric (#11081)
- [MAINTENANCE] Type narrowing on compute_metrics with a single metric (#11089)
- [MAINTENANCE] Implement ColumnValuesMatchRegexValues metric (#11088)
- [MAINTENANCE] Implement ColumnValuesNotMatchRegexValues metric (#11096)
- [MAINTENANCE] Run gx-sqlalchemy-redshift tests. (#11094)
1.3.14
- [FEATURE] Fix ExpectColumnValuesToBeOfType bug and also work with sqla2 (#11062)
- [FEATURE] Add gx-redshift extra dependency (#11063)
- [FEATURE] Enable SQLAlchemy 2.x support for BigQuery (#11059)
- [BUGFIX] Add test for 8-bit character support in row conditions parser (#11053)
- [BUGFIX] Respect context_root_dir in get_context (#11078)
- [DOCS] update schedule instructions (#11080)
- [MAINTENANCE] update docs usage of posthog (#11060)
- [MAINTENANCE] Improve package autocompletion behavior (#11070)
- [MAINTENANCE] Add BatchColumnTypes metric (#11069)
- [MAINTENANCE] Implement SampleValues metric (#11071)
- [MAINTENANCE] Implement ColumnDistinctValuesCount (#11075)
- [MAINTENANCE] Implement ColumnNullCount metric (#11073)
- [MAINTENANCE] Revert "[FEATURE] Add gx-redshift extra dependency" (#11079)
1.3.13
- [FEATURE] Add initial RedShift datasource (#11011)
- [BUGFIX] Prevent sqlite metric impl from overwriting default sqlalchemy (#11055)
- [DOCS] Add key pair authentication as a limitation of ExpectAI in manage_expectations.md (#11047) (thanks @adeola-ak)
- [DOCS] reflect change on metrics page, clarify perms (#11052)
- [DOCS] test coverage metrics part 2 (table) (#11046)
- [DOCS] completeness change detection (#11039)
- [DOCS] ccd fast follow (#11056)
- [DOCS] update coverage health screenshot (#11057)
- [MAINTENANCE] Use get_metric_provider internal to registry (#11044)
1.3.12
- [DOCS] KL divergence gallery fix (#11040)
- [MAINTENANCE] Add MINORBUMP title tag. (#10841)
- [MAINTENANCE] Add a sqlite execution engine and 1 sqlite specific metric. (#11042)
1.3.11
- [FEATURE] Add the ability to run checkpoints with cloud windowed expectations (#11027)
- [BUGFIX] Distinct values expectations correctly compare dates and datetimes (#11030)
- [DOCS] restore link checker (#11025)
- [DOCS] - single category for Expectations (#11008)
- [DOCS] fix error in filesystem data source docs (#11019)
- [MAINTENANCE] Remove default snowflake role (#11004)
- [MAINTENANCE] Add mode to props sent in analytics (#11001)
- [MAINTENANCE] Update ci.yml so pr targets become pr-event targets (#11031)
- [MAINTENANCE] Remove timber from CODEOWNERS (#10996)
- [MAINTENANCE] Update aws ci secret vars. (#11035)
- [MAINTENANCE] Revert Update aws ci secret vars. (#11036)
- [MAINTENANCE] Add ci aws creds. (#11037)
- [MAINTENANCE] Point tests to aws buckets in oss account. (#11034)
- [MAINTENANCE] Fix atomic diagnostic observed value renderers when used with datetime (#11033)
1.3.10
- [DOCS] beta badge followup (#11015)
- [DOCS] Test coverage metrics (#11002)
- [MAINTENANCE] refactor to use data_context fixture (#10997)
- [MAINTENANCE] Remove unneeded tests (#11007)
- [MAINTENANCE] remove numeric dqi from validity expectations (#11005)
- [MAINTENANCE] Upgrade transitive dependencies and stop using internal docusaurus functions (#11009)
- [MAINTENANCE] Stop over alerting on failures (#11021)
- [MAINTENANCE] remove outdated walkthrough modal (#11022)
- [MAINTENANCE] Bump mysql max_connections for tests (#11023)
1.3.9
- [FEATURE] Remove batch_id parameter from Metric classes (#10971)
- [FEATURE]
QueryRowCount
metric (#10964) - [FEATURE] ColumnPairValueInSet metric (#10969)
- [FEATURE] MultiColumnValues metric (#10973)
- [BUGFIX] Validation Definition factory add_or_update doesnt allow updating batch definition (#10960)
- [BUGFIX] Fix 3 batch.compute_metrics bugs and enforce len(metrics) == len(results) (#10979)
- [BUGFIX] Ensure Asset.get_batch_definition returns BatchDefinition with ID (#10986)
- [BUGFIX] Raise error when ExpectColumnValuesToBeBetween is run against an unsupported column (#10995)
- [DOCS] make airflow provider discoverable (#10967)
- [DOCS] Adding title to codeblocks in API (#10970)
- [DOCS] Adds script to update links when new docs version is cut (#10976)
- [DOCS] Add README.md to scripts folder (#10982)
- [DOCS] DOC-1045: Beta badge (#10980)
- [DOCS] DSB-1312: Fix validation definition parameters display (#10981)
- [DOCS] temporarily remove link checker (#10992)
- [DOCS] volume change detection (#10927)
- [DOCS] update action docs to include custom field example (#10987)
- [DOCS] update search key (#10994)
- [DOCS] Adding formatting to codeblocks in API (#10985)
- [MAINTENANCE] Remove
Domain
mixin from Metrics API (#10966) - [MAINTENANCE] Remove old workflow. (#10975)
- [MAINTENANCE] Slack notification message - remove duplicated link text, decluttering (#10890) (thanks @data-han)
- [MAINTENANCE] Upgrade mypy to version 1.15.0 (#10988)
- [MAINTENANCE] Change github action event name we exclude from marker tests (#10991)
- [MAINTENANCE] Remove unused domain key (#10983)
- [MAINTENANCE] Analytics event for validation definition runs (#10984)
- [MAINTENANCE] Upgrade ruff to version 0.9.9 (#10990)
- [MAINTENANCE] Remove duplicated configuration (#10989)
- [MAINTENANCE] refactor to use data_context fixture (#10997)
1.3.8
- [FEATURE]
Batch.compute_metrics()
(#10950) - [FEATURE]
ColumnValuesNonNull
andColumnValuesNonNullCount
metrics (#10959) - [FEATURE] Add mean to metrics API (#10961)
- [FEATURE] Remove batch_id parameter from Metric classes (#10971)
- [DOCS] SSO cta (#10872)
- [DOCS] Display args, returns and raises as tables in API reference pages (#10910)
- [DOCS] typo (#10965)
- [DOCS] Args and Raises in API reference should be able to display several rows (#10968)
- [MAINTENANCE] Remove
table
parameter from all MetricDomain
s (#10954) - [CONTRIB] remove table domain key (#10956) (thanks @VolkovGeoPhy)
1.3.7
- [FEATURE] BatchRowCount Metric (#10944)
- [BUGFIX] remove unused domain key (#10951)
- [DOCS] Replacing search keys with env variables (#10940)
- [DOCS] SSO cta (#10872)
- [MAINTENANCE] Make
Metric.config
un-instantiable and excluded from auto-complete (#10938) - [MAINTENANCE] Drop jinja2 v2 support (#10941)
- [MAINTENANCE] Require
Metric.name
instead of usingname
inference (#10953)
1.3.6
- [BUGFIX] Quote password before passing to SnowflakeURL (#10919)
- [BUGFIX] Trim the unexpected rows query (#10923)
- [BUGFIX] Make
MetricConfiguration.id
immutable (#10929) - [BUGFIX]
test_diagnostic_checklist
import error (#10934) - [BUGFIX] ExpectTableRowCountToBeBetween fails validation with Runtime Parameters (#10925) (thanks @eric-brady)
- [DOCS] Fix HTML entity character in API reference code blocks (#10915)
- [DOCS] AI-recommended Expectations (#10913)
- [DOCS] Fix lack of formatting in actions.py (#10918)
- [DOCS] Feedback form issues should have status "intake" (#10933)
- [DOCS] Fix sidebar highlight by deleting subpages from the sidebar (#10903)
- [DOCS] Added useLocation mock (#10939)
- [MAINTENANCE] Ensure clear error if cloud mode requested and env vars aren't found (#10916)
- [MAINTENANCE] Remove concurrency block from GitHub CI workflow (#10930)
- [MAINTENANCE] Add
Metric
andDomain
base classes (#10920) - [MAINTENANCE] Remove unreferenced docs snippets (#10937)
- [MAINTENANCE] Metric Result types (#10932)
- [MAINTENANCE] Make
Metric.config
un-instantiable and excluded from auto-complete (#10938)
1.3.5
- [DOCS] New icons for admonitions (#10899)
- [DOCS] Algolia fix (#10907)
- [MAINTENANCE] Add
row_condition
datetime testing for Pandas and Spark (#10892) - [MAINTENANCE] Cleanup bigquery every 3 hours (#10900)
- [MAINTENANCE] Add
strict
to Window type (#10906) - [MAINTENANCE] ensure run_id on ValidationDefinition.run (#10909)
1.3.4
- [BUGFIX]
row_condition
datetimes getting tuncated to dates (#10891) - [DOCS] restore lychee (#10889)
- [DOCS] DOC-966: display properties in api reference as tables (#10880)
- [DOCS] DOC-966: display api reference methods signatures as code blocks (#10882)
- [DOCS] Dynamic Parameters for Completeness Expectations (#10873)
- [DOCS] Deleting versioned pages of 0.18 that should not be versioned (#10893)
- [MAINTENANCE] Allow forked PRs to run CI (#10894)
- [MAINTENANCE] Remove bot check on permissions checker action (#10895)
1.3.3
- [BUGFIX] Make validation results' describe_dict return a serializable dict (#10863)
- [BUGFIX] Allow adding Expectations with identical attributes to Suites (#10884)
- [DOCS] Add titles to properties and methods sections in API Reference (#10821)
- [DOCS] Update documentation around batch_parameters and link to updated API docs. (#10877)
- [DOCS] Corrections and clarifications for result_format (#10875)
- [MAINTENANCE] Handle
aws-chunked
encoding type data inTupleS3StoreBackend
(#10861) - [MAINTENANCE] Add user-agent-str to analytics events (#10869)
- [MAINTENANCE] Add method to set analytics user_agent_str (#10883)
- [MAINTENANCE] Convert BatchTestSetup.asset property to BatchTestSetup… (#10864)
- [MAINTENANCE] Migrate from
databricks-sql-connector
todatabricks-sqlalchemy
in tests (#10886)
1.3.2
- [FEATURE] CheckpointFactory.add_or_update (#10856)
- [FEATURE] Enable strict_min/max for ExpectTableRowCountToBeBetween (#10845)
- [BUGFIX]
ExpectColumnUniqueValueCountToBeBetween
strict_min
andstrict_max
not getting set (#10835) - [BUGFIX] Extend existing version logic for pandas
series.between()
inclusive
to missing conditions (#10837) - [BUGFIX] Add input args validators to various Expectations (#10833)
- [DOCS] Expectation selection, group by data quality issue (#10806)
- [DOCS] Editing Admonition titles (#10813)
- [DOCS] consolidate info about analytics / usage stats (#10853)
- [DOCS] update checkpoint snippet location (#10854)
- [DOCS] In-app agent request (#10836)
- [DOCS] small fixes for newer DQ use case articles (#10847)
- [DOCS] Adding keys to duplicated headers (#10846)
- [DOCS] fix custom SQL Expectation approach for cloud (#10844)
- [DOCS] update screenshot of observed value (#10867)
- [MAINTENANCE] Add
--force-reinstall
flag toinvoke deps
and update help text (#10834) - [MAINTENANCE] Update
responses
pin due to mypy error with latest release (#10842) - [MAINTENANCE] Remove xfailed test (#10843)
- [MAINTENANCE] Pin
boto3
due to breaking change (#10862) - [MAINTENANCE] Change mssql tests to use version 18 driver (#10868)
- [MAINTENANCE] Temporary fix to move past failing schema cleanup (#10860)
- [MAINTENANCE] Unpin
snowflake-sqlalchemy
(#10838) - [MAINTENANCE] CI skips xfailed quoted identifier tests (#10857)
- [MAINTENANCE] Enforce a minimum length of 2 for MulticolumnMapExpectation
column_list
(#10850)
1.3.1
- [BUGFIX] Ensure datetime.time can be serialized to JSON (#10795)
- [BUGFIX] Stop overwriting template with description (#10826)
- [DOCS] restore Lychee link checking (#10797)
- [DOCS] replace
context.sources
withcontext.data_sources
(#10794) - [DOCS] ADR around public API docstrings (#10798)
- [DOCS] Change home banner buttons (#10804)
- [DOCS] Remove uppercase transformation for alerts' titles (#10800)
- [DOCS] Adding commonroom web tracking snippet (#10805)
- [DOCS] Adding/deleting other supported databases (#10812)
- [DOCS] Update Learn data pipeline tutorial page (#10828)
- [MAINTENANCE] Implement suite factory add_or_update (#10796)
- [MAINTENANCE] add expectation params to ColumnMapExpectation
mostly
field (#10829) - [MAINTENANCE] Bump
posthog
to V3 (#10814) - [MAINTENANCE] Update expectations to use canonical data quality issues (#10807)
- [MAINTENANCE] Nightly cleanup of stray bigquery schemas (#10815)
- [MAINTENANCE] Enforce mandatory docstrings for public API decorated objects (#10799)
- [MAINTENANCE] Add bigquery requirements file to bigquery cleanup script (#10819)
- [MAINTENANCE] Fix cleanup script (#10820)
- [MAINTENANCE] Enforce comments with linter ignores (#10817)
- [MAINTENANCE] Add to git blame ignore rev (#10822)
- [MAINTENANCE] Ignore Marshmallow V4 warnings (#10825)
- [MAINTENANCE] Change logger warning to debug (#10790)
- [MAINTENANCE] Better logging around and only calling cleanup when we have old BigQuery schemas (#10824)
- [MAINTENANCE] Add
context.validation_definitions.add_or_update
support (#10818)
1.3.0
- [BUGFIX] Handle expectation description from cloud (#10768)
- [BUGFIX] Renderer for UnexpectedRowsExpectation (#10758)
- [BUGFIX] Fix format of UnexpectedRowsExpectation observed_value to be int (#10777)
- [BUGFIX] Metric table.column_type should properly evaluate for snowflake (#10776)
- [BUGFIX] Fix expectation description rendering in DataDocs (#10789)
- [BUGFIX]
Databricks
Fix Type Translation -ExpectColumnValuesToBeInTypeList
andExpectColumnValuesToBeInType
(#10791) - [BUGFIX] Metric
table.column_type
should properly evaluate for Postgres (#10793) - [DOCS] Clarify Connect GX Cloud landing page (#10761)
- [DOCS] Remove
print(validation_results.result_url)
as it isn't supported (#10760) - [DOCS] SUJ-E (#10665)
- [DOCS] Fix underline in links on inline code (#10783)
- [DOCS] Remove unnecessary escape character in Expectation for Gallery (#10780)
- [DOCS] Custom Actions (#10772)
- [DOCS] Schema change detection (#10755)
- [DOCS] Update public_api to include
ValidationAction
components (#10752) - [MAINTENANCE] Change ci pipeline to pull_request_target with a permissions check to allow CI on forks (#10467)
- [MAINTENANCE] Revert "[MAINTENANCE] Change ci pipeline to pull_request_target with a permissions check to allow CI on forks" (#10773)
- [MAINTENANCE] Minor code clean up and refactor around column type exp… (#10764)
- [MAINTENANCE] Diagram on how multi-datasource test setup works (#10766)
- [MAINTENANCE] Add
UnexpectedRowsExpectation
observed value renderer (#10779) - [MAINTENANCE] Remove
docs_link_checker.py
(#10781) - [MAINTENANCE] Add ENUM for Data Quality Issues, Update Core Expectations Docstrings/Schemas (#10759)
- [MAINTENANCE] Adding more test cases for snowflake types (#10786)
- [MAINTENANCE] Update
tasks.py
to remove reference toisort
(#10782) - [MAINTENANCE] Remove GX Cloud onboarding script (#10785)
- [MAINTENANCE] Check filepath existence when evaluating public API report (#10754)
- [MAINTENANCE] Add EventBridge Scheduler service to
cloud-tests
(#10774) - [MAINTENANCE] Deprecate
DataContext.add_or_update_datasource
(#10784) - [MAINTENANCE] Allow
CheckpointResult
andActionContext
to be importable from top-level checkpoint module (#10788) - [MAINTENANCE] Clean up
cloud-tests
environment variables (#10792) - [MAINTENANCE] Adding
databricks
compatibility types (#10787)
1.2.6
- [BUGFIX] Enable custom actions in V1 (#10743)
- [BUGFIX] Fix like pattern expectations to work without optional SQL deps (#10745)
- [BUGFIX] Default
exact_match
toTrue
forExpectTableColumnsToMatchSet
(#10746) - [BUGFIX] check for variance in validator and batch asset (#10744)
- [DOCS] Update Row Condition guidance (#10736)
- [DOCS] Update banner content (#10747)
- [DOCS] key-pair auth for Snowflake (#10751)
- [MAINTENANCE] Add
JOIN
test cases forUnexpectedRowsExpectation
(#10733) - [MAINTENANCE] Enable custom table names in expectation testing framework (#10724)
- [MAINTENANCE] Prefix schema (#10742)
- [MAINTENANCE] Atomic diagnostic observed value renderer for
Expect table columns to match set
(#10748) - [MAINTENANCE] Simplify bigquery assertion (#10750)
1.2.5
- [FEATURE]
expect_table_columns_to_match_ordered_list
observed value renderer (#10683) - [FEATURE] Value-set Expectation observed value renderers (#10718)
- [BUGFIX]
UnexpectedRowsExpectation
- Unable to use{batch}
keyword with partitioner for some backends (#10721) - [DOCS] Cloud Expectation condition docs (#10690)
- [DOCS] DSB-1233: addyng non-versioned-section styling to all the cloud section (#10694)
- [DOCS] Ensure "Connect GX Cloud to ..." pages accurately reflect the current workflow (#10689)
- [DOCS] DSB-1219: Adding redirects (#10692)
- [DOCS] Add databricks to supported datasources in corresponding expectations (#10691)
- [DOCS] Update Manage Data Assets page to reflect the current UI and remove duplicate content (#10695)
- [DOCS] Changing announcement banner (#10703)
- [DOCS] data quality uniqueness article (#10584)
- [DOCS] remove abandoned pages (#10704)
- [DOCS] add code block titles to avoid overlaps in display (#10708)
- [DOCS] Fixing close button on Announcement bar (#10717)
- [DOCS] link fixes - December 2024 (#10716)
- [DOCS] Make announcement bar not closable (#10719)
- [DOCS] - Wrong dependency included in Set Up a GX Environment (#10722)
- [DOCS] data quality -- freshness (#10612)
- [DOCS] fix batch definition data types (#10723)
- [DOCS] fix docs typo (#10725)
- [MAINTENANCE] Pin
snowflake-sqlalchemy
due to breaking change (#10698) - [MAINTENANCE] Add atomic diagnostic renderer to
ExpectColumnMostCommonValueToBeInSet
(#10697) - [MAINTENANCE] Add tests around expectations (#10688)
- [MAINTENANCE] Write tests for misconfigured expectations error reporting (#10696)
- [MAINTENANCE] Test expectations against Snowflake column types (#10706)
- [MAINTENANCE] Test remaining expectations (#10715)
- [MAINTENANCE] Logging message in Datasource store (#10729)
- [MAINTENANCE] Test postgres type support (#10727)
- [CONTRIB] Handle connection error during version check (#10720) (thanks @stejin)
1.2.4
- [DOCS] ADR around not using meta fields (#10672)
- [DOCS] Update Expectation conditions docs (#10661)
- [DOCS] community contributions - November 2024 (#10681)
- [DOCS] Data quality on integrity (#10583)
- [MAINTENANCE] : standardize _atomic_diagnostic_observed_value (#10643)
- [MAINTENANCE] Add support to framework for spark integration testing (#10670)
- [MAINTENANCE] Reduce test duration of flakey test (#10663)
- [MAINTENANCE] DatabricksSQL expectation testing (#10653)
- [MAINTENANCE] Add datetime inference to test framework (#10666)
- [MAINTENANCE] Add bigquery to marker tests (#10674)
- [MAINTENANCE] Update testing framework to work with bigquery (#10675)
- [MAINTENANCE] Fixture to get assets for test framework (#10673)
- [MAINTENANCE] Update CODEOWNERS with reqs owner. (#10684)
- [MAINTENANCE] Remove commented out code (#10686)
- [MAINTENANCE] Tests to prove sqlite partitioners work (#10676)
- [MAINTENANCE] Condition parser typing and row conditions testing (#10667)
- [MAINTENANCE] Improve experience around expectation deletion with Cloud-backed suites (#10662)
1.2.3
- [BUGFIX] double-sided z score renderer (#10648)
- [BUGFIX] Stop masking config strings (#10625)
- [DOCS] Mark actions as not ready for contributions (#10646)
- [DOCS] MS Teams Action (#10655)
- [DOCS] Remove install instructions for redshift and trino (#10660)
- [MAINTENANCE] Clean up Azure CI configuration (#10638)
- [MAINTENANCE] add Aaron to teams file (#10641)
- [MAINTENANCE] Bump ruff to
0.7.2
(#10629) - [MAINTENANCE] Bump
docstring-parser
to0.16
(#10608) - [MAINTENANCE] Add integration test for
MicrosoftTeamsNotificationAction
(#10628) - [MAINTENANCE] Clean up
MicrosoftTeamsNotificationAction
docstring and import patterns (#10642) - [MAINTENANCE] Add constant for all unparameterized data sources to test (#10654)
- [MAINTENANCE] Refactor Checkpoint utils (#10649)
- [MAINTENANCE] Sqlite integration testing (#10657)
- [MAINTENANCE] Use random schema in integration tests (#10658)
1.2.2
- [FEATURE] Add check for valid column type when calling add_batch_def in a sql asset (#10590)
- [FEATURE] Expectations tests against SQL backends infer column types (#10622)
- [BUGFIX] Parse spaces in row condition column name (#10611)
- [BUGFIX] Batch Expectations correctly handle
date
min and max values (#10613) - [BUGFIX] Mask conn_str in configs (#10626)
- [BUGFIX] Missing renderer params when
row_condition
is used (#10632) - [DOCS] Updated cloud action support posture to be in line with reality (#10609)
- [DOCS] Add dynamic parameters documentation (#10483)
- [DOCS] Fix column name in failing example for ExpectColumnValuesToBeB… (#10620)
- [DOCS] remove unsupported actions (#10624)
- [MAINTENANCE] Bump mermaid from 10.9.0 to 10.9.3 in /docs/docusaurus (#10549)
- [MAINTENANCE] Bump http-proxy-middleware from 2.0.6 to 2.0.7 in /docs/docusaurus (#10566)
- [MAINTENANCE] Mock posthog in action tests (#10615)
- [MAINTENANCE] Add another member to teams.yml (#10616)
- [MAINTENANCE] Validate Expectation JSON Schema follows meta-schema specification (#10627)
- [MAINTENANCE] Prevent unneeded test setup/teardown (#10619)
- [MAINTENANCE] dynamically generate extra table names in tests (#10630)
- [MAINTENANCE] test cleanup (#10631)
- [MAINTENANCE] Add mysql support to testing framework (#10633)
- [MAINTENANCE] Make PR Title Checker GH Action more secure (#10636)
- [MAINTENANCE] Add mssql support to testing framework (#10634)
1.2.1
- [BUGFIX] Add redirect for deploy-gx-agent (#10573)
- [BUGFIX] Fix typing on
mostly
andvalue_set
fields (#10571) - [BUGFIX]
ExpectationSuite
equality should ignore expectation ordering (#10562) - [BUGFIX] Get
MicrosoftTeamsNotificationAction
working with V1 (#10593) - [BUGFIX] Support string substitution for EmailAction (#10600)
- [BUGFIX] Ensure that data docs are accessible through MS Teams action results (#10599)
- [BUGFIX] Incorrect row count when
UnexpectedRowsExpectation
returns more than 200 rows (#10604) - [DOCS] Edit API reference internal links to prevent 404s (#10528)
- [DOCS] data quality distribution analysis, working draft (#10440)
- [DOCS] Changing broken links in changelog file and some left in reference/API (#10588)
- [DOCS] Fixes small friction points noticed during onboarding (#10560)
- [DOCS] remove duplication in GCP Secret Manager instructions (#10591)
- [DOCS] loose ends for python 3.12 support (#10596)
- [DOCS] Fixes more small issues noticed during onboarding (#10598)
- [DOCS] Mark
MicrosoftTeamsNotificationAction
as first-class (#10595) - [DOCS] Add lychee to spot broken urls (#10585)
- [MAINTENANCE] PostgreSQL Expectation Tests (#10582)
- [MAINTENANCE] Snowflake Expectation Tests (#10586)
- [MAINTENANCE] Reenable xfailed e2e tests (#10555)
- [MAINTENANCE] Add test to public api to ensure that decorated methods have decorated parent classes (#10529)
- [MAINTENANCE] Bump
ruff
andmypy
versions to0.7.1
and1.13.0
, respectively (#10565) - [MAINTENANCE] Return informative error when saving expectation suite (#10570)
- [MAINTENANCE] Filesystem expectation testing (#10556)
- [MAINTENANCE] Update teams.yml devrel members. (#10567)
- [MAINTENANCE] Update 0.18.x changelog for release of 0.18.22 (#10575)
- [MAINTENANCE] Add more canonical expectation tests (#10578)
- [MAINTENANCE] Clean up misc utils (#10581)
- [MAINTENANCE] update docs link for configuring credentials (#10580)
- [MAINTENANCE] DRY up config substitution for slack notifications (#10602)
- [MAINTENANCE] Support config substitution for
MicrosoftTeamsNotificationAction
(#10606) - [MAINTENANCE] Add testing support for multi-asset data sources (#10592)
- [MAINTENANCE] Instrument analytics for Checkpoint action creation and runs (#10597)
1.2.0
- [BUGFIX] Remove
row_condition
from Expectations for which it does not apply (#10519) - [BUGFIX] fix rendering performance (#10530)
- [BUGFIX] Ensure that file-backed domain objects are stored in JSON files (#10523)
- [BUGFIX] File Path Batch Definitions serialize incorrectly (#10543)
- [DOCS] Bump max Python version in docs (#10522)
- [DOCS] Fix some typos (#10521)
- [DOCS] Add redirects for old URLs that no longer exist (#10516)
- [DOCS] Update Data Doc site configuration page (#10536)
- [DOCS] Add base
Datasource
to Public API (#10527) - [DOCS] DSB-1009: Add Learn page for GX - Airflow data pipeline tutorial (#10534)
- [DOCS] Change href from relative path to root in API docs (version 0.18) (#10507)
- [DOCS] Fixing broken links (#10541)
- [DOCS] Community/issues board mentions (#10548)
- [DOCS] Update _redirects (#10558)
- [MAINTENANCE] ruff 0.6.9 + mypy 0.12 (#10525)
- [MAINTENANCE] Bump
ruff
to0.7.0
(#10535) - [MAINTENANCE] Add
DataAsset.get_batch_definition
to public API docs (#10533) - [MAINTENANCE] Remove
TRY203
Ruff violations (#10540) - [MAINTENANCE] Update gx row_condition parser (#10524)
- [MAINTENANCE] Use python 3.12 in netlify (#10531)
- [MAINTENANCE] Update airflow snippet to use checkpoint name rather than id (#10551)
- [MAINTENANCE] Fix azure aws/spark tests (#10550)
- [MAINTENANCE] Remove util functions from public API (#10557)
- [MAINTENANCE] Basic expectation testing framework (#10554)
- [MAINTENANCE] Reenable xfailed e2e tests (#10555)
1.1.3
- [BUGFIX] Fix datadocs icons (#10511)
- [DOCS] Add
public_api
decorators to object factories (#10513) - [DOCS] Patch incorrect label in migration guide (#10518)
- [MAINTENANCE] Remove
snapshottest
dependency (#10498) - [MAINTENANCE] Add GH Actions for release process (#10502)
- [MAINTENANCE] Support Python 3.12 (#10503)
- [MAINTENANCE] Patch
ge_releaser
installation pattern in released-related GH Actions (#10509) - [MAINTENANCE] Enable pact test for all expectation suites (#10506)
- [MAINTENANCE] Isolate
clickhouse
marker in CI (#10512)
1.1.2
- [FEATURE] Add context.enable_analytics method (#10385)
- [BUGFIX] V1 Validator shouldn't mutate user's result format dict (#10496)
- [DOCS] Update min version in
_data.jsx
(#10494) - [MAINTENANCE] Remove
result_url
fromCheckpointResult
(#10493) - [MAINTENANCE] Deprecate context.get_datasource (#10471)
1.1.1
- [BUGFIX] Ensure that
SlackNotificationAction
credentials don't get serialized (#10476) - [BUGFIX] Ensure that Cloud-backed validation results get IDs (#10478)
- [DOCS] Remove Python 3.8 reference from readme (#10474)
- [DOCS] dbt Tutorial created in collaboration with Jonathan Porter (#10458)
- [DOCS] Replace terms.json urls in v0.18 (#10479)
- [DOCS] V0 to V1 Migration Guide (#10477)
- [MAINTENANCE] Remove Python 3.8 Support (EOL) (#10441)
- [MAINTENANCE] Bump dompurify from 3.0.11 to 3.1.7 in /docs/docusaurus (#10465)
- [MAINTENANCE] Bump express from 4.19.2 to 4.21.0 in /docs/docusaurus (#10464)
- [MAINTENANCE] Bump webpack from 5.88.2 to 5.94.0 in /docs/docusaurus (#10463)
- [MAINTENANCE] Bump micromatch from 4.0.5 to 4.0.8 in /docs/docusaurus (#10466)
- [MAINTENANCE] Remove old team and non-gx employees from teams.yml (#10469)
- [MAINTENANCE] Remove contrib pipeline. (#10470)
- [MAINTENANCE] Remove
makefun
dependency (#10472) - [MAINTENANCE] Add
public-api
check back to CI (#10449) - [MAINTENANCE] Clean up requirements files (#10485)
- [MAINTENANCE] Remove
ipython
dependency (#10487) - [MAINTENANCE] Remove
pytz
dependency (#10489) - [MAINTENANCE] Update experimental metric repository for V1 backend api (#10486)
- [MAINTENANCE] Remove
urllib3
dependency (#10488)
1.1.0
- [FEATURE] Update
Batch.validate()
API to accept expectation parameters (#10456) - [BUGFIX] README.md updated link (#10446)
- [BUGFIX] Ensure that fluent_datasources show up in context (#10438)
- [BUGFIX] Enable
SlackNotificationAction
variable substitution (#10443) - [DOCS] Bump python version to 3.9 in docs (#10453)
- [DOCS] add example of environment variable substitution (#10417)
- [DOCS] Add
Databricks (SQL)
to Cloud supported list (#10452) - [MAINTENANCE] Improve context.data_sources autocomplete (#10447)
- [MAINTENANCE] Use
Comparable
type alias for Expectation min/max value (#10448) - [MAINTENANCE] Remove
mostly
fromExpectColumnUniqueValueCountToBeBetween
(#10450) - [MAINTENANCE] Limit Result Format and
QueryMetricProvider
total unexpected records (#10432) - [MAINTENANCE] Mark GX as stable on PyPi (#10457)
- [MAINTENANCE] Add Alena Hutchinson to core developers team (#10459)
- [MAINTENANCE] Remove Python 3.8 Support (EOL) (#10441)
1.0.6
- [FEATURE] Add windows attribute to support experimental gx-cloud feature (#10402)
- [FEATURE] Descriptive error if open_data_docs called with no data docs (#10439)
- [BUGFIX] Ensure suite.render() is called when loading suites (#10434)
- [DOCS] Update docs for
UnexpectedRowsExpectation
(#10391) - [DOCS] Exclude templates files from algolia search (#10401) (thanks @JessSaavedra)
- [DOCS] DSB-1116: Reorganize and update GX Cloud deployment and architecture patterns into GX Cloud overview (#10345)
- [DOCS] Fix typo in overview docs (#10429)
- [DOCS] Go back to old search bar design (#10409) (thanks @JessSaavedra)
- [DOCS] Fix styles for search bar (#10436) (thanks @deborahniesz)
- [DOCS] Data quality tech doc on Volume (#10362) (thanks @Quantisan)
- [MAINTENANCE] ruff
0.5.3
->0.6.8
(#10442) - [MAINTENANCE] Add test showing expectation parameters being passed to… (#10435)
- [MAINTENANCE] Update expectation equality checks to ignore rendered content (#10444)
1.0.5
- [BUGFIX] Using
{batch}
keyword inUnexpectedRowsQuery
(#10392) - [BUGFIX] Fix Databricks SQL Regex and Like based Expectations (#10406)
- [BUGFIX] Support Spark connect dataframes (#10420)
- [BUGFIX] Handle DatabricksSQL attribute error and update dependency (#10424)
- [DOCS] Add Connect to Databricks SQL page in GX Cloud (#10394) (thanks @allisongx)
- [DOCS] Changelog updates
0.18.18
->0.18.21
(#10422) - [DOCS] Add Connect to Databricks SQL to GX Cloud docs TOC (#10423)
- [MAINTENANCE] Fix
SQLAlchemyExectionEngine.get_connection()
typing + update column identifier tests (#10399) - [MAINTENANCE] Move FabricPowerBIDatasource out of experimental dir (#10419)
1.0.4
- [BUGFIX] Fix action equality (#10393)
- [BUGFIX] Patch additional issues with data docs page retrieval in checkpoint actions (#10400)
- [DOCS] Add CTAs to request a demo (#10389)
- [MAINTENANCE] Ensure that all nested validation definition diagnostics are emitted from a parent checkpoint (#10386)
- [MAINTENANCE] Fix
SQLAlchemyExectionEngine.get_connection()
typing + update column identifier tests (#10399)
1.0.3
- [FEATURE] Replace get_batch_list_from_batch_request with get_batch and get_batch_identifiers_list (#10295)
- [FEATURE] Add Checkpoint.run analytics (#10382)
- [FEATURE] BatchDefinition.get_batch_identifiers_list (#10383)
- [BUGFIX] Patch issue with data docs page retrieval in checkpoint actions (#10374)
- [DOCS] Update changelog attributions for 1.0 releases (#10348)
- [DOCS] Embed Wistia video in GX Core introduction (#10366) (thanks @JessSaavedra)
- [DOCS] added data doc support posture (#10373)
- [DOCS] Adding BigQuery to GX Core support posture (#10375)
- [DOCS] Update Learn data quality use case articles to use <small> tags (#10377)
- [DOCS] Hide feedback survey on homepage (#10378) (thanks @deborahniesz)
- [MAINTENANCE] SQLAlchemy 2 typing (#10112)
- [MAINTENANCE] Update
Expectation
equality to simplify meta and notes checks (#10349) - [MAINTENANCE] Add
description
field toExpectationConfigurationSchema
and render alwaysdescription
overtemplate_str
(#10347) - [MAINTENANCE] Clean up GX error types (#10356)
- [MAINTENANCE] Check that
BatchDefinitions
andExpectationSuites
are up-to-date before saving (#10277) - [MAINTENANCE] Clean up test fixtures (#10358)
- [MAINTENANCE] Move "freshness"-related exceptions to separate file (#10359)
- [MAINTENANCE] Guard against dictionary
KeyError
s (#10353) - [MAINTENANCE] Add "freshness" checks for ValidationDefinitions and Checkpoints (#10365)
- [MAINTENANCE] Additional tests for
BatchDefinition
andExpectationSuite
freshness (#10380) - [MAINTENANCE] Delete misc functions from
test_utils
(#10357) - [MAINTENANCE] Additional tests for
ValidationDefinition
andCheckpoint
freshness (#10381)
1.0.2
- [FEATURE] Allow setting result format when calling batch.validate (#10281)
- [BUGFIX] FabricPowerBIDatasource 1.0 - TypeError: _PowerBIAsset.build_batch_request() got an unexpected keyword argument 'options' (#10318)
- [BUGFIX] Prevent pydantic type coercion of Value Sets (#10325)
- [BUGFIX] B/v1 509/remove df from result (#10338)
- [BUGFIX] Patch
SlackRenderer
andEmailRenderer
active_batch_definition
issues (#10344) (thanks @masfworld) - [BUGFIX] Show FDS Asset name in DataDocs (#9953)
- [DOCS] Update README.md (#10294)
- [DOCS] Fix gx core sidebar inconsistency in version 0.18 (#10302)
- [DOCS] Fix GX Core failing build (#10300)
- [DOCS] update allow list ips (#10308)
- [DOCS] Corrects typo in description for ExpectColumnMaxToBeBetween's min_value arg (#10285)
- [DOCS] Add pathname to Docs JIRA tickets description (#10312)
- [DOCS] Delete legacy version 0.17 files from docs (#10279)
- [DOCS] Theme selector (#10181)
- [DOCS] Corrects description of printed Validation Results object as json instead of yaml (#10287)
- [DOCS] Updates Data Asset prerequisite for create a Validation Definition guide to Batch Definition (#10288)
- [DOCS] Updates descriptions of Data Contexts with general use cases for each. (#10292)
- [DOCS] Updated airflow docs for core 1.0 compatibility (#10319)
- [DOCS] Indicate named parameters in reference table by including the value types (#10299)
- [DOCS] Updates to "Connect to GX Cloud with Python" guide (#10315)
- [DOCS] Fix bad typo (#10329)
- [DOCS] Removes dead links to old docs from Expectation docstrings (#10317)
- [DOCS] Adds instructions on persisting environment variables in Z Shell to the configure credentials guide (#10330)
- [DOCS] Data quality tech doc on Missingness (#10134)
- [DOCS] Regenerate superscript numbers (#10337)
- [DOCS] Replace Slack alerts with email alerts (#10320)
- [MAINTENANCE] Add metadata to UnexpectedRowsExpectation (#10311)
- [MAINTENANCE]
UnexpectedRowsExpectation
renderer and validation improvements (#10334)
1.0.1
- [BUGFIX] Checkpoint references the instance of ValidationDefinition t… (#10274)
- [DOCS] Promote 1.0 to the last version (#10261)
- [DOCS] Updates broken internal link in GX Cloud docs for v1.0 and v0.18 (#10247)
- [DOCS] Adds query strings and headers to all full code examples in GX Core docs (#10258)
- [DOCS] Replaces references to "GX OSS" and "GX 1.0" with "GX Core" (#10255)
- [DOCS] Quick fix to code block in test an Expectation guide (#10267)
- [DOCS] Update docstrings to reference Expectations by class name instead of validator method (#10268)
- [DOCS] Remove DatabricksSQL references to a
/database
path in connection string. (#10273) - [DOCS] Update application_integration_support.md (#10280)
- [DOCS] Correct database name in Databricks SQL docstring (#10148)
- [DOCS] LAK-1048: Update instructions to add assets (#10200)
- [DOCS] Corrects typo in
results_url
toresult_url
(#10283) - [DOCS] Remove examples dir (#10293)
- [DOCS] Updates to support and contribution docs to align with updated support posture (#10298)
- [DOCS] Updates method for checking the version of the installed GX Core library (#10286)
- [DOCS] Removes orphaned pages and content held over from OSS docs. (#10260)
- [MAINTENANCE] Loosen raumel pin for CVE-2019-20478 (#10266)
- [MAINTENANCE] Prevent CI from emitting analytics events (#10263)
- [MAINTENANCE] Add public api decorators to validation definition (#10282)
- [MAINTENANCE] Ignore Azure CI when emitting analytics events (#10291)
- [MAINTENANCE] Add validation definition ids to checkpoint creation events (#10290)
- [MAINTENANCE] mypy 1.11.2 (#10142)
- [MAINTENANCE] Remove override of
ValidationDefinition
init (#10278)
1.0.0
- [BUGFIX] Always rerender content (#10257)
- [BUGFIX] Ensure that all diagnostics for a Checkpoint's children validation definitions appear in error messages (#10250)
- [MAINTENANCE] Revert "[BUGFIX] Ensure that all diagnostics for a Checkpoint's children validation definitions appear in error messages" (#10256)
1.0.0a6
- [FEATURE] Add the public api to context.data_source and context.data_source.get (#10180)
- [FEATURE] Remove order_by from Asset API (#10187)
- [FEATURE] Rename name_* params to name (#10188)
- [FEATURE] Rename suite_param to expectation_param in validation_definitition (#10196)
- [FEATURE] Delete batch definition by name. (#10197)
- [FEATURE] Filter bad validation definitions and checkpoints coming back through stores. (#10219)
- [BUGFIX] Allow 0 ValidationDefinitions on a Checkpoint (#10194)
- [BUGFIX] Add directive to control generation of reader methods. (#10198)
- [BUGFIX] Ensure that data source and nested objects obtain IDs on add for all environments (#10221)
- [BUGFIX] Add StoreBackendError to missing exception list. (#10224)
- [BUGFIX] Use
is_added
checks inidentifier_bundle
serialization logic (#10245) - [BUGFIX] Filter and log bad expectations when loading a suite (#10248)
- [DOCS] Updated feedback modal (#10168)
- [DOCS] Fix syntax around getting batch definitions (#10189)
- [DOCS] Update file system batch params sample to use strings (#10190)
- [DOCS] DSB-796: Fix syntax highlighting (#10192)
- [DOCS] Puts 1.0 connect to SQL data code snippets in the documentation under test. (#10203)
- [DOCS] cloud UI v0 updates (#10205)
- [DOCS] Update GX version support in support posture (#10208)
- [DOCS] Transition feedback Jira tickets to kanban board (#10212)
- [DOCS] Updated deprecation policy (#10223)
- [DOCS] GX 1.0: Put documentation code under test for connect to filesystem data guides (#10186)
- [DOCS] Update README.md to remove out dated info on how to contribute to docs (#10226)
- [DOCS] Puts 1.0 documentation example code for how to run validations under test (#10230)
- [DOCS] Puts 1.0 example scripts for connecting to dataframe data under test. (#10225)
- [DOCS] puts 1.0 code under test for how to define Expectations (#10229)
- [DOCS] Revises the glossary for 1.0 (#10209)
- [DOCS] Puts scripts for 1.0 "create a Data Context" docs under test (#10228)
- [DOCS] Puts 1.0 example code for Checkpoints, Actions, and Result Format under test. (#10232)
- [DOCS] Puts 1.0 examples for how to customize Expectations under test. (#10235)
- [DOCS] Puts 1.0 example code for how to configure project settings under test (#10240)
- [DOCS] Puts 1.0 doc examples for how to configure Data Docs into scripts under test (#10243)
- [DOCS] Add docs tests step to CI (#10220)
- [DOCS] DOC-818: Update GX Core Overview and Try GX (#10237)
- [DOCS] Update README.md to reflect contribution posture (#10244)
- [MAINTENANCE] Update
teams.yml
(#10178) - [MAINTENANCE] Remove
notify_on
from base Action (#10179) - [MAINTENANCE] Remove
SuiteParameterStore
(#10191) - [MAINTENANCE] Use context manager to close session in CloudDataContext (#10195)
- [MAINTENANCE] Ensure GXCloudStoreBackend session is closed (#10204)
- [MAINTENANCE] Delete CloudMigrator and ConfigurationBundle (#10207)
- [MAINTENANCE] Ensure CloudDataStore session is closed (#10206)
- [MAINTENANCE] Update Posthog payloads (#10183)
- [MAINTENANCE] Ensure that
context.validation_definitions.all()
works with Cloud (#10216) - [MAINTENANCE] Add required keys to SuiteValidationResult.meta (#10214)
- [MAINTENANCE] Remove cascading saves within Checkpoint hierarchy (#10218)
- [MAINTENANCE] Get tests around rendered content passing (#10215)
- [MAINTENANCE] Raise informative errors if child objects are not persisted before parent (#10217)
- [MAINTENANCE] Update import path for UnexpectedRowsExpectation (#10234)
- [MAINTENANCE] Add posthog event for all deserialization error. (#10239)
- [MAINTENANCE] Enable Codecov Test Result Reporting (#10211)
- [MAINTENANCE] Add batch_parameters to validation results payload (#10236)
- [MAINTENANCE] Cut over analytics to prod (#10241)
- [MAINTENANCE] Add
AddedDiagnostics
helper class tois_added
flows (#10249)
1.0.0a5
- [FEATURE] add slack analytics for cloud (#9944)
- [FEATURE] Add serialization logic to Expectation models (#9949)
- [FEATURE] Add get data context mercury v1 integration test. (#9978)
- [FEATURE] SnowflakeDatasource update (#10005)
- [FEATURE] SnowflakeDatasource make
role
+warehouse
required (#10021) - [FEATURE] Experimental Python 3.12 support (#8862)
- [FEATURE] Add atomic renderer for
ExpectMulticolumnSumToEqual
(#10076) - [FEATURE] Add missing atomic renderers to Expectations (#10079)
- [FEATURE] Snowflake - Key-Pair auth updates from
0.18.x
(#10095) - [FEATURE] Add sentence case titles to Expectation schemas (#10097)
- [FEATURE] Use v1 data context endpoint (cloud) (#10093)
- [FEATURE] SnowflakeDatasource - AccountIdentifier error improvments (#10104)
- [FEATURE] use v1 cloud api for data sources (#10094)
- [FEATURE] Make save method for data context variables public (#10057)
- [FEATURE] Add context.data_sources.all (#10116)
- [FEATURE] Misc Data Source cleanup (#10126)
- [FEATURE] Clean up import structure for gx (#10146)
- [FEATURE] Turn on remaining v1 endpoints (#10155)
- [FEATURE] Update dataframe batch.validate workflow (#10165)
- [BUGFIX] Migrate back to github hosted runners until docker issue is fixed (#10011)
- [BUGFIX] Fix parsing of account/me response. (#10015)
- [BUGFIX] Handle OSError during save on read-only file system. (#10024)
- [BUGFIX] add ecr caching to trino and spark images (#10037)
- [BUGFIX] Avoid writing to great_expectations.yml during init (#10038)
- [BUGFIX] Z-score renderer when
double_sided
(#10084) - [BUGFIX] SQLDatasource (V1) - lowercase unquoted schema_names for SQLAlchemy case-sensitivity compatibility (#10109)
- [BUGFIX] Revert package update (#10118)
- [BUGFIX] Remove illegible duplicate local Data Docs link from Slack renderer (#10130)
- [BUGFIX] Fix type of StoreBackend._manually_initialize_store_backend_id (#10159)
- [BUGFIX] On store add, add id to input model (#10167)
- [BUGFIX] Add checkpoint_id to validation result meta (#10169)
- [BUGFIX] Update binary path in mssql docker image (#10171)
- [DOCS] Revises and reorganizes content for installing additional dependencies per the GX 1.0 ToC (#9934)
- [DOCS] Initial revision and reorg of "Create a Data Context" content for revised GX 1.0 ToC (#9938)
- [DOCS] Removes content for integrating with GCP from the BigQuery SQL connect to data topic in the 0.18.x docs (#9955)
- [DOCS] Clarify SQL Expectation Support in GX Cloud Docs (#9951)
- [DOCS] core expectation model metadata (#9967)
- [DOCS] Update Table and Multi Column Expectation docstrings (#9990)
- [DOCS] Add Alerts Content to the GX Cloud Documentation (#9880)
- [DOCS] Updates Expectations docstrings with supported OSS Data Sources for gallery (#10030)
- [DOCS] Adds GX 1.0 preview docs for Run Validations topic (#10026)
- [DOCS] Connect to data using SQL for GX 1.0 (#9971)
- [DOCS] Remove splitter from data asset docs and add batch definition documentation to expectation docs (#10032)
- [DOCS] Update path to config_variables.yml file in docs. (#10044)
- [DOCS] Add data quality use case TOC skeleton under Learn (#10049)
- [DOCS] GX 1.0 updated docs for Expectations (#10048)
- [DOCS] Updates broken links to code examples in github (#10059)
- [DOCS] Update feedback modal (#10054)
- [DOCS] Included all new expectations, grouped by DQ issue (#10062)
- [DOCS] 0.18.9 -> 0.18.17 changelogs (#10068)
- [DOCS] GX 1.0 Checkpoint guides (#10055)
- [DOCS] 1.0 Customize Expectations guides (#10066)
- [DOCS] Updated integrated support policy for 1.0 (#10064)
- [DOCS] Fix typo (#10083)
- [DOCS] Fix styles for hovering button in terminal (#10090)
- [DOCS] update gx cloud and airflow doc (#10025)
- [DOCS] Updated documentation for the GX Scheduler (#10103)
- [DOCS] 1.0 connect to filesystem data guides (#10115)
- [DOCS] 1.0 guides for connecting to data in dataframes (#10133)
- [DOCS] 1.0 guide for getting sample data for testing or data exploration (#10136)
- [DOCS] Added more expectations for Cloud, sorted by DQ issue (#10137)
- [DOCS] Incorporating review feedback (#10138)
- [DOCS] first draft for Data Quality: Schema tech doc (#10022)
- [DOCS] Update docs to include Runner and suppress Agent (#10139)
- [DOCS] Typo corrections in GX Cloud docs (#10156)
- [DOCS] Integrate feedback modal with Jira (#10110)
- [DOCS] DSB-961: Fix table of contents highlighting (#10152)
- [DOCS] Add dedicated page for scheduler (#10158)
- [DOCS] 1-0 guide: how to toggle analytics collection (#10166)
- [DOCS] 1.0 preview docs: Configure project Stores (#10150)
- [DOCS] 1.0 guide for securely storing and accessing credentials and tokens (#10157)
- [DOCS] updated older support policy (#10174)
- [MAINTENANCE] Exclude patterns from codecov reports (#9941)
- [MAINTENANCE] Temporary: xfail tests that hit fastapi (#9946)
- [MAINTENANCE] Clean up extraneous GX Cloud enums (#9947)
- [MAINTENANCE] Add fastapi to docker-compose for mercury (#9948)
- [MAINTENANCE] Changes to allow local testing using mercury's docker-compose (#9976)
- [MAINTENANCE] Ensure that validation definitions and checkpoints save before running (#9963)
- [MAINTENANCE] core expectation metadata (#9985)
- [MAINTENANCE] Export types for all of GX (V1 pre-release) (#9987)
- [MAINTENANCE] Add
metadata
property to Expectation schemas (#9993) - [MAINTENANCE] Add schemas for Table and Multi-Column Expectations (#9991)
- [MAINTENANCE] Migrate ci to enterprise-arc runners (#9757)
- [MAINTENANCE] Upgrade to pytest 8 (#10006)
- [MAINTENANCE] ruff
0.4.8
(#10009) - [MAINTENANCE] Add custom types to Expectation schemas (#9994)
- [MAINTENANCE] Remove unused properties on single Expectation (#10004)
- [MAINTENANCE] Patch for CVE-2024-36039 (#10016)
- [MAINTENANCE] Bump context config version to 4.0 (#10013)
- [MAINTENANCE] Clean up top-level
conftest.py
(#10014) - [MAINTENANCE] Refactor metadata for ColumnAggregate Expectations (#10019)
- [MAINTENANCE] Rename
ExpectationConfiguration
expectation_type
totype
(#10018) - [MAINTENANCE] Define JSON Schemas for ColumnAggregate Expectations (#10020)
- [MAINTENANCE] configure images to pull through our ecr cache (#10001)
- [MAINTENANCE] Move
mostly
to correct Expectation classes (#10027) - [MAINTENANCE] Add metadata to
ColumnMapExpectations
(#10034) - [MAINTENANCE] : change expectation kwarg types (breaking change) (#10051)
- [MAINTENANCE] add json schema field description (#10065)
- [MAINTENANCE] update ignore panda db client warning (#10071)
- [MAINTENANCE] Improve Expectation schemas (#10099)
- [MAINTENANCE] Have DCV point at V1 (#10102)
- [MAINTENANCE] Update
ConfigStr
+ConfigUri
json schema definition (#10023) - [MAINTENANCE] Parametrize
TestConnectionError
(#10105) - [MAINTENANCE] Loosen
ruamel.yaml
pin (v1) (#10106) - [MAINTENANCE] Remove public api decorator from non-public V1 code. (#10111)
- [MAINTENANCE] Update yarn.lock to handle vanta vulnerbilities. (#10114)
- [MAINTENANCE] Pin setuptools, we error with the latest. (#10119)
- [MAINTENANCE] Revert "[MAINTENANCE] Pin setuptools, we error with the latest." (#10123)
- [MAINTENANCE] Allow numpy 2 (#10122)
- [MAINTENANCE] Ruff
0.5.3
(#10124) - [MAINTENANCE] Forbid extra attrs on V1 Pydantic models (#10127)
- [MAINTENANCE] Add context.data_sources.get (#10125)
- [MAINTENANCE] mypy -
possibly-undefined
(#10092) - [MAINTENANCE] Remove immutability from validation definition (#10141)
- [MAINTENANCE] Add a clause when we reraise exceptions in tuple_store_backend.py (#10160)
- [MAINTENANCE] update_datasource returns the updated datasource (#10170)
- [MAINTENANCE] Temporarily update Pandas pins to unblock V1 prerelease (#10175)