refresh for original repos #5
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Owner
dmaresma
commented
Jun 11, 2025
dmaresma
commented
- Tests pass
- ruff format
- README.md updated (if relevant)
- CHANGELOG.md entry added
…722) Updates the requirements on [pre-commit](https://github.com/pre-commit/pre-commit) to permit the latest version. - [Release notes](https://github.com/pre-commit/pre-commit/releases) - [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md) - [Commits](pre-commit/pre-commit@v3.7.1...v4.2.0) --- updated-dependencies: - dependency-name: pre-commit dependency-version: 4.2.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Fix required in export and added item and fields format * Removed not from not field.required * Update odcs_v3_importer.py * Update odcs_v3_importer.py Changed server.storageAccount * Updated regex requirements * Updated regex to be more universal * Fixed formatting * Fixed more formatting * fix turn nullable to required in test * fix PR issues --------- Co-authored-by: Damien Maresma <[email protected]>
Updates the requirements on [databricks-sql-connector](https://github.com/databricks/databricks-sql-python) to permit the latest version. - [Release notes](https://github.com/databricks/databricks-sql-python/releases) - [Changelog](https://github.com/databricks/databricks-sql-python/blob/main/CHANGELOG.md) - [Commits](databricks/databricks-sql-python@v3.7.0...v4.0.2) --- updated-dependencies: - dependency-name: databricks-sql-connector dependency-version: 4.0.2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [moto](https://github.com/getmoto/moto) from 5.1.1 to 5.1.3. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@5.1.1...5.1.3) --- updated-dependencies: - dependency-name: moto dependency-version: 5.1.3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…sions Hopefully resolves #729
* feat: more descriptive csv importer Replaced csv importer with a duckdb-based method. Output is more descriptive, including required and unique, when these differ from default value, up to 5 examples of each non-binary/non-boolean field, and min/max values on numeric fields. * Fix ruff format * fixed test * fix: supressing deprecation warning in lint/resolve.py --------- Co-authored-by: jochen <[email protected]>
* deep nesting of json objects in duckdb
Signed-off-by: Emmanuel Ferdman <[email protected]>
Updates the requirements on [databricks-sdk](https://github.com/databricks/databricks-sdk-py) to permit the latest version. - [Release notes](https://github.com/databricks/databricks-sdk-py/releases) - [Changelog](https://github.com/databricks/databricks-sdk-py/blob/main/CHANGELOG.md) - [Commits](databricks/databricks-sdk-py@v0.0.1...v0.50.0) --- updated-dependencies: - dependency-name: databricks-sdk dependency-version: 0.50.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…attened when exporting cds schema) (#740) Co-authored-by: Gilles Guglielmoni <[email protected]>
* feat: support quality definition at field and model level in great expectation export * fix: test_export_great_expectation failing test --------- Co-authored-by: Simon Auger <[email protected]>
* Use pip package for dcs
- Extracted the DataContractSpecification and the OpenDataContractSpecification in separate pip modules and use them in the CLI. - `datacontract import --format excel`: Import from Excel template https://github.com/datacontract/open-data-contract-standard-excel-template (#742) - Resolves #745
Bumps [pymssql](https://github.com/pymssql/pymssql) from 2.3.2 to 2.3.4. - [Release notes](https://github.com/pymssql/pymssql/releases) - [Changelog](https://github.com/pymssql/pymssql/blob/master/ChangeLog.rst) - [Commits](pymssql/pymssql@v2.3.2...v2.3.4) --- updated-dependencies: - dependency-name: pymssql dependency-version: 2.3.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [uvicorn](https://github.com/encode/uvicorn) from 0.34.0 to 0.34.2. - [Release notes](https://github.com/encode/uvicorn/releases) - [Changelog](https://github.com/encode/uvicorn/blob/master/docs/release-notes.md) - [Commits](Kludex/uvicorn@0.34.0...0.34.2) --- updated-dependencies: - dependency-name: uvicorn dependency-version: 0.34.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…ke sql (#756) * Include datacontract descriptions as comments in the snowflake ddl on export. * CHANGELOG.md
* added support for variant type in spark import and sql exporter * added support for variant type in spark import and sql exporter
Updates the requirements on [rich](https://github.com/Textualize/rich) to permit the latest version. - [Release notes](https://github.com/Textualize/rich/releases) - [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v13.7.0...v14.0.0) --- updated-dependencies: - dependency-name: rich dependency-version: 14.0.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…ed (#760) * added support for variant type in spark import and sql exporter * added support for variant type in spark import and sql exporter * complex types fix when exporting to sql and databricksType is defined. * complex types fix when exporting to sql and databricksType is defined. * complex types fix when exporting to sql and databricksType is defined.
…741) Updates the requirements on [pydantic](https://github.com/pydantic/pydantic) to permit the latest version. - [Release notes](https://github.com/pydantic/pydantic/releases) - [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md) - [Commits](pydantic/pydantic@v2.8.2...v2.11.3) --- updated-dependencies: - dependency-name: pydantic dependency-version: 2.11.3 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…3.0 (#744) Updates the requirements on [aiobotocore](https://github.com/aio-libs/aiobotocore) to permit the latest version. - [Release notes](https://github.com/aio-libs/aiobotocore/releases) - [Changelog](https://github.com/aio-libs/aiobotocore/blob/master/CHANGES.rst) - [Commits](aio-libs/aiobotocore@2.17.0...2.22.0) --- updated-dependencies: - dependency-name: aiobotocore dependency-version: 2.22.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…763) Bumps [testcontainers[kafka,minio,mssql,postgres]](https://github.com/testcontainers/testcontainers-python) from 4.9.2 to 4.10.0. - [Release notes](https://github.com/testcontainers/testcontainers-python/releases) - [Changelog](https://github.com/testcontainers/testcontainers-python/blob/main/CHANGELOG.md) - [Commits](testcontainers/testcontainers-python@testcontainers-v4.9.2...testcontainers-v4.10.0) --- updated-dependencies: - dependency-name: testcontainers[kafka,minio,mssql,postgres] dependency-version: 4.10.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [moto](https://github.com/getmoto/moto) from 5.1.3 to 5.1.4. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@5.1.3...5.1.4) --- updated-dependencies: - dependency-name: moto dependency-version: 5.1.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* added support for variant type in spark import and sql exporter * complex types fix when exporting to sql and databricksType is defined. * complex types fix when exporting to sql and databricksType is defined. * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * Enhance SparkImporter with logging and improve table comment retrieval handling --------- Co-authored-by: Alan Reese <[email protected]>
…cks function (#768) * fix: Soda Exporter did not correctly pass server object to create_checks function * missed the import * fix: Inline get_server method to avoid circular dependencies * Update changelog --------- Co-authored-by: jochen <[email protected]>
…specified on contract (#748) * fix: changed dbt constraint vs data test behaviour when no model type is specified in the data contract * fix: removed unused args * chore: updated changelog --------- Co-authored-by: jochenchrist <[email protected]>
…port (#767) * adding export for mermaid * adding mermaid export * adding the mermaid figure in the html export * adding mermaid figure to html export * adding test_export_mermaid * updating readme * ruff format and updating changelog * ruff format and updating changelog * updating changelog * update changelog * update changelog * updating the html export * changing test_export_mermaid w/ checks structural elements rather than exact string matching * Update README * Renamed from _export to _exporter Some styling * Move diagram closer to data model --------- Co-authored-by: jochen <[email protected]>
…rk importer support
…object (#771) * added support for variant type in spark import and sql exporter * added support for variant type in spark import and sql exporter * complex types fix when exporting to sql and databricksType is defined. * complex types fix when exporting to sql and databricksType is defined. * complex types fix when exporting to sql and databricksType is defined. * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * added table level comments to spark importer * Enhance SparkImporter with logging and improve table comment retrieval handling * started building import as sourc --> dataframe * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * modified spark importer to also accept a dataframe object * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description * updated spark importer pytest to test for dataframe object and description --------- Co-authored-by: Alan Reese <[email protected]> Co-authored-by: jochenchrist <[email protected]>
#773) Updates the requirements on [databricks-sdk](https://github.com/databricks/databricks-sdk-py) to permit the latest version. - [Release notes](https://github.com/databricks/databricks-sdk-py/releases) - [Changelog](https://github.com/databricks/databricks-sdk-py/blob/main/CHANGELOG.md) - [Commits](databricks/databricks-sdk-py@v0.0.1...v0.54.0) --- updated-dependencies: - dependency-name: databricks-sdk dependency-version: 0.54.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [moto](https://github.com/getmoto/moto) from 5.1.4 to 5.1.5. - [Release notes](https://github.com/getmoto/moto/releases) - [Changelog](https://github.com/getmoto/moto/blob/master/CHANGELOG.md) - [Commits](getmoto/moto@5.1.4...5.1.5) --- updated-dependencies: - dependency-name: moto dependency-version: 5.1.5 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: jochenchrist <[email protected]>
* Add data contract version and enable version search - add version number below contract title - add version number to data-search attribute * Update CHANGELOG
* UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * UPDATE * feat: enhance ODCS html with additional sections for support, pricing, team, roles, and SLA properties * UPDATE --------- Co-authored-by: jochen <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
15 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.