Commit be0c75f
Merge devel into runtime (#3385)
* override local marimo theme for dashboard (#3337)
This ensures custom CSS is always readable.
* Fix DocSearch v4 styles (#3338)
* Fix DocSearch v4 styles
* Fix search input styles for light and dark modes
* docs: update weaviate destination docs and version (#3352)
* Redshift feature: Include STS session token in COPY CREDENTIALS. (#3307)
* Redshift feature: Include STS session token in COPY CREDENTIALS. If aws_session_token is present, append the session token. Keeps IAM_ROLE path and long-lieved keys unchanged
---------
Co-authored-by: Tim Hable <[email protected]>
* fixes sqlglot from find (#3357)
* fixes athena refresh mode (#3313)
* adds filter to exclude dropped tables in staging destination, implements for athena
* enables refresh mode tests for athena, fixes tests
* fixes staging_allowed_local_path on databricks, bumps databricks connector in lockfile
* passes dropped tables schemas to filter, adjust athena filter
* allows to disable lake formation
* fix: backwards compatible traces (#3354)
* makes trace backward compat with 1.17.0 and earlier
* skips trace if any error in unpickle
* always saves merged pipeline trace to have consistent pipeline.last_trace property
* tests for past traces, broken traces and other improvements
* (docs) adds community destinations (#3326)
* adds community destinations
* Apply suggestions from code review
applies crate fixes
Co-authored-by: Andreas Motl <[email protected]>
---------
Co-authored-by: Andreas Motl <[email protected]>
* fix: dashboard no longer crashes on broken home cell (#3348)
* split home and workspace render methods
* header row dry-er
* catch-all errors in home()-cell
* local try-catch for broken traces
* e2e test for broken trace
* removes this
* shows navigation on pipeline attach error
---------
Co-authored-by: Marcin Rudolf <[email protected]>
* (fix) use sparse checkout for dlt init dlthub (#3356)
* adds option to sparse checkout repo
* use sparse checkout for llm context
* fixes sqlglot from find
* adds checkout after sparse clone
* explains unknown path tests
* Fix: The child table column remains in the schema as a partial column with seen-null-first=True (#3131)
* child table column removed from parent
* A utility functin that checks whether a column has seen-null-first set
* Improved comments and docstrings, separate method in worker
* null column not inferred if exists as compound
* Column level x-normalizer cleaning moved outside of worker
* Test for empty column becoming compound
* Test clean_seen_null_first_hint
* Uncalled source in pipeline.run( (#3369)
* fix flaky dashboard tests (#3370)
* improves dashboard multi schema test
* closes and waits for sections in multi-schema test
* removes command line snippet with generic text in exceptions
* disables transformers pokeapi test
* feat: `Schema.to_mermaid()` (#3364)
* Add dlt.Schema.to_mermaid() method
---------
Co-authored-by: jayant <[email protected]>
* Refactor boundary timestamp handling in SqlMergeFollowupJob and SqlalchemyMergeFollowupJob to ensure current load package creation time is used when no boundary timestamp is provided. Update DltResourceHints class to streamline timestamp validation for active_record_timestamp and boundary_timestamp. Adjust tests accordingly. (#3378)
* feat: `snowflake` clustering key modifications (#3365)
* add support for snowflake clustering key modifications
* add cluster column order test case
* update snowflake cluster hint docs
* switch to reading snowflake cluster hints from table schema
* docs: lifecycle of `@dlt.hub.transformation` and `dlt.Relation` (#3329)
* Lifecycle of a dlt transformation
* Added test to match lifecycle docs
* (fix) 3351 fixes default type var (#3373)
* tests minimal typing extensions in alpine docker
* keeps typevar default but does not use it in the code for backwart compat
---------
Co-authored-by: djudjuu <[email protected]>
Co-authored-by: Anton Burnashev <[email protected]>
Co-authored-by: Violetta Mishechkina <[email protected]>
Co-authored-by: Tim Hable <[email protected]>
Co-authored-by: Tim Hable <[email protected]>
Co-authored-by: rudolfix <[email protected]>
Co-authored-by: Andreas Motl <[email protected]>
Co-authored-by: anuunchin <[email protected]>
Co-authored-by: Thierry Jean <[email protected]>
Co-authored-by: jayant <[email protected]>
Co-authored-by: Menna <[email protected]>
Co-authored-by: Jorrit Sandbrink <[email protected]>1 parent b243302 commit be0c75f
File tree
75 files changed
+2770
-844
lines changed- deploy/dlt
- dlt
- _workspace
- cli
- helpers/dashboard
- common
- destination
- libs
- schema
- storages
- dataset
- destinations
- impl
- athena
- clickhouse
- databricks
- dremio
- ducklake
- dummy
- redshift
- snowflake
- sqlalchemy
- extract
- helpers
- load
- normalize
- pipeline
- docs
- docs_tools/examples
- website
- docs
- dlt-ecosystem/destinations
- general-usage
- dataset-access
- hub/features/transformations
- reference
- src/css
- tests
- e2e/helpers/dashboard
- extract
- helpers
- libs
- load
- athena_iceberg
- pipeline
- snowflake
- normalize
- pipeline
- cases/traces
- dlt.1.15_botched
- dlt.1.15
- dlt.1.18.2
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
75 files changed
+2770
-844
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
19 | | - | |
| 19 | + | |
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | 32 | | |
34 | 33 | | |
35 | 34 | | |
36 | 35 | | |
| 36 | + | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | | - | |
| 40 | + | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | | - | |
| 44 | + | |
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
48 | | - | |
49 | | - | |
| 48 | + | |
| 49 | + | |
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
55 | | - | |
56 | | - | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
122 | | - | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
123 | 125 | | |
124 | 126 | | |
125 | 127 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
378 | 378 | | |
379 | 379 | | |
380 | 380 | | |
| 381 | + | |
| 382 | + | |
381 | 383 | | |
382 | 384 | | |
383 | 385 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
488 | 488 | | |
489 | 489 | | |
490 | 490 | | |
| 491 | + | |
| 492 | + | |
491 | 493 | | |
492 | 494 | | |
493 | 495 | | |
| |||
0 commit comments