Skip to content

Conversation

@rafaqz
Copy link
Owner

@rafaqz rafaqz commented Mar 8, 2025

all finialised breaking changes for the next breaking version

tiemvanderdeure and others added 3 commits March 9, 2025 00:29
)

* DimVector of NamedTuple is a NamedTuple table

* bugfix

* remove show

* fix ambiguity
… for `AbstractDimStack` (#903)

* add combine method

* test groupby and similar

* docs entry
@codecov
Copy link

codecov bot commented Mar 9, 2025

Codecov Report

❌ Patch coverage is 86.75214% with 93 lines in your changes missing coverage. Please review.
✅ Project coverage is 87.30%. Comparing base (ec87f70) to head (569bb35).

Files with missing lines Patch % Lines
src/table_ops.jl 81.44% 18 Missing ⚠️
src/dimindices.jl 87.68% 17 Missing ⚠️
src/array/indexing.jl 70.27% 11 Missing ⚠️
src/stack/indexing.jl 33.33% 10 Missing ⚠️
src/groupby.jl 90.47% 6 Missing ⚠️
src/stack/stack.jl 91.30% 6 Missing ⚠️
src/tables.jl 94.23% 6 Missing ⚠️
src/Dimensions/dimension.jl 58.33% 5 Missing ⚠️
src/array/array.jl 90.74% 5 Missing ⚠️
src/utils.jl 42.85% 4 Missing ⚠️
... and 5 more
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #946      +/-   ##
==========================================
+ Coverage   86.91%   87.30%   +0.39%     
==========================================
  Files          55       57       +2     
  Lines        5341     5687     +346     
==========================================
+ Hits         4642     4965     +323     
- Misses        699      722      +23     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

* add preservedims keyword to DimTable

* add tests

* Apply suggestions from code review

Co-authored-by: Anshul Singhvi <[email protected]>

* tests, and fix DimSlices

* better table docs

* cleanup

* test

* indexing overhaul

* fix similar and broadcast for basicdimarray

* bugfix rebuildsliced

* more indexing cleanup

* cleanup similar and gubfix indexing

* bugfixes

* uncomment

* fix doctests

* just dont doctest unreproducable failures, for now

* combine new Tables integrations

* bugfix and cleanup show

* bugfix and more tests for preservedims and mergedims

---------

Co-authored-by: Anshul Singhvi <[email protected]>
rafaqz and others added 3 commits June 28, 2025 19:11
* iterate values where no layer is missing

* add tests

* add skipmissing to reference
* Table Materializer Methods

* Made col Optional for DimArray

* Apply suggestions from code review

Co-authored-by: Rafael Schouten <[email protected]>

* Handle coordinates with different loci

* replaced At() with Contains() in _coords_to_ords

* Added optional selectors and public methods for table materializer

* Updated table constructors for DimArray and DimStack

* Updated DimArray and DimStack docs to include table materializer methods

* Table materializer test cases

* export table materializer methods

* Added Random to tables.jl test cases

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Removed exports

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Replaced selector type with instance.

* Table materializer can now infer dimensions from the coordinates.

* Update src/stack/stack.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Added support for guessing the dimension ordering and span for Dates and DateTimes

* Replaced LinRange with StepRangeLen in _build_dim

* Added Tables.istable check to DimArray constructor

* Update src/array/array.jl

* merge materialize2

* fix scuffed merge

* filter instead of indexing in test for clarity

* fix DimSlices doc

* fix ambiguities

* bugfixes

* do checks and call Tables.columns before constructing stack from table

* test dimensions are automatically detected when constructing dimstack

* comments not docstrings for internals

* check for columnaccess if dims are passed

* add type argument to dimarray_from_table

* allow passing name to DimStack

* add a section to the documentation

* use Tables.columnnames instead of keys

* make DimArray work with all tables that are abstractarrays

* do not treat dimvectors as tables

* simplify get_column

---------

Co-authored-by: Rafael Schouten <[email protected]>
Co-authored-by: Tiem van der Deure <[email protected]>
@rafaqz
Copy link
Owner Author

rafaqz commented Aug 11, 2025

@tiemvanderdeure could you possibly resolve the broadcast.jl conflicts locally and PR them? (merge main into broken and just keep the changes to broadcast.jl)

There is now the BasicDimArray broadcast style, and your changes clash, and I'm not totally accross the new broadcast changes to know what to keep.

I can resolve the other conflicts afterwards

@rafaqz
Copy link
Owner Author

rafaqz commented Aug 15, 2025

Ok CHANGELOG.jl added, closing #983

After this I want to merge to main and bump a new breaking version, if there are any reviews or complaints about that get them in in the next 24 hours!

tiemvanderdeure and others added 4 commits August 17, 2025 11:35
* add _similar dispatch for abstractdimarray

* update tests

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

---------

Co-authored-by: Rafael Schouten <[email protected]>
* standardise interface methods and remove index

* update Changelog

* cleanup

* move const

* cleanup

* remove index from test

* dont export index

* last index

* tweaks

* more tweaks

* fix tests

---------

Co-authored-by: Raf Schouten <[email protected]>
* Forward name keyword in groupby

* Add test for setting groupby name explicitly

* Update src/groupby.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update test/groupby.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Add Changelog entry

* Mention name keyword in docstring

---------

Co-authored-by: Rafael Schouten <[email protected]>
@felixcremer
Copy link
Collaborator

Do you want to also merge the other breaking branches as well or what is your timeline for the breaking release?

@rafaqz
Copy link
Owner Author

rafaqz commented Aug 21, 2025

I'm not sure they will all make it, or how long it's worth waiting

@felixcremer
Copy link
Collaborator

felixcremer commented Sep 23, 2025

Do you have an idea why code coverage drops so significantly? It seems to be a lot of indirect changes but the test changes seem to be mainly removing index. I am wondering whether we are not hitting certain dispatch routes not anymore.

EDIT: We somehow skipped the dimindeces and methods tests which dropped the codecov massively.

@felixcremer
Copy link
Collaborator

This change incorporates the PRs:
#876 #839 #903 #917 #1009 #1041 #739 #1082 #1083 #1087 #1084 #1062

tiemvanderdeure and others added 2 commits October 15, 2025 19:46
…tions (#1113)

* do 0.6, 0.7.2 broke for us (#1099)

* Fix tests on julia 1.12 (#1110)

* use isequal instead of === to compare NaN

* drop all and broadcast

* specify DimensionalData.Dimensions to make reference unique in docs

* drop convert method for name to abstractstring

* remove `merge` method for dimstack with iterators of pairs

* add to changelog

---------

Co-authored-by: Lazaro Alonso <[email protected]>
@rafaqz
Copy link
Owner Author

rafaqz commented Oct 16, 2025

@codecov-ai-reviewer test

@codecov-ai
Copy link
Contributor

codecov-ai bot commented Oct 16, 2025

On it! Codecov is generating unit tests for this PR.

@codecov-ai
Copy link
Contributor

codecov-ai bot commented Oct 16, 2025

Sentry has determined that unit tests are not necessary for this PR.

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 16, 2025

lol, codecov is lazy on this one

@tiemvanderdeure
Copy link
Collaborator

Should we make a plan for which PR's we still want to include and when we want to release this? Just so it doesn't drag on forever

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 26, 2025

@tiemvanderdeure isn't it just your broadcast PR? I'm not waiting for anything else

@tiemvanderdeure
Copy link
Collaborator

There are a few open PRs that are marked breaking like #847 #926 #991 and possibly including refdims in tables by default #1119. Are we including any of those as well or is that for the next breaking release?

I think #1118 is already safe to merge - but I can make a Rasters branch for DD 0.30 later today and run tests to double check.

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 26, 2025

Yeah please test in Rasters first.

Those branches are all breaking but none of them are ready, so they can wait.

tiemvanderdeure and others added 4 commits October 30, 2025 12:38
* implement `instantiate` - get rid of BasicDimensionalStyle

* fix setindex! for opaquearray to make some error messages clearer

* fix materialize!
* put D parameter in AbstractDimStack

* update CHANGELOG.md
@tiemvanderdeure
Copy link
Collaborator

tiemvanderdeure commented Nov 5, 2025

Oops I made a typo in git and pushed directly to this branch....

EDIT: Figured it out

@rafaqz
Copy link
Owner Author

rafaqz commented Nov 5, 2025

Avoid reaching for --force, this branch is many hundreds of hours of work now. Given my current transient lifestyle its probably worth more than every material thing that I own 😂

I know we have a lot of copies of it but stil, just revert unless its your own branch. We could even block non PR changes to breaking.

rafaqz and others added 5 commits November 6, 2025 11:26
* Add dims fallback

* Update matmul for mixtures of normal arrays and dimarrays

* Fix bugs

* Add and remove some comparedims checks

* Add tests for matmul with DimUnitRange axes

* Test that dims is nothing for an array

* Test that dims returns dims if all axes DimUnitRange

* Check lookup of anon dims
* Complete unfinished docstring example

* Support refdims in DimTable

* Test refdims in DimTable

* By default add no refdims to Tables

To make feature non-breaking

* Update tables tests

* Test getcolumn for DimStack/DimArray

* Remove unused variable

* Update constructor calls

* Correctly compute dimnums

* Use all dims to compute colnames

* By default include refdims

* Make sure data-array is duplicated if necessary

* Add preservedims/refdims test

* Fix some bugs

* Add more joint compatibility tests with refdims

* Support AoG selection of refdims

* Only extended array with dims if needed

* Test AoG with refdims

* refdims doc line

---------

Co-authored-by: Rafael Schouten <[email protected]>
* add DimStackArray

* export DimStackArray

* add tests

* add a docstring

* drop inner constructor

Co-authored-by: Rafael Schouten <[email protected]>

* fix missing }

* fix DimStackArray type definition

* add tests for broadcast over stack

* add to the docs

---------

Co-authored-by: Rafael Schouten <[email protected]>
rafaqz and others added 2 commits November 9, 2025 22:01
Co-authored-by: Felix Cremer <[email protected]>
* Swap dims test and value test in ==

* Add isequal test

* Add broken test for dimarray isequal with different axes

* Make the same swap in == also for DimStack

* Add isequal for AbstractDimArray and AbstractDimstack

* Fix stack test

* Update test/stack.jl

Co-authored-by: Tiem van der Deure <[email protected]>

* Add Changelog entry

---------

Co-authored-by: Rafael Schouten <[email protected]>
Co-authored-by: Tiem van der Deure <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants