v0.5.22

[desmondcheongzx]

What's Changed 🚀

💥 Breaking Changes

• refactor!: use struct datatype as daft representation of tuples @universalmind303 (refactor!: use struct datatype as daft representation of tuples #5030)

✨ Features

• feat: Add uv.lock to git @desmondcheongzx (feat: Add uv.lock to git #5065)
• feat: Add Hash Function Support for Decimal128, Time, Timestamp, Timestamptz Datatypes @Zyiqin-Miranda (feat: Add Hash Function Support for Decimal128, Time, Timestamp, Timestamptz Datatypes  #5026)
• feat: pushdown for lance scan @Jay-ju (feat: pushdown for lance scan #4710)
• feat: add lance merge_column task @Jay-ju (feat: add lance merge_column task #5008)
• feat: Make the max parallel of scan tasks configurable for Native Runner @plotor (feat: Make the max parallel of scan tasks configurable for Native Runner #5018)
• feat: basic generator udf @kevinzwang (feat: basic generator udf #5036)
• feat: implements an openai provider with embed_text @rchowell (feat: implements an openai provider with embed_text #4997)
• feat: daft.File object store support @universalmind303 (feat: daft.File object store support #5002)

🐛 Bug Fixes

• fix: Use cachebusting and range request fallback for HTTP requests to Hugging Face CDNs @desmondcheongzx (fix: Use cachebusting and range request fallback for HTTP requests to Hugging Face CDNs #5061)
• fix: Use async for starting and calling udf actors in flotilla @colin-ho (fix: Use async for starting and calling udf actors in flotilla #5000)
• fix: Always refresh tqdm when updating total @colin-ho (fix: Always refresh tqdm when updating total #5033)
• fix: Fix docs build @desmondcheongzx (fix: Fix docs build #5066)
• fix: require uv as prerequisite for development setup @ykdojo (fix: require uv as prerequisite for development setup #5059)
• fix: Add missing source command in Makefile install-docs-deps target @ykdojo (fix: Add missing source command in Makefile install-docs-deps target #5060)
• fix: Mermaid syntax error when enable explain analyze for Native Runner @plotor (fix: Mermaid syntax error when enable explain analyze for Native Runner #5052)
• fix: clean notebook output before running tests & tweak doc proc notebook @malcolmgreaves (fix: clean notebook output before running tests & tweak doc proc notebook #5055)
• fix: correct Modin query optimizer value in comparison tables @ykdojo (fix: correct Modin query optimizer value in comparison tables #4983)
• fix: skip credentialed tests if not from main @rchowell (fix: skip credentialed tests if not from main #5048)
• fix: subprocess UDF inherits current process env @rchowell (fix: subprocess UDF inherits current process env #5047)
• fix: sql/spark read_iceberg and read_deltalake @kevinzwang (fix: sql/spark read_iceberg and read_deltalake #5035)
• fix(blc): Disabled pipefail @rohitkulshreshtha (fix(blc): Disabled pipefail #5031)

♻️ Refactor

• refactor!: use struct datatype as daft representation of tuples @universalmind303 (refactor!: use struct datatype as daft representation of tuples #5030)

📖 Documentation

• docs: Make overview page legible for light mode @desmondcheongzx (docs: Make overview page legible for light mode #5067)
• docs: Move custom python code higher up in docs @desmondcheongzx (docs: Move custom python code higher up in docs #5064)
• docs: Add better description in overview page @jaychia (docs: Add better description in overview page #5063)
• docs: remove core_concepts.md and broken anchor link references @ykdojo (docs: remove core_concepts.md and broken anchor link references #5062)
• docs: fix formatting @rchowell (docs: fix formatting #4994)
• docs: remove runllm widget @ccmao1130 (docs: remove runllm widget #5056)
• docs: add reo script to docs @ccmao1130 (docs: add reo script to docs #5049)
• docs: fix broken UDF link due to core_concepts.md redirect @ykdojo (docs: fix broken UDF link due to core_concepts.md redirect #5022)
• docs: fix typo "Github" --> "GitHub" @metonym (docs: fix typo "Github" --> "GitHub" #5025)
• docs: fix df.limit link in quickstart.md @rockokw (docs: fix df.limit link in quickstart.md #5013)

👷 CI

• ci: Don't run pr test suite on non-code changes fr @desmondcheongzx (ci: Don't run pr test suite on non-code changes fr #5057)

🔧 Maintenance

• chore: Remove deprecated APIs for 0.6 @colin-ho (chore: Remove deprecated APIs for 0.6 #5050)
• chore: disable hugging face library progress bars @kevinzwang (chore: disable hugging face library progress bars #5040)
• chore: relax assertion in flaky sharding distribution test @Jay-ju (chore: relax assertion in flaky sharding distribution test #5053)
• chore(dev): use pyproject.toml to manage the dev dependencies @xy-xin (chore(dev): use pyproject.toml to manage the dev dependencies #4849)
• chore: random the counter during creating DistributedActorPoolProject… @stayrascal (chore: random the counter during creating DistributedActorPoolProject… #5039)

⏪ Reverts

• revert: Temporarily revert "Remove deprecated APIs for 0.6" @desmondcheongzx (revert: Temporarily revert "Remove deprecated APIs for 0.6" #5068)

Full Changelog: v0.5.21...v0.5.22

---

This discussion was created from the release v0.5.22.