Tracking issue for release 0.3.0

[xushiyan]

Tasks

Issues

• All other issues in the release milestone should be closed.

Prepare release candidate(s)

• Create a release branch
• Bump the version in the release branch for the target RC
• Bump the version in main branch
• Upload the target RC artifacts to the ASF dev repo (SVN)
• Verify the target RC artifacts
• Push a desired RC release git tag to the release branch
• Start VOTE in [email protected]

Important

Proceed from here only after VOTE passes.

Official release

• Bump the version in the release branch for the official release
• Push the official release git tag to the release branch
• Upload the release artifacts to the ASF release repo (SVN)
• Merge a PR to update the changelog in main branch
• Publish release notes in https://github.com/apache/hudi-rs/releases
• Register ASF release in https://reporter.apache.org/addrelease.html?hudi
• Send ANNOUNCE email to dev and user email lists
• Close this tracking issue and the release milestone

[xushiyan]

Changelog

All notable changes to this project will be documented in this file.

[unreleased]

🚀 Features

• Define Hudi error types across hudi-core (feat: define Hudi error types across hudi-core #124) by @gohalo
• Support filter pushdown for datafusion (feat: support filter pushdown for datafusion #203) by @jonathanc-n
• Add demo app and integration tests (feat: add demo app and integration tests #226) by @xushiyan
• Add TimelineSelector to support timeline loading (feat: add TimelineSelector to support timeline loading #233) by @xushiyan
• Add hoodie.read.listing.parallelism config (feat: add hoodie.read.listing.parallelism config #235) by @xushiyan
• Support row filters for FileGroupReader (feat: support row filters for FileGroupReader #237) by @xushiyan
• Implement incremental query for COW tables (feat: implement incremental query for COW tables #236) by @xushiyan
• Implement log file reader for parquet log block (feat: implement log file reader for parquet log block #244) by @xushiyan
• Implement basic record merge semantics (feat: implement basic record merge semantics #249) by @xushiyan
• Add APIs for MOR snapshot reads (feat: add APIs for MOR snapshot reads #247) by @xushiyan
• Support time travel query for MOR tables (feat: support time travel query for MOR tables #256) by @xushiyan
• Support incremental read MOR tables (feat: support incremental read MOR tables #258) by @xushiyan
• Support MOR read-optimized query (feat: support MOR read-optimized query #259) by @xushiyan
• Support reading MOR with rollback (feat: support reading MOR with rollback #264) by @xushiyan
• Align python table APIs with rust (feat: align python table APIs with rust #267) by @xushiyan
• Add APIs to support incremental query impl (feat: add APIs to support incremental query impl #272) by @xushiyan

🐛 Bug Fixes

• Simplify partition filter format by taking tuple of strings (fix: simplify partition filter format by taking tuple of strings #170) by @kazdy
• Improve api to get file slices splits (fix: improve api to get file slices splits #185) by @xushiyan
• Handle schema retrieval for datafusion api (fix: handle schema retrieval for datafusion api #187) by @xushiyan
• Include commit_seqno for merge order (fix: include commit_seqno for merge order #250) by @xushiyan
• Format Hudi config enum should show the full config key (fix: format Hudi config enum should show the full config key #254) by @Kunal-Singh-Dadhwal
• Derive record merge strategy based on table configs (fix: derive record merge strategy based on table configs #260) by @xushiyan
• Handle as-of timestamp for excluding file groups (fix: handle as-of timestamp for excluding file groups #268) by @xushiyan
• Build up incremental file groups (fix: build up incremental file groups #273) by @xushiyan

🚜 Refactor

• Reorganize custom error types (refactor: reorganize custom error types #215) by @xushiyan
• Add API stubs for performing incremental queries (refactor: add API stubs for performing incremental queries #220) by @xushiyan
• Enhance Filter and related structs (refactor: enhance Filter and related structs #221) by @xushiyan
• Improve TimelineSelector API (refactor: improve TimelineSelector API #234) by @xushiyan
• Improve BaseFile APIs (refactor: improve BaseFile APIs #239) by @xushiyan
• Improve file system view's listing flow (refactor: improve file system view's listing flow #251) by @xushiyan
• Use static MetaField schema for incr query (refactor: use static MetaField schema for incr query #252) by @xushiyan
• Rename crate hudi-tests to hudi-test (refactor: rename crate hudi-tests to hudi-test #262) by @xushiyan
• Remove use of Filter from public APIs (refactor: remove use of Filter from public APIs #266) by @xushiyan

📚 Documentation

• Update README examples (docs: update README examples #194) by @xushiyan
• Update release and dev guides (docs: update release and dev guides #195) by @xushiyan
• Add example to hudi-datafusion crate (docs: add example to hudi-datafusion crate #202) by @jonathanc-n
• Add CREATE EXTERNAL TABLE example in datafusion crate (docs: add CREATE EXTERNAL TABLE example in datafusion crate #213) by @jonathanc-n
• Clarify issues in the dev guide (docs: clarify issues in the dev guide  #224) by @xushiyan
• Add in-code docs for FileGroup (docs: add in-code docs for FileGroup #269) by @xushiyan
• Update README.md to show table API examples (docs: update README.md to show table API examples #274) by @xushiyan

🛠️ Build

• (deps) Bump codecov/codecov-action from 4 to 5 (build(deps): bump codecov/codecov-action from 4 to 5 #184) by @dependabot[bot]
• (deps) Upgrade datafusion and object store (build(deps): upgrade datafusion and object store #182) by @kazdy
• (deps) Upgrade datafusion to 42.2.0 (build(deps): upgrade datafusion to 42.2.0 #192) by @xushiyan
• (deps) Upgrade Datafusion, Arrow, and Rust versions (build(deps): upgrade Datafusion, Arrow, and Rust versions #197) by @jonathanc-n
• (deps) Update pyo3 requirement from 0.22.2 to 0.22.4 (build(deps): update pyo3 requirement from 0.22.2 to 0.22.4 #212) by @jonathanc-n
• (deps) Clean up dependencies (build(deps): clean up dependencies #240) by @xushiyan
• (dep) Upgrade rustc, arrow, and tarpaulin setting (build(dep): upgrade rustc, arrow, and tarpaulin setting #276) by @xushiyan

⚙️ Miscellaneous Tasks

• Update release script and guide (chore: update release script and guide #200) by @xushiyan
• Update changelog for 0.2.0 (chore: update changelog for 0.2.0 #201) by @xushiyan
• Update pull request guidelines for contributors (chore: update pull request guidelines for contributors #204) by @jonathanc-n
• Add more dev commands and update the project's short description (chore: add more dev commands and update the project's short description #217) by @xushiyan
• Update codecov threshold (chore: update codecov threshold #222) by @xushiyan
• Update codecov config (chore: update codecov config #245) by @xushiyan
• Update codecov-action to v5 (chore: update codecov-action to v5 #248) by @K-dash
• (ci) Add rust dependency caching with rust-cache action (chore(ci): add rust dependency caching with rust-cache action #265) by @K-dash

New Contributors

• @K-dash made their first contribution in chore(ci): add rust dependency caching with rust-cache action #265

• @Kunal-Singh-Dadhwal made their first contribution in fix: format Hudi config enum should show the full config key #254

• @jonathanc-n made their first contribution in feat: support filter pushdown for datafusion #203