v0.4.3

[jaychia]

What's Changed 🚀

• build(docs): Adds make docs phony target @rchowell (build(docs): Adds make docs phony target #3693)

✨ Features

• feat: Add a new dashboard UI to Daft @raunakab (feat: Add a new dashboard UI to Daft #3738)
• feat(shuffles): Determination logic for pre shuffle merge @colin-ho (feat(shuffles): Determination logic for pre shuffle merge #3674)
• feat: Limit number of sources in merged scan task @colin-ho (feat: Limit number of sources in merged scan task  #3695)
• feat: Expose parquet chunk size to swordfish reads @colin-ho (feat: Expose parquet chunk size to swordfish reads #3714)
• feat: add LiteralValue::Int8 and Int16 @ugoa (feat: add LiteralValue::Int8 and Int16 #3736)
• feat: with_column(s)_renamed expression for DataFrame @jessie-young (feat: with_column(s)_renamed expression for DataFrame #3732)
• feat: Explain for swordfish @colin-ho (feat: Explain for swordfish #3667)
• feat: Adds .describe() to DataFrame and DESCRIBE to SQL @rchowell (feat: Adds .describe() to DataFrame and DESCRIBE to SQL #3720)
• feat: Add column format option to iter rows @colin-ho (feat: Add column format option to iter rows #3681)
• feat(core): make micropartition streamable over tables @universalmind303 (feat(core): make micropartition streamable over tables #3709)
• feat(iceberg): Adds support for read_iceberg with metadata_location to Daft-SQL @rchowell (feat(iceberg): Adds support for read_iceberg with metadata_location to Daft-SQL #3701)
• feat: Overwrite partitions mode @colin-ho (feat: Overwrite partitions mode #3687)
• feat(docs): Adds copy-to-clipboard to code samples @rchowell (feat(docs): Adds copy-to-clipboard to code samples #3702)
• feat(connect): sql @universalmind303 (feat(connect): sql #3696)
• feat: add binary string operations (length and concatenation) @f4t4nt (feat: add binary string operations (length and concatenation) #3646)
• feat(sql): Adds url_download and url_upload to daft-sql @rchowell (feat(sql): Adds url_download and url_upload to daft-sql #3690)
• feat(connect): distinct + sort @universalmind303 (feat(connect): distinct + sort #3677)
• feat(core): Implement null-safe equality operator @f4t4nt (feat(core): Implement null-safe equality operator #3663)
• feat(sql): Adds JsonScanBuilder to daft-scan and read_json to daft-sql @rchowell (feat(sql): Adds JsonScanBuilder to daft-scan and read_json to daft-sql #3683)
• feat: support using S3Config.credentials_provider for writes @kevinzwang (feat: support using S3Config.credentials_provider for writes #3648)
• feat(sql): Adds FROM source check for string paths @rchowell (feat(sql): Adds FROM source check for string paths #3679)
• feat(connect): Rust ray exec @universalmind303 (feat(connect): Rust ray exec #3666)

🐛 Bug Fixes

• fix: Set filter selectivity estimate lower bound @colin-ho (fix: Set filter selectivity estimate lower bound #3694)
• fix(join): joining on different types @kevinzwang (fix(join): joining on different types #3716)
• fix: to_cnf and to_dnf functions @kevinzwang (fix: to_cnf and to_dnf functions #3728)
• fix: pushdowns for unpivot @universalmind303 (fix: pushdowns for unpivot #3724)
• fix(optimizer): Fix issues with join graph construction @desmondcheongzx (fix(optimizer): Fix issues with join graph construction #3668)
• fix: Run filter null join key optimization once @colin-ho (fix: Run filter null join key optimization once #3657)

🚀 Performance

• perf: Track accumulated selectivity in logical plan to improve probe side decisions @desmondcheongzx (perf: Track accumulated selectivity in logical plan to improve probe side decisions #3734)
• perf: simplify boolean expression rules @kevinzwang (perf: simplify boolean expression rules #3731)
• perf(shuffles): Incrementally retrieve metadata in reduce @colin-ho (perf(shuffles): Incrementally retrieve metadata in reduce #3545)
• perf: Improve stats for join side determination @colin-ho (perf: Improve stats for join side determination #3655)

♻️ Refactor

• refactor: remove eyre from daft-connect @universalmind303 (refactor: remove eyre from daft-connect #3719)
• refactor(execution): NativeExecutor refactor @universalmind303 (refactor(execution): NativeExecutor refactor #3689)
• refactor: logical op constructor+builder boundary @kevinzwang (refactor: logical op constructor+builder boundary #3684)
• refactor(connect): internal refactoring to make connect code more organized & extensible @universalmind303 (refactor(connect): internal refactoring to make connect code more organized & extensible #3680)

📖 Documentation

• docs: linked mkdocs & api docs @ccmao1130 (docs: linked mkdocs & api docs #3703)
• docs: higher quality daft diagram for readme @ccmao1130 (docs: higher quality daft diagram for readme #3697)
• docs: add daft launcher docs to docs v2 @ccmao1130 (docs: add daft launcher docs to docs v2 #3678)

👷 CI

• ci: skip tests during publishing of release @jaychia (ci: skip tests during publishing of release #3744)
• ci: Allow upstream git refs to be used for benchmarking @desmondcheongzx (ci: Allow upstream git refs to be used for benchmarking #3730)
• ci: Remove daft tracing @raunakab (ci: Remove daft tracing #3692)
• ci: Add new benchmarking cluster profile @raunakab (ci: Add new benchmarking cluster profile #3665)

🔧 Maintenance

• chore: Pin sql server version in docker compose @colin-ho (chore: Pin sql server version in docker compose #3715)
• chore(connect): better error propagation & handling @universalmind303 (chore(connect): better error propagation & handling #3675)
• chore(connect): consolidate multiple files in tests/connect @universalmind303 (chore(connect): consolidate multiple files in tests/connect #3676)

Full Changelog: v0.4.2...v0.4.3

---

This discussion was created from the release v0.4.3.