Upgrade to use Spark 3.5.5, Iceberg 1.7.1, Java 17

What's Changed

• Spark => 3.5.4, Iceberg => 1.7.1 by @mgmarino in #8

Full Changelog: release/2024.10.30...release/2025.01.08

> sha256sum *.tar.gz
7c680d8e2ec7c7a80b2b4a9e4a2d0f24c79247b7e594762382ea5dcb71b07d3a  pyspark-3.5.4.tar.gz

Upgrade to use Spark 3.5.3, Iceberg 1.6.1

What's Changed

• Bump Versions by @mgmarino in #7

Full Changelog: release/2024.06.14...release/2024.10.30

> sha256sum *.tar.gz
658c9b4ba7a46c61039f2ebe3b311726318fae7f931068c2669b3cf5c45db9de  pyspark-3.5.3.tar.gz

Upgrade to use Spark 3.5.1

What's Changed

• Upgrade to use Spark 3.5.1 by @mgmarino in #6

Full Changelog: release/2024.02.01...release/2024.06.14

> sha256sum *.tar.gz
0f1d990fb642609c525b926778e427ea6c26d9b2a26d35f91acf09a4fd03acb7  pyspark-3.5.1.tar.gz

Fix reference to pyspark version (3.3.0 only)

What's Changed

• Fix reference to pyspark version (3.3.0 only) by @mgmarino in #5

Full Changelog: release/2024.01.31...release/2024.02.01

> sha256sum *.tar.gz
173b1caa8aa3edf6db8a855361bb3a1dbedaf7231f06875d0ad84cf51ab2bb4b  pyspark-3.3.0.tar.gz

Exclude AWS SDK components

What's Changed

• Exclude AWS SDK components by @mgmarino in #4

Full Changelog: release/2024.01.18...release/2024.01.31

527c6528e9fcd774db847b959fb2ef5bd5b11bf5ce389c96ef799b1620235ac4 pyspark-3.3.0.tar.gz
df73d1b8d48477b7685dea29d7ab072e510c7f448425df4b45a8d879c3e34c17 pyspark-3.4.1.tar.gz

Use shaded uber jar for custom external dependencies

What's Changed

• Build fat, shaded jar for custom external dependencies by @mgmarino in #3

Full Changelog: release/2024.01.17...release/2024.01.18

SHA256:

09c40d8b58b0a432e7237408cc4dc8c259997c9ca4e987f824a25d6009493c8d  pyspark-3.3.0.tar.gz
71089524aa442650645bafe916066240094632fe58990affe53a96d06ac3552a  pyspark-3.4.1.tar.gz

Update Spark dependencies

What's Changed

• Fix Spark Dependencies by @mgmarino in #2

Full Changelog: release/2024.01.15...release/2024.01.17

SHA256:

e6b24c4ff740504a1aadb03d330c6a393a3b2b00c3dc827906195cf0b32cc822  pyspark-3.3.0.tar.gz
efacea7c1df7db7b4e00d5adc2dc4a6488703181260424df2b8418dc34604175  pyspark-3.4.1.tar.gz

Shade aws glue client dependencies

Rem

Initial release of custom spark

What's Changed

• Add initial custom version of Spark by @mgmarino in #1

New Contributors

• @mgmarino made their first contribution in #1

Full Changelog: https://github.com/tadodotcom/data-spark/commits/release/2024.01.15