v0.13.0
Includes Beam 2.48.0 support.
π§ Breaking Changes
- Support is dropped for Elasticsearch 6.
- Elasticsearch 7 is migrated to new elastic search java client
- File Taps API changed to accept read params
β οΈ avro write default suffix is now".avro"
(previously was""
). Extension is not appended automatically anymore.
π Enhancements
- Clean up Configuration initialization in scio-parquet (#4791) @clairemcginty
- Support EmptyMatchTreatment on TextIO (#4644) @turb
- Remove scio-elasticsearch v6 (#4802) @RustedBones
- Added optional header to saveAsDynamicTextFile (#4463) @ruchirsachdeva
- CoderTest changes for v0.13.x (#4806) @shnapz
- Remove deprecated avro specific coder macro (#4807) @RustedBones
- Relax avro record type bound (#4803) @RustedBones
- Mark Kryo coders nondeterminisitic (#4814) @kellen
- Provide module specific kryo coder registrar (#4753) @RustedBones
- Move TableRow API from core to GCP module (#4821) @RustedBones
- Add a better worded exception of unsupported SpecificRecord coder case (#4815) @shnapz
- Factorize scalactic and scalatest versions (#4836) @RustedBones
- Make ZSTD default compression for Parquet writes (#4726) @clairemcginty
- Added new JdbcIO read/write params to Scio (#4820) @shnapz
- Add prefix & suffix param for all IO APIs (#4809) @RustedBones
- Support EmptyMatchTreatment on JsonIO (#4818) @RustedBones
- Remove old skewed-join API (#4808) @RustedBones
- Support missing BQ write parameters (#4810) @RustedBones
- Use transform finder in JdbcIOTest (#4865) @RustedBones
- Cleanup context from fanout API (#4873) @RustedBones
- Move to avro extensions (#4883) @kellen
- Group grpc transforms (#4879) @RustedBones
- Safe coder unwrap (#4887) @RustedBones
- Add helper methods for Parquet ReadFiles transforms (#4801) @clairemcginty
π Bug Fixes
- Fix site generation (#4891) @RustedBones
- Fix stray copypaste error (#4892) @kellen
- Fix spelling in LowPriorityCoderDerivation (#4844) @shnapz
- Add newline in .sbtopts (#4835) @RustedBones
- Correct shardNameTemplate in tests (#4817) @kellen
- Fix build badge (#4798) @RustedBones
π Documentation
- Fix GHA Build Documnetation step (#4833) @RustedBones
- Fix site settings (#4834) @RustedBones
- Add new sbt-site-paradox plugin (#4837) @RustedBones
- Documentation revamp (#4871) @kellen
- Update doc for 0.13 release (#4893) @RustedBones
ποΈ Build improvements
- Clean dependencies and add CI checks (#4732) @RustedBones
- Ignore checkerframework update (#4843) @RustedBones
- Move scalafix rules in proper package (#4855) @RustedBones
- Move scalafix rules in proper package (cont'd) (#4856) @RustedBones
- Sync apache commons lib with beam (#4863) @RustedBones
- Set io implementation as provided for smb and parquet (#4857) @RustedBones
- Leverage sbt-project-matrix to test all scalafix rules in isolation (#4874) @RustedBones
- Fix scio version for scalafix (#4875) @RustedBones
- Fix semanticdb (#4877) @RustedBones
- Drop java 8 in CI, set java 11 default, test java 17 (#4747) @RustedBones
- Fix dependency issues (#4876) @RustedBones
π± Dependency Updates
- Update scala-collection-compat to 2.10.0 (#4790) @scala-steward
- Update sbt-ci-release to 1.5.12 (#4796) @scala-steward
- Update elasticsearch-java to 8.7.1 (#4795) @scala-steward
- Update cassandra-all to 3.11.15 (#4799) @scala-steward
- Update elasticsearch-java to 8.8.0 (#4822) @scala-steward
- Update kryo-shaded to 4.0.3 (#4823) @scala-steward
- Update sbt-explicit-dependencies to 0.3.1 (#4824) @scala-steward
- Update sbt-ghpages to 0.8.0 (#4825) @scala-steward
- Update sbt-site to 1.5.0 (#4827) @scala-steward
- Update sbt, sbt-dependency-tree to 1.8.3 (#4830) @scala-steward
- Update scalatest to 3.2.16 (#4832) @scala-steward
- Update scalactic to 3.2.16 (#4831) @scala-steward
- Update commons-io to 2.12.0 (#4828) @scala-steward
- Update jedis to 4.4.1 (#4841) @scala-steward
- Update jakarta.json-api to 2.0.2 (#4839) @scala-steward
- Update testcontainers-scala-elasticsearch, ... to 0.40.16 (#4838) @scala-steward
- Update scalafmt-core to 3.7.4 (#4847) @scala-steward
- Update jakarta.json-api to 2.1.2 (#4845) @scala-steward
- Update sbt-scoverage to 2.0.8 (#4854) @scala-steward
- Update sbt to 1.9.0 (#4850) @scala-steward
- Update sbt-scalafix to 0.11.0 (#4853) @scala-steward
- Update flink to v1.16 (#4858) @RustedBones
- Update sbt-jmh to 0.4.5 (#4861) @scala-steward
- Update scala versions to 2.12.18 and 2.13.11 (#4864) @RustedBones
- Update jedis to 4.4.2 (#4870) @scala-steward
- Update sbt-header to 5.10.0 (#4867) @scala-steward
- Update elasticsearch-java to 8.8.1 (#4866) @scala-steward
- Update mysql-socket-factory to 1.11.2 (#4826) @scala-steward
- Update mysql-socket-factory-connector-j-8 to 1.12.0 (#4884) @scala-steward
- Update jedis to 4.4.3 (#4885) @scala-steward
- Update testcontainers-scala-elasticsearch, ... to 0.40.17 (#4889) @scala-steward
- Update scala-collection-compat to 2.11.0 (#4888) @scala-steward
- Update beam-runners-core-construction-java, ... to 2.48.0 (#4846) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.4.1 to 4.4.2 (#4842) @dependabot
Contributors to this release
@RustedBones, @clairemcginty, @dependabot, @kellen, @ruchirsachdeva, @scala-steward, @turb, and @shnapz
Full Changelog: v0.12.8...v0.13.0