Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SUPPORT] 0.11 hudi upgraded to 1.0. #12651

Closed
liujinhui1994 opened this issue Jan 16, 2025 · 6 comments
Closed

[SUPPORT] 0.11 hudi upgraded to 1.0. #12651

liujinhui1994 opened this issue Jan 16, 2025 · 6 comments

Comments

@liujinhui1994
Copy link
Contributor

I read the official information and can't seem to find out how to upgrade lower versions of hudi to 1.0. We currently have 7,000 hudi tables in version 0.11. Can you guide me? I'm worried about the big risks.

hudi 0.11
spark3.2
flink1.8
hadoop3

@danny0405
Copy link
Contributor

you may need to upgrade to 0.15.0 first, we better do some manual tests from 0.15.0 to 1.0

@ad1happy2go
Copy link
Collaborator

@liujinhui1994 To migrate to 1.0.0, you have to atleast upgrade to 0.14.x +. There is one known regression also when you migrate from 0.11.0 to 0.14.1 and 0.15.0 regarding ComplexKeyGenerator. Please check it out if this will affect your usecase or not.

@BruceKellan
Copy link
Contributor

flink 1.8?

As far as I can remember, flink 1.8 is not supported in version 0.11.

@rangareddy
Copy link

In Hudi 1.0, new Flink bundles are supported starting from Flink 1.19 and 1.20.

Please refer the Hudi Flink Support Matrix:

Hudi Supported Flink version
1.0.x 1.14.x, 1.15.x, 1.16.x, 1.17.x, 1.18.x, 1.19.x, 1.20.x (default build)
0.15.x 1.14.x, 1.15.x, 1.16.x, 1.17.x, 1.18.x
0.14.x 1.13.x, 1.14.x, 1.15.x, 1.16.x, 1.17.x
0.13.x 1.13.x, 1.14.x, 1.15.x, 1.16.x
0.12.x 1.13.x, 1.14.x, 1.15.x
0.11.x 1.13.x, 1.14.x

@rangareddy
Copy link

And also find Hudi Migration Guide:

https://hudi.apache.org/docs/deployment#upgrading-to-100

@ad1happy2go
Copy link
Collaborator

Closing this one. Please reopen in case of any concerns or create a new one for more issues.

@github-project-automation github-project-automation bot moved this from ⏳ Awaiting Triage to ✅ Done in Hudi Issue Support Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

5 participants