Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix azure databricks + docs #15

Merged
merged 3 commits into from
Jan 31, 2025
Merged

fix azure databricks + docs #15

merged 3 commits into from
Jan 31, 2025

Conversation

aldevv
Copy link
Contributor

@aldevv aldevv commented Jan 27, 2025

No description provided.

Copy link

@shackra shackra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not 100% sure if databricks hostname is a flag required always 100% of the time that this connector is use, but without a default value it may be better to set it to required.


func GetAccountHostname(cfg *viper.Viper) string {
if cfg.GetString(config.AccountHostnameField.FieldName) == "" {
return "accounts." + GetHostname(cfg)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this will work for Azure or GCP, as the hostname provided will be something like 8757561887652360.0.gcp.databricks.com or adb-5555555555555555.19.azuredatabricks.net, but the account hostnames for those need to be accounts.gcp.databricks.com and accounts.azuredatabricks.net respectively. Prepending "accounts" to the hostnames will result in accounts.8757561887652360.0.gcp.databricks.com and accounts.adb-5555555555555555.19.azuredatabricks.net, which isn't correct.

Copy link
Contributor

@btipling btipling Jan 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ggreer Isn't that solved by just using account-hostname ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes but we should change the behavior to detect GCP and Azure hostnames and return correct account hostnames for them.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ggreer I made this change 7de4791

@btipling btipling merged commit 74592dc into main Jan 31, 2025
3 checks passed
@btipling btipling deleted the jbernal/azure_databricks_fix branch January 31, 2025 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants