Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix volume mount of spark-run on local cluster #3827

Merged
merged 1 commit into from
Apr 15, 2024
Merged

Fix volume mount of spark-run on local cluster #3827

merged 1 commit into from
Apr 15, 2024

Conversation

edingroot
Copy link
Contributor

@edingroot edingroot commented Apr 12, 2024 •
edited
Loading

Description

Error when running paasta spark-run --cluster-manager local ...

$ paasta spark-run --aws-profile dev --cluster-manager local --cmd 'echo done'
...
docker: Error response from daemon: fill out specgen: host directory cannot be empty.

This happens after a recent refactor which makes pod_template_path be empty when cluster-manager is local.

Test

./.tox/py38-linux/bin/paasta spark-run --aws-profile=dev --cluster-manager local --cmd 'echo done'

@edingroot edingroot merged commit 7c1b30c into master Apr 15, 2024
9 checks passed
@edingroot edingroot deleted the u/chi/local_spark_run_mount branch April 15, 2024 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@88manpreet 88manpreet 88manpreet approved these changes

@CaptainSame CaptainSame Awaiting requested review from CaptainSame

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@edingroot @88manpreet @chi-yelp