Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Purge dask-expr #1648

Merged
merged 3 commits into from
Jan 16, 2025
Merged

Purge dask-expr #1648

merged 3 commits into from
Jan 16, 2025

Conversation

hendrikmakait
Copy link
Member

Follow-up to dask/dask#11623
Closes #1647

The only thing I haven't purged is the dask_expr_version column from the runs.

@@ -142,7 +141,6 @@ def tpch_database_table_schema(request, testrun_uid, scale, query, local):
originalname=request.node.originalname,
path=str(request.node.path.relative_to(TEST_DIR)),
dask_version=dask.__version__,
dask_expr_version=dask_expr.__version__,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a DB change. I'm not sure if any of our CI jobs reacts to this. Technically, this would require a DB migration (but I'm also fine with just setting this to null)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If I understand correctly, this would just set the TPCHRun.dask_expr_version to None, which is allowed:

dask_expr_version = Column(String, nullable=True)
. To change the actual data model, we do indeed need a migration and should remove the linked line from the ORM model.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, that's what I wanted. Thanks for checking

@hendrikmakait hendrikmakait requested a review from fjetter January 16, 2025 12:18
@fjetter fjetter merged commit 1e9d697 into main Jan 16, 2025
11 of 13 checks passed
@fjetter fjetter deleted the purge-dask-expr branch January 16, 2025 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

⚠️ CI failed ⚠️
3 participants