Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: a new workflow always generates two new datasets #877

Closed
1 task done
aittalam opened this issue Feb 14, 2025 · 0 comments · Fixed by #884
Closed
1 task done

[BUG]: a new workflow always generates two new datasets #877

aittalam opened this issue Feb 14, 2025 · 0 comments · Fixed by #884
Assignees
Labels
bug Something isn't working

Comments

@aittalam
Copy link
Member

Description

When one inference + eval workflow is run, two datasets are generated by the same inference job instead of just one.

Reproduction

  • Run a new evaluation workflow given a dataset which already has GT
  • Check the list of datasets at the end of the workflow: two new datasets with predictions will be generated by the same model

Relevant log output

Expected behavior

Only one dataset should be generated.
I already pinpointed the issue which is that dataset generation has been enabled automatically both at job level and at workflow level.
I have a possible solution in mind, will self-assign this issue and push a PR soon for it.

System Info

  • OS: Mac
  • Lumigator version: 1bb8af9

Have you searched for similar issues before submitting this one?

  • Yes, I have searched for similar issues
@aittalam aittalam added the bug Something isn't working label Feb 14, 2025
@aittalam aittalam self-assigned this Feb 14, 2025
@aittalam aittalam linked a pull request Feb 17, 2025 that will close this issue
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant