Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrade tests are flaky #112

Open
beliaev-maksim opened this issue Jun 27, 2023 · 0 comments
Open

upgrade tests are flaky #112

beliaev-maksim opened this issue Jun 27, 2023 · 0 comments
Labels
bug Something isn't working Kubeflow 1.8 This issue affects the Charmed Kubeflow 1.8 release

Comments

@beliaev-maksim
Copy link
Member

it looks like that when we call for an upgrade sometimes we have a race when the charm is refreshed but manifests are still of the old version.
That causes tests to fail (which is healed by rerun)

Traceback (most recent call last):
  File "/home/runner/work/training-operator/training-operator/tests/integration/test_charm.py", line 261, in test_upgrade
    assert (
AssertionError: assert ('tfjobs.kubeflow.org', 'v0.6.0') in [('xgboostjobs.kubeflow.org', 'v0.10.0'), ('tfjobs.kubeflow.org', 'v0.10.0'), ('pytorchjobs.kubeflow.org', 'v0.10.0'), ('mxjobs.kubeflow.org', 'v0.10.0'), ('mpijobs.kubeflow.org', 'v0.10.0'), ('paddlejobs.kubeflow.org', 'v0.10.0')]

see https://github.com/canonical/training-operator/actions/runs/5331136179/jobs/9660014634

@ca-scribner ca-scribner added the bug Something isn't working label Jul 5, 2023
@orfeas-k orfeas-k added the Kubeflow 1.8 This issue affects the Charmed Kubeflow 1.8 release label Aug 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Kubeflow 1.8 This issue affects the Charmed Kubeflow 1.8 release
Projects
None yet
Development

No branches or pull requests

3 participants