You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The model ops test generation workflow(i.e .github/workflows/model-analysis.yml with generate_models_ops_test = True), generates model ops test in forge/test/models_ops/ path by extracting the unique ops configuration across all the models and then create PR for the generated models ops test and since all the generated model ops are marked with push pytest marker, ON PR workflow (.github/workflows/on-pr.yml) will run all the pytest including the generated models ops test. There will failure for the generated model ops test.
Instead of manually searching the failed test and update the failed test with xfail marker with failure reason. Create a script which will take a pytest logs fails which contains failures of the generated models ops test and search for failed test with respect to generated models ops test and update the failed test with xfail marker and failure reason extracted from the same pytest logs file for the respective test
The text was updated successfully, but these errors were encountered:
The model ops test generation workflow(i.e
.github/workflows/model-analysis.yml with generate_models_ops_test = True
), generates model ops test inforge/test/models_ops/
path by extracting the unique ops configuration across all the models and then create PR for the generated models ops test and since all the generated model ops are marked with push pytest marker, ON PR workflow (.github/workflows/on-pr.yml
) will run all the pytest including the generated models ops test. There will failure for the generated model ops test.Instead of manually searching the failed test and update the failed test with xfail marker with failure reason. Create a script which will take a pytest logs fails which contains failures of the generated models ops test and search for failed test with respect to generated models ops test and update the failed test with xfail marker and failure reason extracted from the same pytest logs file for the respective test
The text was updated successfully, but these errors were encountered: