Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Speed up unit tests #760

Closed
wants to merge 25 commits into from
Closed

Conversation

joeylegere
Copy link
Contributor

@joeylegere joeylegere commented May 3, 2022

This is an interim solution to make our CI wait times less unbearable until we switch to Jenkins. Leverages pytest-split and github actions' matrix strategy to split all our tests across multiple workers.

If there are tests which are not part of the test durations file, then pytest-split assumes average execution time for them. This shouldn't cause too much of a problem, but I've included a script to periodically regenerate these average cases if we want to.

@codecov
Copy link

codecov bot commented May 3, 2022

Codecov Report

Merging #760 (134bcf4) into master (ed6a908) will increase coverage by 0.16%.
The diff coverage is n/a.

❗ Current head 134bcf4 differs from pull request most recent head 20f6a97. Consider uploading reports for the commit 20f6a97 to get more accurate results

@@            Coverage Diff             @@
##           master     #760      +/-   ##
==========================================
+ Coverage   81.86%   82.02%   +0.16%     
==========================================
  Files          42       42              
  Lines        4984     4984              
==========================================
+ Hits         4080     4088       +8     
+ Misses        904      896       -8     
Impacted Files Coverage Δ
bittensor/_dataset/dataset_impl.py 89.40% <0.00%> (-0.32%) ⬇️
bittensor/_subtensor/subtensor_impl.py 79.44% <0.00%> (ø)
bittensor/_metagraph/metagraph_impl.py 64.02% <0.00%> (+0.30%) ⬆️
bittensor/_threadpool/__init__.py 80.95% <0.00%> (+4.76%) ⬆️
bittensor/_config/__init__.py 80.64% <0.00%> (+9.67%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ed6a908...20f6a97. Read the comment docs.

@joeylegere joeylegere closed this May 5, 2022
@joeylegere joeylegere deleted the feature/make-tests-go-brr branch May 13, 2022 02:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants