Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] v0.3.0 wheels #1850

Closed
wants to merge 7 commits into from
Closed

[Versioning] v0.3.0 wheels #1850

wants to merge 7 commits into from

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jan 30, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 30, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1850

Note: Links to docs will display an error until the docs builds have been completed.

❌ 17 New Failures

As of commit 41c43bd with merge base d930f5c (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 30, 2024
@vmoens vmoens added the ciflow/binaries/all Build all binaries label Jan 30, 2024
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 30, 2024

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 30, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 62.8974ms 62.5163ms 15.9958 Ops/s 16.0599 Ops/s $\color{#d91a1a}-0.40\%$
test_sync 39.9815ms 34.2097ms 29.2315 Ops/s 28.9101 Ops/s $\color{#35bf28}+1.11\%$
test_async 0.1054s 32.9355ms 30.3624 Ops/s 29.8932 Ops/s $\color{#35bf28}+1.57\%$
test_simple 0.4126s 0.4117s 2.4289 Ops/s 2.3076 Ops/s $\textbf{\color{#35bf28}+5.26\%}$
test_transformed 0.6435s 0.5876s 1.7019 Ops/s 1.6603 Ops/s $\color{#35bf28}+2.51\%$
test_serial 1.3903s 1.3361s 0.7485 Ops/s 0.7293 Ops/s $\color{#35bf28}+2.63\%$
test_parallel 1.2885s 1.2103s 0.8262 Ops/s 0.8309 Ops/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-True-True-True] 0.1732ms 22.2445μs 44.9549 KOps/s 46.8422 KOps/s $\color{#d91a1a}-4.03\%$
test_step_mdp_speed[True-True-True-True-False] 47.0270μs 13.2581μs 75.4254 KOps/s 76.4334 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-True-True-False-True] 43.0900μs 12.8510μs 77.8151 KOps/s 80.5191 KOps/s $\color{#d91a1a}-3.36\%$
test_step_mdp_speed[True-True-True-False-False] 48.6230μs 7.7283μs 129.3952 KOps/s 131.6007 KOps/s $\color{#d91a1a}-1.68\%$
test_step_mdp_speed[True-True-False-True-True] 70.2600μs 23.7284μs 42.1437 KOps/s 43.9902 KOps/s $\color{#d91a1a}-4.20\%$
test_step_mdp_speed[True-True-False-True-False] 37.9500μs 14.5378μs 68.7861 KOps/s 69.2313 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-True-False-False-True] 41.5770μs 14.1700μs 70.5718 KOps/s 71.8355 KOps/s $\color{#d91a1a}-1.76\%$
test_step_mdp_speed[True-True-False-False-False] 31.4980μs 9.0250μs 110.8029 KOps/s 112.4897 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[True-False-True-True-True] 56.7150μs 24.5970μs 40.6553 KOps/s 41.3859 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[True-False-True-True-False] 54.6510μs 15.9992μs 62.5032 KOps/s 62.8471 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[True-False-True-False-True] 69.9800μs 13.9388μs 71.7422 KOps/s 72.5589 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-False-True-False-False] 28.1630μs 9.0823μs 110.1044 KOps/s 111.9686 KOps/s $\color{#d91a1a}-1.66\%$
test_step_mdp_speed[True-False-False-True-True] 50.3440μs 25.3476μs 39.4514 KOps/s 39.5985 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[True-False-False-True-False] 44.5920μs 16.9968μs 58.8345 KOps/s 58.5232 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-False-False-False-True] 40.0340μs 15.2251μs 65.6809 KOps/s 66.9806 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[True-False-False-False-False] 32.2700μs 10.2804μs 97.2729 KOps/s 98.9955 KOps/s $\color{#d91a1a}-1.74\%$
test_step_mdp_speed[False-True-True-True-True] 61.5240μs 24.8093μs 40.3074 KOps/s 41.6090 KOps/s $\color{#d91a1a}-3.13\%$
test_step_mdp_speed[False-True-True-True-False] 58.8490μs 16.0537μs 62.2910 KOps/s 63.5474 KOps/s $\color{#d91a1a}-1.98\%$
test_step_mdp_speed[False-True-True-False-True] 64.2490μs 16.5162μs 60.5465 KOps/s 63.2278 KOps/s $\color{#d91a1a}-4.24\%$
test_step_mdp_speed[False-True-True-False-False] 34.3540μs 10.2281μs 97.7701 KOps/s 100.0243 KOps/s $\color{#d91a1a}-2.25\%$
test_step_mdp_speed[False-True-False-True-True] 66.7540μs 25.6618μs 38.9684 KOps/s 39.7841 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[False-True-False-True-False] 48.9110μs 17.2136μs 58.0937 KOps/s 58.4099 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[False-True-False-False-True] 47.9290μs 17.6331μs 56.7115 KOps/s 58.8497 KOps/s $\color{#d91a1a}-3.63\%$
test_step_mdp_speed[False-True-False-False-False] 45.8850μs 11.5131μs 86.8578 KOps/s 88.6567 KOps/s $\color{#d91a1a}-2.03\%$
test_step_mdp_speed[False-False-True-True-True] 68.1060μs 27.2271μs 36.7282 KOps/s 37.0608 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[False-False-True-True-False] 61.4430μs 18.3141μs 54.6029 KOps/s 54.1758 KOps/s $\color{#35bf28}+0.79\%$
test_step_mdp_speed[False-False-True-False-True] 45.6950μs 17.4932μs 57.1652 KOps/s 57.9861 KOps/s $\color{#d91a1a}-1.42\%$
test_step_mdp_speed[False-False-True-False-False] 45.3930μs 11.6233μs 86.0338 KOps/s 87.1246 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[False-False-False-True-True] 56.7450μs 28.1775μs 35.4893 KOps/s 36.2267 KOps/s $\color{#d91a1a}-2.04\%$
test_step_mdp_speed[False-False-False-True-False] 56.2650μs 19.8252μs 50.4408 KOps/s 51.4529 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-False-False-False-True] 54.7610μs 18.6240μs 53.6942 KOps/s 55.0895 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[False-False-False-False-False] 38.0900μs 12.5841μs 79.4655 KOps/s 80.3870 KOps/s $\color{#d91a1a}-1.15\%$
test_values[generalized_advantage_estimate-True-True] 11.9643ms 9.4004ms 106.3785 Ops/s 104.1251 Ops/s $\color{#35bf28}+2.16\%$
test_values[vec_generalized_advantage_estimate-True-True] 61.1728ms 35.7524ms 27.9701 Ops/s 28.2245 Ops/s $\color{#d91a1a}-0.90\%$
test_values[td0_return_estimate-False-False] 0.2464ms 0.1675ms 5.9699 KOps/s 6.0246 KOps/s $\color{#d91a1a}-0.91\%$
test_values[td1_return_estimate-False-False] 25.8020ms 23.0829ms 43.3222 Ops/s 41.2368 Ops/s $\textbf{\color{#35bf28}+5.06\%}$
test_values[vec_td1_return_estimate-False-False] 37.2985ms 35.3620ms 28.2789 Ops/s 28.1801 Ops/s $\color{#35bf28}+0.35\%$
test_values[td_lambda_return_estimate-True-False] 36.6184ms 33.4852ms 29.8640 Ops/s 28.7572 Ops/s $\color{#35bf28}+3.85\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.8641ms 35.3516ms 28.2873 Ops/s 27.9958 Ops/s $\color{#35bf28}+1.04\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.3450ms 8.1840ms 122.1891 Ops/s 118.8743 Ops/s $\color{#35bf28}+2.79\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3317ms 1.9322ms 517.5427 Ops/s 542.6812 Ops/s $\color{#d91a1a}-4.63\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5585ms 0.3548ms 2.8185 KOps/s 2.8080 KOps/s $\color{#35bf28}+0.38\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.0728ms 46.1800ms 21.6544 Ops/s 20.6935 Ops/s $\color{#35bf28}+4.64\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.1572ms 3.0128ms 331.9205 Ops/s 331.5034 Ops/s $\color{#35bf28}+0.13\%$
test_dqn_speed 11.4407ms 5.7441ms 174.0911 Ops/s 174.6213 Ops/s $\color{#d91a1a}-0.30\%$
test_ddpg_speed 12.0477ms 11.0442ms 90.5453 Ops/s 89.1706 Ops/s $\color{#35bf28}+1.54\%$
test_sac_speed 24.9480ms 22.7110ms 44.0315 Ops/s 44.0303 Ops/s $+0.00\%$
test_redq_speed 15.0562ms 14.0165ms 71.3445 Ops/s 71.1307 Ops/s $\color{#35bf28}+0.30\%$
test_redq_deprec_speed 22.2068ms 21.2771ms 46.9989 Ops/s 47.4095 Ops/s $\color{#d91a1a}-0.87\%$
test_td3_speed 26.0818ms 16.0433ms 62.3313 Ops/s 62.8458 Ops/s $\color{#d91a1a}-0.82\%$
test_cql_speed 72.8423ms 71.9419ms 13.9001 Ops/s 13.8666 Ops/s $\color{#35bf28}+0.24\%$
test_a2c_speed 23.7727ms 21.3522ms 46.8335 Ops/s 47.0624 Ops/s $\color{#d91a1a}-0.49\%$
test_ppo_speed 22.5523ms 21.4608ms 46.5966 Ops/s 46.6058 Ops/s $\color{#d91a1a}-0.02\%$
test_reinforce_speed 22.3543ms 20.5843ms 48.5807 Ops/s 48.2732 Ops/s $\color{#35bf28}+0.64\%$
test_iql_speed 55.6972ms 54.5879ms 18.3191 Ops/s 17.7770 Ops/s $\color{#35bf28}+3.05\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.0201ms 2.6727ms 374.1599 Ops/s 372.7228 Ops/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 92.1786ms 0.5682ms 1.7601 KOps/s 1.9778 KOps/s $\textbf{\color{#d91a1a}-11.01\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7720ms 0.4810ms 2.0788 KOps/s 2.0852 KOps/s $\color{#d91a1a}-0.30\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3637ms 2.7359ms 365.5133 Ops/s 356.2686 Ops/s $\color{#35bf28}+2.59\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8400ms 0.5031ms 1.9875 KOps/s 1.9913 KOps/s $\color{#d91a1a}-0.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9650ms 0.4821ms 2.0742 KOps/s 2.0935 KOps/s $\color{#d91a1a}-0.92\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5609ms 2.4644ms 405.7733 Ops/s 408.6530 Ops/s $\color{#d91a1a}-0.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9639ms 0.6184ms 1.6170 KOps/s 1.6155 KOps/s $\color{#35bf28}+0.10\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7170ms 0.5937ms 1.6843 KOps/s 1.6899 KOps/s $\color{#d91a1a}-0.33\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2061ms 2.7130ms 368.6009 Ops/s 367.7904 Ops/s $\color{#35bf28}+0.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8079ms 0.5094ms 1.9632 KOps/s 1.9769 KOps/s $\color{#d91a1a}-0.69\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 92.7530ms 0.5807ms 1.7221 KOps/s 2.0440 KOps/s $\textbf{\color{#d91a1a}-15.75\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1110ms 2.7168ms 368.0806 Ops/s 371.7270 Ops/s $\color{#d91a1a}-0.98\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8617ms 0.5070ms 1.9725 KOps/s 1.9933 KOps/s $\color{#d91a1a}-1.04\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 1.9343ms 0.5338ms 1.8732 KOps/s 2.0856 KOps/s $\textbf{\color{#d91a1a}-10.19\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.6621ms 2.4480ms 408.4931 Ops/s 404.9554 Ops/s $\color{#35bf28}+0.87\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0023ms 0.6237ms 1.6034 KOps/s 1.6173 KOps/s $\color{#d91a1a}-0.86\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8483ms 0.5969ms 1.6754 KOps/s 1.6848 KOps/s $\color{#d91a1a}-0.56\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1019s 9.9869ms 100.1307 Ops/s 119.5355 Ops/s $\textbf{\color{#d91a1a}-16.23\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.8860ms 13.1413ms 76.0962 Ops/s 75.1357 Ops/s $\color{#35bf28}+1.28\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.2468ms 2.5261ms 395.8701 Ops/s 397.2579 Ops/s $\color{#d91a1a}-0.35\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1036s 8.0099ms 124.8462 Ops/s 97.6908 Ops/s $\textbf{\color{#35bf28}+27.80\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.4447ms 13.5834ms 73.6194 Ops/s 75.3782 Ops/s $\color{#d91a1a}-2.33\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.9923ms 2.5916ms 385.8568 Ops/s 398.4367 Ops/s $\color{#d91a1a}-3.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1161s 11.1108ms 90.0026 Ops/s 119.9245 Ops/s $\textbf{\color{#d91a1a}-24.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.5076ms 13.8950ms 71.9681 Ops/s 74.4827 Ops/s $\color{#d91a1a}-3.38\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.0557ms 2.7808ms 359.6076 Ops/s 366.3252 Ops/s $\color{#d91a1a}-1.83\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 30, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1253s 0.1235s 8.0959 Ops/s 8.2237 Ops/s $\color{#d91a1a}-1.55\%$
test_sync 0.1423s 0.1410s 7.0900 Ops/s 7.1613 Ops/s $\color{#d91a1a}-1.00\%$
test_async 0.2714s 0.1356s 7.3751 Ops/s 7.4365 Ops/s $\color{#d91a1a}-0.83\%$
test_single_pixels 0.1388s 0.1384s 7.2266 Ops/s 6.9997 Ops/s $\color{#35bf28}+3.24\%$
test_sync_pixels 0.1085s 0.1054s 9.4897 Ops/s 9.1425 Ops/s $\color{#35bf28}+3.80\%$
test_async_pixels 0.2337s 95.2947ms 10.4938 Ops/s 10.5557 Ops/s $\color{#d91a1a}-0.59\%$
test_simple 0.9541s 0.8862s 1.1284 Ops/s 1.1582 Ops/s $\color{#d91a1a}-2.57\%$
test_transformed 1.2039s 1.1395s 0.8776 Ops/s 0.8932 Ops/s $\color{#d91a1a}-1.75\%$
test_serial 2.5235s 2.4555s 0.4073 Ops/s 0.4084 Ops/s $\color{#d91a1a}-0.28\%$
test_parallel 3.2803s 3.2246s 0.3101 Ops/s 0.3078 Ops/s $\color{#35bf28}+0.76\%$
test_step_mdp_speed[True-True-True-True-True] 85.8910μs 33.6327μs 29.7330 KOps/s 29.4669 KOps/s $\color{#35bf28}+0.90\%$
test_step_mdp_speed[True-True-True-True-False] 41.9100μs 19.8437μs 50.3938 KOps/s 49.0700 KOps/s $\color{#35bf28}+2.70\%$
test_step_mdp_speed[True-True-True-False-True] 38.1710μs 18.6211μs 53.7026 KOps/s 51.9954 KOps/s $\color{#35bf28}+3.28\%$
test_step_mdp_speed[True-True-True-False-False] 40.6410μs 11.4070μs 87.6651 KOps/s 88.6438 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-True-False-True-True] 54.1310μs 35.5055μs 28.1647 KOps/s 27.8230 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-True-False] 48.2300μs 21.9971μs 45.4605 KOps/s 45.3326 KOps/s $\color{#35bf28}+0.28\%$
test_step_mdp_speed[True-True-False-False-True] 38.1310μs 20.5742μs 48.6046 KOps/s 48.0141 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-False-False] 30.4610μs 13.1809μs 75.8675 KOps/s 76.2503 KOps/s $\color{#d91a1a}-0.50\%$
test_step_mdp_speed[True-False-True-True-True] 62.2600μs 36.8115μs 27.1654 KOps/s 26.4901 KOps/s $\color{#35bf28}+2.55\%$
test_step_mdp_speed[True-False-True-True-False] 47.4610μs 23.9429μs 41.7660 KOps/s 41.4611 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-False-True-False-True] 78.6710μs 20.2962μs 49.2704 KOps/s 46.6918 KOps/s $\textbf{\color{#35bf28}+5.52\%}$
test_step_mdp_speed[True-False-True-False-False] 35.0600μs 13.4636μs 74.2744 KOps/s 75.7188 KOps/s $\color{#d91a1a}-1.91\%$
test_step_mdp_speed[True-False-False-True-True] 77.6410μs 39.8518μs 25.0930 KOps/s 25.3483 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-False-False-True-False] 55.9410μs 25.9332μs 38.5605 KOps/s 39.2704 KOps/s $\color{#d91a1a}-1.81\%$
test_step_mdp_speed[True-False-False-False-True] 0.1091ms 22.2635μs 44.9165 KOps/s 43.3537 KOps/s $\color{#35bf28}+3.60\%$
test_step_mdp_speed[True-False-False-False-False] 81.7010μs 14.9807μs 66.7524 KOps/s 66.5493 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[False-True-True-True-True] 64.5910μs 37.0175μs 27.0143 KOps/s 26.7456 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[False-True-True-True-False] 46.2510μs 23.8987μs 41.8433 KOps/s 41.8414 KOps/s $+0.00\%$
test_step_mdp_speed[False-True-True-False-True] 48.2610μs 24.3509μs 41.0662 KOps/s 39.8034 KOps/s $\color{#35bf28}+3.17\%$
test_step_mdp_speed[False-True-True-False-False] 38.6310μs 15.1944μs 65.8139 KOps/s 65.7912 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[False-True-False-True-True] 69.5810μs 39.8798μs 25.0754 KOps/s 25.3574 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-False-True-False] 71.5710μs 25.6893μs 38.9268 KOps/s 38.7815 KOps/s $\color{#35bf28}+0.37\%$
test_step_mdp_speed[False-True-False-False-True] 50.5700μs 26.3795μs 37.9082 KOps/s 37.3990 KOps/s $\color{#35bf28}+1.36\%$
test_step_mdp_speed[False-True-False-False-False] 35.3300μs 16.8744μs 59.2613 KOps/s 59.1331 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-False-True-True-True] 64.0110μs 41.0035μs 24.3881 KOps/s 24.6854 KOps/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[False-False-True-True-False] 46.7010μs 27.3997μs 36.4967 KOps/s 35.9702 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[False-False-True-False-True] 52.9810μs 26.1301μs 38.2700 KOps/s 37.6877 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-False-True-False-False] 43.0910μs 17.3648μs 57.5879 KOps/s 59.7862 KOps/s $\color{#d91a1a}-3.68\%$
test_step_mdp_speed[False-False-False-True-True] 72.3010μs 42.4579μs 23.5527 KOps/s 23.8691 KOps/s $\color{#d91a1a}-1.33\%$
test_step_mdp_speed[False-False-False-True-False] 51.5800μs 29.0917μs 34.3741 KOps/s 34.3464 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-False-False-False-True] 53.6700μs 27.4110μs 36.4817 KOps/s 35.6855 KOps/s $\color{#35bf28}+2.23\%$
test_step_mdp_speed[False-False-False-False-False] 84.2010μs 18.6427μs 53.6404 KOps/s 54.0732 KOps/s $\color{#d91a1a}-0.80\%$
test_values[generalized_advantage_estimate-True-True] 27.1000ms 26.5743ms 37.6304 Ops/s 37.4935 Ops/s $\color{#35bf28}+0.37\%$
test_values[vec_generalized_advantage_estimate-True-True] 89.4381ms 3.3710ms 296.6466 Ops/s 308.7894 Ops/s $\color{#d91a1a}-3.93\%$
test_values[td0_return_estimate-False-False] 0.1011ms 64.2357μs 15.5677 KOps/s 15.7908 KOps/s $\color{#d91a1a}-1.41\%$
test_values[td1_return_estimate-False-False] 57.9877ms 55.9974ms 17.8580 Ops/s 17.5254 Ops/s $\color{#35bf28}+1.90\%$
test_values[vec_td1_return_estimate-False-False] 2.1430ms 1.7878ms 559.3358 Ops/s 561.9678 Ops/s $\color{#d91a1a}-0.47\%$
test_values[td_lambda_return_estimate-True-False] 91.6852ms 88.8944ms 11.2493 Ops/s 10.9661 Ops/s $\color{#35bf28}+2.58\%$
test_values[vec_td_lambda_return_estimate-True-False] 3.9338ms 1.8173ms 550.2755 Ops/s 546.1760 Ops/s $\color{#35bf28}+0.75\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.1731ms 24.9602ms 40.0637 Ops/s 39.4797 Ops/s $\color{#35bf28}+1.48\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9097ms 0.7288ms 1.3721 KOps/s 1.3904 KOps/s $\color{#d91a1a}-1.32\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8740ms 0.6805ms 1.4695 KOps/s 1.4971 KOps/s $\color{#d91a1a}-1.84\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5387ms 1.4759ms 677.5408 Ops/s 680.3803 Ops/s $\color{#d91a1a}-0.42\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9605ms 0.6922ms 1.4446 KOps/s 1.4618 KOps/s $\color{#d91a1a}-1.18\%$
test_dqn_speed 14.7269ms 7.2844ms 137.2790 Ops/s 136.8052 Ops/s $\color{#35bf28}+0.35\%$
test_ddpg_speed 99.9108ms 15.0871ms 66.2817 Ops/s 70.8584 Ops/s $\textbf{\color{#d91a1a}-6.46\%}$
test_sac_speed 28.0649ms 27.4381ms 36.4456 Ops/s 36.1145 Ops/s $\color{#35bf28}+0.92\%$
test_redq_speed 12.4426ms 11.3504ms 88.1027 Ops/s 86.8008 Ops/s $\color{#35bf28}+1.50\%$
test_redq_deprec_speed 23.2625ms 22.2421ms 44.9597 Ops/s 45.0994 Ops/s $\color{#d91a1a}-0.31\%$
test_td3_speed 28.4789ms 18.4151ms 54.3031 Ops/s 53.8922 Ops/s $\color{#35bf28}+0.76\%$
test_cql_speed 74.3919ms 73.2968ms 13.6432 Ops/s 13.5305 Ops/s $\color{#35bf28}+0.83\%$
test_a2c_speed 25.2070ms 24.4709ms 40.8649 Ops/s 40.8080 Ops/s $\color{#35bf28}+0.14\%$
test_ppo_speed 25.5576ms 24.7392ms 40.4216 Ops/s 40.5911 Ops/s $\color{#d91a1a}-0.42\%$
test_reinforce_speed 24.2561ms 23.5459ms 42.4703 Ops/s 42.4096 Ops/s $\color{#35bf28}+0.14\%$
test_iql_speed 49.9353ms 49.0485ms 20.3880 Ops/s 20.3070 Ops/s $\color{#35bf28}+0.40\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.8780ms 3.6198ms 276.2573 Ops/s 274.7813 Ops/s $\color{#35bf28}+0.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6758ms 0.5498ms 1.8187 KOps/s 1.8274 KOps/s $\color{#d91a1a}-0.48\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7631ms 0.5217ms 1.9167 KOps/s 1.9130 KOps/s $\color{#35bf28}+0.19\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.9527ms 3.6041ms 277.4629 Ops/s 273.2045 Ops/s $\color{#35bf28}+1.56\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7836ms 0.5469ms 1.8284 KOps/s 1.8402 KOps/s $\color{#d91a1a}-0.64\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6901ms 0.5158ms 1.9387 KOps/s 1.9321 KOps/s $\color{#35bf28}+0.34\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4373ms 3.2860ms 304.3238 Ops/s 299.1904 Ops/s $\color{#35bf28}+1.72\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1311s 0.7911ms 1.2640 KOps/s 1.4773 KOps/s $\textbf{\color{#d91a1a}-14.44\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7638ms 0.6457ms 1.5488 KOps/s 1.5508 KOps/s $\color{#d91a1a}-0.13\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.8528ms 3.6051ms 277.3848 Ops/s 271.7143 Ops/s $\color{#35bf28}+2.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8257ms 0.5490ms 1.8214 KOps/s 1.8135 KOps/s $\color{#35bf28}+0.44\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7116ms 0.5214ms 1.9180 KOps/s 1.9133 KOps/s $\color{#35bf28}+0.25\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.9686ms 3.6294ms 275.5310 Ops/s 271.8994 Ops/s $\color{#35bf28}+1.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7231ms 0.5491ms 1.8213 KOps/s 1.8386 KOps/s $\color{#d91a1a}-0.94\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7330ms 0.5168ms 1.9350 KOps/s 1.9303 KOps/s $\color{#35bf28}+0.24\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4871ms 3.3457ms 298.8927 Ops/s 299.0400 Ops/s $\color{#d91a1a}-0.05\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9333ms 0.6734ms 1.4851 KOps/s 1.4700 KOps/s $\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8336ms 0.6460ms 1.5479 KOps/s 1.5394 KOps/s $\color{#35bf28}+0.55\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1219s 12.3383ms 81.0483 Ops/s 97.4181 Ops/s $\textbf{\color{#d91a1a}-16.80\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.9763ms 16.5262ms 60.5098 Ops/s 60.4859 Ops/s $\color{#35bf28}+0.04\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.9652ms 3.1461ms 317.8501 Ops/s 334.6005 Ops/s $\textbf{\color{#d91a1a}-5.01\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1205s 10.0481ms 99.5210 Ops/s 99.1354 Ops/s $\color{#35bf28}+0.39\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.9465ms 16.3735ms 61.0744 Ops/s 53.5321 Ops/s $\textbf{\color{#35bf28}+14.09\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.5815ms 3.1402ms 318.4551 Ops/s 332.0309 Ops/s $\color{#d91a1a}-4.09\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1214s 10.3431ms 96.6828 Ops/s 98.0067 Ops/s $\color{#d91a1a}-1.35\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 19.0066ms 16.6088ms 60.2092 Ops/s 60.0159 Ops/s $\color{#35bf28}+0.32\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.5677ms 3.3394ms 299.4591 Ops/s 311.4194 Ops/s $\color{#d91a1a}-3.84\%$

@vmoens vmoens added Release versioning Versioning change (version number etc) Environments Adds or modifies an environment wrapper Data Data-related PR, will launch data-related jobs labels Jan 31, 2024
@vmoens vmoens added the ciflow/docs tests full docs CI label Jan 31, 2024
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 31, 2024

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

@vmoens vmoens closed this Jan 31, 2024
@vmoens vmoens deleted the release/0.3.0 branch April 3, 2024 06:04
@vmoens vmoens restored the release/0.3.0 branch April 3, 2024 06:04
@vmoens vmoens deleted the release/0.3.0 branch August 7, 2024 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ciflow/binaries/all Build all binaries ciflow/docs tests full docs CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Data Data-related PR, will launch data-related jobs Environments Adds or modifies an environment wrapper Release versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot