Skip to content

Commit

Permalink
feature_cloud-ci-9c48b19811c0c09ecc0f96180391c3b210016405
Browse files Browse the repository at this point in the history
  • Loading branch information
satyaog committed Apr 12, 2024
1 parent 61e36c7 commit 81306d3
Show file tree
Hide file tree
Showing 2 changed files with 41 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
```
=================
Benchmark results
=================
fail n perf sem% std% peak_memory score weight
bert-fp16 0 5 151.02 0.1% 1.3% 24616 300.725584 0.00
bert-fp32 0 5 27.38 0.2% 2.3% 31580 54.595067 0.00
bert-tf32 0 5 115.84 0.1% 1.4% 31582 230.642201 0.00
bert-tf32-fp16 0 5 149.74 0.1% 0.8% 24616 298.387146 3.00
bf16 0 5 269.27 0.1% 3.2% 1804 536.886456 0.00
convnext_large-fp16 0 5 306.23 1.0% 11.9% 27478 613.486119 0.00
convnext_large-fp32 0 5 42.92 1.1% 13.9% 49598 85.161724 0.00
convnext_large-tf32 0 5 124.38 1.7% 21.5% 49598 248.974869 0.00
convnext_large-tf32-fp16 0 5 307.92 0.9% 11.0% 27478 614.876403 3.00
davit_large 0 5 291.07 0.3% 6.0% 34016 581.571322 1.00
davit_large-multi 0 4 361.19 2.2% 33.9% 37565 361.192001 5.00
dlrm 0 4 439977.31 0.9% 13.5% 7120 439977.312025 1.00
focalnet 0 5 379.50 0.3% 5.4% 26322 761.349663 2.00
fp16 0 5 252.66 0.1% 1.4% 1804 506.666461 0.00
fp32 0 5 18.99 0.1% 1.1% 2182 37.891780 0.00
llama 0 5 476.72 5.5% 78.3% 28442 929.438126 1.00
opt-1_3b 1 1 NaN NaN NaN -1 NaN 5.00
opt-6_7b 1 1 NaN NaN NaN 1534 NaN 5.00
reformer 0 5 55.58 0.2% 2.7% 25420 110.939912 1.00
regnet_y_128gf 0 5 78.26 0.5% 7.9% 31570 156.606182 2.00
resnet152 0 5 635.91 0.4% 6.6% 35958 1268.006105 1.00
resnet152-multi 0 4 793.77 2.2% 34.5% 43101 793.767437 5.00
resnet50 0 5 997.33 0.9% 15.2% 4746 1984.886806 1.00
rwkv 5 5 NaN NaN NaN 1574 NaN 1.00
stargan 0 5 38.03 1.5% 26.7% 53428 75.865288 1.00
super-slomo 0 5 41.29 0.5% 8.9% 33816 82.860098 1.00
t5 0 5 46.25 0.2% 4.3% 35460 92.544174 2.00
tf32 0 5 133.01 0.1% 1.3% 2182 265.167064 0.00
whisper 0 5 215.00 0.1% 1.4% 36740 428.188616 1.00
Scores
------
Failure rate: 5.22% (FAIL)
Score: 96.85
```
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 81306d3

Please sign in to comment.