Skip to content

Latest commit

 

History

History
209 lines (183 loc) · 39.5 KB

bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

209 lines (183 loc) · 39.5 KB

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: darwin-arm64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.03x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.00x slower
  • Memory change: 1.21x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 160 ms 172 ms: 1.07x slower
chameleon 4.33 ms 4.42 ms: 1.02x slower
docutils 1.44 sec 1.52 sec: 1.06x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (2): html5lib, tornado_http

Benchmarks with tag 'asyncio':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
async_tree_io_tg 565 ms 546 ms: 1.03x faster
async_tree_eager_cpu_io_mixed_tg 331 ms 333 ms: 1.00x slower
async_tree_eager_cpu_io_mixed 359 ms 363 ms: 1.01x slower
async_tree_eager_tg 41.3 ms 42.2 ms: 1.02x slower
async_tree_none 209 ms 215 ms: 1.03x slower
async_tree_eager 60.2 ms 63.1 ms: 1.05x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (10): async_tree_eager_io, async_tree_io, async_tree_cpu_io_mixed_tg, async_tree_eager_memoization_tg, async_tree_memoization_tg, async_tree_eager_io_tg, async_tree_cpu_io_mixed, async_tree_none_tg, async_tree_eager_memoization, async_tree_memoization

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
float 48.5 ms 47.6 ms: 1.02x faster
nbody 59.7 ms 64.0 ms: 1.07x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_effbot 2.58 ms 2.57 ms: 1.00x faster
regex_v8 17.2 ms 17.4 ms: 1.01x slower
regex_compile 68.4 ms 71.8 ms: 1.05x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): regex_dna

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
tomli_loads 1.48 sec 1.24 sec: 1.20x faster
unpickle_pure_python 140 us 131 us: 1.07x faster
pickle_pure_python 179 us 171 us: 1.05x faster
xml_etree_process 36.9 ms 35.8 ms: 1.03x faster
xml_etree_generate 52.9 ms 51.6 ms: 1.03x faster
pickle 7.49 us 7.37 us: 1.02x faster
xml_etree_iterparse 71.9 ms 70.9 ms: 1.01x faster
json_dumps 6.18 ms 6.10 ms: 1.01x faster
pickle_dict 18.3 us 18.2 us: 1.00x faster
json_loads 16.9 us 16.9 us: 1.00x faster
unpickle_list 2.91 us 2.95 us: 1.01x slower
xml_etree_parse 102 ms 106 ms: 1.04x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (2): pickle_list, unpickle

Benchmarks with tag 'startup':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
python_startup 15.0 ms 16.4 ms: 1.09x slower
python_startup_no_site 12.2 ms 13.5 ms: 1.11x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
mako 6.95 ms 6.37 ms: 1.09x faster
django_template 19.5 ms 21.2 ms: 1.09x slower
genshi_text 14.0 ms 16.1 ms: 1.15x slower
genshi_xml 29.7 ms 39.6 ms: 1.33x slower
Geometric mean (ref) 1.11x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
tomli_loads 1.48 sec 1.24 sec: 1.20x faster
mako 6.95 ms 6.37 ms: 1.09x faster
fannkuch 251 ms 233 ms: 1.08x faster
unpickle_pure_python 140 us 131 us: 1.07x faster
deepcopy_memo 22.7 us 21.6 us: 1.05x faster
pickle_pure_python 179 us 171 us: 1.05x faster
async_tree_io_tg 565 ms 546 ms: 1.03x faster
xml_etree_process 36.9 ms 35.8 ms: 1.03x faster
xml_etree_generate 52.9 ms 51.6 ms: 1.03x faster
pyflate 322 ms 314 ms: 1.03x faster
pprint_safe_repr 465 ms 457 ms: 1.02x faster
float 48.5 ms 47.6 ms: 1.02x faster
coverage 45.7 ms 44.9 ms: 1.02x faster
pickle 7.49 us 7.37 us: 1.02x faster
xml_etree_iterparse 71.9 ms 70.9 ms: 1.01x faster
logging_format 3.35 us 3.31 us: 1.01x faster
json_dumps 6.18 ms 6.10 ms: 1.01x faster
logging_simple 3.06 us 3.03 us: 1.01x faster
pprint_pformat 949 ms 944 ms: 1.01x faster
pickle_dict 18.3 us 18.2 us: 1.00x faster
telco 4.60 ms 4.59 ms: 1.00x faster
regex_effbot 2.58 ms 2.57 ms: 1.00x faster
json_loads 16.9 us 16.9 us: 1.00x faster
deepcopy_reduce 1.81 us 1.82 us: 1.00x slower
gc_traversal 2.46 ms 2.47 ms: 1.00x slower
async_tree_eager_cpu_io_mixed_tg 331 ms 333 ms: 1.00x slower
coroutines 15.9 ms 15.9 ms: 1.00x slower
spectral_norm 66.5 ms 67.0 ms: 1.01x slower
asyncio_tcp_ssl 1.28 sec 1.29 sec: 1.01x slower
async_tree_eager_cpu_io_mixed 359 ms 363 ms: 1.01x slower
regex_v8 17.2 ms 17.4 ms: 1.01x slower
unpickle_list 2.91 us 2.95 us: 1.01x slower
bpe_tokeniser 3.06 sec 3.09 sec: 1.01x slower
richards_super 35.1 ms 35.5 ms: 1.01x slower
deepcopy 203 us 206 us: 1.01x slower
meteor_contest 70.2 ms 71.2 ms: 1.01x slower
thrift 432 us 439 us: 1.02x slower
mdp 1.42 sec 1.44 sec: 1.02x slower
generators 22.8 ms 23.2 ms: 1.02x slower
sqlite_synth 1.54 us 1.57 us: 1.02x slower
scimark_fft 181 ms 185 ms: 1.02x slower
chameleon 4.33 ms 4.42 ms: 1.02x slower
async_tree_eager_tg 41.3 ms 42.2 ms: 1.02x slower
dask 219 ms 224 ms: 1.02x slower
create_gc_cycles 900 us 923 us: 1.02x slower
flaskblogging 3.49 ms 3.59 ms: 1.03x slower
logging_silent 60.3 ns 61.9 ns: 1.03x slower
async_tree_none 209 ms 215 ms: 1.03x slower
go 100 ms 103 ms: 1.03x slower
xml_etree_parse 102 ms 106 ms: 1.04x slower
sympy_expand 226 ms 235 ms: 1.04x slower
sympy_sum 69.3 ms 72.2 ms: 1.04x slower
sympy_str 132 ms 137 ms: 1.04x slower
bench_thread_pool 458 us 477 us: 1.04x slower
async_generators 284 ms 297 ms: 1.04x slower
scimark_monte_carlo 42.4 ms 44.3 ms: 1.05x slower
crypto_pyaes 49.6 ms 51.9 ms: 1.05x slower
scimark_sparse_mat_mult 2.78 ms 2.91 ms: 1.05x slower
async_tree_eager 60.2 ms 63.1 ms: 1.05x slower
regex_compile 68.4 ms 71.8 ms: 1.05x slower
typing_runtime_protocols 88.7 us 93.3 us: 1.05x slower
sympy_integrate 10.3 ms 10.9 ms: 1.05x slower
docutils 1.44 sec 1.52 sec: 1.06x slower
sqlglot_optimize 30.9 ms 32.7 ms: 1.06x slower
dulwich_log 27.5 ms 29.1 ms: 1.06x slower
pycparser 631 ms 668 ms: 1.06x slower
bench_mp_pool 47.3 ms 50.5 ms: 1.07x slower
aiohttp 1.03 ms 1.10 ms: 1.07x slower
nbody 59.7 ms 64.0 ms: 1.07x slower
hexiom 4.08 ms 4.38 ms: 1.07x slower
2to3 160 ms 172 ms: 1.07x slower
mypy2 381 ms 409 ms: 1.07x slower
nqueens 52.6 ms 56.6 ms: 1.07x slower
scimark_sor 95.4 ms 103 ms: 1.08x slower
django_template 19.5 ms 21.2 ms: 1.09x slower
python_startup 15.0 ms 16.4 ms: 1.09x slower
raytrace 147 ms 163 ms: 1.11x slower
python_startup_no_site 12.2 ms 13.5 ms: 1.11x slower
gunicorn 1.04 ms 1.16 ms: 1.12x slower
chaos 34.8 ms 39.2 ms: 1.13x slower
sqlglot_transpile 888 us 1.00 ms: 1.13x slower
sqlglot_parse 731 us 831 us: 1.14x slower
deltablue 2.15 ms 2.48 ms: 1.15x slower
genshi_text 14.0 ms 16.1 ms: 1.15x slower
scimark_lu 66.7 ms 79.6 ms: 1.19x slower
comprehensions 10.2 us 12.2 us: 1.20x slower
genshi_xml 29.7 ms 39.6 ms: 1.33x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (22): asyncio_tcp, pathlib, async_tree_eager_io, html5lib, pickle_list, asyncio_websockets, pidigits, regex_dna, richards, json, unpickle, async_tree_io, async_tree_cpu_io_mixed_tg, async_tree_eager_memoization_tg, async_tree_memoization_tg, async_tree_eager_io_tg, async_tree_cpu_io_mixed, tornado_http, async_tree_none_tg, async_tree_eager_memoization, async_tree_memoization, pylint Ignored benchmarks (1) of results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: sqlglot_normalize

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.01x
  • 95% likely to have a slowdown of 1.01x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: 1.21x