Skip to content

Latest commit

 

History

History
213 lines (190 loc) · 41.1 KB

bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c-vs-base.md

File metadata and controls

213 lines (190 loc) · 41.1 KB

Results vs. base

  • fork: python
  • ref: ec91e1c2762412f1408b
  • machine: linux-x86_64
  • commit hash: ec91e1c
  • commit date: 2025-01-23
  • overall geometric mean: 1.137x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.12x slower
  • Memory change: 1.20x

Benchmarks with tag 'apps':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
2to3 255 ms 305 ms: 1.19x slower
docutils 2.57 sec 2.80 sec: 1.09x slower
sphinx 984 ms 1.11 sec: 1.13x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
async_tree_io_tg 622 ms 581 ms: 1.07x faster
async_tree_none_tg 261 ms 252 ms: 1.04x faster
async_tree_io 624 ms 610 ms: 1.02x faster
asyncio_websockets 517 ms 512 ms: 1.01x faster
async_tree_memoization_tg 316 ms 321 ms: 1.02x slower
async_tree_cpu_io_mixed_tg 484 ms 503 ms: 1.04x slower
async_tree_none 270 ms 287 ms: 1.06x slower
async_tree_cpu_io_mixed 494 ms 534 ms: 1.08x slower
async_tree_memoization 323 ms 353 ms: 1.09x slower
coroutines 21.7 ms 24.0 ms: 1.11x slower
async_generators 322 ms 368 ms: 1.14x slower
Geometric mean (ref) 1.03x slower

Benchmarks with tag 'math':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
pidigits 192 ms 206 ms: 1.07x slower
float 70.6 ms 77.0 ms: 1.09x slower
nbody 87.1 ms 129 ms: 1.48x slower
Geometric mean (ref) 1.20x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
regex_effbot 2.57 ms 2.77 ms: 1.07x slower
regex_dna 168 ms 184 ms: 1.09x slower
regex_compile 127 ms 151 ms: 1.20x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (1): regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
xml_etree_iterparse 100 ms 87.3 ms: 1.15x faster
xml_etree_parse 129 ms 128 ms: 1.01x faster
json_loads 27.4 us 30.4 us: 1.11x slower
json_dumps 11.4 ms 12.9 ms: 1.13x slower
xml_etree_generate 83.6 ms 96.3 ms: 1.15x slower
xml_etree_process 59.0 ms 69.1 ms: 1.17x slower
unpickle_pure_python 214 us 251 us: 1.17x slower
pickle_pure_python 312 us 374 us: 1.20x slower
tomli_loads 1.92 sec 2.33 sec: 1.21x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
python_startup 14.6 ms 15.3 ms: 1.04x slower
python_startup_no_site 7.44 ms 9.59 ms: 1.29x slower
Geometric mean (ref) 1.16x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
genshi_xml 49.4 ms 59.9 ms: 1.21x slower
django_template 35.5 ms 43.3 ms: 1.22x slower
genshi_text 21.6 ms 27.6 ms: 1.28x slower
mako 11.8 ms 15.7 ms: 1.34x slower
Geometric mean (ref) 1.26x slower

All benchmarks:

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
create_gc_cycles 1.85 ms 1.37 ms: 1.35x faster
gc_traversal 4.23 ms 3.17 ms: 1.34x faster
xml_etree_iterparse 100 ms 87.3 ms: 1.15x faster
async_tree_io_tg 622 ms 581 ms: 1.07x faster
sqlite_synth 2.20 us 2.08 us: 1.06x faster
async_tree_none_tg 261 ms 252 ms: 1.04x faster
async_tree_io 624 ms 610 ms: 1.02x faster
asyncio_websockets 517 ms 512 ms: 1.01x faster
xml_etree_parse 129 ms 128 ms: 1.01x faster
async_tree_memoization_tg 316 ms 321 ms: 1.02x slower
async_tree_cpu_io_mixed_tg 484 ms 503 ms: 1.04x slower
python_startup 14.6 ms 15.3 ms: 1.04x slower
pathlib 17.8 ms 18.8 ms: 1.06x slower
async_tree_none 270 ms 287 ms: 1.06x slower
pycparser 1.12 sec 1.19 sec: 1.07x slower
bench_mp_pool 88.2 ms 94.5 ms: 1.07x slower
pidigits 192 ms 206 ms: 1.07x slower
regex_effbot 2.57 ms 2.77 ms: 1.07x slower
json 4.93 ms 5.30 ms: 1.08x slower
async_tree_cpu_io_mixed 494 ms 534 ms: 1.08x slower
docutils 2.57 sec 2.80 sec: 1.09x slower
float 70.6 ms 77.0 ms: 1.09x slower
async_tree_memoization 323 ms 353 ms: 1.09x slower
regex_dna 168 ms 184 ms: 1.09x slower
dulwich_log 75.1 ms 82.3 ms: 1.10x slower
bpe_tokeniser 4.25 sec 4.66 sec: 1.10x slower
coroutines 21.7 ms 24.0 ms: 1.11x slower
json_loads 27.4 us 30.4 us: 1.11x slower
json_dumps 11.4 ms 12.9 ms: 1.13x slower
pylint 280 ms 317 ms: 1.13x slower
generators 28.4 ms 32.1 ms: 1.13x slower
sphinx 984 ms 1.11 sec: 1.13x slower
logging_silent 106 ns 120 ns: 1.13x slower
k_core 2.04 sec 2.32 sec: 1.14x slower
async_generators 322 ms 368 ms: 1.14x slower
xml_etree_generate 83.6 ms 96.3 ms: 1.15x slower
many_optionals 1.02 ms 1.18 ms: 1.15x slower
spectral_norm 96.0 ms 111 ms: 1.16x slower
mdp 2.34 sec 2.71 sec: 1.16x slower
pprint_safe_repr 707 ms 821 ms: 1.16x slower
subparsers 21.8 ms 25.4 ms: 1.16x slower
sqlglot_normalize 104 ms 121 ms: 1.17x slower
xml_etree_process 59.0 ms 69.1 ms: 1.17x slower
unpickle_pure_python 214 us 251 us: 1.17x slower
pprint_pformat 1.44 sec 1.69 sec: 1.17x slower
scimark_sor 116 ms 138 ms: 1.18x slower
logging_simple 6.07 us 7.21 us: 1.19x slower
sqlglot_optimize 52.0 ms 61.9 ms: 1.19x slower
2to3 255 ms 305 ms: 1.19x slower
regex_compile 127 ms 151 ms: 1.20x slower
telco 7.16 ms 8.57 ms: 1.20x slower
sympy_expand 453 ms 543 ms: 1.20x slower
pickle_pure_python 312 us 374 us: 1.20x slower
logging_format 6.78 us 8.17 us: 1.21x slower
tomli_loads 1.92 sec 2.33 sec: 1.21x slower
genshi_xml 49.4 ms 59.9 ms: 1.21x slower
deepcopy 259 us 315 us: 1.22x slower
nqueens 78.1 ms 95.2 ms: 1.22x slower
sympy_sum 153 ms 186 ms: 1.22x slower
django_template 35.5 ms 43.3 ms: 1.22x slower
sympy_integrate 19.7 ms 24.2 ms: 1.22x slower
pyflate 416 ms 509 ms: 1.23x slower
scimark_fft 316 ms 388 ms: 1.23x slower
deepcopy_reduce 2.62 us 3.22 us: 1.23x slower
coverage 79.3 ms 97.8 ms: 1.23x slower
go 114 ms 141 ms: 1.23x slower
scimark_lu 111 ms 137 ms: 1.23x slower
thrift 741 us 916 us: 1.24x slower
sympy_str 270 ms 335 ms: 1.24x slower
comprehensions 16.9 us 20.9 us: 1.24x slower
connected_components 392 ms 488 ms: 1.24x slower
shortest_path 433 ms 540 ms: 1.25x slower
sqlalchemy_imperative 19.2 ms 24.0 ms: 1.25x slower
chaos 55.4 ms 69.4 ms: 1.25x slower
sqlglot_transpile 1.53 ms 1.93 ms: 1.26x slower
scimark_sparse_mat_mult 4.36 ms 5.51 ms: 1.26x slower
typing_runtime_protocols 159 us 201 us: 1.27x slower
genshi_text 21.6 ms 27.6 ms: 1.28x slower
scimark_monte_carlo 64.2 ms 82.6 ms: 1.29x slower
sqlalchemy_declarative 128 ms 164 ms: 1.29x slower
hexiom 5.75 ms 7.40 ms: 1.29x slower
raytrace 260 ms 335 ms: 1.29x slower
python_startup_no_site 7.44 ms 9.59 ms: 1.29x slower
crypto_pyaes 66.8 ms 86.5 ms: 1.30x slower
deepcopy_memo 29.7 us 38.5 us: 1.30x slower
sqlglot_parse 1.23 ms 1.60 ms: 1.30x slower
fannkuch 371 ms 485 ms: 1.31x slower
richards 42.3 ms 56.5 ms: 1.34x slower
mako 11.8 ms 15.7 ms: 1.34x slower
meteor_contest 98.2 ms 131 ms: 1.34x slower
richards_super 48.4 ms 65.9 ms: 1.36x slower
nbody 87.1 ms 129 ms: 1.48x slower
deltablue 3.09 ms 4.78 ms: 1.55x slower
bench_thread_pool 1.03 ms 3.32 ms: 3.21x slower
Geometric mean (ref) 1.17x slower

Benchmark hidden because not significant (1): regex_v8 Ignored benchmarks (1) of results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-vultr-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json: html5lib

  • Geometric mean (including insignificant results): 1.137x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.14x
  • 95% likely to have a slowdown of 1.13x
  • 99% likely to have a slowdown of 1.12x

Memory

  • memory change: 1.20x