Skip to content

Latest commit

 

History

History
200 lines (174 loc) · 36.5 KB

bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257-vs-base.md

File metadata and controls

200 lines (174 loc) · 36.5 KB

Results vs. base

  • fork: python
  • ref: 327a257e6ae4ad0e3b6e
  • machine: linux-x86_64
  • commit hash: 327a257
  • commit date: 2025-01-23
  • overall geometric mean: 1.134x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.09x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
2to3 505 ms 617 ms: 1.22x slower
docutils 3.66 sec 4.12 sec: 1.12x slower
html5lib 86.8 ms 106 ms: 1.22x slower
sphinx 1.42 sec 1.63 sec: 1.15x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
async_tree_io_tg 928 ms 803 ms: 1.16x faster
async_tree_none_tg 389 ms 351 ms: 1.11x faster
coroutines 36.1 ms 33.8 ms: 1.07x faster
async_tree_cpu_io_mixed 728 ms 785 ms: 1.08x slower
async_tree_memoization 531 ms 578 ms: 1.09x slower
async_generators 515 ms 584 ms: 1.13x slower
async_tree_none 384 ms 480 ms: 1.25x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (4): async_tree_memoization_tg, asyncio_websockets, async_tree_io, async_tree_cpu_io_mixed_tg

Benchmarks with tag 'math':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
float 104 ms 114 ms: 1.09x slower
nbody 130 ms 186 ms: 1.43x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
regex_effbot 4.74 ms 4.08 ms: 1.16x faster
regex_compile 178 ms 209 ms: 1.17x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (2): regex_dna, regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
xml_etree_iterparse 168 ms 151 ms: 1.11x faster
xml_etree_process 97.4 ms 103 ms: 1.06x slower
xml_etree_generate 133 ms 145 ms: 1.09x slower
pickle_pure_python 435 us 478 us: 1.10x slower
tomli_loads 2.82 sec 3.20 sec: 1.13x slower
json_dumps 15.8 ms 18.1 ms: 1.14x slower
unpickle_pure_python 331 us 394 us: 1.19x slower
xml_etree_parse 189 ms 227 ms: 1.20x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (1): json_loads

Benchmarks with tag 'startup':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
python_startup 29.4 ms 35.2 ms: 1.19x slower
python_startup_no_site 16.5 ms 22.3 ms: 1.35x slower
Geometric mean (ref) 1.27x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
django_template 54.7 ms 64.1 ms: 1.17x slower
genshi_xml 72.6 ms 86.3 ms: 1.19x slower
mako 18.8 ms 24.3 ms: 1.29x slower
genshi_text 32.0 ms 43.6 ms: 1.36x slower
Geometric mean (ref) 1.25x slower

All benchmarks:

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
create_gc_cycles 3.53 ms 2.65 ms: 1.33x faster
bench_mp_pool 112 ms 95.0 ms: 1.18x faster
regex_effbot 4.74 ms 4.08 ms: 1.16x faster
async_tree_io_tg 928 ms 803 ms: 1.16x faster
xml_etree_iterparse 168 ms 151 ms: 1.11x faster
async_tree_none_tg 389 ms 351 ms: 1.11x faster
coroutines 36.1 ms 33.8 ms: 1.07x faster
pycparser 1.78 sec 1.69 sec: 1.06x faster
shortest_path 998 ms 1.05 sec: 1.05x slower
scimark_sor 188 ms 199 ms: 1.06x slower
xml_etree_process 97.4 ms 103 ms: 1.06x slower
async_tree_cpu_io_mixed 728 ms 785 ms: 1.08x slower
k_core 4.26 sec 4.62 sec: 1.08x slower
sqlglot_optimize 82.0 ms 88.9 ms: 1.08x slower
async_tree_memoization 531 ms 578 ms: 1.09x slower
thrift 1.19 ms 1.30 ms: 1.09x slower
connected_components 860 ms 939 ms: 1.09x slower
xml_etree_generate 133 ms 145 ms: 1.09x slower
scimark_sparse_mat_mult 7.50 ms 8.20 ms: 1.09x slower
float 104 ms 114 ms: 1.09x slower
pickle_pure_python 435 us 478 us: 1.10x slower
docutils 3.66 sec 4.12 sec: 1.12x slower
sympy_expand 641 ms 726 ms: 1.13x slower
async_generators 515 ms 584 ms: 1.13x slower
deepcopy 344 us 390 us: 1.13x slower
tomli_loads 2.82 sec 3.20 sec: 1.13x slower
json_dumps 15.8 ms 18.1 ms: 1.14x slower
scimark_lu 164 ms 188 ms: 1.15x slower
sphinx 1.42 sec 1.63 sec: 1.15x slower
telco 10.7 ms 12.3 ms: 1.15x slower
subparsers 35.4 ms 41.1 ms: 1.16x slower
django_template 54.7 ms 64.1 ms: 1.17x slower
regex_compile 178 ms 209 ms: 1.17x slower
sympy_str 403 ms 475 ms: 1.18x slower
mdp 3.56 sec 4.22 sec: 1.18x slower
genshi_xml 72.6 ms 86.3 ms: 1.19x slower
unpickle_pure_python 331 us 394 us: 1.19x slower
generators 43.9 ms 52.4 ms: 1.19x slower
python_startup 29.4 ms 35.2 ms: 1.19x slower
chaos 86.0 ms 103 ms: 1.20x slower
xml_etree_parse 189 ms 227 ms: 1.20x slower
comprehensions 24.2 us 29.3 us: 1.21x slower
many_optionals 1.16 ms 1.42 ms: 1.22x slower
html5lib 86.8 ms 106 ms: 1.22x slower
2to3 505 ms 617 ms: 1.22x slower
scimark_fft 438 ms 536 ms: 1.22x slower
scimark_monte_carlo 98.0 ms 120 ms: 1.23x slower
coverage 118 ms 146 ms: 1.24x slower
crypto_pyaes 108 ms 134 ms: 1.24x slower
pylint 417 ms 518 ms: 1.24x slower
richards 63.5 ms 79.1 ms: 1.25x slower
spectral_norm 141 ms 176 ms: 1.25x slower
async_tree_none 384 ms 480 ms: 1.25x slower
pyflate 649 ms 810 ms: 1.25x slower
gc_traversal 7.68 ms 9.72 ms: 1.27x slower
richards_super 63.5 ms 80.8 ms: 1.27x slower
bench_thread_pool 3.73 ms 4.76 ms: 1.28x slower
pprint_safe_repr 972 ms 1.24 sec: 1.28x slower
bpe_tokeniser 5.95 sec 7.63 sec: 1.28x slower
pprint_pformat 1.88 sec 2.41 sec: 1.28x slower
sympy_sum 199 ms 256 ms: 1.29x slower
mako 18.8 ms 24.3 ms: 1.29x slower
pathlib 25.7 ms 33.2 ms: 1.29x slower
sqlalchemy_declarative 179 ms 234 ms: 1.30x slower
logging_simple 9.20 us 12.3 us: 1.34x slower
typing_runtime_protocols 226 us 305 us: 1.35x slower
hexiom 8.31 ms 11.2 ms: 1.35x slower
meteor_contest 139 ms 188 ms: 1.35x slower
nqueens 105 ms 142 ms: 1.35x slower
python_startup_no_site 16.5 ms 22.3 ms: 1.35x slower
genshi_text 32.0 ms 43.6 ms: 1.36x slower
go 161 ms 220 ms: 1.37x slower
raytrace 341 ms 470 ms: 1.38x slower
sqlglot_parse 1.82 ms 2.51 ms: 1.38x slower
sqlglot_transpile 2.28 ms 3.18 ms: 1.39x slower
logging_format 9.02 us 12.7 us: 1.40x slower
fannkuch 493 ms 695 ms: 1.41x slower
sqlalchemy_imperative 22.5 ms 32.0 ms: 1.42x slower
nbody 130 ms 186 ms: 1.43x slower
sympy_integrate 27.0 ms 39.1 ms: 1.44x slower
deepcopy_memo 39.0 us 57.5 us: 1.48x slower
deltablue 4.77 ms 7.30 ms: 1.53x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (14): sqlite_synth, async_tree_memoization_tg, regex_dna, pidigits, sqlglot_normalize, asyncio_websockets, async_tree_io, dulwich_log, async_tree_cpu_io_mixed_tg, json_loads, logging_silent, regex_v8, deepcopy_reduce, json

  • Geometric mean (including insignificant results): 1.134x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.11x
  • 95% likely to have a slowdown of 1.10x
  • 99% likely to have a slowdown of 1.09x

Memory

  • memory change: 1.19x