Skip to content

Latest commit

 

History

History
206 lines (181 loc) · 38.5 KB

bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c-vs-base.md

File metadata and controls

206 lines (181 loc) · 38.5 KB

Results vs. base

  • fork: python
  • ref: ec91e1c2762412f1408b
  • machine: linux-x86_64
  • commit hash: ec91e1c
  • commit date: 2025-01-23
  • overall geometric mean: 1.136x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.12x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
2to3 475 ms 548 ms: 1.15x slower
docutils 3.84 sec 4.25 sec: 1.11x slower
html5lib 88.6 ms 112 ms: 1.26x slower
sphinx 1.43 sec 1.65 sec: 1.16x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
async_tree_io_tg 969 ms 803 ms: 1.21x faster
async_tree_none_tg 379 ms 359 ms: 1.06x faster
asyncio_websockets 728 ms 768 ms: 1.05x slower
async_tree_memoization_tg 487 ms 517 ms: 1.06x slower
async_tree_cpu_io_mixed 711 ms 788 ms: 1.11x slower
coroutines 30.2 ms 33.8 ms: 1.12x slower
async_generators 519 ms 595 ms: 1.15x slower
async_tree_none 388 ms 450 ms: 1.16x slower
async_tree_memoization 509 ms 600 ms: 1.18x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (2): async_tree_cpu_io_mixed_tg, async_tree_io

Benchmarks with tag 'math':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
nbody 131 ms 177 ms: 1.35x slower
Geometric mean (ref) 1.08x slower

Benchmark hidden because not significant (2): pidigits, float

Benchmarks with tag 'regex':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
regex_v8 37.3 ms 32.8 ms: 1.14x faster
regex_dna 296 ms 325 ms: 1.10x slower
regex_effbot 4.32 ms 4.78 ms: 1.11x slower
regex_compile 167 ms 197 ms: 1.18x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
json_loads 37.8 us 40.7 us: 1.08x slower
xml_etree_iterparse 142 ms 160 ms: 1.12x slower
xml_etree_parse 193 ms 225 ms: 1.17x slower
unpickle_pure_python 311 us 366 us: 1.17x slower
xml_etree_generate 121 ms 145 ms: 1.20x slower
pickle_pure_python 413 us 512 us: 1.24x slower
xml_etree_process 84.0 ms 107 ms: 1.28x slower
tomli_loads 2.50 sec 3.26 sec: 1.31x slower
Geometric mean (ref) 1.17x slower

Benchmark hidden because not significant (1): json_dumps

Benchmarks with tag 'startup':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
python_startup 29.2 ms 32.4 ms: 1.11x slower
python_startup_no_site 17.2 ms 21.8 ms: 1.26x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
django_template 50.1 ms 59.1 ms: 1.18x slower
genshi_xml 72.2 ms 95.0 ms: 1.32x slower
mako 17.2 ms 25.3 ms: 1.47x slower
genshi_text 29.6 ms 47.1 ms: 1.59x slower
Geometric mean (ref) 1.38x slower

All benchmarks:

Benchmark results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json results/bm-20250123-3.14.0a4+-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json
create_gc_cycles 3.57 ms 2.93 ms: 1.22x faster
async_tree_io_tg 969 ms 803 ms: 1.21x faster
regex_v8 37.3 ms 32.8 ms: 1.14x faster
bench_mp_pool 104 ms 92.8 ms: 1.12x faster
gc_traversal 8.98 ms 8.46 ms: 1.06x faster
sqlite_synth 4.03 us 3.80 us: 1.06x faster
async_tree_none_tg 379 ms 359 ms: 1.06x faster
scimark_sor 166 ms 173 ms: 1.04x slower
asyncio_websockets 728 ms 768 ms: 1.05x slower
async_tree_memoization_tg 487 ms 517 ms: 1.06x slower
json_loads 37.8 us 40.7 us: 1.08x slower
dulwich_log 99.8 ms 109 ms: 1.09x slower
sympy_expand 648 ms 708 ms: 1.09x slower
regex_dna 296 ms 325 ms: 1.10x slower
json 7.52 ms 8.27 ms: 1.10x slower
pylint 417 ms 459 ms: 1.10x slower
regex_effbot 4.32 ms 4.78 ms: 1.11x slower
pathlib 30.3 ms 33.6 ms: 1.11x slower
async_tree_cpu_io_mixed 711 ms 788 ms: 1.11x slower
docutils 3.84 sec 4.25 sec: 1.11x slower
spectral_norm 140 ms 155 ms: 1.11x slower
python_startup 29.2 ms 32.4 ms: 1.11x slower
mdp 3.62 sec 4.05 sec: 1.12x slower
sympy_str 419 ms 469 ms: 1.12x slower
sqlalchemy_declarative 204 ms 228 ms: 1.12x slower
sympy_sum 227 ms 254 ms: 1.12x slower
coroutines 30.2 ms 33.8 ms: 1.12x slower
xml_etree_iterparse 142 ms 160 ms: 1.12x slower
shortest_path 939 ms 1.05 sec: 1.12x slower
crypto_pyaes 101 ms 115 ms: 1.13x slower
hexiom 9.14 ms 10.4 ms: 1.14x slower
pprint_safe_repr 1.00 sec 1.14 sec: 1.14x slower
connected_components 849 ms 971 ms: 1.14x slower
async_generators 519 ms 595 ms: 1.15x slower
2to3 475 ms 548 ms: 1.15x slower
sphinx 1.43 sec 1.65 sec: 1.16x slower
async_tree_none 388 ms 450 ms: 1.16x slower
xml_etree_parse 193 ms 225 ms: 1.17x slower
scimark_lu 155 ms 181 ms: 1.17x slower
unpickle_pure_python 311 us 366 us: 1.17x slower
scimark_fft 463 ms 544 ms: 1.18x slower
sympy_integrate 30.6 ms 36.0 ms: 1.18x slower
django_template 50.1 ms 59.1 ms: 1.18x slower
async_tree_memoization 509 ms 600 ms: 1.18x slower
telco 11.3 ms 13.3 ms: 1.18x slower
regex_compile 167 ms 197 ms: 1.18x slower
comprehensions 24.2 us 28.6 us: 1.18x slower
bench_thread_pool 3.64 ms 4.35 ms: 1.19x slower
xml_etree_generate 121 ms 145 ms: 1.20x slower
deepcopy 370 us 444 us: 1.20x slower
deepcopy_memo 47.9 us 57.8 us: 1.21x slower
thrift 1.18 ms 1.42 ms: 1.21x slower
fannkuch 558 ms 675 ms: 1.21x slower
sqlglot_optimize 75.3 ms 91.8 ms: 1.22x slower
scimark_sparse_mat_mult 6.32 ms 7.76 ms: 1.23x slower
logging_format 9.80 us 12.1 us: 1.24x slower
pickle_pure_python 413 us 512 us: 1.24x slower
pprint_pformat 1.88 sec 2.34 sec: 1.25x slower
nqueens 106 ms 132 ms: 1.25x slower
go 170 ms 213 ms: 1.25x slower
pyflate 662 ms 833 ms: 1.26x slower
html5lib 88.6 ms 112 ms: 1.26x slower
python_startup_no_site 17.2 ms 21.8 ms: 1.26x slower
logging_simple 9.00 us 11.4 us: 1.27x slower
xml_etree_process 84.0 ms 107 ms: 1.28x slower
raytrace 352 ms 450 ms: 1.28x slower
meteor_contest 139 ms 178 ms: 1.28x slower
coverage 120 ms 154 ms: 1.28x slower
sqlalchemy_imperative 26.5 ms 34.0 ms: 1.29x slower
subparsers 33.0 ms 42.6 ms: 1.29x slower
scimark_monte_carlo 88.0 ms 114 ms: 1.30x slower
tomli_loads 2.50 sec 3.26 sec: 1.31x slower
genshi_xml 72.2 ms 95.0 ms: 1.32x slower
richards_super 71.3 ms 94.4 ms: 1.33x slower
richards 60.9 ms 80.7 ms: 1.33x slower
deepcopy_reduce 3.94 us 5.23 us: 1.33x slower
sqlglot_transpile 2.30 ms 3.09 ms: 1.34x slower
bpe_tokeniser 6.10 sec 8.20 sec: 1.34x slower
nbody 131 ms 177 ms: 1.35x slower
typing_runtime_protocols 219 us 299 us: 1.36x slower
sqlglot_parse 1.92 ms 2.63 ms: 1.37x slower
generators 42.1 ms 57.7 ms: 1.37x slower
deltablue 5.07 ms 7.16 ms: 1.41x slower
chaos 86.5 ms 123 ms: 1.42x slower
many_optionals 1.14 ms 1.66 ms: 1.46x slower
mako 17.2 ms 25.3 ms: 1.47x slower
genshi_text 29.6 ms 47.1 ms: 1.59x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (9): pidigits, float, sqlglot_normalize, json_dumps, pycparser, async_tree_cpu_io_mixed_tg, k_core, async_tree_io, logging_silent

  • Geometric mean (including insignificant results): 1.136x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.13x
  • 95% likely to have a slowdown of 1.12x
  • 99% likely to have a slowdown of 1.12x

Memory

  • memory change: 1.19x