Skip to content

Latest commit

 

History

History
213 lines (190 loc) · 41.1 KB

bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257-vs-base.md

File metadata and controls

213 lines (190 loc) · 41.1 KB

Results vs. base

  • fork: python
  • ref: 327a257e6ae4ad0e3b6e
  • machine: linux-x86_64
  • commit hash: 327a257
  • commit date: 2025-01-23
  • overall geometric mean: 1.159x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.14x slower
  • Memory change: 1.20x

Benchmarks with tag 'apps':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
2to3 257 ms 315 ms: 1.23x slower
docutils 2.56 sec 2.89 sec: 1.13x slower
sphinx 983 ms 1.14 sec: 1.16x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
async_tree_io_tg 620 ms 595 ms: 1.04x faster
async_tree_none_tg 262 ms 258 ms: 1.02x faster
async_tree_io 621 ms 628 ms: 1.01x slower
async_tree_cpu_io_mixed_tg 498 ms 514 ms: 1.03x slower
async_tree_memoization_tg 313 ms 331 ms: 1.06x slower
async_tree_cpu_io_mixed 509 ms 547 ms: 1.08x slower
async_tree_none 271 ms 297 ms: 1.10x slower
async_tree_memoization 322 ms 365 ms: 1.14x slower
coroutines 22.0 ms 25.3 ms: 1.15x slower
async_generators 319 ms 382 ms: 1.20x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
pidigits 212 ms 202 ms: 1.05x faster
float 70.6 ms 78.1 ms: 1.11x slower
nbody 91.9 ms 139 ms: 1.51x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
regex_v8 23.6 ms 24.2 ms: 1.03x slower
regex_dna 169 ms 183 ms: 1.08x slower
regex_effbot 2.61 ms 2.88 ms: 1.10x slower
regex_compile 129 ms 161 ms: 1.25x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
xml_etree_iterparse 99.9 ms 89.6 ms: 1.12x faster
xml_etree_parse 128 ms 130 ms: 1.01x slower
json_loads 27.5 us 30.5 us: 1.11x slower
json_dumps 11.3 ms 13.2 ms: 1.17x slower
xml_etree_generate 83.5 ms 99.9 ms: 1.20x slower
unpickle_pure_python 224 us 275 us: 1.23x slower
pickle_pure_python 322 us 395 us: 1.23x slower
xml_etree_process 60.8 ms 75.9 ms: 1.25x slower
tomli_loads 1.96 sec 2.46 sec: 1.25x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
python_startup 14.6 ms 15.3 ms: 1.05x slower
python_startup_no_site 7.41 ms 9.59 ms: 1.29x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
genshi_xml 49.4 ms 64.9 ms: 1.31x slower
django_template 35.3 ms 46.6 ms: 1.32x slower
mako 11.7 ms 16.3 ms: 1.39x slower
genshi_text 21.5 ms 30.1 ms: 1.40x slower
Geometric mean (ref) 1.36x slower

All benchmarks:

Benchmark results/bm-20250123-3.14.0a4+-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json
create_gc_cycles 1.83 ms 1.33 ms: 1.37x faster
gc_traversal 4.18 ms 3.24 ms: 1.29x faster
xml_etree_iterparse 99.9 ms 89.6 ms: 1.12x faster
sqlite_synth 2.23 us 2.08 us: 1.07x faster
pidigits 212 ms 202 ms: 1.05x faster
async_tree_io_tg 620 ms 595 ms: 1.04x faster
async_tree_none_tg 262 ms 258 ms: 1.02x faster
xml_etree_parse 128 ms 130 ms: 1.01x slower
async_tree_io 621 ms 628 ms: 1.01x slower
regex_v8 23.6 ms 24.2 ms: 1.03x slower
async_tree_cpu_io_mixed_tg 498 ms 514 ms: 1.03x slower
pathlib 18.5 ms 19.1 ms: 1.03x slower
python_startup 14.6 ms 15.3 ms: 1.05x slower
async_tree_memoization_tg 313 ms 331 ms: 1.06x slower
async_tree_cpu_io_mixed 509 ms 547 ms: 1.08x slower
bench_mp_pool 88.5 ms 95.7 ms: 1.08x slower
regex_dna 169 ms 183 ms: 1.08x slower
json 4.92 ms 5.35 ms: 1.09x slower
async_tree_none 271 ms 297 ms: 1.10x slower
regex_effbot 2.61 ms 2.88 ms: 1.10x slower
float 70.6 ms 78.1 ms: 1.11x slower
json_loads 27.5 us 30.5 us: 1.11x slower
pycparser 1.12 sec 1.25 sec: 1.11x slower
dulwich_log 76.5 ms 85.3 ms: 1.11x slower
docutils 2.56 sec 2.89 sec: 1.13x slower
bpe_tokeniser 4.26 sec 4.83 sec: 1.13x slower
async_tree_memoization 322 ms 365 ms: 1.14x slower
k_core 2.04 sec 2.33 sec: 1.14x slower
logging_silent 105 ns 120 ns: 1.15x slower
coroutines 22.0 ms 25.3 ms: 1.15x slower
mdp 2.44 sec 2.80 sec: 1.15x slower
pylint 281 ms 326 ms: 1.16x slower
sphinx 983 ms 1.14 sec: 1.16x slower
json_dumps 11.3 ms 13.2 ms: 1.17x slower
many_optionals 1.04 ms 1.24 ms: 1.19x slower
subparsers 22.4 ms 26.7 ms: 1.19x slower
sqlglot_optimize 52.8 ms 63.1 ms: 1.20x slower
xml_etree_generate 83.5 ms 99.9 ms: 1.20x slower
telco 7.28 ms 8.72 ms: 1.20x slower
async_generators 319 ms 382 ms: 1.20x slower
sqlglot_normalize 105 ms 126 ms: 1.20x slower
scimark_sor 116 ms 140 ms: 1.20x slower
generators 27.5 ms 33.3 ms: 1.21x slower
2to3 257 ms 315 ms: 1.23x slower
unpickle_pure_python 224 us 275 us: 1.23x slower
pickle_pure_python 322 us 395 us: 1.23x slower
sympy_expand 460 ms 567 ms: 1.23x slower
pprint_safe_repr 704 ms 871 ms: 1.24x slower
pyflate 420 ms 519 ms: 1.24x slower
coverage 79.7 ms 98.7 ms: 1.24x slower
spectral_norm 91.7 ms 114 ms: 1.24x slower
sqlalchemy_declarative 130 ms 162 ms: 1.24x slower
go 115 ms 144 ms: 1.25x slower
regex_compile 129 ms 161 ms: 1.25x slower
xml_etree_process 60.8 ms 75.9 ms: 1.25x slower
sympy_sum 154 ms 193 ms: 1.25x slower
sympy_integrate 19.9 ms 25.0 ms: 1.25x slower
tomli_loads 1.96 sec 2.46 sec: 1.25x slower
pprint_pformat 1.43 sec 1.80 sec: 1.26x slower
chaos 56.9 ms 71.7 ms: 1.26x slower
logging_simple 6.40 us 8.07 us: 1.26x slower
scimark_fft 311 ms 393 ms: 1.27x slower
nqueens 77.5 ms 98.4 ms: 1.27x slower
sympy_str 273 ms 348 ms: 1.27x slower
thrift 746 us 951 us: 1.28x slower
sqlalchemy_imperative 19.5 ms 24.9 ms: 1.28x slower
comprehensions 16.6 us 21.3 us: 1.28x slower
raytrace 264 ms 339 ms: 1.28x slower
connected_components 387 ms 497 ms: 1.28x slower
sqlglot_transpile 1.55 ms 1.99 ms: 1.29x slower
scimark_lu 112 ms 144 ms: 1.29x slower
sqlglot_parse 1.25 ms 1.61 ms: 1.29x slower
python_startup_no_site 7.41 ms 9.59 ms: 1.29x slower
logging_format 7.05 us 9.16 us: 1.30x slower
shortest_path 424 ms 552 ms: 1.30x slower
deepcopy 254 us 332 us: 1.31x slower
crypto_pyaes 67.0 ms 87.6 ms: 1.31x slower
typing_runtime_protocols 162 us 212 us: 1.31x slower
scimark_monte_carlo 63.9 ms 83.7 ms: 1.31x slower
hexiom 5.84 ms 7.66 ms: 1.31x slower
genshi_xml 49.4 ms 64.9 ms: 1.31x slower
meteor_contest 99.8 ms 131 ms: 1.32x slower
django_template 35.3 ms 46.6 ms: 1.32x slower
deepcopy_reduce 2.56 us 3.41 us: 1.33x slower
deepcopy_memo 30.2 us 40.3 us: 1.33x slower
fannkuch 370 ms 496 ms: 1.34x slower
richards 41.9 ms 56.8 ms: 1.35x slower
scimark_sparse_mat_mult 4.20 ms 5.82 ms: 1.38x slower
richards_super 47.8 ms 66.5 ms: 1.39x slower
mako 11.7 ms 16.3 ms: 1.39x slower
genshi_text 21.5 ms 30.1 ms: 1.40x slower
nbody 91.9 ms 139 ms: 1.51x slower
deltablue 3.11 ms 4.74 ms: 1.52x slower
bench_thread_pool 1.03 ms 3.33 ms: 3.23x slower
Geometric mean (ref) 1.20x slower

Benchmark hidden because not significant (1): asyncio_websockets Ignored benchmarks (1) of results/bm-20250123-3.14.0a4+-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json: html5lib

  • Geometric mean (including insignificant results): 1.159x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.17x
  • 95% likely to have a slowdown of 1.15x
  • 99% likely to have a slowdown of 1.14x

Memory

  • memory change: 1.20x