Skip to content

Latest commit

 

History

History
205 lines (182 loc) · 26 KB

bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f-vs-base.md

File metadata and controls

205 lines (182 loc) · 26 KB

Results vs. base

  • fork: python
  • ref: ab61d3f4303d14a413bc
  • machine: linux-x86_64
  • commit hash: ab61d3f
  • commit date: 2025-01-20
  • overall geometric mean: 1.031x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.02x slower
  • Memory change: 1.00x

Benchmarks with tag 'apps':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
2to3 304 ms 314 ms: 1.03x slower
docutils 2.81 sec 2.85 sec: 1.02x slower
html5lib 68.6 ms 73.2 ms: 1.07x slower
sphinx 1.12 sec 1.13 sec: 1.02x slower
Geometric mean (ref) 1.03x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
async_tree_none_tg 246 ms 250 ms: 1.02x slower
async_tree_none 283 ms 288 ms: 1.02x slower
async_tree_io_tg 578 ms 588 ms: 1.02x slower
async_tree_io 604 ms 615 ms: 1.02x slower
async_generators 370 ms 377 ms: 1.02x slower
async_tree_memoization 346 ms 355 ms: 1.02x slower
async_tree_memoization_tg 313 ms 322 ms: 1.03x slower
coroutines 23.7 ms 25.3 ms: 1.07x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (3): async_tree_cpu_io_mixed_tg, async_tree_cpu_io_mixed, asyncio_websockets

Benchmarks with tag 'math':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
float 76.2 ms 80.1 ms: 1.05x slower
pidigits 190 ms 203 ms: 1.06x slower
nbody 130 ms 139 ms: 1.07x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'regex':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
regex_effbot 2.87 ms 2.80 ms: 1.02x faster
regex_v8 23.9 ms 23.5 ms: 1.02x faster
regex_dna 184 ms 185 ms: 1.00x slower
regex_compile 150 ms 160 ms: 1.06x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'serialize':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
json_dumps 13.0 ms 13.1 ms: 1.01x slower
json_loads 30.3 us 30.7 us: 1.01x slower
xml_etree_parse 128 ms 130 ms: 1.02x slower
xml_etree_iterparse 87.1 ms 88.7 ms: 1.02x slower
xml_etree_generate 96.9 ms 99.1 ms: 1.02x slower
tomli_loads 2.33 sec 2.43 sec: 1.05x slower
pickle_pure_python 371 us 395 us: 1.06x slower
xml_etree_process 69.3 ms 75.4 ms: 1.09x slower
unpickle_pure_python 248 us 277 us: 1.12x slower
Geometric mean (ref) 1.04x slower

Benchmarks with tag 'startup':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
python_startup_no_site 9.55 ms 9.61 ms: 1.01x slower
python_startup 15.2 ms 15.4 ms: 1.01x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'template':

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
mako 15.9 ms 16.2 ms: 1.02x slower
django_template 43.2 ms 45.2 ms: 1.04x slower
genshi_xml 60.1 ms 63.7 ms: 1.06x slower
genshi_text 27.7 ms 30.3 ms: 1.09x slower
Geometric mean (ref) 1.05x slower

All benchmarks:

Benchmark bm-20250120-vultr-x86_64-python-0a6412f9cc9e694e7629-3.14.0a4+-0a6412f bm-20250120-vultr-x86_64-python-ab61d3f4303d14a413bc-3.14.0a4+-ab61d3f
mdp 2.70 sec 2.63 sec: 1.03x faster
regex_effbot 2.87 ms 2.80 ms: 1.02x faster
regex_v8 23.9 ms 23.5 ms: 1.02x faster
regex_dna 184 ms 185 ms: 1.00x slower
gc_traversal 3.13 ms 3.14 ms: 1.00x slower
k_core 2.31 sec 2.33 sec: 1.01x slower
python_startup_no_site 9.55 ms 9.61 ms: 1.01x slower
json_dumps 13.0 ms 13.1 ms: 1.01x slower
pathlib 18.8 ms 19.0 ms: 1.01x slower
coverage 98.7 ms 99.5 ms: 1.01x slower
python_startup 15.2 ms 15.4 ms: 1.01x slower
bench_thread_pool 3.31 ms 3.35 ms: 1.01x slower
meteor_contest 131 ms 133 ms: 1.01x slower
json_loads 30.3 us 30.7 us: 1.01x slower
docutils 2.81 sec 2.85 sec: 1.02x slower
bench_mp_pool 94.5 ms 95.9 ms: 1.02x slower
xml_etree_parse 128 ms 130 ms: 1.02x slower
sphinx 1.12 sec 1.13 sec: 1.02x slower
async_tree_none_tg 246 ms 250 ms: 1.02x slower
async_tree_none 283 ms 288 ms: 1.02x slower
async_tree_io_tg 578 ms 588 ms: 1.02x slower
mako 15.9 ms 16.2 ms: 1.02x slower
thrift 916 us 932 us: 1.02x slower
sqlalchemy_imperative 24.3 ms 24.7 ms: 1.02x slower
async_tree_io 604 ms 615 ms: 1.02x slower
xml_etree_iterparse 87.1 ms 88.7 ms: 1.02x slower
async_generators 370 ms 377 ms: 1.02x slower
connected_components 487 ms 497 ms: 1.02x slower
sqlalchemy_declarative 164 ms 167 ms: 1.02x slower
comprehensions 20.9 us 21.3 us: 1.02x slower
xml_etree_generate 96.9 ms 99.1 ms: 1.02x slower
sympy_sum 187 ms 191 ms: 1.02x slower
async_tree_memoization 346 ms 355 ms: 1.02x slower
nqueens 95.7 ms 98.2 ms: 1.03x slower
shortest_path 538 ms 552 ms: 1.03x slower
async_tree_memoization_tg 313 ms 322 ms: 1.03x slower
sympy_integrate 24.2 ms 24.9 ms: 1.03x slower
sympy_expand 547 ms 563 ms: 1.03x slower
crypto_pyaes 86.6 ms 89.1 ms: 1.03x slower
fannkuch 478 ms 493 ms: 1.03x slower
dulwich_log 82.0 ms 84.5 ms: 1.03x slower
richards 56.4 ms 58.2 ms: 1.03x slower
sqlglot_optimize 61.9 ms 63.8 ms: 1.03x slower
deepcopy 312 us 322 us: 1.03x slower
pyflate 502 ms 518 ms: 1.03x slower
2to3 304 ms 314 ms: 1.03x slower
sympy_str 333 ms 344 ms: 1.03x slower
scimark_monte_carlo 81.4 ms 84.3 ms: 1.04x slower
sqlglot_normalize 122 ms 126 ms: 1.04x slower
many_optionals 1.18 ms 1.22 ms: 1.04x slower
sqlglot_transpile 1.92 ms 1.99 ms: 1.04x slower
bpe_tokeniser 4.66 sec 4.85 sec: 1.04x slower
sqlglot_parse 1.58 ms 1.65 ms: 1.04x slower
richards_super 65.1 ms 67.8 ms: 1.04x slower
chaos 68.9 ms 71.8 ms: 1.04x slower
pycparser 1.18 sec 1.23 sec: 1.04x slower
deepcopy_reduce 3.27 us 3.41 us: 1.04x slower
subparsers 25.6 ms 26.7 ms: 1.04x slower
django_template 43.2 ms 45.2 ms: 1.04x slower
tomli_loads 2.33 sec 2.43 sec: 1.05x slower
deepcopy_memo 38.4 us 40.3 us: 1.05x slower
deltablue 4.64 ms 4.87 ms: 1.05x slower
raytrace 326 ms 342 ms: 1.05x slower
float 76.2 ms 80.1 ms: 1.05x slower
generators 31.4 ms 33.1 ms: 1.05x slower
scimark_fft 375 ms 395 ms: 1.05x slower
scimark_lu 135 ms 142 ms: 1.05x slower
typing_runtime_protocols 201 us 211 us: 1.05x slower
spectral_norm 107 ms 113 ms: 1.06x slower
genshi_xml 60.1 ms 63.7 ms: 1.06x slower
regex_compile 150 ms 160 ms: 1.06x slower
pprint_safe_repr 817 ms 868 ms: 1.06x slower
pidigits 190 ms 203 ms: 1.06x slower
logging_simple 7.41 us 7.88 us: 1.06x slower
pickle_pure_python 371 us 395 us: 1.06x slower
pprint_pformat 1.68 sec 1.80 sec: 1.07x slower
hexiom 7.30 ms 7.78 ms: 1.07x slower
coroutines 23.7 ms 25.3 ms: 1.07x slower
nbody 130 ms 139 ms: 1.07x slower
go 138 ms 148 ms: 1.07x slower
html5lib 68.6 ms 73.2 ms: 1.07x slower
scimark_sor 132 ms 141 ms: 1.07x slower
logging_format 8.42 us 9.06 us: 1.08x slower
scimark_sparse_mat_mult 5.40 ms 5.81 ms: 1.08x slower
xml_etree_process 69.3 ms 75.4 ms: 1.09x slower
genshi_text 27.7 ms 30.3 ms: 1.09x slower
logging_silent 112 ns 124 ns: 1.10x slower
unpickle_pure_python 248 us 277 us: 1.12x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (8): sqlite_synth, telco, async_tree_cpu_io_mixed_tg, async_tree_cpu_io_mixed, create_gc_cycles, asyncio_websockets, json, pylint

  • Geometric mean (including insignificant results): 1.031x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.02x
  • 95% likely to have a slowdown of 1.02x
  • 99% likely to have a slowdown of 1.02x

Memory

  • memory change: 1.00x