Skip to content

Latest commit

 

History

History
200 lines (175 loc) · 37.1 KB

bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60-vs-base.md

File metadata and controls

200 lines (175 loc) · 37.1 KB

Results vs. base

  • fork: python
  • ref: 86c1a60d5a28cfb51f88
  • machine: linux-x86_64
  • commit hash: 86c1a60
  • commit date: 2025-01-22
  • overall geometric mean: 1.120x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.09x slower
  • Memory change: 1.20x

Benchmarks with tag 'apps':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
2to3 503 ms 629 ms: 1.25x slower
docutils 3.76 sec 4.39 sec: 1.17x slower
html5lib 89.2 ms 121 ms: 1.36x slower
sphinx 1.55 sec 1.68 sec: 1.08x slower
Geometric mean (ref) 1.21x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
async_tree_io_tg 988 ms 783 ms: 1.26x faster
async_tree_none_tg 401 ms 352 ms: 1.14x faster
async_tree_io 933 ms 853 ms: 1.09x faster
asyncio_websockets 773 ms 717 ms: 1.08x faster
async_tree_memoization 572 ms 539 ms: 1.06x faster
async_tree_cpu_io_mixed_tg 665 ms 731 ms: 1.10x slower
Geometric mean (ref) 1.05x faster

Benchmark hidden because not significant (5): async_tree_cpu_io_mixed, async_tree_memoization_tg, async_generators, coroutines, async_tree_none

Benchmarks with tag 'math':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
float 114 ms 104 ms: 1.10x faster
pidigits 250 ms 234 ms: 1.07x faster
nbody 128 ms 186 ms: 1.46x slower
Geometric mean (ref) 1.07x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
regex_compile 177 ms 192 ms: 1.09x slower
regex_v8 32.8 ms 36.0 ms: 1.10x slower
regex_dna 285 ms 316 ms: 1.11x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (1): regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
json_dumps 16.8 ms 18.4 ms: 1.10x slower
xml_etree_parse 205 ms 238 ms: 1.16x slower
tomli_loads 2.65 sec 3.30 sec: 1.25x slower
pickle_pure_python 449 us 566 us: 1.26x slower
unpickle_pure_python 313 us 398 us: 1.27x slower
xml_etree_process 84.0 ms 120 ms: 1.43x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (3): xml_etree_generate, json_loads, xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
python_startup 29.7 ms 32.9 ms: 1.11x slower
python_startup_no_site 17.6 ms 21.7 ms: 1.23x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
django_template 48.8 ms 52.2 ms: 1.07x slower
genshi_xml 75.5 ms 87.8 ms: 1.16x slower
genshi_text 32.8 ms 48.6 ms: 1.48x slower
mako 16.9 ms 26.8 ms: 1.58x slower
Geometric mean (ref) 1.31x slower

All benchmarks:

Benchmark results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json results/bm-20250122-3.14.0a4+-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json
create_gc_cycles 4.24 ms 2.58 ms: 1.64x faster
gc_traversal 10.9 ms 8.40 ms: 1.30x faster
async_tree_io_tg 988 ms 783 ms: 1.26x faster
bench_mp_pool 105 ms 84.7 ms: 1.24x faster
async_tree_none_tg 401 ms 352 ms: 1.14x faster
float 114 ms 104 ms: 1.10x faster
async_tree_io 933 ms 853 ms: 1.09x faster
sqlite_synth 4.14 us 3.84 us: 1.08x faster
asyncio_websockets 773 ms 717 ms: 1.08x faster
pidigits 250 ms 234 ms: 1.07x faster
async_tree_memoization 572 ms 539 ms: 1.06x faster
sqlglot_normalize 156 ms 148 ms: 1.05x faster
spectral_norm 141 ms 150 ms: 1.06x slower
pycparser 1.63 sec 1.74 sec: 1.07x slower
richards_super 78.2 ms 83.7 ms: 1.07x slower
django_template 48.8 ms 52.2 ms: 1.07x slower
pathlib 28.8 ms 31.0 ms: 1.08x slower
sphinx 1.55 sec 1.68 sec: 1.08x slower
regex_compile 177 ms 192 ms: 1.09x slower
regex_v8 32.8 ms 36.0 ms: 1.10x slower
async_tree_cpu_io_mixed_tg 665 ms 731 ms: 1.10x slower
json_dumps 16.8 ms 18.4 ms: 1.10x slower
shortest_path 928 ms 1.02 sec: 1.10x slower
k_core 4.22 sec 4.65 sec: 1.10x slower
many_optionals 1.40 ms 1.55 ms: 1.11x slower
python_startup 29.7 ms 32.9 ms: 1.11x slower
sympy_expand 645 ms 716 ms: 1.11x slower
regex_dna 285 ms 316 ms: 1.11x slower
generators 41.5 ms 46.4 ms: 1.12x slower
sympy_integrate 30.8 ms 34.6 ms: 1.12x slower
logging_format 11.3 us 12.8 us: 1.14x slower
pylint 411 ms 469 ms: 1.14x slower
hexiom 9.37 ms 10.8 ms: 1.15x slower
pyflate 716 ms 829 ms: 1.16x slower
xml_etree_parse 205 ms 238 ms: 1.16x slower
genshi_xml 75.5 ms 87.8 ms: 1.16x slower
docutils 3.76 sec 4.39 sec: 1.17x slower
logging_simple 9.96 us 11.7 us: 1.18x slower
mdp 3.66 sec 4.31 sec: 1.18x slower
sympy_sum 213 ms 250 ms: 1.18x slower
sympy_str 397 ms 470 ms: 1.18x slower
nqueens 107 ms 128 ms: 1.19x slower
sqlglot_optimize 77.3 ms 92.3 ms: 1.19x slower
sqlglot_parse 1.81 ms 2.18 ms: 1.20x slower
subparsers 33.6 ms 40.5 ms: 1.21x slower
connected_components 799 ms 969 ms: 1.21x slower
sqlalchemy_declarative 199 ms 241 ms: 1.21x slower
deepcopy_memo 44.5 us 54.3 us: 1.22x slower
crypto_pyaes 102 ms 124 ms: 1.22x slower
telco 11.6 ms 14.1 ms: 1.22x slower
coverage 123 ms 151 ms: 1.22x slower
sqlglot_transpile 2.15 ms 2.63 ms: 1.22x slower
go 160 ms 197 ms: 1.23x slower
python_startup_no_site 17.6 ms 21.7 ms: 1.23x slower
meteor_contest 155 ms 192 ms: 1.24x slower
tomli_loads 2.65 sec 3.30 sec: 1.25x slower
2to3 503 ms 629 ms: 1.25x slower
scimark_fft 430 ms 539 ms: 1.25x slower
pickle_pure_python 449 us 566 us: 1.26x slower
unpickle_pure_python 313 us 398 us: 1.27x slower
logging_silent 146 ns 187 ns: 1.28x slower
chaos 80.4 ms 104 ms: 1.29x slower
bpe_tokeniser 5.71 sec 7.40 sec: 1.30x slower
bench_thread_pool 3.70 ms 4.80 ms: 1.30x slower
scimark_sparse_mat_mult 6.65 ms 8.65 ms: 1.30x slower
deepcopy 347 us 455 us: 1.31x slower
pprint_safe_repr 880 ms 1.16 sec: 1.32x slower
deepcopy_reduce 3.77 us 5.04 us: 1.34x slower
pprint_pformat 1.77 sec 2.38 sec: 1.35x slower
fannkuch 504 ms 680 ms: 1.35x slower
scimark_lu 150 ms 202 ms: 1.35x slower
sqlalchemy_imperative 24.8 ms 33.6 ms: 1.35x slower
html5lib 89.2 ms 121 ms: 1.36x slower
typing_runtime_protocols 237 us 324 us: 1.36x slower
scimark_sor 148 ms 204 ms: 1.38x slower
raytrace 355 ms 494 ms: 1.39x slower
xml_etree_process 84.0 ms 120 ms: 1.43x slower
scimark_monte_carlo 89.5 ms 128 ms: 1.43x slower
thrift 959 us 1.38 ms: 1.43x slower
comprehensions 22.4 us 32.4 us: 1.44x slower
nbody 128 ms 186 ms: 1.46x slower
genshi_text 32.8 ms 48.6 ms: 1.48x slower
deltablue 4.70 ms 6.99 ms: 1.49x slower
richards 56.9 ms 87.4 ms: 1.54x slower
mako 16.9 ms 26.8 ms: 1.58x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (11): async_tree_cpu_io_mixed, xml_etree_generate, async_tree_memoization_tg, json_loads, regex_effbot, xml_etree_iterparse, async_generators, coroutines, json, async_tree_none, dulwich_log

  • Geometric mean (including insignificant results): 1.120x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.10x
  • 95% likely to have a slowdown of 1.09x
  • 99% likely to have a slowdown of 1.09x

Memory

  • memory change: 1.20x