Skip to content

Latest commit

 

History

History
188 lines (161 loc) · 20.6 KB

bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257-vs-3.12.6.md

File metadata and controls

188 lines (161 loc) · 20.6 KB

Results vs. 3.12.6

  • fork: python
  • ref: 327a257e6ae4ad0e3b6e
  • machine: linux-x86_64
  • commit hash: 327a257
  • commit date: 2025-01-23
  • overall geometric mean: 1.060x faster
  • HPT reliability: 95.85%
  • HPT 99th percentile: 1.00x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
2to3 456 ms 505 ms: 1.11x slower
docutils 4.00 sec 3.66 sec: 1.09x faster
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (1): html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
async_tree_io_tg 1.93 sec 928 ms: 2.08x faster
async_tree_io 1.85 sec 917 ms: 2.01x faster
async_tree_none 741 ms 384 ms: 1.93x faster
async_tree_memoization 977 ms 531 ms: 1.84x faster
async_tree_none_tg 704 ms 389 ms: 1.81x faster
async_tree_memoization_tg 930 ms 540 ms: 1.72x faster
async_tree_cpu_io_mixed_tg 1.10 sec 699 ms: 1.57x faster
async_tree_cpu_io_mixed 1.08 sec 728 ms: 1.48x faster
async_generators 589 ms 515 ms: 1.14x faster
asyncio_websockets 748 ms 720 ms: 1.04x faster
coroutines 29.5 ms 36.1 ms: 1.22x slower
Geometric mean (ref) 1.53x faster

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
float 123 ms 104 ms: 1.19x faster
nbody 119 ms 130 ms: 1.09x slower
Geometric mean (ref) 1.02x faster

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
regex_effbot 5.13 ms 4.74 ms: 1.08x faster
regex_v8 32.5 ms 35.0 ms: 1.08x slower
regex_dna 278 ms 301 ms: 1.08x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): regex_compile

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
xml_etree_parse 241 ms 189 ms: 1.28x faster
json_dumps 14.3 ms 15.8 ms: 1.10x slower
unpickle_pure_python 300 us 331 us: 1.11x slower
json_loads 37.9 us 42.6 us: 1.13x slower
xml_etree_process 83.7 ms 97.4 ms: 1.16x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (4): tomli_loads, xml_etree_iterparse, pickle_pure_python, xml_etree_generate

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
python_startup_no_site 17.6 ms 16.5 ms: 1.07x faster
python_startup 23.7 ms 29.4 ms: 1.24x slower
Geometric mean (ref) 1.08x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
genshi_xml 67.6 ms 72.6 ms: 1.07x slower
mako 15.7 ms 18.8 ms: 1.20x slower
django_template 44.9 ms 54.7 ms: 1.22x slower
Geometric mean (ref) 1.14x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
async_tree_io_tg 1.93 sec 928 ms: 2.08x faster
async_tree_io 1.85 sec 917 ms: 2.01x faster
async_tree_none 741 ms 384 ms: 1.93x faster
async_tree_memoization 977 ms 531 ms: 1.84x faster
async_tree_none_tg 704 ms 389 ms: 1.81x faster
async_tree_memoization_tg 930 ms 540 ms: 1.72x faster
async_tree_cpu_io_mixed_tg 1.10 sec 699 ms: 1.57x faster
async_tree_cpu_io_mixed 1.08 sec 728 ms: 1.48x faster
deepcopy 468 us 344 us: 1.36x faster
deepcopy_memo 52.4 us 39.0 us: 1.35x faster
xml_etree_parse 241 ms 189 ms: 1.28x faster
pathlib 31.6 ms 25.7 ms: 1.23x faster
sqlalchemy_declarative 218 ms 179 ms: 1.21x faster
raytrace 408 ms 341 ms: 1.20x faster
float 123 ms 104 ms: 1.19x faster
richards_super 72.8 ms 63.5 ms: 1.15x faster
async_generators 589 ms 515 ms: 1.14x faster
scimark_fft 500 ms 438 ms: 1.14x faster
comprehensions 27.1 us 24.2 us: 1.12x faster
pyflate 727 ms 649 ms: 1.12x faster
sympy_sum 222 ms 199 ms: 1.12x faster
mdp 3.97 sec 3.56 sec: 1.11x faster
pylint 465 ms 417 ms: 1.11x faster
nqueens 117 ms 105 ms: 1.11x faster
bpe_tokeniser 6.59 sec 5.95 sec: 1.11x faster
spectral_norm 156 ms 141 ms: 1.10x faster
sympy_integrate 29.8 ms 27.0 ms: 1.10x faster
sqlalchemy_imperative 24.7 ms 22.5 ms: 1.10x faster
fannkuch 540 ms 493 ms: 1.10x faster
docutils 4.00 sec 3.66 sec: 1.09x faster
regex_effbot 5.13 ms 4.74 ms: 1.08x faster
go 172 ms 161 ms: 1.07x faster
python_startup_no_site 17.6 ms 16.5 ms: 1.07x faster
logging_format 9.59 us 9.02 us: 1.06x faster
pprint_pformat 1.98 sec 1.88 sec: 1.06x faster
meteor_contest 146 ms 139 ms: 1.05x faster
asyncio_websockets 748 ms 720 ms: 1.04x faster
richards 60.3 ms 63.5 ms: 1.05x slower
sqlite_synth 3.87 us 4.12 us: 1.06x slower
generators 41.1 ms 43.9 ms: 1.07x slower
genshi_xml 67.6 ms 72.6 ms: 1.07x slower
regex_v8 32.5 ms 35.0 ms: 1.08x slower
scimark_lu 152 ms 164 ms: 1.08x slower
sqlglot_optimize 76.0 ms 82.0 ms: 1.08x slower
regex_dna 278 ms 301 ms: 1.08x slower
nbody 119 ms 130 ms: 1.09x slower
sympy_expand 582 ms 641 ms: 1.10x slower
json_dumps 14.3 ms 15.8 ms: 1.10x slower
json 6.85 ms 7.56 ms: 1.10x slower
unpickle_pure_python 300 us 331 us: 1.11x slower
2to3 456 ms 505 ms: 1.11x slower
telco 9.59 ms 10.7 ms: 1.11x slower
deltablue 4.27 ms 4.77 ms: 1.12x slower
scimark_sparse_mat_mult 6.70 ms 7.50 ms: 1.12x slower
thrift 1.06 ms 1.19 ms: 1.12x slower
json_loads 37.9 us 42.6 us: 1.13x slower
scimark_sor 167 ms 188 ms: 1.13x slower
xml_etree_process 83.7 ms 97.4 ms: 1.16x slower
dulwich_log 100 ms 118 ms: 1.18x slower
mako 15.7 ms 18.8 ms: 1.20x slower
django_template 44.9 ms 54.7 ms: 1.22x slower
coroutines 29.5 ms 36.1 ms: 1.22x slower
coverage 95.4 ms 118 ms: 1.24x slower
python_startup 23.7 ms 29.4 ms: 1.24x slower
gc_traversal 5.86 ms 7.68 ms: 1.31x slower
create_gc_cycles 1.94 ms 3.53 ms: 1.82x slower
bench_mp_pool 20.7 ms 112 ms: 5.40x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (23): regex_compile, logging_simple, html5lib, sqlglot_transpile, tomli_loads, xml_etree_iterparse, pycparser, pickle_pure_python, hexiom, crypto_pyaes, pprint_safe_repr, typing_runtime_protocols, pidigits, logging_silent, chaos, scimark_monte_carlo, sqlglot_parse, deepcopy_reduce, sqlglot_normalize, xml_etree_generate, sympy_str, genshi_text, bench_thread_pool Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.060x faster

HPT report

  • Reliability score: 95.85% likely to be faster
  • 90% likely to have a speedup of 1.01x
  • 95% likely to have a speedup of 1.00x
  • 99% likely to have a speedup of 1.00x

Memory

  • memory change: 1.13x