Skip to content

Latest commit

 

History

History
181 lines (154 loc) · 20.3 KB

bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c-vs-3.13.0rc2.md

File metadata and controls

181 lines (154 loc) · 20.3 KB

Results vs. 3.13.0rc2

  • fork: python
  • ref: ec91e1c2762412f1408b
  • machine: linux-x86_64
  • commit hash: ec91e1c
  • commit date: 2025-01-23
  • overall geometric mean: 1.026x faster
  • HPT reliability: 92.64%
  • HPT 99th percentile: 1.00x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
2to3 445 ms 475 ms: 1.07x slower
docutils 4.01 sec 3.84 sec: 1.05x faster
Geometric mean (ref) 1.01x faster

Benchmark hidden because not significant (1): html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
async_tree_io 1.39 sec 898 ms: 1.55x faster
async_tree_none 572 ms 388 ms: 1.47x faster
async_tree_io_tg 1.40 sec 969 ms: 1.45x faster
async_tree_memoization 709 ms 509 ms: 1.39x faster
async_tree_memoization_tg 670 ms 487 ms: 1.38x faster
async_tree_none_tg 504 ms 379 ms: 1.33x faster
async_tree_cpu_io_mixed 889 ms 711 ms: 1.25x faster
async_tree_cpu_io_mixed_tg 852 ms 701 ms: 1.22x faster
async_generators 567 ms 519 ms: 1.09x faster
asyncio_websockets 766 ms 728 ms: 1.05x faster
Geometric mean (ref) 1.28x faster

Benchmark hidden because not significant (1): coroutines

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
nbody 119 ms 131 ms: 1.10x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (2): pidigits, float

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
regex_effbot 4.74 ms 4.32 ms: 1.10x faster
regex_compile 182 ms 167 ms: 1.09x faster
regex_dna 282 ms 296 ms: 1.05x slower
regex_v8 32.8 ms 37.3 ms: 1.14x slower
Geometric mean (ref) 1.00x faster

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
xml_etree_iterparse 177 ms 142 ms: 1.24x faster
xml_etree_parse 231 ms 193 ms: 1.20x faster
tomli_loads 2.78 sec 2.50 sec: 1.11x faster
unpickle_pure_python 290 us 311 us: 1.07x slower
json_loads 34.3 us 37.8 us: 1.10x slower
json_dumps 14.1 ms 16.9 ms: 1.20x slower
Geometric mean (ref) 1.02x faster

Benchmark hidden because not significant (3): xml_etree_process, xml_etree_generate, pickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
python_startup_no_site 15.3 ms 17.2 ms: 1.13x slower
python_startup 22.4 ms 29.2 ms: 1.30x slower
Geometric mean (ref) 1.21x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
genshi_text 31.7 ms 29.6 ms: 1.07x faster
mako 15.9 ms 17.2 ms: 1.08x slower
django_template 44.3 ms 50.1 ms: 1.13x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): genshi_xml

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
async_tree_io 1.39 sec 898 ms: 1.55x faster
async_tree_none 572 ms 388 ms: 1.47x faster
async_tree_io_tg 1.40 sec 969 ms: 1.45x faster
async_tree_memoization 709 ms 509 ms: 1.39x faster
async_tree_memoization_tg 670 ms 487 ms: 1.38x faster
deepcopy 498 us 370 us: 1.34x faster
async_tree_none_tg 504 ms 379 ms: 1.33x faster
async_tree_cpu_io_mixed 889 ms 711 ms: 1.25x faster
xml_etree_iterparse 177 ms 142 ms: 1.24x faster
async_tree_cpu_io_mixed_tg 852 ms 701 ms: 1.22x faster
xml_etree_parse 231 ms 193 ms: 1.20x faster
pylint 470 ms 417 ms: 1.13x faster
go 191 ms 170 ms: 1.13x faster
spectral_norm 157 ms 140 ms: 1.12x faster
tomli_loads 2.78 sec 2.50 sec: 1.11x faster
regex_effbot 4.74 ms 4.32 ms: 1.10x faster
regex_compile 182 ms 167 ms: 1.09x faster
async_generators 567 ms 519 ms: 1.09x faster
meteor_contest 150 ms 139 ms: 1.08x faster
telco 12.2 ms 11.3 ms: 1.08x faster
richards 65.5 ms 60.9 ms: 1.08x faster
scimark_sor 179 ms 166 ms: 1.08x faster
genshi_text 31.7 ms 29.6 ms: 1.07x faster
scimark_sparse_mat_mult 6.76 ms 6.32 ms: 1.07x faster
nqueens 112 ms 106 ms: 1.06x faster
asyncio_websockets 766 ms 728 ms: 1.05x faster
mdp 3.80 sec 3.62 sec: 1.05x faster
docutils 4.01 sec 3.84 sec: 1.05x faster
pprint_pformat 1.94 sec 1.88 sec: 1.03x faster
bpe_tokeniser 6.28 sec 6.10 sec: 1.03x faster
regex_dna 282 ms 296 ms: 1.05x slower
generators 40.0 ms 42.1 ms: 1.05x slower
scimark_lu 146 ms 155 ms: 1.06x slower
dulwich_log 93.7 ms 99.8 ms: 1.06x slower
2to3 445 ms 475 ms: 1.07x slower
thrift 1.10 ms 1.18 ms: 1.07x slower
unpickle_pure_python 290 us 311 us: 1.07x slower
sympy_expand 601 ms 648 ms: 1.08x slower
sympy_sum 210 ms 227 ms: 1.08x slower
mako 15.9 ms 17.2 ms: 1.08x slower
comprehensions 22.2 us 24.2 us: 1.09x slower
sqlglot_parse 1.76 ms 1.92 ms: 1.09x slower
sqlglot_normalize 140 ms 153 ms: 1.10x slower
nbody 119 ms 131 ms: 1.10x slower
json_loads 34.3 us 37.8 us: 1.10x slower
sympy_str 379 ms 419 ms: 1.11x slower
coverage 107 ms 120 ms: 1.12x slower
python_startup_no_site 15.3 ms 17.2 ms: 1.13x slower
hexiom 8.11 ms 9.14 ms: 1.13x slower
django_template 44.3 ms 50.1 ms: 1.13x slower
regex_v8 32.8 ms 37.3 ms: 1.14x slower
deltablue 4.44 ms 5.07 ms: 1.14x slower
json 6.51 ms 7.52 ms: 1.15x slower
json_dumps 14.1 ms 16.9 ms: 1.20x slower
logging_silent 130 ns 156 ns: 1.20x slower
bench_thread_pool 2.89 ms 3.64 ms: 1.26x slower
python_startup 22.4 ms 29.2 ms: 1.30x slower
create_gc_cycles 2.41 ms 3.57 ms: 1.48x slower
gc_traversal 5.70 ms 8.98 ms: 1.57x slower
bench_mp_pool 18.7 ms 104 ms: 5.54x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (28): deepcopy_memo, html5lib, deepcopy_reduce, pidigits, scimark_monte_carlo, typing_runtime_protocols, richards_super, coroutines, scimark_fft, xml_etree_process, xml_etree_generate, float, pickle_pure_python, pyflate, genshi_xml, sqlglot_optimize, crypto_pyaes, sqlite_synth, sympy_integrate, pathlib, pprint_safe_repr, fannkuch, raytrace, pycparser, chaos, sqlglot_transpile, logging_simple, logging_format Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers

  • Geometric mean (including insignificant results): 1.026x faster

HPT report

  • Reliability score: 92.64% likely to be faster
  • 90% likely to have a speedup of 1.00x
  • 95% likely to have a speedup of 1.00x
  • 99% likely to have a speedup of 1.00x

Memory

  • memory change: 1.13x