Skip to content

Latest commit

 

History

History
179 lines (151 loc) · 19 KB

bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c-vs-3.12.6.md

File metadata and controls

179 lines (151 loc) · 19 KB

Results vs. 3.12.6

  • fork: python
  • ref: ec91e1c2762412f1408b
  • machine: linux-x86_64
  • commit hash: ec91e1c
  • commit date: 2025-01-23
  • overall geometric mean: 1.064x faster
  • HPT reliability: 99.71%
  • HPT 99th percentile: 1.01x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
docutils 4.00 sec 3.84 sec: 1.04x faster
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (2): 2to3, html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
async_tree_io 1.85 sec 898 ms: 2.06x faster
async_tree_io_tg 1.93 sec 969 ms: 2.00x faster
async_tree_memoization 977 ms 509 ms: 1.92x faster
async_tree_memoization_tg 930 ms 487 ms: 1.91x faster
async_tree_none 741 ms 388 ms: 1.91x faster
async_tree_none_tg 704 ms 379 ms: 1.86x faster
async_tree_cpu_io_mixed_tg 1.10 sec 701 ms: 1.57x faster
async_tree_cpu_io_mixed 1.08 sec 711 ms: 1.52x faster
async_generators 589 ms 519 ms: 1.13x faster
Geometric mean (ref) 1.57x faster

Benchmark hidden because not significant (2): asyncio_websockets, coroutines

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
float 123 ms 115 ms: 1.07x faster
nbody 119 ms 131 ms: 1.10x slower
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
regex_effbot 5.13 ms 4.32 ms: 1.19x faster
regex_compile 187 ms 167 ms: 1.12x faster
regex_dna 278 ms 296 ms: 1.06x slower
regex_v8 32.5 ms 37.3 ms: 1.15x slower
Geometric mean (ref) 1.02x faster

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
xml_etree_parse 241 ms 193 ms: 1.25x faster
xml_etree_iterparse 169 ms 142 ms: 1.19x faster
tomli_loads 2.88 sec 2.50 sec: 1.16x faster
pickle_pure_python 436 us 413 us: 1.05x faster
xml_etree_generate 127 ms 121 ms: 1.05x faster
json_dumps 14.3 ms 16.9 ms: 1.18x slower
Geometric mean (ref) 1.05x faster

Benchmark hidden because not significant (3): json_loads, xml_etree_process, unpickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
python_startup 23.7 ms 29.2 ms: 1.23x slower
Geometric mean (ref) 1.10x slower

Benchmark hidden because not significant (1): python_startup_no_site

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
genshi_xml 67.6 ms 72.2 ms: 1.07x slower
mako 15.7 ms 17.2 ms: 1.10x slower
django_template 44.9 ms 50.1 ms: 1.12x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c
async_tree_io 1.85 sec 898 ms: 2.06x faster
async_tree_io_tg 1.93 sec 969 ms: 2.00x faster
async_tree_memoization 977 ms 509 ms: 1.92x faster
async_tree_memoization_tg 930 ms 487 ms: 1.91x faster
async_tree_none 741 ms 388 ms: 1.91x faster
async_tree_none_tg 704 ms 379 ms: 1.86x faster
async_tree_cpu_io_mixed_tg 1.10 sec 701 ms: 1.57x faster
async_tree_cpu_io_mixed 1.08 sec 711 ms: 1.52x faster
deepcopy 468 us 370 us: 1.26x faster
xml_etree_parse 241 ms 193 ms: 1.25x faster
xml_etree_iterparse 169 ms 142 ms: 1.19x faster
regex_effbot 5.13 ms 4.32 ms: 1.19x faster
raytrace 408 ms 352 ms: 1.16x faster
tomli_loads 2.88 sec 2.50 sec: 1.16x faster
async_generators 589 ms 519 ms: 1.13x faster
comprehensions 27.1 us 24.2 us: 1.12x faster
regex_compile 187 ms 167 ms: 1.12x faster
pylint 465 ms 417 ms: 1.11x faster
spectral_norm 156 ms 140 ms: 1.11x faster
nqueens 117 ms 106 ms: 1.11x faster
pycparser 1.79 sec 1.62 sec: 1.10x faster
pyflate 727 ms 662 ms: 1.10x faster
mdp 3.97 sec 3.62 sec: 1.10x faster
scimark_monte_carlo 96.4 ms 88.0 ms: 1.10x faster
deepcopy_memo 52.4 us 47.9 us: 1.09x faster
scimark_fft 500 ms 463 ms: 1.08x faster
bpe_tokeniser 6.59 sec 6.10 sec: 1.08x faster
float 123 ms 115 ms: 1.07x faster
sqlalchemy_declarative 218 ms 204 ms: 1.07x faster
crypto_pyaes 107 ms 101 ms: 1.06x faster
scimark_sparse_mat_mult 6.70 ms 6.32 ms: 1.06x faster
pprint_pformat 1.98 sec 1.88 sec: 1.05x faster
pickle_pure_python 436 us 413 us: 1.05x faster
meteor_contest 146 ms 139 ms: 1.05x faster
xml_etree_generate 127 ms 121 ms: 1.05x faster
docutils 4.00 sec 3.84 sec: 1.04x faster
regex_dna 278 ms 296 ms: 1.06x slower
genshi_xml 67.6 ms 72.2 ms: 1.07x slower
sqlalchemy_imperative 24.7 ms 26.5 ms: 1.07x slower
sqlglot_parse 1.79 ms 1.92 ms: 1.07x slower
sympy_str 385 ms 419 ms: 1.09x slower
mako 15.7 ms 17.2 ms: 1.10x slower
nbody 119 ms 131 ms: 1.10x slower
json 6.85 ms 7.52 ms: 1.10x slower
hexiom 8.27 ms 9.14 ms: 1.10x slower
thrift 1.06 ms 1.18 ms: 1.11x slower
sympy_expand 582 ms 648 ms: 1.11x slower
django_template 44.9 ms 50.1 ms: 1.12x slower
logging_silent 139 ns 156 ns: 1.12x slower
regex_v8 32.5 ms 37.3 ms: 1.15x slower
telco 9.59 ms 11.3 ms: 1.18x slower
json_dumps 14.3 ms 16.9 ms: 1.18x slower
deltablue 4.27 ms 5.07 ms: 1.19x slower
python_startup 23.7 ms 29.2 ms: 1.23x slower
coverage 95.4 ms 120 ms: 1.26x slower
gc_traversal 5.86 ms 8.98 ms: 1.53x slower
create_gc_cycles 1.94 ms 3.57 ms: 1.84x slower
bench_mp_pool 20.7 ms 104 ms: 5.00x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (32): logging_simple, pathlib, pidigits, asyncio_websockets, sqlglot_normalize, deepcopy_reduce, typing_runtime_protocols, genshi_text, richards_super, python_startup_no_site, sqlglot_transpile, go, sqlglot_optimize, dulwich_log, html5lib, scimark_sor, json_loads, xml_etree_process, richards, scimark_lu, chaos, coroutines, sympy_sum, logging_format, generators, sympy_integrate, fannkuch, pprint_safe_repr, unpickle_pure_python, sqlite_synth, 2to3, bench_thread_pool Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250123-3.14.0a4+-ec91e1c/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4+-ec91e1c.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.064x faster

HPT report

  • Reliability score: 99.71% likely to be faster
  • 90% likely to have a speedup of 1.03x
  • 95% likely to have a speedup of 1.02x
  • 99% likely to have a speedup of 1.01x

Memory

  • memory change: 1.13x