fork: python
ref: 86c1a60d5a28cfb51f88
machine: linux-x86_64
commit hash: 86c1a60
commit date: 2025-01-22
overall geometric mean: 1.049x faster
HPT reliability: 99.54%
HPT 99th percentile: 1.00x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
2to3
456 ms
503 ms: 1.10x slower
docutils
4.00 sec
3.76 sec: 1.06x faster
Geometric mean
(ref)
1.01x slower
Benchmark hidden because not significant (1): html5lib
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
async_tree_io
1.85 sec
933 ms: 1.98x faster
async_tree_io_tg
1.93 sec
988 ms: 1.96x faster
async_tree_memoization_tg
930 ms
511 ms: 1.82x faster
async_tree_none
741 ms
414 ms: 1.79x faster
async_tree_none_tg
704 ms
401 ms: 1.75x faster
async_tree_memoization
977 ms
572 ms: 1.71x faster
async_tree_cpu_io_mixed_tg
1.10 sec
665 ms: 1.66x faster
async_tree_cpu_io_mixed
1.08 sec
758 ms: 1.42x faster
coroutines
29.5 ms
36.3 ms: 1.23x slower
Geometric mean
(ref)
1.47x faster
Benchmark hidden because not significant (2): async_generators, asyncio_websockets
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
float
123 ms
114 ms: 1.08x faster
nbody
119 ms
128 ms: 1.07x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
regex_compile
187 ms
177 ms: 1.05x faster
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (3): regex_effbot, regex_v8, regex_dna
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
xml_etree_parse
241 ms
205 ms: 1.18x faster
tomli_loads
2.88 sec
2.65 sec: 1.09x faster
xml_etree_generate
127 ms
140 ms: 1.10x slower
json_dumps
14.3 ms
16.8 ms: 1.17x slower
json_loads
37.9 us
47.9 us: 1.26x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (4): xml_etree_iterparse, xml_etree_process, pickle_pure_python, unpickle_pure_python
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
python_startup
23.7 ms
29.7 ms: 1.25x slower
Geometric mean
(ref)
1.12x slower
Benchmark hidden because not significant (1): python_startup_no_site
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
mako
15.7 ms
16.9 ms: 1.07x slower
django_template
44.9 ms
48.8 ms: 1.09x slower
genshi_text
30.2 ms
32.8 ms: 1.09x slower
genshi_xml
67.6 ms
75.5 ms: 1.12x slower
Geometric mean
(ref)
1.09x slower
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60
async_tree_io
1.85 sec
933 ms: 1.98x faster
async_tree_io_tg
1.93 sec
988 ms: 1.96x faster
async_tree_memoization_tg
930 ms
511 ms: 1.82x faster
async_tree_none
741 ms
414 ms: 1.79x faster
async_tree_none_tg
704 ms
401 ms: 1.75x faster
async_tree_memoization
977 ms
572 ms: 1.71x faster
async_tree_cpu_io_mixed_tg
1.10 sec
665 ms: 1.66x faster
async_tree_cpu_io_mixed
1.08 sec
758 ms: 1.42x faster
deepcopy
468 us
347 us: 1.35x faster
comprehensions
27.1 us
22.4 us: 1.21x faster
deepcopy_memo
52.4 us
44.5 us: 1.18x faster
xml_etree_parse
241 ms
205 ms: 1.18x faster
scimark_fft
500 ms
430 ms: 1.16x faster
bpe_tokeniser
6.59 sec
5.71 sec: 1.15x faster
raytrace
408 ms
355 ms: 1.15x faster
pylint
465 ms
411 ms: 1.13x faster
scimark_sor
167 ms
148 ms: 1.13x faster
pprint_pformat
1.98 sec
1.77 sec: 1.12x faster
thrift
1.06 ms
959 us: 1.11x faster
pycparser
1.79 sec
1.63 sec: 1.10x faster
spectral_norm
156 ms
141 ms: 1.10x faster
pprint_safe_repr
967 ms
880 ms: 1.10x faster
pathlib
31.6 ms
28.8 ms: 1.10x faster
sqlalchemy_declarative
218 ms
199 ms: 1.09x faster
tomli_loads
2.88 sec
2.65 sec: 1.09x faster
nqueens
117 ms
107 ms: 1.09x faster
sqlglot_transpile
2.34 ms
2.15 ms: 1.09x faster
mdp
3.97 sec
3.66 sec: 1.08x faster
scimark_monte_carlo
96.4 ms
89.5 ms: 1.08x faster
float
123 ms
114 ms: 1.08x faster
go
172 ms
160 ms: 1.08x faster
fannkuch
540 ms
504 ms: 1.07x faster
deepcopy_reduce
4.04 us
3.77 us: 1.07x faster
docutils
4.00 sec
3.76 sec: 1.06x faster
richards
60.3 ms
56.9 ms: 1.06x faster
crypto_pyaes
107 ms
102 ms: 1.06x faster
chaos
84.9 ms
80.4 ms: 1.06x faster
regex_compile
187 ms
177 ms: 1.05x faster
logging_silent
139 ns
146 ns: 1.05x slower
typing_runtime_protocols
224 us
237 us: 1.06x slower
meteor_contest
146 ms
155 ms: 1.06x slower
sqlite_synth
3.87 us
4.14 us: 1.07x slower
nbody
119 ms
128 ms: 1.07x slower
mako
15.7 ms
16.9 ms: 1.07x slower
richards_super
72.8 ms
78.2 ms: 1.07x slower
django_template
44.9 ms
48.8 ms: 1.09x slower
genshi_text
30.2 ms
32.8 ms: 1.09x slower
json
6.85 ms
7.48 ms: 1.09x slower
xml_etree_generate
127 ms
140 ms: 1.10x slower
deltablue
4.27 ms
4.70 ms: 1.10x slower
2to3
456 ms
503 ms: 1.10x slower
sympy_expand
582 ms
645 ms: 1.11x slower
genshi_xml
67.6 ms
75.5 ms: 1.12x slower
hexiom
8.27 ms
9.37 ms: 1.13x slower
json_dumps
14.3 ms
16.8 ms: 1.17x slower
dulwich_log
100 ms
118 ms: 1.17x slower
logging_format
9.59 us
11.3 us: 1.18x slower
telco
9.59 ms
11.6 ms: 1.21x slower
coroutines
29.5 ms
36.3 ms: 1.23x slower
python_startup
23.7 ms
29.7 ms: 1.25x slower
json_loads
37.9 us
47.9 us: 1.26x slower
coverage
95.4 ms
123 ms: 1.29x slower
gc_traversal
5.86 ms
10.9 ms: 1.86x slower
create_gc_cycles
1.94 ms
4.24 ms: 2.19x slower
bench_mp_pool
20.7 ms
105 ms: 5.06x slower
Geometric mean
(ref)
1.02x faster
Benchmark hidden because not significant (25): xml_etree_iterparse, sympy_sum, regex_effbot, pyflate, async_generators, scimark_lu, scimark_sparse_mat_mult, sqlglot_normalize, python_startup_no_site, pidigits, html5lib, sqlalchemy_imperative, xml_etree_process, generators, regex_v8, sqlglot_parse, sqlglot_optimize, regex_dna, pickle_pure_python, sympy_str, asyncio_websockets, sympy_integrate, unpickle_pure_python, logging_simple, bench_thread_pool
Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (6) of results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
Geometric mean (including insignificant results): 1.049x faster
Reliability score: 99.54% likely to be faster
90% likely to have a speedup of 1.03x
95% likely to have a speedup of 1.02x
99% likely to have a speedup of 1.00x