fork: python
ref: 327a257e6ae4ad0e3b6e
machine: linux-x86_64
commit hash: 327a257
commit date: 2025-01-23
overall geometric mean: 1.018x faster
HPT reliability: 91.45%
HPT 99th percentile: 1.00x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
2to3
445 ms
505 ms: 1.14x slower
docutils
4.01 sec
3.66 sec: 1.09x faster
html5lib
92.6 ms
86.8 ms: 1.07x faster
Geometric mean
(ref)
1.01x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
async_tree_io
1.39 sec
917 ms: 1.51x faster
async_tree_io_tg
1.40 sec
928 ms: 1.51x faster
async_tree_none
572 ms
384 ms: 1.49x faster
async_tree_memoization
709 ms
531 ms: 1.34x faster
async_tree_none_tg
504 ms
389 ms: 1.30x faster
async_tree_memoization_tg
670 ms
540 ms: 1.24x faster
async_tree_cpu_io_mixed
889 ms
728 ms: 1.22x faster
async_tree_cpu_io_mixed_tg
852 ms
699 ms: 1.22x faster
async_generators
567 ms
515 ms: 1.10x faster
asyncio_websockets
766 ms
720 ms: 1.06x faster
coroutines
30.9 ms
36.1 ms: 1.17x slower
Geometric mean
(ref)
1.24x faster
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
float
116 ms
104 ms: 1.12x faster
nbody
119 ms
130 ms: 1.10x slower
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
regex_v8
32.8 ms
35.0 ms: 1.07x slower
regex_dna
282 ms
301 ms: 1.07x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (2): regex_compile, regex_effbot
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
xml_etree_parse
231 ms
189 ms: 1.22x faster
xml_etree_generate
122 ms
133 ms: 1.09x slower
json_dumps
14.1 ms
15.8 ms: 1.12x slower
xml_etree_process
85.9 ms
97.4 ms: 1.13x slower
unpickle_pure_python
290 us
331 us: 1.14x slower
json_loads
34.3 us
42.6 us: 1.24x slower
Geometric mean
(ref)
1.05x slower
Benchmark hidden because not significant (3): xml_etree_iterparse, tomli_loads, pickle_pure_python
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
python_startup_no_site
15.3 ms
16.5 ms: 1.08x slower
python_startup
22.4 ms
29.4 ms: 1.31x slower
Geometric mean
(ref)
1.19x slower
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
mako
15.9 ms
18.8 ms: 1.18x slower
django_template
44.3 ms
54.7 ms: 1.23x slower
Geometric mean
(ref)
1.10x slower
Benchmark hidden because not significant (2): genshi_xml, genshi_text
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257
async_tree_io
1.39 sec
917 ms: 1.51x faster
async_tree_io_tg
1.40 sec
928 ms: 1.51x faster
async_tree_none
572 ms
384 ms: 1.49x faster
deepcopy
498 us
344 us: 1.45x faster
async_tree_memoization
709 ms
531 ms: 1.34x faster
async_tree_none_tg
504 ms
389 ms: 1.30x faster
deepcopy_memo
50.1 us
39.0 us: 1.29x faster
async_tree_memoization_tg
670 ms
540 ms: 1.24x faster
xml_etree_parse
231 ms
189 ms: 1.22x faster
async_tree_cpu_io_mixed
889 ms
728 ms: 1.22x faster
async_tree_cpu_io_mixed_tg
852 ms
699 ms: 1.22x faster
go
191 ms
161 ms: 1.19x faster
pathlib
29.9 ms
25.7 ms: 1.17x faster
richards_super
73.2 ms
63.5 ms: 1.15x faster
telco
12.2 ms
10.7 ms: 1.14x faster
pylint
470 ms
417 ms: 1.13x faster
sympy_integrate
30.2 ms
27.0 ms: 1.12x faster
float
116 ms
104 ms: 1.12x faster
spectral_norm
157 ms
141 ms: 1.11x faster
fannkuch
547 ms
493 ms: 1.11x faster
async_generators
567 ms
515 ms: 1.10x faster
docutils
4.01 sec
3.66 sec: 1.09x faster
scimark_fft
473 ms
438 ms: 1.08x faster
meteor_contest
150 ms
139 ms: 1.08x faster
html5lib
92.6 ms
86.8 ms: 1.07x faster
mdp
3.80 sec
3.56 sec: 1.07x faster
nqueens
112 ms
105 ms: 1.07x faster
asyncio_websockets
766 ms
720 ms: 1.06x faster
sympy_sum
210 ms
199 ms: 1.06x faster
bpe_tokeniser
6.28 sec
5.95 sec: 1.06x faster
pprint_pformat
1.94 sec
1.88 sec: 1.04x faster
scimark_sor
179 ms
188 ms: 1.05x slower
sympy_str
379 ms
403 ms: 1.06x slower
regex_v8
32.8 ms
35.0 ms: 1.07x slower
sympy_expand
601 ms
641 ms: 1.07x slower
regex_dna
282 ms
301 ms: 1.07x slower
deltablue
4.44 ms
4.77 ms: 1.07x slower
logging_simple
8.56 us
9.20 us: 1.07x slower
crypto_pyaes
100 ms
108 ms: 1.08x slower
python_startup_no_site
15.3 ms
16.5 ms: 1.08x slower
scimark_monte_carlo
90.6 ms
98.0 ms: 1.08x slower
logging_silent
130 ns
141 ns: 1.08x slower
thrift
1.10 ms
1.19 ms: 1.08x slower
xml_etree_generate
122 ms
133 ms: 1.09x slower
comprehensions
22.2 us
24.2 us: 1.09x slower
generators
40.0 ms
43.9 ms: 1.10x slower
sqlglot_optimize
74.7 ms
82.0 ms: 1.10x slower
nbody
119 ms
130 ms: 1.10x slower
coverage
107 ms
118 ms: 1.10x slower
scimark_sparse_mat_mult
6.76 ms
7.50 ms: 1.11x slower
json_dumps
14.1 ms
15.8 ms: 1.12x slower
scimark_lu
146 ms
164 ms: 1.12x slower
xml_etree_process
85.9 ms
97.4 ms: 1.13x slower
2to3
445 ms
505 ms: 1.14x slower
pycparser
1.57 sec
1.78 sec: 1.14x slower
unpickle_pure_python
290 us
331 us: 1.14x slower
sqlglot_normalize
140 ms
162 ms: 1.16x slower
json
6.51 ms
7.56 ms: 1.16x slower
coroutines
30.9 ms
36.1 ms: 1.17x slower
mako
15.9 ms
18.8 ms: 1.18x slower
django_template
44.3 ms
54.7 ms: 1.23x slower
json_loads
34.3 us
42.6 us: 1.24x slower
dulwich_log
93.7 ms
118 ms: 1.26x slower
bench_thread_pool
2.89 ms
3.73 ms: 1.29x slower
python_startup
22.4 ms
29.4 ms: 1.31x slower
gc_traversal
5.70 ms
7.68 ms: 1.35x slower
create_gc_cycles
2.41 ms
3.53 ms: 1.46x slower
bench_mp_pool
18.7 ms
112 ms: 5.98x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (20): xml_etree_iterparse, richards, logging_format, regex_compile, pyflate, pprint_safe_repr, raytrace, typing_runtime_protocols, regex_effbot, pidigits, genshi_xml, genshi_text, deepcopy_reduce, tomli_loads, hexiom, chaos, sqlite_synth, sqlglot_parse, sqlglot_transpile, pickle_pure_python
Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (8) of results/bm-20250123-3.14.0a4+-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4+-327a257.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
Geometric mean (including insignificant results): 1.018x faster
Reliability score: 91.45% likely to be faster
90% likely to have a speedup of 1.00x
95% likely to have a speedup of 1.00x
99% likely to have a speedup of 1.00x