fork: Yhg1s
ref: bb495b05f9c1a3d5224b
machine: linux-x86_64
commit hash: bb495b0
commit date: 2025-01-21
overall geometric mean: 1.001x slower
HPT reliability: 94.52%
HPT 99th percentile: 1.00x slower
Memory change: 1.04x
Benchmarks with tag 'apps':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
html5lib
91.2 ms
89.1 ms: 1.02x faster
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (3): 2to3, docutils, sphinx
Benchmarks with tag 'asyncio':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
coroutines
23.5 ms
23.2 ms: 1.02x faster
async_tree_cpu_io_mixed_tg
575 ms
568 ms: 1.01x faster
async_tree_cpu_io_mixed
603 ms
598 ms: 1.01x faster
async_generators
447 ms
445 ms: 1.00x faster
async_tree_memoization
429 ms
434 ms: 1.01x slower
Geometric mean
(ref)
1.00x faster
Benchmark hidden because not significant (6): async_tree_io, async_tree_none, async_tree_memoization_tg, async_tree_none_tg, asyncio_websockets, async_tree_io_tg
Benchmarks with tag 'math':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
float
107 ms
108 ms: 1.01x slower
nbody
128 ms
132 ms: 1.03x slower
pidigits
184 ms
194 ms: 1.05x slower
Geometric mean
(ref)
1.03x slower
Benchmarks with tag 'regex':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
regex_effbot
2.95 ms
2.84 ms: 1.04x faster
regex_v8
25.4 ms
24.7 ms: 1.03x faster
regex_compile
167 ms
168 ms: 1.01x slower
regex_dna
182 ms
184 ms: 1.01x slower
Geometric mean
(ref)
1.01x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
unpickle_pure_python
328 us
325 us: 1.01x faster
xml_etree_parse
129 ms
128 ms: 1.01x faster
json_loads
28.6 us
28.7 us: 1.00x slower
tomli_loads
2.33 sec
2.34 sec: 1.00x slower
Geometric mean
(ref)
1.00x faster
Benchmark hidden because not significant (5): pickle_pure_python, xml_etree_generate, xml_etree_iterparse, json_dumps, xml_etree_process
Benchmarks with tag 'startup':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
python_startup
15.7 ms
15.7 ms: 1.00x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (1): python_startup_no_site
Benchmarks with tag 'template':
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
mako
17.0 ms
16.9 ms: 1.01x faster
genshi_xml
63.3 ms
64.1 ms: 1.01x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (2): django_template, genshi_text
Benchmark
bm-20250109-vultr-x86_64-python-7dc41ad6a7826ffc675f-3.14.0a3+-7dc41ad
bm-20250121-vultr-x86_64-Yhg1s-bb495b05f9c1a3d5224b-3.14.0a3+-bb495b0
regex_effbot
2.95 ms
2.84 ms: 1.04x faster
regex_v8
25.4 ms
24.7 ms: 1.03x faster
pprint_pformat
2.00 sec
1.94 sec: 1.03x faster
pprint_safe_repr
965 ms
937 ms: 1.03x faster
html5lib
91.2 ms
89.1 ms: 1.02x faster
coroutines
23.5 ms
23.2 ms: 1.02x faster
sympy_expand
583 ms
574 ms: 1.01x faster
telco
8.78 ms
8.66 ms: 1.01x faster
logging_format
10.0 us
9.90 us: 1.01x faster
logging_simple
8.99 us
8.88 us: 1.01x faster
async_tree_cpu_io_mixed_tg
575 ms
568 ms: 1.01x faster
pyflate
640 ms
632 ms: 1.01x faster
thrift
1.01 ms
997 us: 1.01x faster
pycparser
1.37 sec
1.35 sec: 1.01x faster
unpickle_pure_python
328 us
325 us: 1.01x faster
xml_etree_parse
129 ms
128 ms: 1.01x faster
async_tree_cpu_io_mixed
603 ms
598 ms: 1.01x faster
mako
17.0 ms
16.9 ms: 1.01x faster
generators
38.8 ms
38.5 ms: 1.01x faster
logging_silent
187 ns
186 ns: 1.01x faster
crypto_pyaes
90.8 ms
90.1 ms: 1.01x faster
bpe_tokeniser
4.99 sec
4.96 sec: 1.01x faster
k_core
2.35 sec
2.34 sec: 1.01x faster
scimark_fft
374 ms
372 ms: 1.01x faster
async_generators
447 ms
445 ms: 1.00x faster
python_startup
15.7 ms
15.7 ms: 1.00x slower
fannkuch
482 ms
483 ms: 1.00x slower
sqlalchemy_declarative
183 ms
183 ms: 1.00x slower
scimark_monte_carlo
104 ms
104 ms: 1.00x slower
json_loads
28.6 us
28.7 us: 1.00x slower
tomli_loads
2.33 sec
2.34 sec: 1.00x slower
nqueens
95.5 ms
95.9 ms: 1.00x slower
sympy_integrate
25.1 ms
25.2 ms: 1.01x slower
sqlglot_parse
2.31 ms
2.32 ms: 1.01x slower
dulwich_log
89.8 ms
90.5 ms: 1.01x slower
chaos
95.0 ms
95.7 ms: 1.01x slower
spectral_norm
109 ms
110 ms: 1.01x slower
regex_compile
167 ms
168 ms: 1.01x slower
many_optionals
1.23 ms
1.24 ms: 1.01x slower
async_tree_memoization
429 ms
434 ms: 1.01x slower
genshi_xml
63.3 ms
64.1 ms: 1.01x slower
regex_dna
182 ms
184 ms: 1.01x slower
deepcopy
324 us
328 us: 1.01x slower
hexiom
9.34 ms
9.48 ms: 1.01x slower
float
107 ms
108 ms: 1.01x slower
subparsers
28.4 ms
28.8 ms: 1.01x slower
scimark_lu
154 ms
157 ms: 1.02x slower
scimark_sor
202 ms
206 ms: 1.02x slower
go
235 ms
240 ms: 1.02x slower
raytrace
492 ms
503 ms: 1.02x slower
comprehensions
27.3 us
28.0 us: 1.02x slower
nbody
128 ms
132 ms: 1.03x slower
mdp
2.67 sec
2.79 sec: 1.05x slower
scimark_sparse_mat_mult
5.22 ms
5.46 ms: 1.05x slower
pidigits
184 ms
194 ms: 1.05x slower
Geometric mean
(ref)
1.00x slower
Benchmark hidden because not significant (41): sphinx, pathlib, typing_runtime_protocols, async_tree_io, pylint, bench_thread_pool, deepcopy_memo, pickle_pure_python, async_tree_none, async_tree_memoization_tg, coverage, meteor_contest, deepcopy_reduce, 2to3, sqlglot_normalize, bench_mp_pool, python_startup_no_site, gc_traversal, docutils, sympy_str, async_tree_none_tg, asyncio_websockets, xml_etree_generate, create_gc_cycles, xml_etree_iterparse, shortest_path, sympy_sum, json_dumps, richards_super, django_template, sqlalchemy_imperative, xml_etree_process, sqlite_synth, genshi_text, richards, deltablue, async_tree_io_tg, json, connected_components, sqlglot_transpile, sqlglot_optimize
Geometric mean (including insignificant results): 1.001x slower
Reliability score: 94.52% likely to be slow
90% likely to have a slowdown of 1.00x
95% likely to have a slowdown of 1.00x
99% likely to have a slowdown of 1.00x