Skip to content

Latest commit

 

History

History
211 lines (187 loc) · 40.1 KB

bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9-vs-base.md

File metadata and controls

211 lines (187 loc) · 40.1 KB

Results vs. base

  • fork: python
  • ref: 2ed5ee9a50454b3fce87
  • machine: linux-x86_64
  • commit hash: 2ed5ee9
  • commit date: 2025-01-22
  • overall geometric mean: 1.151x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.13x slower
  • Memory change: 1.20x

Benchmarks with tag 'apps':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
2to3 256 ms 312 ms: 1.22x slower
docutils 2.60 sec 2.86 sec: 1.10x slower
sphinx 993 ms 1.14 sec: 1.15x slower
Geometric mean (ref) 1.15x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
async_tree_io_tg 618 ms 581 ms: 1.06x faster
async_tree_none_tg 260 ms 246 ms: 1.05x faster
async_tree_memoization_tg 306 ms 318 ms: 1.04x slower
async_tree_cpu_io_mixed_tg 482 ms 505 ms: 1.05x slower
async_tree_none 267 ms 288 ms: 1.08x slower
async_tree_cpu_io_mixed 494 ms 540 ms: 1.09x slower
async_tree_memoization 324 ms 355 ms: 1.10x slower
coroutines 22.0 ms 24.9 ms: 1.13x slower
async_generators 322 ms 381 ms: 1.18x slower
Geometric mean (ref) 1.05x slower

Benchmark hidden because not significant (2): asyncio_websockets, async_tree_io

Benchmarks with tag 'math':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
float 70.9 ms 78.1 ms: 1.10x slower
pidigits 192 ms 220 ms: 1.15x slower
nbody 90.7 ms 136 ms: 1.50x slower
Geometric mean (ref) 1.24x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
regex_v8 23.6 ms 24.3 ms: 1.03x slower
regex_dna 173 ms 180 ms: 1.04x slower
regex_effbot 2.72 ms 2.89 ms: 1.06x slower
regex_compile 129 ms 159 ms: 1.23x slower
Geometric mean (ref) 1.09x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
xml_etree_iterparse 91.5 ms 89.0 ms: 1.03x faster
json_loads 27.6 us 30.8 us: 1.12x slower
json_dumps 11.4 ms 12.9 ms: 1.13x slower
xml_etree_generate 83.3 ms 98.9 ms: 1.19x slower
unpickle_pure_python 226 us 275 us: 1.22x slower
pickle_pure_python 322 us 397 us: 1.23x slower
tomli_loads 1.96 sec 2.43 sec: 1.24x slower
xml_etree_process 60.6 ms 75.7 ms: 1.25x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (1): xml_etree_parse

Benchmarks with tag 'startup':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
python_startup 14.6 ms 15.3 ms: 1.04x slower
python_startup_no_site 7.43 ms 9.55 ms: 1.29x slower
Geometric mean (ref) 1.16x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
django_template 36.4 ms 44.9 ms: 1.23x slower
genshi_xml 49.9 ms 63.8 ms: 1.28x slower
genshi_text 21.7 ms 29.6 ms: 1.37x slower
mako 11.8 ms 16.2 ms: 1.37x slower
Geometric mean (ref) 1.31x slower

All benchmarks:

Benchmark results/bm-20250122-3.14.0a4+-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json
create_gc_cycles 1.82 ms 1.36 ms: 1.34x faster
gc_traversal 4.18 ms 3.35 ms: 1.25x faster
async_tree_io_tg 618 ms 581 ms: 1.06x faster
sqlite_synth 2.21 us 2.08 us: 1.06x faster
async_tree_none_tg 260 ms 246 ms: 1.05x faster
xml_etree_iterparse 91.5 ms 89.0 ms: 1.03x faster
pathlib 18.8 ms 18.7 ms: 1.01x faster
regex_v8 23.6 ms 24.3 ms: 1.03x slower
async_tree_memoization_tg 306 ms 318 ms: 1.04x slower
python_startup 14.6 ms 15.3 ms: 1.04x slower
regex_dna 173 ms 180 ms: 1.04x slower
async_tree_cpu_io_mixed_tg 482 ms 505 ms: 1.05x slower
regex_effbot 2.72 ms 2.89 ms: 1.06x slower
json 4.98 ms 5.34 ms: 1.07x slower
bench_mp_pool 89.0 ms 95.7 ms: 1.08x slower
async_tree_none 267 ms 288 ms: 1.08x slower
pycparser 1.14 sec 1.24 sec: 1.09x slower
async_tree_cpu_io_mixed 494 ms 540 ms: 1.09x slower
async_tree_memoization 324 ms 355 ms: 1.10x slower
dulwich_log 77.0 ms 84.6 ms: 1.10x slower
docutils 2.60 sec 2.86 sec: 1.10x slower
float 70.9 ms 78.1 ms: 1.10x slower
json_loads 27.6 us 30.8 us: 1.12x slower
coroutines 22.0 ms 24.9 ms: 1.13x slower
json_dumps 11.4 ms 12.9 ms: 1.13x slower
bpe_tokeniser 4.25 sec 4.82 sec: 1.13x slower
k_core 2.05 sec 2.33 sec: 1.14x slower
sphinx 993 ms 1.14 sec: 1.15x slower
pidigits 192 ms 220 ms: 1.15x slower
pylint 282 ms 324 ms: 1.15x slower
logging_silent 103 ns 119 ns: 1.16x slower
mdp 2.31 sec 2.69 sec: 1.16x slower
many_optionals 1.05 ms 1.22 ms: 1.17x slower
sqlglot_normalize 105 ms 124 ms: 1.18x slower
sqlglot_optimize 52.9 ms 62.3 ms: 1.18x slower
subparsers 22.4 ms 26.5 ms: 1.18x slower
async_generators 322 ms 381 ms: 1.18x slower
xml_etree_generate 83.3 ms 98.9 ms: 1.19x slower
logging_simple 6.50 us 7.76 us: 1.19x slower
telco 7.20 ms 8.65 ms: 1.20x slower
spectral_norm 94.0 ms 113 ms: 1.20x slower
pprint_safe_repr 704 ms 850 ms: 1.21x slower
generators 27.3 ms 33.1 ms: 1.21x slower
go 118 ms 143 ms: 1.21x slower
unpickle_pure_python 226 us 275 us: 1.22x slower
2to3 256 ms 312 ms: 1.22x slower
coverage 80.0 ms 97.6 ms: 1.22x slower
sympy_expand 463 ms 567 ms: 1.22x slower
pprint_pformat 1.43 sec 1.76 sec: 1.23x slower
django_template 36.4 ms 44.9 ms: 1.23x slower
logging_format 7.21 us 8.88 us: 1.23x slower
pickle_pure_python 322 us 397 us: 1.23x slower
regex_compile 129 ms 159 ms: 1.23x slower
thrift 749 us 923 us: 1.23x slower
sympy_sum 156 ms 192 ms: 1.23x slower
tomli_loads 1.96 sec 2.43 sec: 1.24x slower
scimark_fft 312 ms 386 ms: 1.24x slower
pyflate 411 ms 509 ms: 1.24x slower
scimark_sor 113 ms 141 ms: 1.24x slower
sympy_integrate 20.0 ms 24.9 ms: 1.24x slower
sqlalchemy_declarative 130 ms 162 ms: 1.24x slower
sqlalchemy_imperative 19.8 ms 24.6 ms: 1.25x slower
xml_etree_process 60.6 ms 75.7 ms: 1.25x slower
sympy_str 275 ms 345 ms: 1.26x slower
scimark_lu 112 ms 141 ms: 1.26x slower
deepcopy 259 us 326 us: 1.26x slower
chaos 56.0 ms 70.9 ms: 1.27x slower
nqueens 77.9 ms 99.1 ms: 1.27x slower
raytrace 266 ms 340 ms: 1.28x slower
sqlglot_transpile 1.56 ms 1.99 ms: 1.28x slower
connected_components 390 ms 498 ms: 1.28x slower
genshi_xml 49.9 ms 63.8 ms: 1.28x slower
shortest_path 427 ms 547 ms: 1.28x slower
crypto_pyaes 67.8 ms 87.0 ms: 1.28x slower
python_startup_no_site 7.43 ms 9.55 ms: 1.29x slower
sqlglot_parse 1.25 ms 1.61 ms: 1.29x slower
comprehensions 16.6 us 21.3 us: 1.29x slower
deepcopy_reduce 2.66 us 3.43 us: 1.29x slower
hexiom 5.90 ms 7.69 ms: 1.30x slower
fannkuch 374 ms 489 ms: 1.31x slower
meteor_contest 98.7 ms 130 ms: 1.32x slower
scimark_monte_carlo 63.0 ms 83.6 ms: 1.33x slower
typing_runtime_protocols 158 us 210 us: 1.33x slower
deepcopy_memo 30.6 us 40.8 us: 1.33x slower
richards 42.4 ms 57.0 ms: 1.34x slower
scimark_sparse_mat_mult 4.17 ms 5.65 ms: 1.35x slower
genshi_text 21.7 ms 29.6 ms: 1.37x slower
richards_super 48.5 ms 66.5 ms: 1.37x slower
mako 11.8 ms 16.2 ms: 1.37x slower
nbody 90.7 ms 136 ms: 1.50x slower
deltablue 3.20 ms 4.80 ms: 1.50x slower
bench_thread_pool 1.04 ms 3.32 ms: 3.21x slower
Geometric mean (ref) 1.19x slower

Benchmark hidden because not significant (3): asyncio_websockets, xml_etree_parse, async_tree_io Ignored benchmarks (1) of results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4+-2ed5ee9.json: html5lib

  • Geometric mean (including insignificant results): 1.151x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.16x
  • 95% likely to have a slowdown of 1.15x
  • 99% likely to have a slowdown of 1.13x

Memory

  • memory change: 1.20x