Skip to content

Latest commit

 

History

History
212 lines (188 loc) · 40.4 KB

bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537-vs-base.md

File metadata and controls

212 lines (188 loc) · 40.4 KB
Raw

Results vs. base

  • fork: python
  • ref: ea2b53739f1128184b41
  • machine: linux-x86_64
  • commit hash: ea2b537
  • commit date: 2024-12-26
  • overall geometric mean: 1.228x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.22x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
2to3 256 ms 349 ms: 1.36x slower
docutils 2.55 sec 2.99 sec: 1.17x slower
sphinx 990 ms 1.14 sec: 1.16x slower
Geometric mean (ref) 1.23x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
coroutines 22.0 ms 23.9 ms: 1.08x slower
async_tree_io_tg 618 ms 722 ms: 1.17x slower
async_tree_cpu_io_mixed_tg 480 ms 565 ms: 1.18x slower
async_tree_cpu_io_mixed 495 ms 594 ms: 1.20x slower
async_tree_io 629 ms 757 ms: 1.20x slower
async_tree_none_tg 256 ms 311 ms: 1.21x slower
async_generators 355 ms 446 ms: 1.25x slower
async_tree_none 278 ms 349 ms: 1.26x slower
async_tree_memoization 333 ms 427 ms: 1.28x slower
async_tree_memoization_tg 308 ms 397 ms: 1.29x slower
Geometric mean (ref) 1.19x slower

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
pidigits 185 ms 199 ms: 1.08x slower
nbody 88.9 ms 123 ms: 1.39x slower
float 74.9 ms 109 ms: 1.46x slower
Geometric mean (ref) 1.30x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
regex_v8 25.1 ms 24.7 ms: 1.02x faster
regex_dna 179 ms 187 ms: 1.04x slower
regex_effbot 2.79 ms 2.92 ms: 1.05x slower
regex_compile 126 ms 167 ms: 1.32x slower
Geometric mean (ref) 1.09x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
xml_etree_iterparse 90.5 ms 89.2 ms: 1.02x faster
json_loads 26.1 us 28.0 us: 1.07x slower
xml_etree_generate 82.6 ms 96.0 ms: 1.16x slower
json_dumps 11.3 ms 13.9 ms: 1.23x slower
xml_etree_process 57.5 ms 72.9 ms: 1.27x slower
tomli_loads 1.89 sec 2.48 sec: 1.32x slower
unpickle_pure_python 211 us 320 us: 1.52x slower
pickle_pure_python 311 us 488 us: 1.57x slower
Geometric mean (ref) 1.22x slower

Benchmark hidden because not significant (1): xml_etree_parse

Benchmarks with tag 'startup':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
python_startup 14.7 ms 15.7 ms: 1.07x slower
python_startup_no_site 7.50 ms 9.81 ms: 1.31x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
genshi_xml 49.0 ms 63.3 ms: 1.29x slower
genshi_text 21.5 ms 30.1 ms: 1.40x slower
django_template 35.1 ms 49.8 ms: 1.42x slower
mako 11.6 ms 16.9 ms: 1.46x slower
Geometric mean (ref) 1.39x slower

All benchmarks:

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
gc_traversal 4.56 ms 3.52 ms: 1.30x faster
sqlite_synth 2.21 us 2.12 us: 1.04x faster
regex_v8 25.1 ms 24.7 ms: 1.02x faster
xml_etree_iterparse 90.5 ms 89.2 ms: 1.02x faster
json 4.77 ms 4.97 ms: 1.04x slower
regex_dna 179 ms 187 ms: 1.04x slower
regex_effbot 2.79 ms 2.92 ms: 1.05x slower
pathlib 18.1 ms 19.2 ms: 1.06x slower
python_startup 14.7 ms 15.7 ms: 1.07x slower
json_loads 26.1 us 28.0 us: 1.07x slower
pidigits 185 ms 199 ms: 1.08x slower
coroutines 22.0 ms 23.9 ms: 1.08x slower
mdp 2.46 sec 2.68 sec: 1.09x slower
bench_mp_pool 89.1 ms 101 ms: 1.13x slower
k_core 2.05 sec 2.36 sec: 1.15x slower
spectral_norm 98.5 ms 113 ms: 1.15x slower
sphinx 990 ms 1.14 sec: 1.16x slower
xml_etree_generate 82.6 ms 96.0 ms: 1.16x slower
bpe_tokeniser 4.25 sec 4.95 sec: 1.16x slower
async_tree_io_tg 618 ms 722 ms: 1.17x slower
docutils 2.55 sec 2.99 sec: 1.17x slower
async_tree_cpu_io_mixed_tg 480 ms 565 ms: 1.18x slower
scimark_fft 315 ms 372 ms: 1.18x slower
dulwich_log 75.5 ms 90.5 ms: 1.20x slower
async_tree_cpu_io_mixed 495 ms 594 ms: 1.20x slower
async_tree_io 629 ms 757 ms: 1.20x slower
many_optionals 1.03 ms 1.24 ms: 1.20x slower
async_tree_none_tg 256 ms 311 ms: 1.21x slower
telco 7.22 ms 8.80 ms: 1.22x slower
scimark_sparse_mat_mult 4.39 ms 5.37 ms: 1.22x slower
json_dumps 11.3 ms 13.9 ms: 1.23x slower
pycparser 1.11 sec 1.37 sec: 1.23x slower
pylint 280 ms 347 ms: 1.24x slower
nqueens 78.1 ms 97.9 ms: 1.25x slower
async_generators 355 ms 446 ms: 1.25x slower
sqlglot_optimize 51.9 ms 65.2 ms: 1.26x slower
async_tree_none 278 ms 349 ms: 1.26x slower
sympy_sum 153 ms 194 ms: 1.26x slower
sympy_expand 457 ms 578 ms: 1.26x slower
shortest_path 433 ms 547 ms: 1.26x slower
sympy_integrate 19.7 ms 25.0 ms: 1.26x slower
deepcopy 255 us 323 us: 1.26x slower
xml_etree_process 57.5 ms 72.9 ms: 1.27x slower
sqlglot_normalize 103 ms 131 ms: 1.27x slower
coverage 78.6 ms 99.9 ms: 1.27x slower
typing_runtime_protocols 158 us 201 us: 1.27x slower
connected_components 392 ms 499 ms: 1.27x slower
async_tree_memoization 333 ms 427 ms: 1.28x slower
async_tree_memoization_tg 308 ms 397 ms: 1.29x slower
genshi_xml 49.0 ms 63.3 ms: 1.29x slower
sympy_str 272 ms 354 ms: 1.30x slower
deepcopy_reduce 2.65 us 3.46 us: 1.31x slower
python_startup_no_site 7.50 ms 9.81 ms: 1.31x slower
subparsers 21.9 ms 28.8 ms: 1.32x slower
tomli_loads 1.89 sec 2.48 sec: 1.32x slower
meteor_contest 99.7 ms 131 ms: 1.32x slower
regex_compile 126 ms 167 ms: 1.32x slower
crypto_pyaes 66.0 ms 88.8 ms: 1.35x slower
pprint_safe_repr 695 ms 943 ms: 1.36x slower
thrift 727 us 989 us: 1.36x slower
2to3 256 ms 349 ms: 1.36x slower
fannkuch 357 ms 488 ms: 1.36x slower
deepcopy_memo 29.1 us 40.1 us: 1.37x slower
pprint_pformat 1.42 sec 1.96 sec: 1.38x slower
generators 27.2 ms 37.5 ms: 1.38x slower
nbody 88.9 ms 123 ms: 1.39x slower
genshi_text 21.5 ms 30.1 ms: 1.40x slower
sqlalchemy_declarative 128 ms 182 ms: 1.42x slower
django_template 35.1 ms 49.8 ms: 1.42x slower
scimark_lu 107 ms 154 ms: 1.43x slower
sqlalchemy_imperative 19.2 ms 27.9 ms: 1.45x slower
mako 11.6 ms 16.9 ms: 1.46x slower
float 74.9 ms 109 ms: 1.46x slower
logging_format 6.84 us 10.1 us: 1.47x slower
logging_simple 6.02 us 9.11 us: 1.51x slower
unpickle_pure_python 211 us 320 us: 1.52x slower
richards_super 47.6 ms 74.2 ms: 1.56x slower
pickle_pure_python 311 us 488 us: 1.57x slower
pyflate 416 ms 654 ms: 1.57x slower
richards 41.6 ms 66.6 ms: 1.60x slower
chaos 57.2 ms 92.5 ms: 1.62x slower
comprehensions 16.9 us 27.4 us: 1.62x slower
hexiom 5.76 ms 9.36 ms: 1.63x slower
scimark_monte_carlo 61.9 ms 103 ms: 1.67x slower
sqlglot_transpile 1.56 ms 2.67 ms: 1.72x slower
logging_silent 102 ns 177 ns: 1.73x slower
sqlglot_parse 1.26 ms 2.30 ms: 1.83x slower
raytrace 258 ms 479 ms: 1.86x slower
scimark_sor 114 ms 214 ms: 1.88x slower
go 116 ms 235 ms: 2.02x slower
deltablue 3.11 ms 7.35 ms: 2.36x slower
bench_thread_pool 1.03 ms 3.37 ms: 3.26x slower
Geometric mean (ref) 1.31x slower

Benchmark hidden because not significant (3): xml_etree_parse, asyncio_websockets, create_gc_cycles Ignored benchmarks (1) of results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json: html5lib

  • Geometric mean (including insignificant results): 1.228x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.24x
  • 95% likely to have a slowdown of 1.23x
  • 99% likely to have a slowdown of 1.22x

Memory

  • memory change: 1.19x