Skip to content

Latest commit

 

History

History
213 lines (190 loc) · 41.1 KB

bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65-vs-base.md

File metadata and controls

213 lines (190 loc) · 41.1 KB
Raw

Results vs. base

  • fork: python
  • ref: aeb9b65aa26444529e4a
  • machine: linux-x86_64
  • commit hash: aeb9b65
  • commit date: 2024-12-27
  • overall geometric mean: 1.232x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.22x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
2to3 255 ms 349 ms: 1.37x slower
docutils 2.54 sec 2.99 sec: 1.18x slower
sphinx 987 ms 1.15 sec: 1.16x slower
Geometric mean (ref) 1.23x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
asyncio_websockets 523 ms 521 ms: 1.00x faster
coroutines 21.2 ms 24.1 ms: 1.14x slower
async_tree_cpu_io_mixed_tg 480 ms 570 ms: 1.19x slower
async_tree_io_tg 612 ms 730 ms: 1.19x slower
async_tree_cpu_io_mixed 498 ms 596 ms: 1.20x slower
async_tree_io 626 ms 763 ms: 1.22x slower
async_tree_none_tg 255 ms 314 ms: 1.23x slower
async_generators 355 ms 445 ms: 1.25x slower
async_tree_none 277 ms 351 ms: 1.27x slower
async_tree_memoization 336 ms 427 ms: 1.27x slower
async_tree_memoization_tg 306 ms 401 ms: 1.31x slower
Geometric mean (ref) 1.20x slower

Benchmarks with tag 'math':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
pidigits 192 ms 190 ms: 1.02x faster
nbody 91.0 ms 127 ms: 1.39x slower
float 75.5 ms 111 ms: 1.47x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
regex_effbot 2.74 ms 2.89 ms: 1.06x slower
regex_v8 23.3 ms 24.8 ms: 1.06x slower
regex_dna 166 ms 180 ms: 1.08x slower
regex_compile 128 ms 169 ms: 1.32x slower
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
xml_etree_iterparse 90.8 ms 88.8 ms: 1.02x faster
json_loads 25.7 us 27.7 us: 1.08x slower
xml_etree_generate 83.4 ms 97.2 ms: 1.17x slower
json_dumps 11.3 ms 13.8 ms: 1.22x slower
xml_etree_process 58.2 ms 73.4 ms: 1.26x slower
tomli_loads 1.92 sec 2.54 sec: 1.32x slower
unpickle_pure_python 211 us 329 us: 1.56x slower
pickle_pure_python 310 us 494 us: 1.59x slower
Geometric mean (ref) 1.23x slower

Benchmark hidden because not significant (1): xml_etree_parse

Benchmarks with tag 'startup':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
python_startup 14.6 ms 15.6 ms: 1.07x slower
python_startup_no_site 7.45 ms 9.77 ms: 1.31x slower
Geometric mean (ref) 1.19x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
genshi_xml 48.8 ms 63.5 ms: 1.30x slower
django_template 35.2 ms 49.8 ms: 1.42x slower
genshi_text 21.4 ms 30.8 ms: 1.44x slower
mako 11.7 ms 17.1 ms: 1.47x slower
Geometric mean (ref) 1.40x slower

All benchmarks:

Benchmark results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json
gc_traversal 4.38 ms 3.28 ms: 1.33x faster
sqlite_synth 2.21 us 2.10 us: 1.05x faster
create_gc_cycles 1.86 ms 1.82 ms: 1.02x faster
xml_etree_iterparse 90.8 ms 88.8 ms: 1.02x faster
pidigits 192 ms 190 ms: 1.02x faster
asyncio_websockets 523 ms 521 ms: 1.00x faster
regex_effbot 2.74 ms 2.89 ms: 1.06x slower
json 4.70 ms 4.98 ms: 1.06x slower
regex_v8 23.3 ms 24.8 ms: 1.06x slower
python_startup 14.6 ms 15.6 ms: 1.07x slower
json_loads 25.7 us 27.7 us: 1.08x slower
regex_dna 166 ms 180 ms: 1.08x slower
pathlib 17.8 ms 19.5 ms: 1.10x slower
spectral_norm 96.8 ms 110 ms: 1.13x slower
bench_mp_pool 88.3 ms 100 ms: 1.14x slower
coroutines 21.2 ms 24.1 ms: 1.14x slower
k_core 2.06 sec 2.35 sec: 1.14x slower
sphinx 987 ms 1.15 sec: 1.16x slower
xml_etree_generate 83.4 ms 97.2 ms: 1.17x slower
bpe_tokeniser 4.28 sec 5.01 sec: 1.17x slower
docutils 2.54 sec 2.99 sec: 1.18x slower
async_tree_cpu_io_mixed_tg 480 ms 570 ms: 1.19x slower
async_tree_io_tg 612 ms 730 ms: 1.19x slower
mdp 2.34 sec 2.79 sec: 1.19x slower
many_optionals 1.03 ms 1.23 ms: 1.20x slower
async_tree_cpu_io_mixed 498 ms 596 ms: 1.20x slower
dulwich_log 75.4 ms 90.7 ms: 1.20x slower
scimark_fft 314 ms 379 ms: 1.21x slower
telco 7.21 ms 8.77 ms: 1.22x slower
json_dumps 11.3 ms 13.8 ms: 1.22x slower
async_tree_io 626 ms 763 ms: 1.22x slower
async_tree_none_tg 255 ms 314 ms: 1.23x slower
pylint 280 ms 347 ms: 1.24x slower
pycparser 1.11 sec 1.38 sec: 1.24x slower
async_generators 355 ms 445 ms: 1.25x slower
sympy_expand 458 ms 576 ms: 1.26x slower
coverage 78.5 ms 98.8 ms: 1.26x slower
nqueens 78.5 ms 98.8 ms: 1.26x slower
sqlglot_optimize 51.9 ms 65.4 ms: 1.26x slower
xml_etree_process 58.2 ms 73.4 ms: 1.26x slower
sympy_sum 154 ms 194 ms: 1.26x slower
async_tree_none 277 ms 351 ms: 1.27x slower
async_tree_memoization 336 ms 427 ms: 1.27x slower
shortest_path 433 ms 551 ms: 1.27x slower
sympy_integrate 19.8 ms 25.2 ms: 1.28x slower
connected_components 391 ms 500 ms: 1.28x slower
sqlglot_normalize 103 ms 132 ms: 1.28x slower
deepcopy 254 us 326 us: 1.28x slower
sympy_str 273 ms 352 ms: 1.29x slower
scimark_sparse_mat_mult 4.29 ms 5.56 ms: 1.30x slower
genshi_xml 48.8 ms 63.5 ms: 1.30x slower
async_tree_memoization_tg 306 ms 401 ms: 1.31x slower
meteor_contest 101 ms 132 ms: 1.31x slower
subparsers 21.9 ms 28.7 ms: 1.31x slower
python_startup_no_site 7.45 ms 9.77 ms: 1.31x slower
typing_runtime_protocols 155 us 204 us: 1.32x slower
regex_compile 128 ms 169 ms: 1.32x slower
tomli_loads 1.92 sec 2.54 sec: 1.32x slower
crypto_pyaes 67.2 ms 89.1 ms: 1.33x slower
deepcopy_reduce 2.60 us 3.46 us: 1.33x slower
pprint_safe_repr 705 ms 956 ms: 1.36x slower
fannkuch 364 ms 494 ms: 1.36x slower
2to3 255 ms 349 ms: 1.37x slower
thrift 725 us 996 us: 1.37x slower
pprint_pformat 1.44 sec 1.99 sec: 1.38x slower
generators 27.5 ms 38.2 ms: 1.39x slower
nbody 91.0 ms 127 ms: 1.39x slower
deepcopy_memo 29.1 us 40.9 us: 1.40x slower
django_template 35.2 ms 49.8 ms: 1.42x slower
sqlalchemy_declarative 128 ms 183 ms: 1.42x slower
sqlalchemy_imperative 19.4 ms 27.8 ms: 1.43x slower
genshi_text 21.4 ms 30.8 ms: 1.44x slower
scimark_lu 109 ms 158 ms: 1.45x slower
mako 11.7 ms 17.1 ms: 1.47x slower
float 75.5 ms 111 ms: 1.47x slower
logging_simple 5.93 us 9.03 us: 1.52x slower
logging_format 6.66 us 10.2 us: 1.53x slower
unpickle_pure_python 211 us 329 us: 1.56x slower
pyflate 415 ms 648 ms: 1.56x slower
richards_super 48.7 ms 76.0 ms: 1.56x slower
richards 43.0 ms 67.9 ms: 1.58x slower
pickle_pure_python 310 us 494 us: 1.59x slower
comprehensions 16.8 us 27.2 us: 1.62x slower
hexiom 5.90 ms 9.56 ms: 1.62x slower
chaos 57.6 ms 93.5 ms: 1.62x slower
scimark_monte_carlo 62.2 ms 106 ms: 1.70x slower
sqlglot_transpile 1.56 ms 2.67 ms: 1.71x slower
logging_silent 106 ns 186 ns: 1.75x slower
sqlglot_parse 1.26 ms 2.30 ms: 1.83x slower
raytrace 262 ms 486 ms: 1.86x slower
scimark_sor 114 ms 217 ms: 1.91x slower
go 117 ms 238 ms: 2.03x slower
deltablue 3.18 ms 7.40 ms: 2.33x slower
bench_thread_pool 1.03 ms 3.37 ms: 3.27x slower
Geometric mean (ref) 1.32x slower

Benchmark hidden because not significant (1): xml_etree_parse Ignored benchmarks (1) of results/bm-20241227-3.14.0a3+-aeb9b65-NOGIL/bm-20241227-vultr-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json: html5lib

  • Geometric mean (including insignificant results): 1.232x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.25x
  • 95% likely to have a slowdown of 1.24x
  • 99% likely to have a slowdown of 1.22x

Memory

  • memory change: 1.19x