Skip to content

Latest commit

 

History

History
212 lines (189 loc) · 40.9 KB

bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537-vs-base.md

File metadata and controls

212 lines (189 loc) · 40.9 KB
Raw

Results vs. base

  • fork: python
  • ref: ea2b53739f1128184b41
  • machine: linux-x86_64
  • commit hash: ea2b537
  • commit date: 2024-12-26
  • overall geometric mean: 1.224x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.21x slower
  • Memory change: 1.18x

Benchmarks with tag 'apps':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
2to3 468 ms 588 ms: 1.26x slower
docutils 3.69 sec 4.82 sec: 1.31x slower
html5lib 78.1 ms 118 ms: 1.51x slower
sphinx 1.43 sec 1.73 sec: 1.21x slower
Geometric mean (ref) 1.32x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
asyncio_websockets 721 ms 753 ms: 1.05x slower
async_tree_io_tg 892 ms 952 ms: 1.07x slower
async_tree_cpu_io_mixed_tg 674 ms 753 ms: 1.12x slower
async_tree_io 908 ms 1.03 sec: 1.13x slower
async_generators 563 ms 643 ms: 1.14x slower
async_tree_memoization_tg 463 ms 545 ms: 1.18x slower
async_tree_none 384 ms 468 ms: 1.22x slower
coroutines 29.9 ms 37.1 ms: 1.24x slower
async_tree_none_tg 355 ms 442 ms: 1.25x slower
async_tree_cpu_io_mixed 671 ms 841 ms: 1.25x slower
async_tree_memoization 482 ms 611 ms: 1.27x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'math':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
nbody 121 ms 166 ms: 1.37x slower
float 116 ms 170 ms: 1.47x slower
Geometric mean (ref) 1.26x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
regex_v8 33.5 ms 31.9 ms: 1.05x faster
regex_dna 271 ms 295 ms: 1.09x slower
regex_effbot 4.08 ms 4.49 ms: 1.10x slower
regex_compile 175 ms 217 ms: 1.24x slower
Geometric mean (ref) 1.09x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
json_dumps 17.1 ms 18.2 ms: 1.06x slower
xml_etree_iterparse 137 ms 147 ms: 1.08x slower
xml_etree_parse 196 ms 212 ms: 1.08x slower
json_loads 31.7 us 37.3 us: 1.18x slower
xml_etree_generate 116 ms 141 ms: 1.22x slower
tomli_loads 2.49 sec 3.33 sec: 1.34x slower
xml_etree_process 79.8 ms 108 ms: 1.35x slower
pickle_pure_python 441 us 601 us: 1.36x slower
unpickle_pure_python 276 us 432 us: 1.57x slower
Geometric mean (ref) 1.24x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
python_startup 25.4 ms 31.0 ms: 1.22x slower
python_startup_no_site 16.2 ms 20.7 ms: 1.28x slower
Geometric mean (ref) 1.25x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
genshi_xml 69.1 ms 85.7 ms: 1.24x slower
genshi_text 29.4 ms 42.9 ms: 1.46x slower
django_template 43.6 ms 65.6 ms: 1.50x slower
mako 17.0 ms 26.4 ms: 1.56x slower
Geometric mean (ref) 1.43x slower

All benchmarks:

Benchmark results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json results/bm-20241226-3.14.0a3+-ea2b537-NOGIL/bm-20241226-linux-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json
gc_traversal 9.52 ms 8.27 ms: 1.15x faster
regex_v8 33.5 ms 31.9 ms: 1.05x faster
sqlite_synth 3.87 us 3.71 us: 1.04x faster
asyncio_websockets 721 ms 753 ms: 1.05x slower
pathlib 27.9 ms 29.7 ms: 1.06x slower
json_dumps 17.1 ms 18.2 ms: 1.06x slower
async_tree_io_tg 892 ms 952 ms: 1.07x slower
xml_etree_iterparse 137 ms 147 ms: 1.08x slower
xml_etree_parse 196 ms 212 ms: 1.08x slower
regex_dna 271 ms 295 ms: 1.09x slower
k_core 4.12 sec 4.52 sec: 1.10x slower
regex_effbot 4.08 ms 4.49 ms: 1.10x slower
async_tree_cpu_io_mixed_tg 674 ms 753 ms: 1.12x slower
shortest_path 910 ms 1.02 sec: 1.12x slower
pycparser 1.58 sec 1.78 sec: 1.13x slower
async_tree_io 908 ms 1.03 sec: 1.13x slower
async_generators 563 ms 643 ms: 1.14x slower
scimark_fft 448 ms 526 ms: 1.17x slower
json_loads 31.7 us 37.3 us: 1.18x slower
async_tree_memoization_tg 463 ms 545 ms: 1.18x slower
connected_components 814 ms 963 ms: 1.18x slower
sympy_expand 614 ms 734 ms: 1.20x slower
create_gc_cycles 3.68 ms 4.42 ms: 1.20x slower
coverage 115 ms 139 ms: 1.20x slower
telco 9.85 ms 11.9 ms: 1.21x slower
sphinx 1.43 sec 1.73 sec: 1.21x slower
meteor_contest 146 ms 178 ms: 1.22x slower
async_tree_none 384 ms 468 ms: 1.22x slower
xml_etree_generate 116 ms 141 ms: 1.22x slower
python_startup 25.4 ms 31.0 ms: 1.22x slower
sqlglot_normalize 134 ms 164 ms: 1.23x slower
spectral_norm 126 ms 155 ms: 1.23x slower
nqueens 109 ms 134 ms: 1.23x slower
dulwich_log 92.3 ms 114 ms: 1.24x slower
genshi_xml 69.1 ms 85.7 ms: 1.24x slower
coroutines 29.9 ms 37.1 ms: 1.24x slower
regex_compile 175 ms 217 ms: 1.24x slower
async_tree_none_tg 355 ms 442 ms: 1.25x slower
async_tree_cpu_io_mixed 671 ms 841 ms: 1.25x slower
many_optionals 1.10 ms 1.38 ms: 1.26x slower
2to3 468 ms 588 ms: 1.26x slower
async_tree_memoization 482 ms 611 ms: 1.27x slower
deepcopy_reduce 3.47 us 4.42 us: 1.27x slower
fannkuch 509 ms 647 ms: 1.27x slower
mdp 3.54 sec 4.51 sec: 1.27x slower
python_startup_no_site 16.2 ms 20.7 ms: 1.28x slower
sympy_sum 198 ms 255 ms: 1.28x slower
sympy_str 357 ms 460 ms: 1.29x slower
sqlglot_optimize 70.2 ms 91.5 ms: 1.30x slower
thrift 1.05 ms 1.37 ms: 1.30x slower
docutils 3.69 sec 4.82 sec: 1.31x slower
generators 42.0 ms 54.9 ms: 1.31x slower
scimark_sparse_mat_mult 6.00 ms 7.85 ms: 1.31x slower
sympy_integrate 26.5 ms 34.8 ms: 1.31x slower
pylint 400 ms 526 ms: 1.32x slower
bpe_tokeniser 5.89 sec 7.82 sec: 1.33x slower
typing_runtime_protocols 209 us 278 us: 1.33x slower
richards 58.1 ms 77.6 ms: 1.33x slower
tomli_loads 2.49 sec 3.33 sec: 1.34x slower
pprint_safe_repr 950 ms 1.28 sec: 1.35x slower
deepcopy 354 us 477 us: 1.35x slower
xml_etree_process 79.8 ms 108 ms: 1.35x slower
subparsers 31.8 ms 43.1 ms: 1.36x slower
pyflate 687 ms 931 ms: 1.36x slower
richards_super 64.9 ms 88.0 ms: 1.36x slower
scimark_lu 151 ms 205 ms: 1.36x slower
pickle_pure_python 441 us 601 us: 1.36x slower
logging_format 9.32 us 12.8 us: 1.37x slower
nbody 121 ms 166 ms: 1.37x slower
logging_simple 9.19 us 12.7 us: 1.38x slower
pprint_pformat 1.91 sec 2.66 sec: 1.39x slower
bench_thread_pool 2.90 ms 4.11 ms: 1.42x slower
sqlalchemy_declarative 175 ms 252 ms: 1.44x slower
crypto_pyaes 95.0 ms 137 ms: 1.44x slower
chaos 83.1 ms 120 ms: 1.45x slower
genshi_text 29.4 ms 42.9 ms: 1.46x slower
float 116 ms 170 ms: 1.47x slower
django_template 43.6 ms 65.6 ms: 1.50x slower
html5lib 78.1 ms 118 ms: 1.51x slower
scimark_monte_carlo 87.4 ms 134 ms: 1.53x slower
deepcopy_memo 39.5 us 60.4 us: 1.53x slower
mako 17.0 ms 26.4 ms: 1.56x slower
unpickle_pure_python 276 us 432 us: 1.57x slower
sqlglot_transpile 2.26 ms 3.55 ms: 1.57x slower
sqlalchemy_imperative 21.9 ms 36.5 ms: 1.67x slower
raytrace 355 ms 595 ms: 1.68x slower
logging_silent 133 ns 226 ns: 1.70x slower
scimark_sor 161 ms 281 ms: 1.74x slower
comprehensions 20.2 us 35.9 us: 1.78x slower
sqlglot_parse 1.68 ms 3.07 ms: 1.82x slower
hexiom 8.56 ms 17.0 ms: 1.99x slower
go 151 ms 313 ms: 2.08x slower
deltablue 4.14 ms 11.9 ms: 2.87x slower
Geometric mean (ref) 1.30x slower

Benchmark hidden because not significant (3): pidigits, bench_mp_pool, json

  • Geometric mean (including insignificant results): 1.224x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.23x
  • 95% likely to have a slowdown of 1.23x
  • 99% likely to have a slowdown of 1.21x

Memory

  • memory change: 1.18x