Skip to content

Latest commit

 

History

History
199 lines (174 loc) · 23.4 KB

bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537-vs-3.13.0rc2.md

File metadata and controls

199 lines (174 loc) · 23.4 KB
Raw

Results vs. 3.13.0rc2

  • fork: python
  • ref: ea2b53739f1128184b41
  • machine: linux-x86_64
  • commit hash: ea2b537
  • commit date: 2024-12-26
  • overall geometric mean: 1.053x faster
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.02x faster
  • Memory change: 1.10x

Benchmarks with tag 'apps':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
2to3 260 ms 256 ms: 1.01x faster
docutils 2.62 sec 2.55 sec: 1.03x faster
Geometric mean (ref) 1.02x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
async_tree_io_tg 913 ms 618 ms: 1.48x faster
async_tree_io 876 ms 629 ms: 1.39x faster
async_tree_memoization 461 ms 333 ms: 1.39x faster
async_tree_cpu_io_mixed 666 ms 495 ms: 1.35x faster
async_tree_memoization_tg 414 ms 308 ms: 1.34x faster
async_tree_cpu_io_mixed_tg 638 ms 480 ms: 1.33x faster
async_tree_none_tg 336 ms 256 ms: 1.31x faster
async_tree_none 354 ms 278 ms: 1.27x faster
coroutines 23.6 ms 22.0 ms: 1.07x faster
async_generators 377 ms 355 ms: 1.06x faster
Geometric mean (ref) 1.26x faster

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
pidigits 217 ms 185 ms: 1.17x faster
float 77.5 ms 74.9 ms: 1.03x faster
nbody 85.1 ms 88.9 ms: 1.04x slower
Geometric mean (ref) 1.05x faster

Benchmarks with tag 'regex':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
regex_effbot 3.08 ms 2.79 ms: 1.11x faster
regex_compile 132 ms 126 ms: 1.05x faster
regex_dna 180 ms 179 ms: 1.01x faster
regex_v8 22.7 ms 25.1 ms: 1.10x slower
Geometric mean (ref) 1.01x faster

Benchmarks with tag 'serialize':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
tomli_loads 2.01 sec 1.89 sec: 1.06x faster
xml_etree_parse 136 ms 129 ms: 1.06x faster
xml_etree_iterparse 94.9 ms 90.5 ms: 1.05x faster
json_loads 27.0 us 26.1 us: 1.03x faster
xml_etree_generate 85.4 ms 82.6 ms: 1.03x faster
xml_etree_process 59.3 ms 57.5 ms: 1.03x faster
pickle_pure_python 294 us 311 us: 1.06x slower
json_dumps 10.5 ms 11.3 ms: 1.08x slower
Geometric mean (ref) 1.02x faster

Benchmark hidden because not significant (1): unpickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
python_startup_no_site 7.39 ms 7.50 ms: 1.01x slower
python_startup 11.0 ms 14.7 ms: 1.34x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
genshi_xml 48.8 ms 49.0 ms: 1.01x slower
mako 11.3 ms 11.6 ms: 1.02x slower
django_template 34.1 ms 35.1 ms: 1.03x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537
async_tree_io_tg 913 ms 618 ms: 1.48x faster
async_tree_io 876 ms 629 ms: 1.39x faster
deepcopy 355 us 255 us: 1.39x faster
async_tree_memoization 461 ms 333 ms: 1.39x faster
async_tree_cpu_io_mixed 666 ms 495 ms: 1.35x faster
async_tree_memoization_tg 414 ms 308 ms: 1.34x faster
deepcopy_memo 39.1 us 29.1 us: 1.34x faster
async_tree_cpu_io_mixed_tg 638 ms 480 ms: 1.33x faster
async_tree_none_tg 336 ms 256 ms: 1.31x faster
async_tree_none 354 ms 278 ms: 1.27x faster
go 141 ms 116 ms: 1.21x faster
scimark_sor 134 ms 114 ms: 1.18x faster
deepcopy_reduce 3.11 us 2.65 us: 1.18x faster
pidigits 217 ms 185 ms: 1.17x faster
pylint 317 ms 280 ms: 1.13x faster
spectral_norm 111 ms 98.5 ms: 1.13x faster
scimark_fft 349 ms 315 ms: 1.11x faster
regex_effbot 3.08 ms 2.79 ms: 1.11x faster
richards 45.2 ms 41.6 ms: 1.09x faster
richards_super 51.6 ms 47.6 ms: 1.09x faster
telco 7.82 ms 7.22 ms: 1.08x faster
pyflate 449 ms 416 ms: 1.08x faster
scimark_sparse_mat_mult 4.71 ms 4.39 ms: 1.07x faster
thrift 778 us 727 us: 1.07x faster
coroutines 23.6 ms 22.0 ms: 1.07x faster
tomli_loads 2.01 sec 1.89 sec: 1.06x faster
async_generators 377 ms 355 ms: 1.06x faster
pprint_safe_repr 738 ms 695 ms: 1.06x faster
xml_etree_parse 136 ms 129 ms: 1.06x faster
pathlib 19.2 ms 18.1 ms: 1.06x faster
generators 28.8 ms 27.2 ms: 1.06x faster
scimark_monte_carlo 65.4 ms 61.9 ms: 1.06x faster
coverage 83.0 ms 78.6 ms: 1.06x faster
pprint_pformat 1.50 sec 1.42 sec: 1.05x faster
scimark_lu 113 ms 107 ms: 1.05x faster
xml_etree_iterparse 94.9 ms 90.5 ms: 1.05x faster
regex_compile 132 ms 126 ms: 1.05x faster
bpe_tokeniser 4.45 sec 4.25 sec: 1.05x faster
hexiom 5.99 ms 5.76 ms: 1.04x faster
json_loads 27.0 us 26.1 us: 1.03x faster
fannkuch 370 ms 357 ms: 1.03x faster
xml_etree_generate 85.4 ms 82.6 ms: 1.03x faster
float 77.5 ms 74.9 ms: 1.03x faster
json 4.93 ms 4.77 ms: 1.03x faster
xml_etree_process 59.3 ms 57.5 ms: 1.03x faster
crypto_pyaes 67.9 ms 66.0 ms: 1.03x faster
docutils 2.62 sec 2.55 sec: 1.03x faster
logging_simple 6.16 us 6.02 us: 1.02x faster
sqlglot_normalize 106 ms 103 ms: 1.02x faster
meteor_contest 102 ms 99.7 ms: 1.02x faster
sqlglot_optimize 52.7 ms 51.9 ms: 1.02x faster
sympy_sum 156 ms 153 ms: 1.01x faster
2to3 260 ms 256 ms: 1.01x faster
sympy_str 275 ms 272 ms: 1.01x faster
nqueens 78.6 ms 78.1 ms: 1.01x faster
regex_dna 180 ms 179 ms: 1.01x faster
deltablue 3.12 ms 3.11 ms: 1.00x faster
logging_silent 103 ns 102 ns: 1.00x faster
sympy_integrate 19.8 ms 19.7 ms: 1.00x faster
sqlglot_parse 1.25 ms 1.26 ms: 1.01x slower
genshi_xml 48.8 ms 49.0 ms: 1.01x slower
dulwich_log 74.8 ms 75.5 ms: 1.01x slower
python_startup_no_site 7.39 ms 7.50 ms: 1.01x slower
raytrace 253 ms 258 ms: 1.02x slower
mako 11.3 ms 11.6 ms: 1.02x slower
typing_runtime_protocols 155 us 158 us: 1.02x slower
comprehensions 16.5 us 16.9 us: 1.03x slower
django_template 34.1 ms 35.1 ms: 1.03x slower
mdp 2.36 sec 2.46 sec: 1.04x slower
nbody 85.1 ms 88.9 ms: 1.04x slower
pickle_pure_python 294 us 311 us: 1.06x slower
json_dumps 10.5 ms 11.3 ms: 1.08x slower
regex_v8 22.7 ms 25.1 ms: 1.10x slower
bench_thread_pool 919 us 1.03 ms: 1.12x slower
python_startup 11.0 ms 14.7 ms: 1.34x slower
create_gc_cycles 1.34 ms 1.83 ms: 1.37x slower
gc_traversal 3.14 ms 4.56 ms: 1.45x slower
bench_mp_pool 11.0 ms 89.1 ms: 8.10x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (9): sqlglot_transpile, asyncio_websockets, chaos, pycparser, sqlite_synth, logging_format, genshi_text, sympy_expand, unpickle_pure_python Ignored benchmarks (15) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20241226-3.14.0a3+-ea2b537/bm-20241226-vultr-x86_64-python-ea2b53739f1128184b41-3.14.0a3+-ea2b537.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers

  • Geometric mean (including insignificant results): 1.053x faster

HPT report

  • Reliability score: 100.00% likely to be faster
  • 90% likely to have a speedup of 1.03x
  • 95% likely to have a speedup of 1.02x
  • 99% likely to have a speedup of 1.02x

Memory

  • memory change: 1.10x