fork: python
ref: aeb9b65aa26444529e4a
machine: linux-x86_64
commit hash: aeb9b65
commit date: 2024-12-27
overall geometric mean: 1.107x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.06x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
2to3
445 ms
400 ms: 1.11x faster
docutils
4.01 sec
3.53 sec: 1.14x faster
html5lib
92.6 ms
80.3 ms: 1.15x faster
Geometric mean
(ref)
1.13x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
async_tree_io
1.39 sec
832 ms: 1.67x faster
async_tree_io_tg
1.40 sec
870 ms: 1.61x faster
async_tree_none
572 ms
374 ms: 1.53x faster
async_tree_memoization
709 ms
474 ms: 1.50x faster
async_tree_memoization_tg
670 ms
454 ms: 1.48x faster
async_tree_none_tg
504 ms
358 ms: 1.41x faster
async_tree_cpu_io_mixed
889 ms
694 ms: 1.28x faster
async_tree_cpu_io_mixed_tg
852 ms
667 ms: 1.28x faster
async_generators
567 ms
534 ms: 1.06x faster
asyncio_websockets
766 ms
725 ms: 1.06x faster
Geometric mean
(ref)
1.33x faster
Benchmark hidden because not significant (1): coroutines
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
pidigits
251 ms
233 ms: 1.08x faster
float
116 ms
108 ms: 1.08x faster
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (1): nbody
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
regex_compile
182 ms
158 ms: 1.15x faster
regex_effbot
4.74 ms
4.32 ms: 1.10x faster
regex_dna
282 ms
271 ms: 1.04x faster
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (1): regex_v8
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
xml_etree_iterparse
177 ms
146 ms: 1.21x faster
xml_etree_parse
231 ms
191 ms: 1.21x faster
xml_etree_process
85.9 ms
75.8 ms: 1.13x faster
tomli_loads
2.78 sec
2.47 sec: 1.12x faster
xml_etree_generate
122 ms
112 ms: 1.09x faster
unpickle_pure_python
290 us
267 us: 1.09x faster
json_loads
34.3 us
31.9 us: 1.08x faster
json_dumps
14.1 ms
15.0 ms: 1.06x slower
Geometric mean
(ref)
1.09x faster
Benchmark hidden because not significant (1): pickle_pure_python
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
python_startup_no_site
15.3 ms
13.4 ms: 1.15x faster
Geometric mean
(ref)
1.07x faster
Benchmark hidden because not significant (1): python_startup
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
genshi_xml
72.1 ms
64.6 ms: 1.12x faster
genshi_text
31.7 ms
28.5 ms: 1.11x faster
django_template
44.3 ms
42.9 ms: 1.03x faster
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (1): mako
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65
async_tree_io
1.39 sec
832 ms: 1.67x faster
async_tree_io_tg
1.40 sec
870 ms: 1.61x faster
async_tree_none
572 ms
374 ms: 1.53x faster
deepcopy
498 us
327 us: 1.52x faster
async_tree_memoization
709 ms
474 ms: 1.50x faster
async_tree_memoization_tg
670 ms
454 ms: 1.48x faster
async_tree_none_tg
504 ms
358 ms: 1.41x faster
deepcopy_memo
50.1 us
38.2 us: 1.31x faster
async_tree_cpu_io_mixed
889 ms
694 ms: 1.28x faster
async_tree_cpu_io_mixed_tg
852 ms
667 ms: 1.28x faster
telco
12.2 ms
9.65 ms: 1.26x faster
pylint
470 ms
382 ms: 1.23x faster
go
191 ms
156 ms: 1.22x faster
xml_etree_iterparse
177 ms
146 ms: 1.21x faster
xml_etree_parse
231 ms
191 ms: 1.21x faster
deepcopy_reduce
4.10 us
3.39 us: 1.21x faster
scimark_sor
179 ms
150 ms: 1.19x faster
spectral_norm
157 ms
131 ms: 1.19x faster
pathlib
29.9 ms
25.3 ms: 1.18x faster
sympy_integrate
30.2 ms
25.5 ms: 1.18x faster
richards_super
73.2 ms
62.5 ms: 1.17x faster
richards
65.5 ms
56.4 ms: 1.16x faster
regex_compile
182 ms
158 ms: 1.15x faster
html5lib
92.6 ms
80.3 ms: 1.15x faster
python_startup_no_site
15.3 ms
13.4 ms: 1.15x faster
scimark_sparse_mat_mult
6.76 ms
5.92 ms: 1.14x faster
docutils
4.01 sec
3.53 sec: 1.14x faster
thrift
1.10 ms
968 us: 1.14x faster
xml_etree_process
85.9 ms
75.8 ms: 1.13x faster
tomli_loads
2.78 sec
2.47 sec: 1.12x faster
meteor_contest
150 ms
134 ms: 1.12x faster
crypto_pyaes
100 ms
89.4 ms: 1.12x faster
genshi_xml
72.1 ms
64.6 ms: 1.12x faster
2to3
445 ms
400 ms: 1.11x faster
bench_thread_pool
2.89 ms
2.60 ms: 1.11x faster
bpe_tokeniser
6.28 sec
5.66 sec: 1.11x faster
genshi_text
31.7 ms
28.5 ms: 1.11x faster
sqlglot_optimize
74.7 ms
67.5 ms: 1.11x faster
sympy_sum
210 ms
190 ms: 1.10x faster
sympy_str
379 ms
345 ms: 1.10x faster
regex_effbot
4.74 ms
4.32 ms: 1.10x faster
fannkuch
547 ms
499 ms: 1.10x faster
mdp
3.80 sec
3.47 sec: 1.10x faster
xml_etree_generate
122 ms
112 ms: 1.09x faster
typing_runtime_protocols
226 us
208 us: 1.09x faster
unpickle_pure_python
290 us
267 us: 1.09x faster
pprint_safe_repr
987 ms
912 ms: 1.08x faster
pidigits
251 ms
233 ms: 1.08x faster
float
116 ms
108 ms: 1.08x faster
scimark_fft
473 ms
440 ms: 1.08x faster
json_loads
34.3 us
31.9 us: 1.08x faster
json
6.51 ms
6.08 ms: 1.07x faster
scimark_monte_carlo
90.6 ms
84.6 ms: 1.07x faster
sympy_expand
601 ms
561 ms: 1.07x faster
async_generators
567 ms
534 ms: 1.06x faster
sqlglot_transpile
2.20 ms
2.07 ms: 1.06x faster
asyncio_websockets
766 ms
725 ms: 1.06x faster
pprint_pformat
1.94 sec
1.85 sec: 1.05x faster
pyflate
664 ms
636 ms: 1.04x faster
pycparser
1.57 sec
1.51 sec: 1.04x faster
regex_dna
282 ms
271 ms: 1.04x faster
django_template
44.3 ms
42.9 ms: 1.03x faster
json_dumps
14.1 ms
15.0 ms: 1.06x slower
gc_traversal
5.70 ms
7.20 ms: 1.26x slower
create_gc_cycles
2.41 ms
3.29 ms: 1.36x slower
bench_mp_pool
18.7 ms
85.5 ms: 4.57x slower
Geometric mean
(ref)
1.09x faster
Benchmark hidden because not significant (22): chaos, sqlite_synth, nqueens, sqlglot_parse, nbody, logging_format, hexiom, logging_simple, deltablue, coroutines, comprehensions, raytrace, sqlglot_normalize, pickle_pure_python, coverage, dulwich_log, python_startup, scimark_lu, mako, logging_silent, regex_v8, generators
Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (8) of results/bm-20241227-3.14.0a3+-aeb9b65/bm-20241227-linux-x86_64-python-aeb9b65aa26444529e4a-3.14.0a3+-aeb9b65.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
Geometric mean (including insignificant results): 1.107x faster
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.08x
95% likely to have a speedup of 1.07x
99% likely to have a speedup of 1.06x