fork: python
ref: 5c814c83cdd3dc42bd96
machine: linux-x86_64
commit hash: 5c814c8
commit date: 2024-12-25
overall geometric mean: 1.130x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.09x slower
Memory change: 1.33x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
2to3
456 ms
575 ms: 1.26x slower
docutils
4.00 sec
4.35 sec: 1.09x slower
html5lib
88.9 ms
127 ms: 1.42x slower
Geometric mean
(ref)
1.25x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
async_tree_io_tg
1.93 sec
942 ms: 2.05x faster
async_tree_io
1.85 sec
1.01 sec: 1.84x faster
async_tree_memoization_tg
930 ms
553 ms: 1.68x faster
async_tree_none_tg
704 ms
422 ms: 1.67x faster
async_tree_none
741 ms
475 ms: 1.56x faster
async_tree_memoization
977 ms
641 ms: 1.52x faster
async_tree_cpu_io_mixed_tg
1.10 sec
739 ms: 1.49x faster
async_tree_cpu_io_mixed
1.08 sec
817 ms: 1.32x faster
async_generators
589 ms
639 ms: 1.08x slower
coroutines
29.5 ms
35.1 ms: 1.19x slower
Geometric mean
(ref)
1.39x faster
Benchmark hidden because not significant (1): asyncio_websockets
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
float
123 ms
158 ms: 1.28x slower
nbody
119 ms
182 ms: 1.53x slower
Geometric mean
(ref)
1.25x slower
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
regex_effbot
5.13 ms
4.27 ms: 1.20x faster
regex_dna
278 ms
290 ms: 1.04x slower
regex_v8
32.5 ms
35.1 ms: 1.08x slower
regex_compile
187 ms
214 ms: 1.15x slower
Geometric mean
(ref)
1.02x slower
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
xml_etree_iterparse
169 ms
134 ms: 1.26x faster
xml_etree_parse
241 ms
212 ms: 1.14x faster
xml_etree_generate
127 ms
138 ms: 1.09x slower
tomli_loads
2.88 sec
3.22 sec: 1.12x slower
json_dumps
14.3 ms
17.5 ms: 1.22x slower
xml_etree_process
83.7 ms
105 ms: 1.25x slower
unpickle_pure_python
300 us
386 us: 1.29x slower
pickle_pure_python
436 us
678 us: 1.56x slower
Geometric mean
(ref)
1.11x slower
Benchmark hidden because not significant (1): json_loads
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
python_startup_no_site
17.6 ms
20.1 ms: 1.14x slower
python_startup
23.7 ms
31.0 ms: 1.31x slower
Geometric mean
(ref)
1.22x slower
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
genshi_xml
67.6 ms
83.0 ms: 1.23x slower
genshi_text
30.2 ms
41.0 ms: 1.36x slower
django_template
44.9 ms
64.8 ms: 1.44x slower
mako
15.7 ms
26.8 ms: 1.70x slower
Geometric mean
(ref)
1.42x slower
Benchmark
bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b
bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8
async_tree_io_tg
1.93 sec
942 ms: 2.05x faster
async_tree_io
1.85 sec
1.01 sec: 1.84x faster
async_tree_memoization_tg
930 ms
553 ms: 1.68x faster
async_tree_none_tg
704 ms
422 ms: 1.67x faster
async_tree_none
741 ms
475 ms: 1.56x faster
async_tree_memoization
977 ms
641 ms: 1.52x faster
async_tree_cpu_io_mixed_tg
1.10 sec
739 ms: 1.49x faster
async_tree_cpu_io_mixed
1.08 sec
817 ms: 1.32x faster
xml_etree_iterparse
169 ms
134 ms: 1.26x faster
regex_effbot
5.13 ms
4.27 ms: 1.20x faster
xml_etree_parse
241 ms
212 ms: 1.14x faster
regex_dna
278 ms
290 ms: 1.04x slower
mdp
3.97 sec
4.23 sec: 1.06x slower
pylint
465 ms
498 ms: 1.07x slower
regex_v8
32.5 ms
35.1 ms: 1.08x slower
async_generators
589 ms
639 ms: 1.08x slower
xml_etree_generate
127 ms
138 ms: 1.09x slower
scimark_fft
500 ms
544 ms: 1.09x slower
docutils
4.00 sec
4.35 sec: 1.09x slower
sqlglot_normalize
157 ms
171 ms: 1.09x slower
deepcopy_reduce
4.04 us
4.40 us: 1.09x slower
bench_thread_pool
3.48 ms
3.83 ms: 1.10x slower
logging_simple
9.45 us
10.4 us: 1.10x slower
dulwich_log
100 ms
111 ms: 1.11x slower
tomli_loads
2.88 sec
3.22 sec: 1.12x slower
nqueens
117 ms
130 ms: 1.12x slower
sqlalchemy_declarative
218 ms
244 ms: 1.12x slower
crypto_pyaes
107 ms
121 ms: 1.13x slower
python_startup_no_site
17.6 ms
20.1 ms: 1.14x slower
regex_compile
187 ms
214 ms: 1.15x slower
sqlglot_optimize
76.0 ms
88.6 ms: 1.17x slower
bpe_tokeniser
6.59 sec
7.78 sec: 1.18x slower
coroutines
29.5 ms
35.1 ms: 1.19x slower
sympy_sum
222 ms
264 ms: 1.19x slower
comprehensions
27.1 us
32.7 us: 1.21x slower
scimark_sparse_mat_mult
6.70 ms
8.09 ms: 1.21x slower
sympy_integrate
29.8 ms
36.3 ms: 1.22x slower
thrift
1.06 ms
1.30 ms: 1.22x slower
json_dumps
14.3 ms
17.5 ms: 1.22x slower
genshi_xml
67.6 ms
83.0 ms: 1.23x slower
sympy_str
385 ms
473 ms: 1.23x slower
fannkuch
540 ms
668 ms: 1.24x slower
generators
41.1 ms
51.0 ms: 1.24x slower
telco
9.59 ms
11.9 ms: 1.24x slower
sympy_expand
582 ms
727 ms: 1.25x slower
xml_etree_process
83.7 ms
105 ms: 1.25x slower
richards_super
72.8 ms
91.3 ms: 1.25x slower
2to3
456 ms
575 ms: 1.26x slower
pyflate
727 ms
923 ms: 1.27x slower
meteor_contest
146 ms
186 ms: 1.27x slower
gc_traversal
5.86 ms
7.46 ms: 1.27x slower
scimark_lu
152 ms
194 ms: 1.27x slower
float
123 ms
158 ms: 1.28x slower
unpickle_pure_python
300 us
386 us: 1.29x slower
pprint_safe_repr
967 ms
1.25 sec: 1.29x slower
typing_runtime_protocols
224 us
292 us: 1.30x slower
logging_format
9.59 us
12.5 us: 1.30x slower
python_startup
23.7 ms
31.0 ms: 1.31x slower
richards
60.3 ms
81.6 ms: 1.35x slower
genshi_text
30.2 ms
41.0 ms: 1.36x slower
pprint_pformat
1.98 sec
2.69 sec: 1.36x slower
scimark_monte_carlo
96.4 ms
133 ms: 1.38x slower
html5lib
88.9 ms
127 ms: 1.42x slower
django_template
44.9 ms
64.8 ms: 1.44x slower
coverage
95.4 ms
138 ms: 1.44x slower
sqlglot_transpile
2.34 ms
3.41 ms: 1.46x slower
chaos
84.9 ms
124 ms: 1.46x slower
hexiom
8.27 ms
12.2 ms: 1.47x slower
raytrace
408 ms
616 ms: 1.51x slower
nbody
119 ms
182 ms: 1.53x slower
sqlalchemy_imperative
24.7 ms
38.1 ms: 1.54x slower
pickle_pure_python
436 us
678 us: 1.56x slower
logging_silent
139 ns
219 ns: 1.57x slower
scimark_sor
167 ms
270 ms: 1.62x slower
go
172 ms
285 ms: 1.66x slower
mako
15.7 ms
26.8 ms: 1.70x slower
create_gc_cycles
1.94 ms
3.50 ms: 1.80x slower
sqlglot_parse
1.79 ms
3.23 ms: 1.81x slower
deltablue
4.27 ms
11.3 ms: 2.65x slower
bench_mp_pool
20.7 ms
91.9 ms: 4.44x slower
Geometric mean
(ref)
1.17x slower
Benchmark hidden because not significant (10): pathlib, deepcopy, sqlite_synth, deepcopy_memo, json_loads, json, asyncio_websockets, pidigits, spectral_norm, pycparser
Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (6) of results/bm-20241225-3.14.0a3+-5c814c8-NOGIL/bm-20241225-linux-x86_64-python-5c814c83cdd3dc42bd96-3.14.0a3+-5c814c8.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
Geometric mean (including insignificant results): 1.130x slower
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.11x
95% likely to have a slowdown of 1.10x
99% likely to have a slowdown of 1.09x