diff --git a/README.md b/README.md index 302557b3..e90a31b2 100644 --- a/README.md +++ b/README.md @@ -23,6 +23,7 @@ Here are some recent and important revisions. πŸ‘‰ [Complete list of results](RE ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-20](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL) | Yhg1s/optimise_recursive_c | b28153d (NOGIL) | 1.171x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.svg) | 1.198x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.svg) | 1.020x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL) | mpage/gh_115999_load_attr_ | d6d4c73 (NOGIL) | 1.087x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.svg) | 1.116x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.svg) | 1.120x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-d6d4c73) | mpage/gh_115999_load_attr_ | d6d4c73 | 1.087x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.svg) | 1.048x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.svg) | 1.002x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL) | Yhg1s/optimise_recursive_c | ddb794a (NOGIL) | 1.185x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.svg) | 1.212x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.svg) | 1.003x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base-mem.svg) | diff --git a/RESULTS.md b/RESULTS.md index 3c6533c5..654db461 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -206,6 +206,7 @@ ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-20](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL) | Yhg1s/optimise_recursive_c | b28153d (NOGIL) | 1.171x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.svg) | 1.198x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.svg) | 1.020x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL) | mpage/gh_115999_load_attr_ | d6d4c73 (NOGIL) | 1.087x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.svg) | 1.116x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.svg) | 1.120x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-d6d4c73-NOGIL/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-d6d4c73) | mpage/gh_115999_load_attr_ | d6d4c73 | 1.087x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.12.6.svg) | 1.048x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-3.13.0rc2.svg) | 1.002x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-d6d4c73/bm-20241220-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-d6d4c73-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL) | Yhg1s/optimise_recursive_c | ddb794a (NOGIL) | 1.185x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.svg) | 1.212x ↓
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.svg) | 1.003x ↑
[πŸ“„](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.md)[πŸ“ˆ](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base-mem.svg) | diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/README.md b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/README.md new file mode 100644 index 00000000..148ebd88 --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/README.md @@ -0,0 +1,43 @@ +# Results + +- fork: Yhg1s/optimise_recursive_c +- version: 3.14.0a3+ +- config: NOGIL +- commit hash: [b28153d](https://github.com/Yhg1s/cpython/commit/b28153d) +- commit date: 2024-12-20T23:07:38+00:00 +- commit merge base: [78ffba4221dcb2e39fd5db80c297d1777588bb59](https://github.com/python/cpython/commit/78ffba4221dcb2e39fd5db80c297d1777588bb59) +- ref: optimise_recursive_c + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12446433348) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d.json) + +### vs. 3.12.6 + +- Geometric mean: 1.171x slower (HPT: reliability of 100.00%, 1.13x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [πŸ“„table](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.md) +- [πŸ“ˆtime plot](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.198x slower (HPT: reliability of 100.00%, 1.15x slower at 99th %ile) +- Memory usage: 1.32x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [πŸ“„table](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.md) +- [πŸ“ˆtime plot](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.020x faster (HPT: reliability of 85.61%, 1.00x faster at 99th %ile) +- Memory usage: 1.00x +- [🧠memory plot](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base-mem.svg) +- [πŸ“„table](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.md) +- [πŸ“ˆtime plot](bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.svg) + diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.md b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.md new file mode 100644 index 00000000..366e10da --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.md @@ -0,0 +1,208 @@ +# Results vs. 3.12.6 + +- fork: Yhg1s +- ref: optimise_recursive_c +- machine: linux-x86_64 +- commit hash: b28153d +- commit date: 2024-12-20 +- overall geometric mean: 1.171x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.13x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 264 ms | 352 ms: 1.34x slower | +| docutils | 2.64 sec | 3.00 sec: 1.14x slower | +| html5lib | 63.6 ms | 90.8 ms: 1.43x slower | +| Geometric mean | (ref) | 1.29x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 742 ms: 1.50x faster | +| async_tree_io | 1.08 sec | 760 ms: 1.42x faster | +| async_tree_none_tg | 446 ms | 317 ms: 1.41x faster | +| async_tree_memoization_tg | 560 ms | 405 ms: 1.38x faster | +| async_tree_none | 464 ms | 352 ms: 1.32x faster | +| async_tree_memoization | 555 ms | 433 ms: 1.28x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 573 ms: 1.26x faster | +| async_tree_cpu_io_mixed | 715 ms | 603 ms: 1.19x faster | +| asyncio_websockets | 517 ms | 520 ms: 1.01x slower | +| coroutines | 23.9 ms | 24.2 ms: 1.01x slower | +| async_generators | 384 ms | 446 ms: 1.16x slower | +| Geometric mean | (ref) | 1.22x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| pidigits | 184 ms | 184 ms: 1.00x faster | +| float | 80.8 ms | 113 ms: 1.40x slower | +| nbody | 89.3 ms | 137 ms: 1.53x slower | +| Geometric mean | (ref) | 1.29x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.89 ms: 1.09x faster | +| regex_dna | 168 ms | 178 ms: 1.06x slower | +| regex_compile | 142 ms | 169 ms: 1.19x slower | +| regex_v8 | 20.6 ms | 24.7 ms: 1.20x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| xml_etree_parse | 139 ms | 129 ms: 1.07x faster | +| xml_etree_iterparse | 96.7 ms | 90.7 ms: 1.07x faster | +| json_loads | 26.5 us | 28.4 us: 1.07x slower | +| xml_etree_generate | 85.2 ms | 97.0 ms: 1.14x slower | +| tomli_loads | 2.11 sec | 2.60 sec: 1.23x slower | +| xml_etree_process | 59.0 ms | 73.4 ms: 1.24x slower | +| json_dumps | 10.4 ms | 14.0 ms: 1.35x slower | +| unpickle_pure_python | 221 us | 331 us: 1.50x slower | +| pickle_pure_python | 308 us | 501 us: 1.63x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 9.82 ms: 1.37x slower | +| python_startup | 9.93 ms | 15.7 ms: 1.59x slower | +| Geometric mean | (ref) | 1.47x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|-----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 62.9 ms: 1.25x slower | +| genshi_text | 22.8 ms | 30.5 ms: 1.34x slower | +| django_template | 34.7 ms | 49.4 ms: 1.42x slower | +| mako | 11.0 ms | 17.1 ms: 1.56x slower | +| Geometric mean | (ref) | 1.39x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 742 ms: 1.50x faster | +| async_tree_io | 1.08 sec | 760 ms: 1.42x faster | +| async_tree_none_tg | 446 ms | 317 ms: 1.41x faster | +| async_tree_memoization_tg | 560 ms | 405 ms: 1.38x faster | +| async_tree_none | 464 ms | 352 ms: 1.32x faster | +| async_tree_memoization | 555 ms | 433 ms: 1.28x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 573 ms: 1.26x faster | +| async_tree_cpu_io_mixed | 715 ms | 603 ms: 1.19x faster | +| pathlib | 21.5 ms | 19.4 ms: 1.11x faster | +| regex_effbot | 3.17 ms | 2.89 ms: 1.09x faster | +| deepcopy | 352 us | 324 us: 1.09x faster | +| xml_etree_parse | 139 ms | 129 ms: 1.07x faster | +| xml_etree_iterparse | 96.7 ms | 90.7 ms: 1.07x faster | +| sqlite_synth | 2.20 us | 2.12 us: 1.04x faster | +| pidigits | 184 ms | 184 ms: 1.00x faster | +| spectral_norm | 110 ms | 110 ms: 1.00x faster | +| asyncio_websockets | 517 ms | 520 ms: 1.01x slower | +| json | 5.02 ms | 5.06 ms: 1.01x slower | +| coroutines | 23.9 ms | 24.2 ms: 1.01x slower | +| gc_traversal | 3.46 ms | 3.51 ms: 1.02x slower | +| regex_dna | 168 ms | 178 ms: 1.06x slower | +| bpe_tokeniser | 4.74 sec | 5.04 sec: 1.06x slower | +| json_loads | 26.5 us | 28.4 us: 1.07x slower | +| pylint | 319 ms | 348 ms: 1.09x slower | +| deepcopy_reduce | 3.08 us | 3.39 us: 1.10x slower | +| scimark_fft | 342 ms | 382 ms: 1.12x slower | +| docutils | 2.64 sec | 3.00 sec: 1.14x slower | +| xml_etree_generate | 85.2 ms | 97.0 ms: 1.14x slower | +| dulwich_log | 78.9 ms | 90.8 ms: 1.15x slower | +| async_generators | 384 ms | 446 ms: 1.16x slower | +| crypto_pyaes | 76.6 ms | 89.9 ms: 1.17x slower | +| sympy_sum | 166 ms | 195 ms: 1.18x slower | +| generators | 32.2 ms | 38.0 ms: 1.18x slower | +| mdp | 2.42 sec | 2.87 sec: 1.19x slower | +| pycparser | 1.17 sec | 1.39 sec: 1.19x slower | +| regex_compile | 142 ms | 169 ms: 1.19x slower | +| regex_v8 | 20.6 ms | 24.7 ms: 1.20x slower | +| sympy_str | 292 ms | 357 ms: 1.22x slower | +| nqueens | 80.1 ms | 98.5 ms: 1.23x slower | +| sympy_integrate | 20.5 ms | 25.3 ms: 1.23x slower | +| tomli_loads | 2.11 sec | 2.60 sec: 1.23x slower | +| sqlglot_optimize | 53.3 ms | 66.1 ms: 1.24x slower | +| thrift | 791 us | 984 us: 1.24x slower | +| sympy_expand | 468 ms | 582 ms: 1.24x slower | +| xml_etree_process | 59.0 ms | 73.4 ms: 1.24x slower | +| sqlglot_normalize | 107 ms | 133 ms: 1.25x slower | +| typing_runtime_protocols | 163 us | 204 us: 1.25x slower | +| genshi_xml | 50.2 ms | 62.9 ms: 1.25x slower | +| sqlalchemy_imperative | 21.8 ms | 27.4 ms: 1.26x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.54 ms: 1.26x slower | +| meteor_contest | 104 ms | 131 ms: 1.27x slower | +| sqlalchemy_declarative | 143 ms | 183 ms: 1.28x slower | +| pprint_safe_repr | 743 ms | 964 ms: 1.30x slower | +| pprint_pformat | 1.52 sec | 2.01 sec: 1.32x slower | +| telco | 6.53 ms | 8.68 ms: 1.33x slower | +| 2to3 | 264 ms | 352 ms: 1.34x slower | +| genshi_text | 22.8 ms | 30.5 ms: 1.34x slower | +| fannkuch | 372 ms | 500 ms: 1.34x slower | +| json_dumps | 10.4 ms | 14.0 ms: 1.35x slower | +| logging_simple | 6.63 us | 9.06 us: 1.37x slower | +| python_startup_no_site | 7.16 ms | 9.82 ms: 1.37x slower | +| comprehensions | 19.8 us | 27.5 us: 1.39x slower | +| coverage | 71.4 ms | 99.0 ms: 1.39x slower | +| logging_format | 7.35 us | 10.2 us: 1.39x slower | +| scimark_lu | 114 ms | 160 ms: 1.40x slower | +| float | 80.8 ms | 113 ms: 1.40x slower | +| django_template | 34.7 ms | 49.4 ms: 1.42x slower | +| pyflate | 448 ms | 639 ms: 1.43x slower | +| html5lib | 63.6 ms | 90.8 ms: 1.43x slower | +| richards | 45.9 ms | 67.2 ms: 1.46x slower | +| richards_super | 51.9 ms | 76.9 ms: 1.48x slower | +| unpickle_pure_python | 221 us | 331 us: 1.50x slower | +| chaos | 62.8 ms | 95.6 ms: 1.52x slower | +| nbody | 89.3 ms | 137 ms: 1.53x slower | +| scimark_monte_carlo | 68.4 ms | 106 ms: 1.54x slower | +| hexiom | 6.17 ms | 9.57 ms: 1.55x slower | +| mako | 11.0 ms | 17.1 ms: 1.56x slower | +| python_startup | 9.93 ms | 15.7 ms: 1.59x slower | +| logging_silent | 109 ns | 177 ns: 1.62x slower | +| sqlglot_transpile | 1.67 ms | 2.72 ms: 1.63x slower | +| pickle_pure_python | 308 us | 501 us: 1.63x slower | +| raytrace | 299 ms | 489 ms: 1.63x slower | +| scimark_sor | 130 ms | 215 ms: 1.65x slower | +| create_gc_cycles | 1.09 ms | 1.84 ms: 1.69x slower | +| go | 139 ms | 238 ms: 1.71x slower | +| sqlglot_parse | 1.36 ms | 2.37 ms: 1.75x slower | +| deltablue | 3.45 ms | 7.39 ms: 2.14x slower | +| bench_thread_pool | 941 us | 3.39 ms: 3.60x slower | +| bench_mp_pool | 10.8 ms | 101 ms: 9.34x slower | +| Geometric mean | (ref) | 1.25x slower | + +Benchmark hidden because not significant (1): deepcopy_memo +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.171x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.17x +- 95% likely to have a slowdown of 1.16x +- 99% likely to have a slowdown of 1.13x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.svg b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.svg new file mode 100644 index 00000000..de3fe1e8 --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.12.6.svg @@ -0,0 +1,3067 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.md b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.md new file mode 100644 index 00000000..1a657e59 --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.md @@ -0,0 +1,203 @@ +# Results vs. 3.13.0rc2 + +- fork: Yhg1s +- ref: optimise_recursive_c +- machine: linux-x86_64 +- commit hash: b28153d +- commit date: 2024-12-20 +- overall geometric mean: 1.198x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.15x slower +- Memory change: 1.32x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 260 ms | 352 ms: 1.36x slower | +| docutils | 2.62 sec | 3.00 sec: 1.15x slower | +| html5lib | 67.0 ms | 90.8 ms: 1.36x slower | +| Geometric mean | (ref) | 1.28x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 742 ms: 1.23x faster | +| async_tree_io | 876 ms | 760 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 573 ms: 1.11x faster | +| async_tree_cpu_io_mixed | 666 ms | 603 ms: 1.10x faster | +| async_tree_memoization | 461 ms | 433 ms: 1.07x faster | +| async_tree_none_tg | 336 ms | 317 ms: 1.06x faster | +| coroutines | 23.6 ms | 24.2 ms: 1.03x slower | +| async_generators | 377 ms | 446 ms: 1.18x slower | +| Geometric mean | (ref) | 1.05x faster | + +Benchmark hidden because not significant (3): async_tree_memoization_tg, async_tree_none, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| pidigits | 217 ms | 184 ms: 1.18x faster | +| float | 77.5 ms | 113 ms: 1.46x slower | +| nbody | 85.1 ms | 137 ms: 1.61x slower | +| Geometric mean | (ref) | 1.26x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| regex_dna | 180 ms | 178 ms: 1.01x faster | +| regex_v8 | 22.7 ms | 24.7 ms: 1.09x slower | +| regex_compile | 132 ms | 169 ms: 1.28x slower | +| Geometric mean | (ref) | 1.07x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 129 ms: 1.06x faster | +| xml_etree_iterparse | 94.9 ms | 90.7 ms: 1.05x faster | +| json_loads | 27.0 us | 28.4 us: 1.05x slower | +| xml_etree_generate | 85.4 ms | 97.0 ms: 1.14x slower | +| xml_etree_process | 59.3 ms | 73.4 ms: 1.24x slower | +| tomli_loads | 2.01 sec | 2.60 sec: 1.29x slower | +| json_dumps | 10.5 ms | 14.0 ms: 1.33x slower | +| unpickle_pure_python | 210 us | 331 us: 1.58x slower | +| pickle_pure_python | 294 us | 501 us: 1.70x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 9.82 ms: 1.33x slower | +| python_startup | 11.0 ms | 15.7 ms: 1.43x slower | +| Geometric mean | (ref) | 1.38x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|-----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 62.9 ms: 1.29x slower | +| genshi_text | 21.5 ms | 30.5 ms: 1.42x slower | +| django_template | 34.1 ms | 49.4 ms: 1.45x slower | +| mako | 11.3 ms | 17.1 ms: 1.51x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 742 ms: 1.23x faster | +| pidigits | 217 ms | 184 ms: 1.18x faster | +| async_tree_io | 876 ms | 760 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 573 ms: 1.11x faster | +| async_tree_cpu_io_mixed | 666 ms | 603 ms: 1.10x faster | +| deepcopy | 355 us | 324 us: 1.10x faster | +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| async_tree_memoization | 461 ms | 433 ms: 1.07x faster | +| async_tree_none_tg | 336 ms | 317 ms: 1.06x faster | +| xml_etree_parse | 136 ms | 129 ms: 1.06x faster | +| xml_etree_iterparse | 94.9 ms | 90.7 ms: 1.05x faster | +| sqlite_synth | 2.21 us | 2.12 us: 1.04x faster | +| spectral_norm | 111 ms | 110 ms: 1.01x faster | +| regex_dna | 180 ms | 178 ms: 1.01x faster | +| pathlib | 19.2 ms | 19.4 ms: 1.01x slower | +| json | 4.93 ms | 5.06 ms: 1.03x slower | +| coroutines | 23.6 ms | 24.2 ms: 1.03x slower | +| deepcopy_memo | 39.1 us | 40.2 us: 1.03x slower | +| json_loads | 27.0 us | 28.4 us: 1.05x slower | +| regex_v8 | 22.7 ms | 24.7 ms: 1.09x slower | +| deepcopy_reduce | 3.11 us | 3.39 us: 1.09x slower | +| scimark_fft | 349 ms | 382 ms: 1.09x slower | +| pylint | 317 ms | 348 ms: 1.10x slower | +| telco | 7.82 ms | 8.68 ms: 1.11x slower | +| gc_traversal | 3.14 ms | 3.51 ms: 1.12x slower | +| bpe_tokeniser | 4.45 sec | 5.04 sec: 1.13x slower | +| xml_etree_generate | 85.4 ms | 97.0 ms: 1.14x slower | +| docutils | 2.62 sec | 3.00 sec: 1.15x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.54 ms: 1.18x slower | +| async_generators | 377 ms | 446 ms: 1.18x slower | +| coverage | 83.0 ms | 99.0 ms: 1.19x slower | +| dulwich_log | 74.8 ms | 90.8 ms: 1.21x slower | +| mdp | 2.36 sec | 2.87 sec: 1.22x slower | +| xml_etree_process | 59.3 ms | 73.4 ms: 1.24x slower | +| pycparser | 1.12 sec | 1.39 sec: 1.24x slower | +| nqueens | 78.6 ms | 98.5 ms: 1.25x slower | +| sympy_sum | 156 ms | 195 ms: 1.25x slower | +| sqlglot_optimize | 52.7 ms | 66.1 ms: 1.25x slower | +| sqlglot_normalize | 106 ms | 133 ms: 1.26x slower | +| thrift | 778 us | 984 us: 1.26x slower | +| sympy_expand | 457 ms | 582 ms: 1.27x slower | +| sympy_integrate | 19.8 ms | 25.3 ms: 1.28x slower | +| regex_compile | 132 ms | 169 ms: 1.28x slower | +| genshi_xml | 48.8 ms | 62.9 ms: 1.29x slower | +| meteor_contest | 102 ms | 131 ms: 1.29x slower | +| tomli_loads | 2.01 sec | 2.60 sec: 1.29x slower | +| sympy_str | 275 ms | 357 ms: 1.30x slower | +| pprint_safe_repr | 738 ms | 964 ms: 1.31x slower | +| generators | 28.8 ms | 38.0 ms: 1.32x slower | +| typing_runtime_protocols | 155 us | 204 us: 1.32x slower | +| crypto_pyaes | 67.9 ms | 89.9 ms: 1.32x slower | +| python_startup_no_site | 7.39 ms | 9.82 ms: 1.33x slower | +| json_dumps | 10.5 ms | 14.0 ms: 1.33x slower | +| pprint_pformat | 1.50 sec | 2.01 sec: 1.34x slower | +| fannkuch | 370 ms | 500 ms: 1.35x slower | +| 2to3 | 260 ms | 352 ms: 1.36x slower | +| html5lib | 67.0 ms | 90.8 ms: 1.36x slower | +| create_gc_cycles | 1.34 ms | 1.84 ms: 1.38x slower | +| genshi_text | 21.5 ms | 30.5 ms: 1.42x slower | +| scimark_lu | 113 ms | 160 ms: 1.42x slower | +| pyflate | 449 ms | 639 ms: 1.42x slower | +| python_startup | 11.0 ms | 15.7 ms: 1.43x slower | +| django_template | 34.1 ms | 49.4 ms: 1.45x slower | +| float | 77.5 ms | 113 ms: 1.46x slower | +| logging_simple | 6.16 us | 9.06 us: 1.47x slower | +| richards | 45.2 ms | 67.2 ms: 1.49x slower | +| richards_super | 51.6 ms | 76.9 ms: 1.49x slower | +| logging_format | 6.84 us | 10.2 us: 1.50x slower | +| mako | 11.3 ms | 17.1 ms: 1.51x slower | +| unpickle_pure_python | 210 us | 331 us: 1.58x slower | +| scimark_sor | 134 ms | 215 ms: 1.60x slower | +| hexiom | 5.99 ms | 9.57 ms: 1.60x slower | +| nbody | 85.1 ms | 137 ms: 1.61x slower | +| scimark_monte_carlo | 65.4 ms | 106 ms: 1.61x slower | +| chaos | 57.3 ms | 95.6 ms: 1.67x slower | +| comprehensions | 16.5 us | 27.5 us: 1.67x slower | +| go | 141 ms | 238 ms: 1.69x slower | +| pickle_pure_python | 294 us | 501 us: 1.70x slower | +| logging_silent | 103 ns | 177 ns: 1.73x slower | +| sqlglot_transpile | 1.56 ms | 2.72 ms: 1.74x slower | +| sqlglot_parse | 1.25 ms | 2.37 ms: 1.90x slower | +| raytrace | 253 ms | 489 ms: 1.93x slower | +| deltablue | 3.12 ms | 7.39 ms: 2.37x slower | +| bench_thread_pool | 919 us | 3.39 ms: 3.69x slower | +| bench_mp_pool | 11.0 ms | 101 ms: 9.17x slower | +| Geometric mean | (ref) | 1.29x slower | + +Benchmark hidden because not significant (3): async_tree_memoization_tg, async_tree_none, asyncio_websockets +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.198x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.20x +- 95% likely to have a slowdown of 1.18x +- 99% likely to have a slowdown of 1.15x + +# Memory +- memory change: 1.32x \ No newline at end of file diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.svg b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.svg new file mode 100644 index 00000000..535a3308 --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-3.13.0rc2.svg @@ -0,0 +1,2982 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base-mem.svg b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base-mem.svg new file mode 100644 index 00000000..a9b7e26d --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base-mem.svg @@ -0,0 +1,3710 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.md b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.md new file mode 100644 index 00000000..953a32a9 --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.md @@ -0,0 +1,175 @@ +# Results vs. base + +- fork: Yhg1s +- ref: optimise_recursive_c +- machine: linux-x86_64 +- commit hash: b28153d +- commit date: 2024-12-20 +- overall geometric mean: 1.020x faster +- HPT reliability: 85.61% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.00x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 360 ms | 352 ms: 1.02x faster | +| docutils | 3.05 sec | 3.00 sec: 1.02x faster | +| html5lib | 91.4 ms | 90.8 ms: 1.01x faster | +| sphinx | 1.16 sec | 1.15 sec: 1.01x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|---------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io | 757 ms | 760 ms: 1.00x slower | +| async_tree_memoization_tg | 402 ms | 405 ms: 1.01x slower | +| async_tree_memoization | 430 ms | 433 ms: 1.01x slower | +| async_tree_cpu_io_mixed | 598 ms | 603 ms: 1.01x slower | +| coroutines | 24.0 ms | 24.2 ms: 1.01x slower | +| async_tree_io_tg | 735 ms | 742 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (5): async_tree_none_tg, async_tree_none, asyncio_websockets, async_generators, async_tree_cpu_io_mixed_tg + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| float | 113 ms | 113 ms: 1.00x slower | +| pidigits | 181 ms | 184 ms: 1.02x slower | +| nbody | 127 ms | 137 ms: 1.08x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_v8 | 24.8 ms | 24.7 ms: 1.00x faster | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (3): regex_compile, regex_dna, regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|--------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| json_dumps | 14.3 ms | 14.0 ms: 1.02x faster | +| xml_etree_generate | 97.2 ms | 97.0 ms: 1.00x faster | +| json_loads | 28.2 us | 28.4 us: 1.01x slower | +| tomli_loads | 2.53 sec | 2.60 sec: 1.03x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (5): xml_etree_process, xml_etree_parse, pickle_pure_python, xml_etree_iterparse, unpickle_pure_python + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup | 17.2 ms | 15.7 ms: 1.09x faster | +| python_startup_no_site | 10.2 ms | 9.82 ms: 1.04x faster | +| Geometric mean | (ref) | 1.07x faster | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_xml | 63.7 ms | 62.9 ms: 1.01x faster | +| genshi_text | 30.7 ms | 30.5 ms: 1.01x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): django_template, mako + +All benchmarks: +=============== + +| Benchmark | bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3+-78ffba4 | bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d | +|---------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| sympy_sum | 349 ms | 195 ms: 1.79x faster | +| sympy_expand | 951 ms | 582 ms: 1.63x faster | +| sympy_str | 478 ms | 357 ms: 1.34x faster | +| sympy_integrate | 29.6 ms | 25.3 ms: 1.17x faster | +| python_startup | 17.2 ms | 15.7 ms: 1.09x faster | +| sqlalchemy_declarative | 197 ms | 183 ms: 1.08x faster | +| bench_mp_pool | 108 ms | 101 ms: 1.07x faster | +| pylint | 365 ms | 348 ms: 1.05x faster | +| python_startup_no_site | 10.2 ms | 9.82 ms: 1.04x faster | +| logging_silent | 184 ns | 177 ns: 1.04x faster | +| deltablue | 7.67 ms | 7.39 ms: 1.04x faster | +| coverage | 102 ms | 99.0 ms: 1.03x faster | +| richards | 69.1 ms | 67.2 ms: 1.03x faster | +| pyflate | 655 ms | 639 ms: 1.03x faster | +| go | 244 ms | 238 ms: 1.02x faster | +| 2to3 | 360 ms | 352 ms: 1.02x faster | +| scimark_sor | 219 ms | 215 ms: 1.02x faster | +| thrift | 1.00 ms | 984 us: 1.02x faster | +| json_dumps | 14.3 ms | 14.0 ms: 1.02x faster | +| pathlib | 19.8 ms | 19.4 ms: 1.02x faster | +| scimark_fft | 388 ms | 382 ms: 1.02x faster | +| raytrace | 497 ms | 489 ms: 1.02x faster | +| logging_simple | 9.21 us | 9.06 us: 1.02x faster | +| docutils | 3.05 sec | 3.00 sec: 1.02x faster | +| telco | 8.81 ms | 8.68 ms: 1.02x faster | +| genshi_xml | 63.7 ms | 62.9 ms: 1.01x faster | +| comprehensions | 27.9 us | 27.5 us: 1.01x faster | +| scimark_monte_carlo | 107 ms | 106 ms: 1.01x faster | +| sqlite_synth | 2.14 us | 2.12 us: 1.01x faster | +| generators | 38.4 ms | 38.0 ms: 1.01x faster | +| hexiom | 9.66 ms | 9.57 ms: 1.01x faster | +| sphinx | 1.16 sec | 1.15 sec: 1.01x faster | +| spectral_norm | 111 ms | 110 ms: 1.01x faster | +| typing_runtime_protocols | 206 us | 204 us: 1.01x faster | +| html5lib | 91.4 ms | 90.8 ms: 1.01x faster | +| genshi_text | 30.7 ms | 30.5 ms: 1.01x faster | +| many_optionals | 1.25 ms | 1.24 ms: 1.01x faster | +| regex_v8 | 24.8 ms | 24.7 ms: 1.00x faster | +| xml_etree_generate | 97.2 ms | 97.0 ms: 1.00x faster | +| float | 113 ms | 113 ms: 1.00x slower | +| sqlglot_normalize | 133 ms | 133 ms: 1.00x slower | +| bench_thread_pool | 3.38 ms | 3.39 ms: 1.00x slower | +| async_tree_io | 757 ms | 760 ms: 1.00x slower | +| nqueens | 98.0 ms | 98.5 ms: 1.00x slower | +| async_tree_memoization_tg | 402 ms | 405 ms: 1.01x slower | +| async_tree_memoization | 430 ms | 433 ms: 1.01x slower | +| dulwich_log | 90.1 ms | 90.8 ms: 1.01x slower | +| deepcopy_memo | 39.9 us | 40.2 us: 1.01x slower | +| pprint_pformat | 1.99 sec | 2.01 sec: 1.01x slower | +| json_loads | 28.2 us | 28.4 us: 1.01x slower | +| pprint_safe_repr | 956 ms | 964 ms: 1.01x slower | +| async_tree_cpu_io_mixed | 598 ms | 603 ms: 1.01x slower | +| scimark_lu | 158 ms | 160 ms: 1.01x slower | +| bpe_tokeniser | 4.99 sec | 5.04 sec: 1.01x slower | +| coroutines | 24.0 ms | 24.2 ms: 1.01x slower | +| async_tree_io_tg | 735 ms | 742 ms: 1.01x slower | +| scimark_sparse_mat_mult | 5.47 ms | 5.54 ms: 1.01x slower | +| pidigits | 181 ms | 184 ms: 1.02x slower | +| fannkuch | 490 ms | 500 ms: 1.02x slower | +| mdp | 2.81 sec | 2.87 sec: 1.02x slower | +| tomli_loads | 2.53 sec | 2.60 sec: 1.03x slower | +| create_gc_cycles | 1.79 ms | 1.84 ms: 1.03x slower | +| gc_traversal | 3.26 ms | 3.51 ms: 1.08x slower | +| nbody | 127 ms | 137 ms: 1.08x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (32): chaos, subparsers, sqlalchemy_imperative, async_tree_none_tg, sqlglot_transpile, django_template, sqlglot_parse, deepcopy_reduce, regex_compile, logging_format, async_tree_none, mako, regex_dna, asyncio_websockets, xml_etree_process, k_core, xml_etree_parse, meteor_contest, deepcopy, async_generators, pickle_pure_python, async_tree_cpu_io_mixed_tg, regex_effbot, crypto_pyaes, pycparser, xml_etree_iterparse, connected_components, shortest_path, unpickle_pure_python, json, sqlglot_optimize, richards_super + +- Geometric mean (including insignificant results): 1.020x faster + +# HPT report + +- Reliability score: 85.61% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.00x \ No newline at end of file diff --git a/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.svg b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.svg new file mode 100644 index 00000000..26f7f19a --- /dev/null +++ b/results/bm-20241220-3.14.0a3+-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3+-b28153d-vs-base.svg @@ -0,0 +1,3424 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +