- fork: python
- ref: 953b49e5468d02afadda
- machine: linux-x86_64
- commit hash: 953b49e
- commit date: 2025-01-07
- overall geometric mean: 1.240x slower
- HPT reliability: 100.00%
- HPT 99th percentile: 1.24x slower
- Memory change: 1.20x
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| 2to3 | 254 ms | 352 ms: 1.39x slower |
| docutils | 2.54 sec | 3.03 sec: 1.19x slower |
| sphinx | 980 ms | 1.17 sec: 1.20x slower |
| Geometric mean | (ref) | 1.26x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| asyncio_websockets | 523 ms | 517 ms: 1.01x faster |
| coroutines | 21.0 ms | 24.2 ms: 1.15x slower |
| async_tree_cpu_io_mixed_tg | 473 ms | 570 ms: 1.20x slower |
| async_tree_io_tg | 601 ms | 729 ms: 1.21x slower |
| async_tree_cpu_io_mixed | 495 ms | 600 ms: 1.21x slower |
| async_tree_none_tg | 250 ms | 311 ms: 1.24x slower |
| async_generators | 352 ms | 442 ms: 1.25x slower |
| async_tree_io | 606 ms | 761 ms: 1.26x slower |
| async_tree_none | 269 ms | 352 ms: 1.31x slower |
| async_tree_memoization_tg | 299 ms | 398 ms: 1.33x slower |
| async_tree_memoization | 324 ms | 432 ms: 1.33x slower |
| Geometric mean | (ref) | 1.22x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| pidigits | 192 ms | 184 ms: 1.05x faster |
| nbody | 91.3 ms | 131 ms: 1.43x slower |
| float | 71.7 ms | 107 ms: 1.49x slower |
| Geometric mean | (ref) | 1.27x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| regex_v8 | 22.8 ms | 25.2 ms: 1.10x slower |
| regex_dna | 169 ms | 187 ms: 1.11x slower |
| regex_effbot | 2.72 ms | 3.03 ms: 1.11x slower |
| regex_compile | 126 ms | 168 ms: 1.33x slower |
| Geometric mean | (ref) | 1.16x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| xml_etree_iterparse | 90.1 ms | 89.5 ms: 1.01x faster |
| xml_etree_parse | 128 ms | 129 ms: 1.01x slower |
| json_loads | 25.8 us | 28.5 us: 1.10x slower |
| xml_etree_generate | 82.8 ms | 97.8 ms: 1.18x slower |
| json_dumps | 11.5 ms | 13.8 ms: 1.21x slower |
| xml_etree_process | 57.6 ms | 74.0 ms: 1.28x slower |
| tomli_loads | 1.90 sec | 2.58 sec: 1.36x slower |
| unpickle_pure_python | 206 us | 330 us: 1.61x slower |
| pickle_pure_python | 309 us | 503 us: 1.63x slower |
| Geometric mean | (ref) | 1.25x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| python_startup | 14.7 ms | 15.7 ms: 1.07x slower |
| python_startup_no_site | 7.50 ms | 9.78 ms: 1.30x slower |
| Geometric mean | (ref) | 1.18x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| genshi_xml | 49.9 ms | 63.3 ms: 1.27x slower |
| genshi_text | 21.7 ms | 30.7 ms: 1.42x slower |
| django_template | 34.9 ms | 49.9 ms: 1.43x slower |
| mako | 11.4 ms | 16.9 ms: 1.48x slower |
| Geometric mean | (ref) | 1.40x slower |
| Benchmark | results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json | results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json |
|---|---|---|
| gc_traversal | 4.23 ms | 3.29 ms: 1.29x faster |
| pidigits | 192 ms | 184 ms: 1.05x faster |
| sqlite_synth | 2.19 us | 2.13 us: 1.03x faster |
| create_gc_cycles | 1.86 ms | 1.82 ms: 1.02x faster |
| asyncio_websockets | 523 ms | 517 ms: 1.01x faster |
| xml_etree_iterparse | 90.1 ms | 89.5 ms: 1.01x faster |
| xml_etree_parse | 128 ms | 129 ms: 1.01x slower |
| python_startup | 14.7 ms | 15.7 ms: 1.07x slower |
| json | 4.72 ms | 5.08 ms: 1.08x slower |
| pathlib | 18.0 ms | 19.5 ms: 1.09x slower |
| regex_v8 | 22.8 ms | 25.2 ms: 1.10x slower |
| json_loads | 25.8 us | 28.5 us: 1.10x slower |
| regex_dna | 169 ms | 187 ms: 1.11x slower |
| regex_effbot | 2.72 ms | 3.03 ms: 1.11x slower |
| mdp | 2.47 sec | 2.76 sec: 1.11x slower |
| bench_mp_pool | 89.4 ms | 101 ms: 1.13x slower |
| spectral_norm | 95.9 ms | 110 ms: 1.14x slower |
| k_core | 2.06 sec | 2.35 sec: 1.14x slower |
| coroutines | 21.0 ms | 24.2 ms: 1.15x slower |
| xml_etree_generate | 82.8 ms | 97.8 ms: 1.18x slower |
| bpe_tokeniser | 4.22 sec | 5.02 sec: 1.19x slower |
| telco | 7.34 ms | 8.74 ms: 1.19x slower |
| docutils | 2.54 sec | 3.03 sec: 1.19x slower |
| sphinx | 980 ms | 1.17 sec: 1.20x slower |
| async_tree_cpu_io_mixed_tg | 473 ms | 570 ms: 1.20x slower |
| dulwich_log | 74.7 ms | 90.1 ms: 1.21x slower |
| json_dumps | 11.5 ms | 13.8 ms: 1.21x slower |
| many_optionals | 1.03 ms | 1.24 ms: 1.21x slower |
| async_tree_io_tg | 601 ms | 729 ms: 1.21x slower |
| async_tree_cpu_io_mixed | 495 ms | 600 ms: 1.21x slower |
| pylint | 280 ms | 346 ms: 1.24x slower |
| scimark_fft | 314 ms | 388 ms: 1.24x slower |
| nqueens | 78.4 ms | 97.1 ms: 1.24x slower |
| async_tree_none_tg | 250 ms | 311 ms: 1.24x slower |
| coverage | 79.1 ms | 99.2 ms: 1.25x slower |
| async_generators | 352 ms | 442 ms: 1.25x slower |
| async_tree_io | 606 ms | 761 ms: 1.26x slower |
| pycparser | 1.10 sec | 1.38 sec: 1.26x slower |
| sympy_expand | 457 ms | 576 ms: 1.26x slower |
| sympy_sum | 154 ms | 194 ms: 1.26x slower |
| genshi_xml | 49.9 ms | 63.3 ms: 1.27x slower |
| shortest_path | 431 ms | 550 ms: 1.28x slower |
| connected_components | 388 ms | 497 ms: 1.28x slower |
| sympy_integrate | 19.7 ms | 25.3 ms: 1.28x slower |
| sqlglot_normalize | 103 ms | 132 ms: 1.28x slower |
| xml_etree_process | 57.6 ms | 74.0 ms: 1.28x slower |
| sqlglot_optimize | 51.8 ms | 66.6 ms: 1.29x slower |
| subparsers | 22.0 ms | 28.6 ms: 1.30x slower |
| python_startup_no_site | 7.50 ms | 9.78 ms: 1.30x slower |
| sympy_str | 271 ms | 355 ms: 1.31x slower |
| async_tree_none | 269 ms | 352 ms: 1.31x slower |
| deepcopy | 253 us | 331 us: 1.31x slower |
| typing_runtime_protocols | 155 us | 203 us: 1.31x slower |
| meteor_contest | 99.3 ms | 131 ms: 1.32x slower |
| async_tree_memoization_tg | 299 ms | 398 ms: 1.33x slower |
| async_tree_memoization | 324 ms | 432 ms: 1.33x slower |
| regex_compile | 126 ms | 168 ms: 1.33x slower |
| scimark_sparse_mat_mult | 4.25 ms | 5.68 ms: 1.34x slower |
| crypto_pyaes | 66.2 ms | 89.7 ms: 1.35x slower |
| tomli_loads | 1.90 sec | 2.58 sec: 1.36x slower |
| deepcopy_reduce | 2.54 us | 3.49 us: 1.37x slower |
| fannkuch | 363 ms | 499 ms: 1.37x slower |
| thrift | 731 us | 1.01 ms: 1.38x slower |
| 2to3 | 254 ms | 352 ms: 1.39x slower |
| generators | 27.1 ms | 37.6 ms: 1.39x slower |
| pprint_safe_repr | 679 ms | 949 ms: 1.40x slower |
| deepcopy_memo | 29.2 us | 41.1 us: 1.41x slower |
| genshi_text | 21.7 ms | 30.7 ms: 1.42x slower |
| sqlalchemy_declarative | 128 ms | 182 ms: 1.42x slower |
| pprint_pformat | 1.38 sec | 1.97 sec: 1.42x slower |
| django_template | 34.9 ms | 49.9 ms: 1.43x slower |
| nbody | 91.3 ms | 131 ms: 1.43x slower |
| sqlalchemy_imperative | 19.2 ms | 27.9 ms: 1.45x slower |
| scimark_lu | 106 ms | 154 ms: 1.45x slower |
| mako | 11.4 ms | 16.9 ms: 1.48x slower |
| float | 71.7 ms | 107 ms: 1.49x slower |
| logging_simple | 5.93 us | 9.12 us: 1.54x slower |
| pyflate | 416 ms | 645 ms: 1.55x slower |
| logging_format | 6.62 us | 10.3 us: 1.55x slower |
| richards_super | 47.5 ms | 73.8 ms: 1.55x slower |
| richards | 41.4 ms | 66.2 ms: 1.60x slower |
| comprehensions | 16.8 us | 27.0 us: 1.61x slower |
| unpickle_pure_python | 206 us | 330 us: 1.61x slower |
| pickle_pure_python | 309 us | 503 us: 1.63x slower |
| chaos | 57.0 ms | 94.8 ms: 1.66x slower |
| scimark_monte_carlo | 62.1 ms | 105 ms: 1.70x slower |
| hexiom | 5.62 ms | 9.53 ms: 1.70x slower |
| sqlglot_transpile | 1.55 ms | 2.66 ms: 1.72x slower |
| logging_silent | 103 ns | 179 ns: 1.74x slower |
| sqlglot_parse | 1.25 ms | 2.32 ms: 1.86x slower |
| raytrace | 258 ms | 491 ms: 1.90x slower |
| scimark_sor | 111 ms | 215 ms: 1.93x slower |
| go | 113 ms | 238 ms: 2.10x slower |
| deltablue | 3.08 ms | 7.35 ms: 2.38x slower |
| bench_thread_pool | 1.03 ms | 3.39 ms: 3.29x slower |
| Geometric mean | (ref) | 1.33x slower |
| Ignored benchmarks (1) of results/bm-20250107-3.14.0a3+-953b49e-NOGIL/bm-20250107-vultr-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json: html5lib |
- Geometric mean (including insignificant results): 1.240x slower
- Reliability score: 100.00% likely to be slow
- 90% likely to have a slowdown of 1.25x
- 95% likely to have a slowdown of 1.25x
- 99% likely to have a slowdown of 1.24x
- memory change: 1.20x