fork: python
ref: 953b49e5468d02afadda
machine: linux-x86_64
commit hash: 953b49e
commit date: 2025-01-07
overall geometric mean: 1.087x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.04x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
docutils
4.01 sec
3.61 sec: 1.11x faster
html5lib
92.6 ms
83.0 ms: 1.12x faster
Geometric mean
(ref)
1.09x faster
Benchmark hidden because not significant (1): 2to3
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
async_tree_io_tg
1.40 sec
807 ms: 1.74x faster
async_tree_io
1.39 sec
853 ms: 1.63x faster
async_tree_none
572 ms
376 ms: 1.52x faster
async_tree_memoization
709 ms
482 ms: 1.47x faster
async_tree_memoization_tg
670 ms
464 ms: 1.44x faster
async_tree_none_tg
504 ms
369 ms: 1.37x faster
async_tree_cpu_io_mixed_tg
852 ms
633 ms: 1.34x faster
async_tree_cpu_io_mixed
889 ms
663 ms: 1.34x faster
async_generators
567 ms
533 ms: 1.06x faster
asyncio_websockets
766 ms
738 ms: 1.04x faster
Geometric mean
(ref)
1.34x faster
Benchmark hidden because not significant (1): coroutines
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
float
116 ms
107 ms: 1.08x faster
pidigits
251 ms
234 ms: 1.07x faster
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (1): nbody
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
regex_compile
182 ms
166 ms: 1.09x faster
regex_effbot
4.74 ms
4.37 ms: 1.08x faster
regex_v8
32.8 ms
31.2 ms: 1.05x faster
regex_dna
282 ms
273 ms: 1.03x faster
Geometric mean
(ref)
1.06x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
xml_etree_iterparse
177 ms
149 ms: 1.19x faster
xml_etree_parse
231 ms
195 ms: 1.18x faster
tomli_loads
2.78 sec
2.49 sec: 1.12x faster
xml_etree_process
85.9 ms
79.2 ms: 1.08x faster
unpickle_pure_python
290 us
271 us: 1.07x faster
xml_etree_generate
122 ms
117 ms: 1.04x faster
json_dumps
14.1 ms
15.4 ms: 1.09x slower
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (2): pickle_pure_python, json_loads
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
python_startup
22.4 ms
24.6 ms: 1.10x slower
Geometric mean
(ref)
1.04x slower
Benchmark hidden because not significant (1): python_startup_no_site
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
genshi_text
31.7 ms
29.5 ms: 1.07x faster
mako
15.9 ms
15.2 ms: 1.05x faster
Geometric mean
(ref)
1.04x faster
Benchmark hidden because not significant (2): genshi_xml, django_template
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e
async_tree_io_tg
1.40 sec
807 ms: 1.74x faster
async_tree_io
1.39 sec
853 ms: 1.63x faster
async_tree_none
572 ms
376 ms: 1.52x faster
deepcopy
498 us
329 us: 1.51x faster
async_tree_memoization
709 ms
482 ms: 1.47x faster
async_tree_memoization_tg
670 ms
464 ms: 1.44x faster
async_tree_none_tg
504 ms
369 ms: 1.37x faster
async_tree_cpu_io_mixed_tg
852 ms
633 ms: 1.34x faster
async_tree_cpu_io_mixed
889 ms
663 ms: 1.34x faster
deepcopy_memo
50.1 us
40.0 us: 1.25x faster
telco
12.2 ms
9.74 ms: 1.25x faster
go
191 ms
154 ms: 1.24x faster
xml_etree_iterparse
177 ms
149 ms: 1.19x faster
deepcopy_reduce
4.10 us
3.45 us: 1.19x faster
xml_etree_parse
231 ms
195 ms: 1.18x faster
pylint
470 ms
397 ms: 1.18x faster
scimark_sor
179 ms
155 ms: 1.15x faster
pathlib
29.9 ms
25.9 ms: 1.15x faster
sympy_integrate
30.2 ms
26.6 ms: 1.14x faster
spectral_norm
157 ms
139 ms: 1.13x faster
richards_super
73.2 ms
65.3 ms: 1.12x faster
richards
65.5 ms
58.5 ms: 1.12x faster
scimark_sparse_mat_mult
6.76 ms
6.04 ms: 1.12x faster
tomli_loads
2.78 sec
2.49 sec: 1.12x faster
html5lib
92.6 ms
83.0 ms: 1.12x faster
nqueens
112 ms
100 ms: 1.11x faster
docutils
4.01 sec
3.61 sec: 1.11x faster
bpe_tokeniser
6.28 sec
5.73 sec: 1.10x faster
fannkuch
547 ms
499 ms: 1.10x faster
regex_compile
182 ms
166 ms: 1.09x faster
meteor_contest
150 ms
138 ms: 1.09x faster
sympy_sum
210 ms
193 ms: 1.09x faster
regex_effbot
4.74 ms
4.37 ms: 1.08x faster
xml_etree_process
85.9 ms
79.2 ms: 1.08x faster
float
116 ms
107 ms: 1.08x faster
chaos
83.6 ms
77.3 ms: 1.08x faster
sqlglot_parse
1.76 ms
1.63 ms: 1.08x faster
sqlglot_normalize
140 ms
130 ms: 1.08x faster
genshi_text
31.7 ms
29.5 ms: 1.07x faster
pidigits
251 ms
234 ms: 1.07x faster
unpickle_pure_python
290 us
271 us: 1.07x faster
pprint_safe_repr
987 ms
928 ms: 1.06x faster
async_generators
567 ms
533 ms: 1.06x faster
sqlglot_transpile
2.20 ms
2.07 ms: 1.06x faster
hexiom
8.11 ms
7.66 ms: 1.06x faster
dulwich_log
93.7 ms
88.6 ms: 1.06x faster
generators
40.0 ms
37.9 ms: 1.05x faster
mako
15.9 ms
15.2 ms: 1.05x faster
regex_v8
32.8 ms
31.2 ms: 1.05x faster
sympy_str
379 ms
361 ms: 1.05x faster
xml_etree_generate
122 ms
117 ms: 1.04x faster
pycparser
1.57 sec
1.51 sec: 1.04x faster
sqlite_synth
3.99 us
3.84 us: 1.04x faster
asyncio_websockets
766 ms
738 ms: 1.04x faster
regex_dna
282 ms
273 ms: 1.03x faster
mdp
3.80 sec
3.69 sec: 1.03x faster
coverage
107 ms
114 ms: 1.06x slower
logging_silent
130 ns
139 ns: 1.07x slower
json_dumps
14.1 ms
15.4 ms: 1.09x slower
bench_thread_pool
2.89 ms
3.17 ms: 1.10x slower
python_startup
22.4 ms
24.6 ms: 1.10x slower
gc_traversal
5.70 ms
7.70 ms: 1.35x slower
create_gc_cycles
2.41 ms
3.55 ms: 1.47x slower
bench_mp_pool
18.7 ms
89.4 ms: 4.78x slower
Geometric mean
(ref)
1.07x faster
Benchmark hidden because not significant (24): genshi_xml, 2to3, crypto_pyaes, sqlglot_optimize, logging_simple, scimark_fft, thrift, nbody, scimark_monte_carlo, django_template, coroutines, pyflate, python_startup_no_site, pprint_pformat, comprehensions, raytrace, json, scimark_lu, pickle_pure_python, json_loads, deltablue, logging_format, sympy_expand, typing_runtime_protocols
Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (8) of results/bm-20250107-3.14.0a3+-953b49e/bm-20250107-linux-x86_64-python-953b49e5468d02afadda-3.14.0a3+-953b49e.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
Geometric mean (including insignificant results): 1.087x faster
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.05x
95% likely to have a speedup of 1.05x
99% likely to have a speedup of 1.04x