8fec1ca70852unit: msthreads: [1, 4, 8]Legacy report: ingestion provenance is unrecorded; no raw artifact is inferred.
Absolute medians on a log time axis. Bars are shorter for faster calls; the dashed line is the best reference for each case.
| case | group | vs PyTorch | vs JAX | not measured | flags |
|---|---|---|---|---|---|
bin_batched_matmul_b32_m128_n128_k128 | Threads: 1 / opt_flops | eager 0.90x trace 1.69x | eager 1.01x trace 1.88x | - | - |
bin_batched_matmul_b32_m128_n128_k128 | Threads: 1 / opt_size | eager 0.90x trace 1.69x | eager 1.01x trace 1.88x | - | - |
bin_batched_matmul_b32_m128_n128_k128 | Threads: 4 / opt_flops | eager 3.29x trace 7.08x | eager 1.77x trace 3.81x | - | - |
bin_batched_matmul_b32_m128_n128_k128 | Threads: 4 / opt_size | eager 3.29x trace 7.08x | eager 1.77x trace 3.81x | - | - |
bin_batched_matmul_b32_m128_n128_k128 | Threads: 8 / opt_flops | eager 3.76x trace 6.07x | eager 1.95x trace 3.14x | - | - |
bin_batched_matmul_b32_m128_n128_k128 | Threads: 8 / opt_size | eager 3.76x trace 6.07x | eager 1.95x trace 3.14x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 1 / opt_flops | eager 0.92x trace 1.15x | eager 0.90x trace 1.13x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 1 / opt_size | eager 0.92x trace 1.15x | eager 0.90x trace 1.13x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 4 / opt_flops | eager 8.03x trace 17.32x | eager 1.76x trace 3.79x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 4 / opt_size | eager 8.03x trace 17.32x | eager 1.76x trace 3.79x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 8 / opt_flops | eager 13.65x trace 23.71x | eager 1.43x trace 2.49x | - | - |
bin_batched_matmul_b32_m64_n64_k64 | Threads: 8 / opt_size | eager 13.65x trace 23.71x | eager 1.43x trace 2.49x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 1 / opt_flops | eager 1.62x trace 1.81x | eager 0.59x trace 0.66x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 1 / opt_size | eager 1.62x trace 1.81x | eager 0.59x trace 0.66x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 4 / opt_flops | eager 19.03x trace 25.55x | eager 3.47x trace 4.66x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 4 / opt_size | eager 19.03x trace 25.55x | eager 3.47x trace 4.66x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 8 / opt_flops | eager 26.37x trace 39.67x | eager 1.81x trace 2.72x | - | - |
bin_batched_outer_product_compact_j16_k16_o64_t64 | Threads: 8 / opt_size | eager 26.37x trace 39.67x | eager 1.81x trace 2.72x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 1 / opt_flops | eager 1.62x trace 6.55x | eager 0.61x trace 2.47x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 1 / opt_size | eager 1.62x trace 6.55x | eager 0.61x trace 2.47x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 4 / opt_flops | eager 20.07x trace 11.81x | eager 2.57x trace 1.51x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 4 / opt_size | eager 20.07x trace 11.81x | eager 2.57x trace 1.51x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 8 / opt_flops | eager 13.50x trace 27.97x | eager 0.85x trace 1.77x | - | - |
bin_batched_outer_product_noncompact_j16_k16_o64_t64 | Threads: 8 / opt_size | eager 13.50x trace 27.97x | eager 0.85x trace 1.77x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 1 / opt_flops | eager 0.24x trace 0.25x | eager 0.16x trace 0.17x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 1 / opt_size | eager 0.24x trace 0.25x | eager 0.16x trace 0.17x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 4 / opt_flops | eager 0.47x trace 0.61x | eager 0.29x trace 0.37x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 4 / opt_size | eager 0.47x trace 0.61x | eager 0.29x trace 0.37x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 8 / opt_flops | eager 0.75x trace 0.73x | eager 0.40x trace 0.39x | - | - |
bin_elementwise_mul_2048x2048 | Threads: 8 / opt_size | eager 0.75x trace 0.73x | eager 0.40x trace 0.39x | - | - |
bin_elementwise_mul_512x512 | Threads: 1 / opt_flops | eager 0.96x trace 0.98x | eager 0.40x trace 0.41x | - | - |
bin_elementwise_mul_512x512 | Threads: 1 / opt_size | eager 0.96x trace 0.98x | eager 0.40x trace 0.41x | - | - |
bin_elementwise_mul_512x512 | Threads: 4 / opt_flops | eager 24.47x trace 36.95x | eager 2.09x trace 3.16x | - | - |
bin_elementwise_mul_512x512 | Threads: 4 / opt_size | eager 24.47x trace 36.95x | eager 2.09x trace 3.16x | - | - |
bin_elementwise_mul_512x512 | Threads: 8 / opt_flops | eager 51.67x trace 116.57x | eager 4.31x trace 9.71x | - | - |
bin_elementwise_mul_512x512 | Threads: 8 / opt_size | eager 51.67x trace 116.57x | eager 4.31x trace 9.71x | - | - |
bin_matmul_1024 | Threads: 1 / opt_flops | eager 0.86x trace 1.04x | eager 0.97x trace 1.17x | - | - |
bin_matmul_1024 | Threads: 1 / opt_size | eager 0.86x trace 1.04x | eager 0.97x trace 1.17x | - | - |
bin_matmul_1024 | Threads: 4 / opt_flops | eager 1.10x trace 1.21x | eager 1.85x trace 2.03x | - | - |
bin_matmul_1024 | Threads: 4 / opt_size | eager 1.10x trace 1.21x | eager 1.85x trace 2.03x | - | - |
bin_matmul_1024 | Threads: 8 / opt_flops | eager 1.11x trace 1.46x | eager 1.58x trace 2.08x | - | - |
bin_matmul_1024 | Threads: 8 / opt_size | eager 1.11x trace 1.46x | eager 1.58x trace 2.08x | - | - |
bin_matmul_256 | Threads: 1 / opt_flops | eager 0.66x trace 0.82x | eager 0.87x trace 1.08x | - | - |
bin_matmul_256 | Threads: 1 / opt_size | eager 0.66x trace 0.82x | eager 0.87x trace 1.08x | - | - |
bin_matmul_256 | Threads: 4 / opt_flops | eager 0.40x trace 2.56x | eager 0.61x trace 3.93x | - | - |
bin_matmul_256 | Threads: 4 / opt_size | eager 0.40x trace 2.56x | eager 0.61x trace 3.93x | - | - |
bin_matmul_256 | Threads: 8 / opt_flops | eager 0.40x trace 6.22x | eager 0.51x trace 8.02x | - | - |
bin_matmul_256 | Threads: 8 / opt_size | eager 0.40x trace 6.22x | eager 0.51x trace 8.02x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 1 / opt_flops | eager 0.27x trace 0.45x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 1 / opt_size | eager 0.27x trace 0.45x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 4 / opt_flops | eager 0.25x trace 0.42x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 4 / opt_size | eager 0.25x trace 0.42x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 8 / opt_flops | eager 0.28x trace 0.44x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_batched_matmul_8x8_batch_4 | Threads: 8 / opt_size | eager 0.28x trace 0.44x | eager 0.05x trace 0.08x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 1 / opt_flops | eager 0.30x trace 0.33x | eager 0.18x trace 0.21x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 1 / opt_size | eager 0.30x trace 0.33x | eager 0.18x trace 0.21x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 4 / opt_flops | eager 0.31x trace 0.33x | eager 0.16x trace 0.17x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 4 / opt_size | eager 0.31x trace 0.33x | eager 0.16x trace 0.17x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 8 / opt_flops | eager 0.31x trace 0.33x | eager 0.18x trace 0.20x | - | - |
bin_omeinsum_high_d_12x12_contract_4_batch_4 | Threads: 8 / opt_size | eager 0.31x trace 0.33x | eager 0.18x trace 0.20x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 1 / opt_flops | eager 0.45x trace 0.91x | eager 0.11x trace 0.22x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 1 / opt_size | eager 0.45x trace 0.91x | eager 0.11x trace 0.22x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 4 / opt_flops | eager 0.55x trace 0.91x | eager 0.15x trace 0.26x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 4 / opt_size | eager 0.55x trace 0.91x | eager 0.15x trace 0.26x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 8 / opt_flops | eager 0.53x trace 2.71x | eager 0.14x trace 0.73x | - | - |
bin_omeinsum_matmul_10x10 | Threads: 8 / opt_size | eager 0.53x trace 2.71x | eager 0.14x trace 0.73x | - | - |
bin_outer_product_4096 | Threads: 1 / opt_flops | eager 1.03x trace 1.03x | eager 1.00x trace 1.00x | - | - |
bin_outer_product_4096 | Threads: 1 / opt_size | eager 1.03x trace 1.03x | eager 1.00x trace 1.00x | - | - |
bin_outer_product_4096 | Threads: 4 / opt_flops | eager 1.52x trace 1.48x | eager 0.88x trace 0.86x | - | - |
bin_outer_product_4096 | Threads: 4 / opt_size | eager 1.52x trace 1.48x | eager 0.88x trace 0.86x | - | - |
bin_outer_product_4096 | Threads: 8 / opt_flops | eager 1.21x trace 1.26x | eager 0.72x trace 0.75x | - | - |
bin_outer_product_4096 | Threads: 8 / opt_size | eager 1.21x trace 1.26x | eager 0.72x trace 0.75x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 1 / opt_flops | eager 0.89x trace 1.11x | eager 0.89x trace 1.11x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 1 / opt_size | eager 0.89x trace 1.11x | eager 0.89x trace 1.11x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 4 / opt_flops | eager 1.43x trace 1.38x | eager 1.50x trace 1.44x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 4 / opt_size | eager 1.43x trace 1.38x | eager 1.50x trace 1.44x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 8 / opt_flops | eager 1.38x trace 2.08x | eager 1.53x trace 2.32x | - | - |
bin_permuted_r4_abcd_dbef_acef_d32 | Threads: 8 / opt_size | eager 1.38x trace 2.08x | eager 1.53x trace 2.32x | - | - |
gm_queen5_5_3.wcsp | Threads: 1 / opt_flops | eager 1.07x trace 1.28x | eager 1.37x trace 1.64x | - | - |
gm_queen5_5_3.wcsp | Threads: 1 / opt_size | eager 1.08x trace 1.01x | eager 1.49x trace 1.39x | - | - |
gm_queen5_5_3.wcsp | Threads: 4 / opt_flops | eager 1.73x trace 2.65x | eager 1.37x trace 2.10x | - | - |
gm_queen5_5_3.wcsp | Threads: 4 / opt_size | eager 1.64x trace 1.94x | eager 1.48x trace 1.75x | - | - |
gm_queen5_5_3.wcsp | Threads: 8 / opt_flops | eager 1.78x trace 3.22x | eager 1.42x trace 2.56x | - | - |
gm_queen5_5_3.wcsp | Threads: 8 / opt_size | eager 1.84x trace 2.40x | eager 1.63x trace 2.13x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 1 / opt_flops | eager 1.13x trace 0.77x | eager 1.28x trace 0.87x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 1 / opt_size | eager 1.12x trace 0.75x | eager 1.36x trace 0.91x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 4 / opt_flops | eager 3.54x trace 2.75x | eager 1.89x trace 1.47x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 4 / opt_size | eager 4.65x trace 3.51x | eager 2.42x trace 1.82x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 8 / opt_flops | eager 6.27x trace 3.37x | eager 2.95x trace 1.58x | - | - |
lm_batch_likelihood_brackets_4_4d | Threads: 8 / opt_size | eager 7.24x trace 4.53x | eager 3.29x trace 2.06x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 1 / opt_flops | eager 1.31x trace 0.70x | eager 1.45x trace 0.78x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 1 / opt_size | eager 1.97x trace 1.07x | eager 1.28x trace 0.70x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 4 / opt_flops | eager 3.60x trace 1.62x | eager 3.06x trace 1.38x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 4 / opt_size | eager 4.05x trace 1.02x | eager 4.34x trace 1.10x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 8 / opt_flops | eager 4.51x trace 1.18x | eager 5.55x trace 1.45x | - | - |
lm_batch_likelihood_sentence_3_12d | Threads: 8 / opt_size | eager 9.60x trace 1.60x | eager 5.61x trace 0.93x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 1 / opt_flops | eager 1.20x trace 0.75x | eager 1.43x trace 0.89x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 1 / opt_size | eager 1.31x trace 0.75x | eager 1.70x trace 0.98x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 4 / opt_flops | eager 6.19x trace 3.67x | eager 3.47x trace 2.06x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 4 / opt_size | eager 4.63x trace 2.08x | eager 2.83x trace 1.27x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 8 / opt_flops | eager 5.87x trace 3.24x | eager 2.95x trace 1.63x | - | - |
lm_batch_likelihood_sentence_4_4d | Threads: 8 / opt_size | eager 6.25x trace 4.46x | eager 3.19x trace 2.28x | - | - |
nary_matmul_chain_64 | Threads: 1 / opt_flops | eager 0.74x trace 0.90x | eager 0.32x trace 0.38x | - | - |
nary_matmul_chain_64 | Threads: 1 / opt_size | eager 0.74x trace 0.90x | eager 0.32x trace 0.38x | - | - |
nary_matmul_chain_64 | Threads: 4 / opt_flops | eager 0.64x trace 2.52x | eager 0.31x trace 1.24x | - | - |
nary_matmul_chain_64 | Threads: 4 / opt_size | eager 0.64x trace 2.52x | eager 0.31x trace 1.24x | - | - |
nary_matmul_chain_64 | Threads: 8 / opt_flops | eager 2.48x trace 3.00x | eager 0.91x trace 1.09x | - | - |
nary_matmul_chain_64 | Threads: 8 / opt_size | eager 2.48x trace 3.00x | eager 0.91x trace 1.09x | - | - |
str_matrix_chain_multiplication_100 | Threads: 1 / opt_flops | eager 0.95x trace 0.91x | eager 0.81x trace 0.78x | - | - |
str_matrix_chain_multiplication_100 | Threads: 1 / opt_size | eager 0.95x trace 0.93x | eager 0.81x trace 0.79x | - | - |
str_matrix_chain_multiplication_100 | Threads: 4 / opt_flops | eager 0.94x trace 1.81x | eager 0.64x trace 1.23x | - | - |
str_matrix_chain_multiplication_100 | Threads: 4 / opt_size | eager 0.93x trace 0.89x | eager 0.64x trace 0.61x | - | - |
str_matrix_chain_multiplication_100 | Threads: 8 / opt_flops | eager 2.10x trace 1.99x | eager 1.52x trace 1.44x | - | - |
str_matrix_chain_multiplication_100 | Threads: 8 / opt_size | eager 2.10x trace 2.10x | eager 1.53x trace 1.53x | - | - |
str_mps_varying_inner_product_200 | Threads: 1 / opt_flops | eager 1.02x trace 0.86x | eager 0.72x trace 0.60x | - | - |
str_mps_varying_inner_product_200 | Threads: 1 / opt_size | eager 1.05x trace 1.04x | eager 0.71x trace 0.70x | - | - |
str_mps_varying_inner_product_200 | Threads: 4 / opt_flops | eager 1.11x trace 1.56x | eager 0.87x trace 1.23x | - | - |
str_mps_varying_inner_product_200 | Threads: 4 / opt_size | eager 1.20x trace 1.25x | eager 0.99x trace 1.04x | - | - |
str_mps_varying_inner_product_200 | Threads: 8 / opt_flops | eager 1.37x trace 1.58x | eager 0.94x trace 1.08x | - | - |
str_mps_varying_inner_product_200 | Threads: 8 / opt_size | eager 1.80x trace 1.57x | eager 1.25x trace 1.09x | - | - |
str_nw_mera_closed_120 | Threads: 1 / opt_flops | eager 0.93x trace 0.90x | eager 0.88x trace 0.85x | - | - |
str_nw_mera_closed_120 | Threads: 1 / opt_size | eager 1.00x trace 1.02x | eager 0.95x trace 0.96x | - | - |
str_nw_mera_closed_120 | Threads: 4 / opt_flops | eager 1.14x trace 1.08x | eager 1.23x trace 1.16x | - | - |
str_nw_mera_closed_120 | Threads: 4 / opt_size | eager 1.26x trace 1.31x | eager 1.34x trace 1.38x | - | - |
str_nw_mera_closed_120 | Threads: 8 / opt_flops | eager 1.27x trace 1.17x | eager 1.38x trace 1.27x | - | - |
str_nw_mera_closed_120 | Threads: 8 / opt_size | eager 1.37x trace 1.46x | eager 1.54x trace 1.65x | - | - |
str_nw_mera_open_26 | Threads: 1 / opt_flops | eager 1.24x trace 1.16x | eager 0.88x trace 0.82x | - | - |
str_nw_mera_open_26 | Threads: 1 / opt_size | eager 1.19x trace 1.12x | eager 0.86x trace 0.81x | - | - |
str_nw_mera_open_26 | Threads: 4 / opt_flops | eager 1.98x trace 1.76x | eager 1.40x trace 1.25x | - | - |
str_nw_mera_open_26 | Threads: 4 / opt_size | eager 1.87x trace 1.68x | eager 1.36x trace 1.22x | - | - |
str_nw_mera_open_26 | Threads: 8 / opt_flops | eager 1.95x trace 2.02x | eager 1.56x trace 1.61x | - | - |
str_nw_mera_open_26 | Threads: 8 / opt_size | eager 1.92x trace 2.03x | eager 1.49x trace 1.57x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 1 / opt_flops | eager 0.73x trace 0.56x | eager 0.82x trace 0.62x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 1 / opt_size | eager 0.73x trace 0.56x | eager 0.82x trace 0.62x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 4 / opt_flops | eager 1.62x trace 1.44x | eager 1.08x trace 0.96x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 4 / opt_size | eager 1.62x trace 1.44x | eager 1.08x trace 0.96x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 8 / opt_flops | eager 2.14x trace 1.82x | eager 0.99x trace 0.84x | - | - |
tensornetwork_permutation_focus_step409_316 | Threads: 8 / opt_size | eager 2.14x trace 1.82x | eager 0.99x trace 0.84x | - | - |
tensornetwork_permutation_light_415 | Threads: 1 / opt_flops | eager 0.59x trace 0.57x | eager 0.63x trace 0.60x | - | - |
tensornetwork_permutation_light_415 | Threads: 1 / opt_size | eager 0.59x trace 0.57x | eager 0.63x trace 0.60x | - | - |
tensornetwork_permutation_light_415 | Threads: 4 / opt_flops | eager 1.44x trace 1.43x | eager 0.91x trace 0.91x | - | - |
tensornetwork_permutation_light_415 | Threads: 4 / opt_size | eager 1.44x trace 1.43x | eager 0.91x trace 0.91x | - | - |
tensornetwork_permutation_light_415 | Threads: 8 / opt_flops | eager 1.82x trace 1.73x | eager 0.80x trace 0.76x | - | - |
tensornetwork_permutation_light_415 | Threads: 8 / opt_size | eager 1.82x trace 1.73x | eager 0.80x trace 0.76x | - | - |
Charts below are ordered best first (smallest ratio).
bin_elementwise_mul_2048x2048 Threads: 1 / opt_flops · n=7bin_elementwise_mul_2048x2048 Threads: 1 / opt_size · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 4 / opt_flops · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 4 / opt_size · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 1 / opt_flops · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 1 / opt_size · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 8 / opt_flops · n=7bin_omeinsum_batched_matmul_8x8_batch_4 Threads: 8 / opt_size · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 1 / opt_flops · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 1 / opt_size · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 8 / opt_flops · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 8 / opt_size · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 4 / opt_flops · n=7bin_omeinsum_high_d_12x12_contract_4_batch_4 Threads: 4 / opt_size · n=7bin_matmul_256 Threads: 8 / opt_flops · n=7bin_matmul_256 Threads: 8 / opt_size · n=7bin_matmul_256 Threads: 4 / opt_flops · n=7bin_matmul_256 Threads: 4 / opt_size · n=7bin_omeinsum_matmul_10x10 Threads: 1 / opt_flops · n=7bin_omeinsum_matmul_10x10 Threads: 1 / opt_size · n=7bin_elementwise_mul_2048x2048 Threads: 4 / opt_flops · n=7bin_elementwise_mul_2048x2048 Threads: 4 / opt_size · n=7bin_omeinsum_matmul_10x10 Threads: 8 / opt_flops · n=7bin_omeinsum_matmul_10x10 Threads: 8 / opt_size · n=7bin_omeinsum_matmul_10x10 Threads: 4 / opt_flops · n=7bin_omeinsum_matmul_10x10 Threads: 4 / opt_size · n=7tensornetwork_permutation_focus_step409_316 Threads: 1 / opt_flops · n=7tensornetwork_permutation_focus_step409_316 Threads: 1 / opt_size · n=7tensornetwork_permutation_light_415 Threads: 1 / opt_flops · n=7tensornetwork_permutation_light_415 Threads: 1 / opt_size · n=7nary_matmul_chain_64 Threads: 4 / opt_flops · n=7nary_matmul_chain_64 Threads: 4 / opt_size · n=7bin_matmul_256 Threads: 1 / opt_flops · n=7bin_matmul_256 Threads: 1 / opt_size · n=7lm_batch_likelihood_sentence_3_12d Threads: 1 / opt_flops · n=7bin_elementwise_mul_2048x2048 Threads: 8 / opt_flops · n=7bin_elementwise_mul_2048x2048 Threads: 8 / opt_size · n=7nary_matmul_chain_64 Threads: 1 / opt_flops · n=7nary_matmul_chain_64 Threads: 1 / opt_size · n=7lm_batch_likelihood_sentence_4_4d Threads: 1 / opt_flops · n=7lm_batch_likelihood_brackets_4_4d Threads: 1 / opt_size · n=7lm_batch_likelihood_sentence_4_4d Threads: 1 / opt_size · n=7lm_batch_likelihood_brackets_4_4d Threads: 1 / opt_flops · n=7bin_matmul_1024 Threads: 1 / opt_flops · n=7bin_matmul_1024 Threads: 1 / opt_size · n=7str_mps_varying_inner_product_200 Threads: 1 / opt_flops · n=7str_matrix_chain_multiplication_100 Threads: 4 / opt_size · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 1 / opt_flops · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 1 / opt_size · n=7str_nw_mera_closed_120 Threads: 1 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 1 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 1 / opt_size · n=7str_matrix_chain_multiplication_100 Threads: 1 / opt_flops · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 1 / opt_flops · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 1 / opt_size · n=7str_matrix_chain_multiplication_100 Threads: 1 / opt_size · n=7str_matrix_chain_multiplication_100 Threads: 4 / opt_flops · n=7bin_elementwise_mul_512x512 Threads: 1 / opt_flops · n=7bin_elementwise_mul_512x512 Threads: 1 / opt_size · n=7str_nw_mera_closed_120 Threads: 1 / opt_size · n=7gm_queen5_5_3.wcsp Threads: 1 / opt_size · n=7lm_batch_likelihood_sentence_3_12d Threads: 4 / opt_size · n=7bin_outer_product_4096 Threads: 1 / opt_flops · n=7bin_outer_product_4096 Threads: 1 / opt_size · n=7str_mps_varying_inner_product_200 Threads: 1 / opt_size · n=7gm_queen5_5_3.wcsp Threads: 1 / opt_flops · n=7lm_batch_likelihood_sentence_3_12d Threads: 1 / opt_size · n=7str_nw_mera_closed_120 Threads: 4 / opt_flops · n=7bin_matmul_1024 Threads: 4 / opt_flops · n=7bin_matmul_1024 Threads: 4 / opt_size · n=7str_mps_varying_inner_product_200 Threads: 4 / opt_flops · n=7bin_matmul_1024 Threads: 8 / opt_flops · n=7bin_matmul_1024 Threads: 8 / opt_size · n=7str_nw_mera_open_26 Threads: 1 / opt_size · n=7str_nw_mera_open_26 Threads: 1 / opt_flops · n=7str_nw_mera_closed_120 Threads: 8 / opt_flops · n=7lm_batch_likelihood_sentence_3_12d Threads: 8 / opt_flops · n=7str_mps_varying_inner_product_200 Threads: 4 / opt_size · n=7bin_outer_product_4096 Threads: 8 / opt_flops · n=7bin_outer_product_4096 Threads: 8 / opt_size · n=7str_nw_mera_closed_120 Threads: 4 / opt_size · n=7str_nw_mera_closed_120 Threads: 8 / opt_size · n=7str_mps_varying_inner_product_200 Threads: 8 / opt_flops · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 8 / opt_flops · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 8 / opt_size · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 4 / opt_flops · n=7bin_permuted_r4_abcd_dbef_acef_d32 Threads: 4 / opt_size · n=7tensornetwork_permutation_light_415 Threads: 4 / opt_flops · n=7tensornetwork_permutation_light_415 Threads: 4 / opt_size · n=7tensornetwork_permutation_focus_step409_316 Threads: 4 / opt_flops · n=7tensornetwork_permutation_focus_step409_316 Threads: 4 / opt_size · n=7bin_outer_product_4096 Threads: 4 / opt_flops · n=7bin_outer_product_4096 Threads: 4 / opt_size · n=7str_mps_varying_inner_product_200 Threads: 8 / opt_size · n=7lm_batch_likelihood_sentence_3_12d Threads: 8 / opt_size · n=7lm_batch_likelihood_sentence_3_12d Threads: 4 / opt_flops · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 1 / opt_flops · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 1 / opt_size · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 1 / opt_flops · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 1 / opt_size · n=7gm_queen5_5_3.wcsp Threads: 4 / opt_size · n=7str_nw_mera_open_26 Threads: 4 / opt_size · n=7tensornetwork_permutation_light_415 Threads: 8 / opt_flops · n=7tensornetwork_permutation_light_415 Threads: 8 / opt_size · n=7gm_queen5_5_3.wcsp Threads: 4 / opt_flops · n=7str_nw_mera_open_26 Threads: 4 / opt_flops · n=7gm_queen5_5_3.wcsp Threads: 8 / opt_flops · n=7tensornetwork_permutation_focus_step409_316 Threads: 8 / opt_flops · n=7tensornetwork_permutation_focus_step409_316 Threads: 8 / opt_size · n=7gm_queen5_5_3.wcsp Threads: 8 / opt_size · n=7str_nw_mera_open_26 Threads: 8 / opt_size · n=7str_nw_mera_open_26 Threads: 8 / opt_flops · n=7str_matrix_chain_multiplication_100 Threads: 8 / opt_flops · n=7lm_batch_likelihood_sentence_4_4d Threads: 4 / opt_size · n=7str_matrix_chain_multiplication_100 Threads: 8 / opt_size · n=7nary_matmul_chain_64 Threads: 8 / opt_flops · n=7nary_matmul_chain_64 Threads: 8 / opt_size · n=7lm_batch_likelihood_brackets_4_4d Threads: 4 / opt_flops · n=7lm_batch_likelihood_sentence_4_4d Threads: 8 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 4 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 4 / opt_size · n=7lm_batch_likelihood_brackets_4_4d Threads: 8 / opt_flops · n=7lm_batch_likelihood_brackets_4_4d Threads: 4 / opt_size · n=7lm_batch_likelihood_sentence_4_4d Threads: 4 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 8 / opt_flops · n=7bin_batched_matmul_b32_m128_n128_k128 Threads: 8 / opt_size · n=7lm_batch_likelihood_sentence_4_4d Threads: 8 / opt_size · n=7lm_batch_likelihood_brackets_4_4d Threads: 8 / opt_size · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 4 / opt_flops · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 4 / opt_size · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 4 / opt_flops · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 4 / opt_size · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 8 / opt_flops · n=7bin_batched_outer_product_noncompact_j16_k16_o64_t64 Threads: 8 / opt_size · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 8 / opt_flops · n=7bin_batched_matmul_b32_m64_n64_k64 Threads: 8 / opt_size · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 4 / opt_flops · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 4 / opt_size · n=7bin_elementwise_mul_512x512 Threads: 4 / opt_flops · n=7bin_elementwise_mul_512x512 Threads: 4 / opt_size · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 8 / opt_flops · n=7bin_batched_outer_product_compact_j16_k16_o64_t64 Threads: 8 / opt_size · n=7bin_elementwise_mul_512x512 Threads: 8 / opt_flops · n=7bin_elementwise_mul_512x512 Threads: 8 / opt_size · n=7zen5-cpu8fec1ca70852b930c092e7177c30bb8af7594a573f31f38e0491084b9414035754a3809ef0f5ae94Generated from the explicit runs below; each section retains its own provenance and thread settings.
Source report: data/results/zen5-cpu/cpu/einsum/20261027_231715/report.md.
cpu/einsumzen5-cpubenchmarks/cpu/einsum.yamldata/results/zen5-cpu/cpu/einsum/20261027_231715/run.yaml20261027_231715Latest run: ./scripts/run_all.sh 1.
This file is generated from one suite run under data/results/zen5-cpu/cpu/einsum/20261027_231715.
8fec1ca70852b930c092e7177c30bb8af7594a57AMD Ryzen AI 9 HX 470 w/ Radeon 890MAuthenticAMD2411221Linux-7.0.0-38-generic-x86_64-with-glibc2.390-3,12-15; 4-11,16-23enabled11FALSE11111111--xla_cpu_multi_thread_eigen=false --xla_cpu_experimental_ynn_fusion_type= intra_op_parallelism_threads=1blas-mklmkl2026.0.2/opt/intel/oneapi/mkl/latest/opt/intel/oneapi/mkl/latest/lib/libmkl_rt.somkl, version 2.12.0+cpu, BLAS_INFO mkl, LAPACK_INFO mkl/workspaces/tenferro-benchmark/.venv/lib/python3.12/site-packages/torch/lib/libgomp.so.1xla_cpu, version 0.10.1, jaxlib 0.10.1, default backend cpu, LAPACK provider none_detectedJulia: version 1.13.3, OMEinsum.jl 0.9.4, BLAS provider LBTConfig([ILP64] libopenblas64_.so), probe threads 1
omeinsum-jl (mode omeinsum_path in the log/report) always
executes the instance's precomputed opt_flops/opt_size path via
OMEinsum.DynamicEinCode pairwise contractions; OMEinsum's own
contraction-order optimizer is never invoked, so the comparison
against tenferro/PyTorch/JAX (which also use the precomputed path)
stays fair.
JULIA_NUM_THREADS also pins LinearAlgebra.BLAS.set_num_threads,
matching the BLAS thread pinning used by the other CPU backends.format_string_colmajor / shapes_colmajor directly with no
PyTorch/JAX-style layout reconstruction.OMEinsum dispatches its pairwise contractions to Julia's own BLAS
(libblastrampoline, OpenBLAS by default; the provider that ran is
reported above). When that differs from the provider tenferro-rs and
PyTorch link against, matmul-shaped rows partly compare BLAS
implementations rather than einsum-runtime overhead; read them
together with the recorded providers. docs/einsum-suite.md records
the measured OMEinsum-over-its-own-BLAS overhead.
Source table: data/results/zen5-cpu/cpu/einsum/20261027_231715/einsum_table_t1_20261027_231715.md
Logs:
data/results/zen5-cpu/cpu/einsum/20261027_231715/tenferro_trace_t1_20261027_231715.logdata/results/zen5-cpu/cpu/einsum/20261027_231715/tenferro_eager_t1_20261027_231715.logdata/results/zen5-cpu/cpu/einsum/20261027_231715/pytorch_cpu_t1_20261027_231715.logdata/results/zen5-cpu/cpu/einsum/20261027_231715/jax_cpu_t1_20261027_231715.logdata/results/zen5-cpu/cpu/einsum/20261027_231715/julia_omeinsum_t1_20261027_231715.logMedian ± IQR (ms). JULIA_NUM_THREADS=1, OMP_NUM_THREADS=1, RAYON_NUM_THREADS=1.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 4.047 ± 0.081 | 2.166 ± 0.085 | 2.396 ± 0.034 | 2.154 ± 0.028 | 6.443 ± 5.395 |
| bin_batched_matmul_b32_m64_n64_k64 | 0.382 ± 0.006 | 0.305 ± 0.005 | 0.331 ± 0.003 | 0.338 ± 0.010 | 0.457 ± 0.736 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 0.134 ± 0.014 | 0.120 ± 0.007 | 0.074 ± 0.001 | 0.203 ± 0.016 | 0.691 ± 1.113 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.485 ± 0.005 | 0.120 ± 0.003 | 0.074 ± 0.001 | 0.196 ± 0.015 | 3.342 ± 1.811 |
| bin_elementwise_mul_2048x2048 | 1.607 ± 0.040 | 1.527 ± 0.026 | 6.445 ± 0.145 | 9.317 ± 1.050 | 7.190 ± 2.489 |
| bin_elementwise_mul_512x512 | 0.049 ± 0.006 | 0.048 ± 0.008 | 0.050 ± 0.001 | 0.119 ± 0.009 | 0.087 ± 0.244 |
| bin_matmul_1024 | 35.925 ± 0.179 | 29.722 ± 0.126 | 34.676 ± 0.106 | 30.646 ± 0.095 | 49.426 ± 16.034 |
| bin_matmul_256 | 0.573 ± 0.021 | 0.460 ± 0.008 | 0.695 ± 0.014 | 0.530 ± 0.004 | 0.703 ± 0.006 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.005 ± 0.000 | 0.003 ± 0.000 | 0.011 ± 0.000 | 0.064 ± 0.005 | 0.007 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.018 ± 0.000 | 0.016 ± 0.000 | 0.054 ± 0.000 | 0.087 ± 0.009 | 0.037 ± 0.009 |
| bin_omeinsum_matmul_10x10 | 0.010 ± 0.000 | 0.005 ± 0.000 | 0.011 ± 0.000 | 0.045 ± 0.006 | 0.012 ± 0.001 |
| bin_outer_product_4096 | 21.457 ± 0.654 | 21.532 ± 0.576 | 20.847 ± 0.912 | 21.456 ± 3.914 | 154.639 ± 30.207 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 38.449 ± 0.417 | 30.948 ± 0.136 | 34.726 ± 0.068 | 34.763 ± 0.194 | 43.122 ± 11.754 |
| gm_queen5_5_3.wcsp | 4492.272 ± 25.246 | 3761.453 ± 6.039 | 3522.951 ± 63.128 | 2736.080 ± 15.119 | 5007.983 ± 65.698 |
| lm_batch_likelihood_brackets_4_4d | 12.527 ± 0.057 | 18.377 ± 0.966 | 16.241 ± 0.156 | 14.358 ± 0.313 | 17.717 ± 7.574 |
| lm_batch_likelihood_sentence_3_12d | 39.877 ± 0.232 | 74.201 ± 0.350 | 56.789 ± 0.457 | 51.156 ± 0.137 | 84.874 ± 38.273 |
| lm_batch_likelihood_sentence_4_4d | 13.188 ± 0.176 | 21.176 ± 0.333 | 17.606 ± 0.291 | 14.778 ± 0.136 | 24.167 ± 23.864 |
| nary_matmul_chain_64 | 0.028 ± 0.000 | 0.023 ± 0.000 | 0.031 ± 0.000 | 0.073 ± 0.006 | 0.054 ± 0.007 |
| str_matrix_chain_multiplication_100 | 8.009 ± 0.058 | 8.348 ± 0.042 | 8.824 ± 0.045 | 10.304 ± 0.253 | 11.130 ± 0.941 |
| str_mps_varying_inner_product_200 | 10.612 ± 0.107 | 12.654 ± 0.129 | 12.347 ± 0.031 | 17.596 ± 0.178 | 18.326 ± 29.974 |
| str_nw_mera_closed_120 | 948.940 ± 2.771 | 987.014 ± 5.354 | 1056.507 ± 2.733 | 1116.942 ± 3.994 | 1189.776 ± 35.081 |
| str_nw_mera_open_26 | 756.553 ± 2.166 | 808.681 ± 2.418 | 654.409 ± 1.261 | 922.037 ± 2.208 | 1093.886 ± 33.365 |
| tensornetwork_permutation_focus_step409_316 | 259.165 ± 0.987 | 342.096 ± 1.296 | 466.793 ± 0.857 | 417.033 ± 1.571 | 387.125 ± 48.689 |
| tensornetwork_permutation_light_415 | 256.016 ± 1.483 | 266.211 ± 1.241 | 450.252 ± 1.470 | 423.649 ± 1.472 | 390.496 ± 107.997 |
Median ± IQR (ms). JULIA_NUM_THREADS=1, OMP_NUM_THREADS=1, RAYON_NUM_THREADS=1.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 4.047 ± 0.081 | 2.166 ± 0.085 | 2.396 ± 0.034 | 2.154 ± 0.028 | 6.443 ± 5.395 |
| bin_batched_matmul_b32_m64_n64_k64 | 0.382 ± 0.006 | 0.305 ± 0.005 | 0.331 ± 0.003 | 0.338 ± 0.010 | 0.457 ± 0.736 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 0.134 ± 0.014 | 0.120 ± 0.007 | 0.074 ± 0.001 | 0.203 ± 0.016 | 0.691 ± 1.113 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.485 ± 0.005 | 0.120 ± 0.003 | 0.074 ± 0.001 | 0.196 ± 0.015 | 3.342 ± 1.811 |
| bin_elementwise_mul_2048x2048 | 1.607 ± 0.040 | 1.527 ± 0.026 | 6.445 ± 0.145 | 9.317 ± 1.050 | 7.190 ± 2.489 |
| bin_elementwise_mul_512x512 | 0.049 ± 0.006 | 0.048 ± 0.008 | 0.050 ± 0.001 | 0.119 ± 0.009 | 0.087 ± 0.244 |
| bin_matmul_1024 | 35.925 ± 0.179 | 29.722 ± 0.126 | 34.676 ± 0.106 | 30.646 ± 0.095 | 49.426 ± 16.034 |
| bin_matmul_256 | 0.573 ± 0.021 | 0.460 ± 0.008 | 0.695 ± 0.014 | 0.530 ± 0.004 | 0.703 ± 0.006 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.005 ± 0.000 | 0.003 ± 0.000 | 0.011 ± 0.000 | 0.064 ± 0.005 | 0.007 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.018 ± 0.000 | 0.016 ± 0.000 | 0.054 ± 0.000 | 0.087 ± 0.009 | 0.037 ± 0.009 |
| bin_omeinsum_matmul_10x10 | 0.010 ± 0.000 | 0.005 ± 0.000 | 0.011 ± 0.000 | 0.045 ± 0.006 | 0.012 ± 0.001 |
| bin_outer_product_4096 | 21.457 ± 0.654 | 21.532 ± 0.576 | 20.847 ± 0.912 | 21.456 ± 3.914 | 154.639 ± 30.207 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 38.449 ± 0.417 | 30.948 ± 0.136 | 34.726 ± 0.068 | 34.763 ± 0.194 | 43.122 ± 11.754 |
| gm_queen5_5_3.wcsp | 1485.442 ± 5.491 | 1584.827 ± 2.815 | 1465.193 ± 6.489 | 1067.073 ± 1.826 | 2009.878 ± 15.527 |
| lm_batch_likelihood_brackets_4_4d | 12.578 ± 0.092 | 18.744 ± 0.322 | 16.768 ± 0.129 | 13.805 ± 0.157 | 28.937 ± 38.364 |
| lm_batch_likelihood_sentence_3_12d | 44.663 ± 0.446 | 81.928 ± 0.763 | 41.633 ± 0.205 | 64.109 ± 0.289 | 91.663 ± 24.404 |
| lm_batch_likelihood_sentence_4_4d | 13.679 ± 0.157 | 23.709 ± 0.758 | 18.121 ± 0.049 | 13.925 ± 0.160 | 27.787 ± 32.991 |
| nary_matmul_chain_64 | 0.028 ± 0.000 | 0.023 ± 0.000 | 0.031 ± 0.000 | 0.073 ± 0.006 | 0.054 ± 0.007 |
| str_matrix_chain_multiplication_100 | 8.219 ± 0.075 | 8.348 ± 0.031 | 8.828 ± 0.036 | 10.342 ± 0.173 | 11.006 ± 0.930 |
| str_mps_varying_inner_product_200 | 11.847 ± 0.052 | 12.047 ± 0.076 | 11.428 ± 0.041 | 16.857 ± 0.307 | 15.188 ± 9.499 |
| str_nw_mera_closed_120 | 888.520 ± 1.115 | 877.532 ± 4.800 | 874.883 ± 2.927 | 926.983 ± 1.513 | 1073.027 ± 21.064 |
| str_nw_mera_open_26 | 751.918 ± 2.763 | 798.729 ± 1.986 | 671.829 ± 2.533 | 932.501 ± 1.794 | 1070.435 ± 32.258 |
| tensornetwork_permutation_focus_step409_316 | 259.165 ± 0.987 | 342.096 ± 1.296 | 466.793 ± 0.857 | 417.033 ± 1.571 | 387.125 ± 48.689 |
| tensornetwork_permutation_light_415 | 256.016 ± 1.483 | 266.211 ± 1.241 | 450.252 ± 1.470 | 423.649 ± 1.472 | 390.496 ± 107.997 |
Source report: data/results/zen5-cpu/cpu/einsum/20261027_235042/report.md.
cpu/einsumzen5-cpubenchmarks/cpu/einsum.yamldata/results/zen5-cpu/cpu/einsum/20261027_235042/run.yaml20261027_235042Latest run: ./scripts/run_all.sh 4.
This file is generated from one suite run under data/results/zen5-cpu/cpu/einsum/20261027_235042.
8fec1ca70852b930c092e7177c30bb8af7594a57AMD Ryzen AI 9 HX 470 w/ Radeon 890MAuthenticAMD2411221Linux-7.0.0-38-generic-x86_64-with-glibc2.390-3,12-15; 4-11,16-23enabled44FALSE44444444--xla_cpu_multi_thread_eigen=true --xla_cpu_experimental_ynn_fusion_type= intra_op_parallelism_threads=4blas-mklmkl2026.0.2/opt/intel/oneapi/mkl/latest/opt/intel/oneapi/mkl/latest/lib/libmkl_rt.somkl, version 2.12.0+cpu, BLAS_INFO mkl, LAPACK_INFO mkl/workspaces/tenferro-benchmark/.venv/lib/python3.12/site-packages/torch/lib/libgomp.so.1xla_cpu, version 0.10.1, jaxlib 0.10.1, default backend cpu, LAPACK provider none_detectedJulia: version 1.13.3, OMEinsum.jl 0.9.4, BLAS provider LBTConfig([ILP64] libopenblas64_.so), probe threads 4
omeinsum-jl (mode omeinsum_path in the log/report) always
executes the instance's precomputed opt_flops/opt_size path via
OMEinsum.DynamicEinCode pairwise contractions; OMEinsum's own
contraction-order optimizer is never invoked, so the comparison
against tenferro/PyTorch/JAX (which also use the precomputed path)
stays fair.
JULIA_NUM_THREADS also pins LinearAlgebra.BLAS.set_num_threads,
matching the BLAS thread pinning used by the other CPU backends.format_string_colmajor / shapes_colmajor directly with no
PyTorch/JAX-style layout reconstruction.OMEinsum dispatches its pairwise contractions to Julia's own BLAS
(libblastrampoline, OpenBLAS by default; the provider that ran is
reported above). When that differs from the provider tenferro-rs and
PyTorch link against, matmul-shaped rows partly compare BLAS
implementations rather than einsum-runtime overhead; read them
together with the recorded providers. docs/einsum-suite.md records
the measured OMEinsum-over-its-own-BLAS overhead.
Source table: data/results/zen5-cpu/cpu/einsum/20261027_235042/einsum_table_t4_20261027_235042.md
Logs:
data/results/zen5-cpu/cpu/einsum/20261027_235042/tenferro_trace_t4_20261027_235042.logdata/results/zen5-cpu/cpu/einsum/20261027_235042/tenferro_eager_t4_20261027_235042.logdata/results/zen5-cpu/cpu/einsum/20261027_235042/pytorch_cpu_t4_20261027_235042.logdata/results/zen5-cpu/cpu/einsum/20261027_235042/jax_cpu_t4_20261027_235042.logdata/results/zen5-cpu/cpu/einsum/20261027_235042/julia_omeinsum_t4_20261027_235042.logMedian ± IQR (ms). JULIA_NUM_THREADS=4, OMP_NUM_THREADS=4, RAYON_NUM_THREADS=4.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 4.246 ± 1.510 | 1.974 ± 0.025 | 0.600 ± 0.007 | 1.115 ± 0.274 | 4.824 ± 3.754 |
| bin_batched_matmul_b32_m64_n64_k64 | 1.645 ± 0.309 | 0.763 ± 0.005 | 0.095 ± 0.001 | 0.434 ± 0.360 | 0.422 ± 0.700 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 0.741 ± 0.009 | 0.552 ± 0.005 | 0.029 ± 0.000 | 0.159 ± 0.096 | 1.423 ± 0.276 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.319 ± 0.005 | 0.542 ± 0.003 | 0.027 ± 0.001 | 0.211 ± 0.153 | 4.034 ± 3.592 |
| bin_elementwise_mul_2048x2048 | 1.929 ± 0.022 | 1.486 ± 0.484 | 3.150 ± 0.219 | 5.202 ± 0.613 | 7.306 ± 0.793 |
| bin_elementwise_mul_512x512 | 0.702 ± 0.004 | 0.465 ± 0.003 | 0.019 ± 0.001 | 0.222 ± 0.099 | 0.077 ± 0.244 |
| bin_matmul_1024 | 17.878 ± 0.589 | 16.251 ± 6.691 | 14.721 ± 0.170 | 8.802 ± 0.121 | 23.128 ± 12.476 |
| bin_matmul_256 | 0.899 ± 0.004 | 0.140 ± 0.001 | 0.351 ± 0.007 | 0.229 ± 0.176 | 0.338 ± 0.021 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.005 ± 0.000 | 0.003 ± 0.000 | 0.012 ± 0.001 | 0.064 ± 0.006 | 0.006 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.018 ± 0.000 | 0.017 ± 0.000 | 0.055 ± 0.001 | 0.105 ± 0.041 | 0.043 ± 0.012 |
| bin_omeinsum_matmul_10x10 | 0.010 ± 0.000 | 0.006 ± 0.000 | 0.011 ± 0.001 | 0.039 ± 0.092 | 0.012 ± 0.001 |
| bin_outer_product_4096 | 11.105 ± 3.773 | 11.441 ± 3.865 | 7.507 ± 0.442 | 12.945 ± 0.167 | 140.577 ± 4.374 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 17.571 ± 0.485 | 18.258 ± 7.728 | 12.732 ± 0.182 | 12.206 ± 0.389 | 19.839 ± 9.967 |
| gm_queen5_5_3.wcsp | 3647.344 ± 65.549 | 2379.539 ± 69.696 | 1375.702 ± 6.216 | 1736.151 ± 32.565 | 4581.752 ± 21.314 |
| lm_batch_likelihood_brackets_4_4d | 14.756 ± 0.047 | 19.000 ± 0.660 | 5.370 ± 0.050 | 10.050 ± 0.335 | 15.527 ± 5.423 |
| lm_batch_likelihood_sentence_3_12d | 27.434 ± 3.537 | 61.126 ± 48.272 | 16.965 ± 0.068 | 19.949 ± 1.095 | 58.235 ± 22.569 |
| lm_batch_likelihood_sentence_4_4d | 20.623 ± 5.836 | 34.835 ± 0.854 | 5.624 ± 0.065 | 10.030 ± 0.402 | 35.908 ± 19.399 |
| nary_matmul_chain_64 | 0.063 ± 0.001 | 0.016 ± 0.000 | 0.025 ± 0.001 | 0.051 ± 0.008 | 0.047 ± 0.032 |
| str_matrix_chain_multiplication_100 | 6.540 ± 0.020 | 3.382 ± 0.011 | 3.609 ± 0.021 | 5.322 ± 0.408 | 7.381 ± 0.617 |
| str_mps_varying_inner_product_200 | 12.694 ± 0.101 | 9.058 ± 0.106 | 8.135 ± 0.055 | 10.361 ± 0.245 | 18.246 ± 3.301 |
| str_nw_mera_closed_120 | 415.837 ± 3.099 | 440.974 ± 11.282 | 386.730 ± 1.625 | 357.625 ± 6.872 | 547.987 ± 15.014 |
| str_nw_mera_open_26 | 414.597 ± 4.057 | 466.773 ± 102.083 | 236.201 ± 1.339 | 332.863 ± 5.670 | 642.859 ± 13.094 |
| tensornetwork_permutation_focus_step409_316 | 212.276 ± 2.742 | 238.555 ± 20.734 | 147.208 ± 0.417 | 220.242 ± 3.315 | 273.073 ± 26.585 |
| tensornetwork_permutation_light_415 | 206.231 ± 27.970 | 207.306 ± 22.942 | 144.041 ± 0.368 | 227.021 ± 7.230 | 265.425 ± 15.746 |
Median ± IQR (ms). JULIA_NUM_THREADS=4, OMP_NUM_THREADS=4, RAYON_NUM_THREADS=4.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 4.246 ± 1.510 | 1.974 ± 0.025 | 0.600 ± 0.007 | 1.115 ± 0.274 | 4.824 ± 3.754 |
| bin_batched_matmul_b32_m64_n64_k64 | 1.645 ± 0.309 | 0.763 ± 0.005 | 0.095 ± 0.001 | 0.434 ± 0.360 | 0.422 ± 0.700 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 0.741 ± 0.009 | 0.552 ± 0.005 | 0.029 ± 0.000 | 0.159 ± 0.096 | 1.423 ± 0.276 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.319 ± 0.005 | 0.542 ± 0.003 | 0.027 ± 0.001 | 0.211 ± 0.153 | 4.034 ± 3.592 |
| bin_elementwise_mul_2048x2048 | 1.929 ± 0.022 | 1.486 ± 0.484 | 3.150 ± 0.219 | 5.202 ± 0.613 | 7.306 ± 0.793 |
| bin_elementwise_mul_512x512 | 0.702 ± 0.004 | 0.465 ± 0.003 | 0.019 ± 0.001 | 0.222 ± 0.099 | 0.077 ± 0.244 |
| bin_matmul_1024 | 17.878 ± 0.589 | 16.251 ± 6.691 | 14.721 ± 0.170 | 8.802 ± 0.121 | 23.128 ± 12.476 |
| bin_matmul_256 | 0.899 ± 0.004 | 0.140 ± 0.001 | 0.351 ± 0.007 | 0.229 ± 0.176 | 0.338 ± 0.021 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.005 ± 0.000 | 0.003 ± 0.000 | 0.012 ± 0.001 | 0.064 ± 0.006 | 0.006 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.018 ± 0.000 | 0.017 ± 0.000 | 0.055 ± 0.001 | 0.105 ± 0.041 | 0.043 ± 0.012 |
| bin_omeinsum_matmul_10x10 | 0.010 ± 0.000 | 0.006 ± 0.000 | 0.011 ± 0.001 | 0.039 ± 0.092 | 0.012 ± 0.001 |
| bin_outer_product_4096 | 11.105 ± 3.773 | 11.441 ± 3.865 | 7.507 ± 0.442 | 12.945 ± 0.167 | 140.577 ± 4.374 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 17.571 ± 0.485 | 18.258 ± 7.728 | 12.732 ± 0.182 | 12.206 ± 0.389 | 19.839 ± 9.967 |
| gm_queen5_5_3.wcsp | 1121.566 ± 7.438 | 948.081 ± 153.408 | 578.710 ± 1.033 | 640.613 ± 8.390 | 1658.170 ± 15.339 |
| lm_batch_likelihood_brackets_4_4d | 18.926 ± 0.093 | 25.079 ± 1.216 | 5.397 ± 0.069 | 10.382 ± 0.433 | 30.606 ± 18.535 |
| lm_batch_likelihood_sentence_3_12d | 27.720 ± 0.321 | 109.431 ± 44.509 | 27.052 ± 0.432 | 25.227 ± 1.251 | 66.763 ± 22.698 |
| lm_batch_likelihood_sentence_4_4d | 12.901 ± 3.499 | 28.737 ± 3.395 | 6.202 ± 0.116 | 10.139 ± 0.423 | 28.104 ± 19.357 |
| nary_matmul_chain_64 | 0.063 ± 0.001 | 0.016 ± 0.000 | 0.025 ± 0.001 | 0.051 ± 0.008 | 0.047 ± 0.032 |
| str_matrix_chain_multiplication_100 | 3.203 ± 0.013 | 3.363 ± 0.025 | 3.608 ± 0.043 | 5.224 ± 0.118 | 7.341 ± 0.650 |
| str_mps_varying_inner_product_200 | 10.260 ± 0.044 | 9.826 ± 0.050 | 8.178 ± 0.021 | 9.884 ± 0.109 | 15.921 ± 5.393 |
| str_nw_mera_closed_120 | 383.280 ± 2.502 | 370.964 ± 6.333 | 293.342 ± 1.175 | 277.434 ± 2.290 | 461.747 ± 27.942 |
| str_nw_mera_open_26 | 411.038 ± 3.382 | 458.514 ± 99.271 | 245.024 ± 1.744 | 337.496 ± 6.789 | 631.238 ± 23.747 |
| tensornetwork_permutation_focus_step409_316 | 212.276 ± 2.742 | 238.555 ± 20.734 | 147.208 ± 0.417 | 220.242 ± 3.315 | 273.073 ± 26.585 |
| tensornetwork_permutation_light_415 | 206.231 ± 27.970 | 207.306 ± 22.942 | 144.041 ± 0.368 | 227.021 ± 7.230 | 265.425 ± 15.746 |
Source report: data/results/zen5-cpu/cpu/einsum/20261028_001612/report.md.
cpu/einsumzen5-cpubenchmarks/cpu/einsum.yamldata/results/zen5-cpu/cpu/einsum/20261028_001612/run.yaml20261028_001612Latest run: ./scripts/run_all.sh 8.
This file is generated from one suite run under data/results/zen5-cpu/cpu/einsum/20261028_001612.
8fec1ca70852b930c092e7177c30bb8af7594a57AMD Ryzen AI 9 HX 470 w/ Radeon 890MAuthenticAMD2411221Linux-7.0.0-38-generic-x86_64-with-glibc2.390-3,12-15; 4-11,16-23enabled88FALSE88888888--xla_cpu_multi_thread_eigen=true --xla_cpu_experimental_ynn_fusion_type= intra_op_parallelism_threads=8blas-mklmkl2026.0.2/opt/intel/oneapi/mkl/latest/opt/intel/oneapi/mkl/latest/lib/libmkl_rt.somkl, version 2.12.0+cpu, BLAS_INFO mkl, LAPACK_INFO mkl/workspaces/tenferro-benchmark/.venv/lib/python3.12/site-packages/torch/lib/libgomp.so.1xla_cpu, version 0.10.1, jaxlib 0.10.1, default backend cpu, LAPACK provider none_detectedJulia: version 1.13.3, OMEinsum.jl 0.9.4, BLAS provider LBTConfig([ILP64] libopenblas64_.so), probe threads 8
omeinsum-jl (mode omeinsum_path in the log/report) always
executes the instance's precomputed opt_flops/opt_size path via
OMEinsum.DynamicEinCode pairwise contractions; OMEinsum's own
contraction-order optimizer is never invoked, so the comparison
against tenferro/PyTorch/JAX (which also use the precomputed path)
stays fair.
JULIA_NUM_THREADS also pins LinearAlgebra.BLAS.set_num_threads,
matching the BLAS thread pinning used by the other CPU backends.format_string_colmajor / shapes_colmajor directly with no
PyTorch/JAX-style layout reconstruction.OMEinsum dispatches its pairwise contractions to Julia's own BLAS
(libblastrampoline, OpenBLAS by default; the provider that ran is
reported above). When that differs from the provider tenferro-rs and
PyTorch link against, matmul-shaped rows partly compare BLAS
implementations rather than einsum-runtime overhead; read them
together with the recorded providers. docs/einsum-suite.md records
the measured OMEinsum-over-its-own-BLAS overhead.
Source table: data/results/zen5-cpu/cpu/einsum/20261028_001612/einsum_table_t8_20261028_001612.md
Logs:
data/results/zen5-cpu/cpu/einsum/20261028_001612/tenferro_trace_t8_20261028_001612.logdata/results/zen5-cpu/cpu/einsum/20261028_001612/tenferro_eager_t8_20261028_001612.logdata/results/zen5-cpu/cpu/einsum/20261028_001612/pytorch_cpu_t8_20261028_001612.logdata/results/zen5-cpu/cpu/einsum/20261028_001612/jax_cpu_t8_20261028_001612.logdata/results/zen5-cpu/cpu/einsum/20261028_001612/julia_omeinsum_t8_20261028_001612.logMedian ± IQR (ms). JULIA_NUM_THREADS=8, OMP_NUM_THREADS=8, RAYON_NUM_THREADS=8.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 3.345 ± 0.968 | 2.072 ± 0.023 | 0.551 ± 0.015 | 1.064 ± 0.087 | 9.428 ± 10.707 |
| bin_batched_matmul_b32_m64_n64_k64 | 1.897 ± 0.350 | 1.092 ± 0.006 | 0.080 ± 0.002 | 0.763 ± 0.219 | 0.768 ± 0.817 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 1.190 ± 0.416 | 0.791 ± 0.007 | 0.030 ± 0.001 | 0.438 ± 0.247 | 1.553 ± 1.404 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.839 ± 0.008 | 0.405 ± 0.006 | 0.030 ± 0.005 | 0.474 ± 0.268 | 4.301 ± 1.597 |
| bin_elementwise_mul_2048x2048 | 2.097 ± 0.037 | 2.155 ± 0.340 | 2.892 ± 0.277 | 5.322 ± 0.198 | 9.144 ± 0.522 |
| bin_elementwise_mul_512x512 | 2.448 ± 0.140 | 1.085 ± 0.397 | 0.021 ± 0.001 | 0.252 ± 0.201 | 0.116 ± 0.399 |
| bin_matmul_1024 | 18.409 ± 3.397 | 14.013 ± 1.839 | 12.585 ± 0.165 | 8.858 ± 0.394 | 30.558 ± 15.645 |
| bin_matmul_256 | 1.749 ± 0.300 | 0.111 ± 0.002 | 0.281 ± 0.006 | 0.218 ± 0.056 | 0.412 ± 0.006 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.008 ± 0.000 | 0.005 ± 0.000 | 0.018 ± 0.001 | 0.103 ± 0.006 | 0.010 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.029 ± 0.001 | 0.027 ± 0.001 | 0.088 ± 0.002 | 0.147 ± 0.074 | 0.038 ± 0.026 |
| bin_omeinsum_matmul_10x10 | 0.046 ± 0.001 | 0.009 ± 0.000 | 0.017 ± 0.000 | 0.063 ± 0.029 | 0.018 ± 0.002 |
| bin_outer_product_4096 | 9.392 ± 2.800 | 9.046 ± 0.626 | 7.454 ± 0.282 | 12.498 ± 0.468 | 197.616 ± 6.924 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 23.002 ± 0.384 | 15.224 ± 5.549 | 11.051 ± 0.247 | 9.936 ± 0.297 | 23.495 ± 6.107 |
| gm_queen5_5_3.wcsp | 4009.796 ± 39.209 | 2214.568 ± 49.833 | 1243.864 ± 12.744 | 1563.443 ± 27.959 | 5626.624 ± 34.861 |
| lm_batch_likelihood_brackets_4_4d | 21.416 ± 2.632 | 39.825 ± 8.985 | 6.353 ± 0.124 | 13.519 ± 0.457 | 50.697 ± 25.946 |
| lm_batch_likelihood_sentence_3_12d | 32.823 ± 0.397 | 125.616 ± 12.520 | 27.876 ± 0.155 | 22.639 ± 3.793 | 74.549 ± 27.278 |
| lm_batch_likelihood_sentence_4_4d | 21.564 ± 0.223 | 39.085 ± 3.573 | 6.656 ± 0.040 | 13.259 ± 0.177 | 44.301 ± 22.738 |
| nary_matmul_chain_64 | 0.093 ± 0.001 | 0.077 ± 0.001 | 0.031 ± 0.001 | 0.085 ± 0.010 | 0.080 ± 0.026 |
| str_matrix_chain_multiplication_100 | 7.690 ± 0.055 | 8.091 ± 0.048 | 3.861 ± 0.020 | 5.332 ± 0.152 | 8.560 ± 1.118 |
| str_mps_varying_inner_product_200 | 15.722 ± 6.264 | 13.648 ± 7.724 | 9.944 ± 0.035 | 14.521 ± 0.123 | 22.127 ± 2.937 |
| str_nw_mera_closed_120 | 418.191 ± 4.944 | 454.306 ± 16.615 | 357.773 ± 2.418 | 328.203 ± 16.327 | 565.853 ± 13.959 |
| str_nw_mera_open_26 | 449.497 ± 2.409 | 434.313 ± 27.184 | 222.787 ± 1.270 | 278.737 ± 3.608 | 705.791 ± 16.419 |
| tensornetwork_permutation_focus_step409_316 | 233.983 ± 15.852 | 274.506 ± 12.049 | 128.458 ± 0.885 | 277.987 ± 3.846 | 334.694 ± 38.522 |
| tensornetwork_permutation_light_415 | 218.170 ± 2.015 | 229.150 ± 2.323 | 126.197 ± 0.933 | 286.035 ± 6.460 | 326.374 ± 34.140 |
Median ± IQR (ms). JULIA_NUM_THREADS=8, OMP_NUM_THREADS=8, RAYON_NUM_THREADS=8.
| Instance | tenferro-rs trace mode (ms) | tenferro-rs eager mode (ms) | PyTorch Python (ms) | JAX Python (XLA CPU dot) (ms) | OMEinsum.jl OpenBLAS (ms) |
|---|---|---|---|---|---|
| bin_batched_matmul_b32_m128_n128_k128 | 3.345 ± 0.968 | 2.072 ± 0.023 | 0.551 ± 0.015 | 1.064 ± 0.087 | 9.428 ± 10.707 |
| bin_batched_matmul_b32_m64_n64_k64 | 1.897 ± 0.350 | 1.092 ± 0.006 | 0.080 ± 0.002 | 0.763 ± 0.219 | 0.768 ± 0.817 |
| bin_batched_outer_product_compact_j16_k16_o64_t64 | 1.190 ± 0.416 | 0.791 ± 0.007 | 0.030 ± 0.001 | 0.438 ± 0.247 | 1.553 ± 1.404 |
| bin_batched_outer_product_noncompact_j16_k16_o64_t64 | 0.839 ± 0.008 | 0.405 ± 0.006 | 0.030 ± 0.005 | 0.474 ± 0.268 | 4.301 ± 1.597 |
| bin_elementwise_mul_2048x2048 | 2.097 ± 0.037 | 2.155 ± 0.340 | 2.892 ± 0.277 | 5.322 ± 0.198 | 9.144 ± 0.522 |
| bin_elementwise_mul_512x512 | 2.448 ± 0.140 | 1.085 ± 0.397 | 0.021 ± 0.001 | 0.252 ± 0.201 | 0.116 ± 0.399 |
| bin_matmul_1024 | 18.409 ± 3.397 | 14.013 ± 1.839 | 12.585 ± 0.165 | 8.858 ± 0.394 | 30.558 ± 15.645 |
| bin_matmul_256 | 1.749 ± 0.300 | 0.111 ± 0.002 | 0.281 ± 0.006 | 0.218 ± 0.056 | 0.412 ± 0.006 |
| bin_omeinsum_batched_matmul_8x8_batch_4 | 0.008 ± 0.000 | 0.005 ± 0.000 | 0.018 ± 0.001 | 0.103 ± 0.006 | 0.010 ± 0.001 |
| bin_omeinsum_high_d_12x12_contract_4_batch_4 | 0.029 ± 0.001 | 0.027 ± 0.001 | 0.088 ± 0.002 | 0.147 ± 0.074 | 0.038 ± 0.026 |
| bin_omeinsum_matmul_10x10 | 0.046 ± 0.001 | 0.009 ± 0.000 | 0.017 ± 0.000 | 0.063 ± 0.029 | 0.018 ± 0.002 |
| bin_outer_product_4096 | 9.392 ± 2.800 | 9.046 ± 0.626 | 7.454 ± 0.282 | 12.498 ± 0.468 | 197.616 ± 6.924 |
| bin_permuted_r4_abcd_dbef_acef_d32 | 23.002 ± 0.384 | 15.224 ± 5.549 | 11.051 ± 0.247 | 9.936 ± 0.297 | 23.495 ± 6.107 |
| gm_queen5_5_3.wcsp | 1227.358 ± 7.209 | 939.443 ± 178.223 | 510.419 ± 3.960 | 575.919 ± 11.914 | 1988.501 ± 81.016 |
| lm_batch_likelihood_brackets_4_4d | 27.041 ± 0.326 | 43.212 ± 0.660 | 5.971 ± 0.214 | 13.143 ± 0.296 | 35.960 ± 19.421 |
| lm_batch_likelihood_sentence_3_12d | 24.891 ± 1.440 | 149.707 ± 61.922 | 15.592 ± 0.142 | 26.671 ± 0.376 | 72.385 ± 25.219 |
| lm_batch_likelihood_sentence_4_4d | 30.016 ± 0.117 | 42.034 ± 12.687 | 6.729 ± 0.059 | 13.175 ± 0.373 | 35.087 ± 22.288 |
| nary_matmul_chain_64 | 0.093 ± 0.001 | 0.077 ± 0.001 | 0.031 ± 0.001 | 0.085 ± 0.010 | 0.080 ± 0.026 |
| str_matrix_chain_multiplication_100 | 8.085 ± 0.118 | 8.069 ± 0.224 | 3.851 ± 0.018 | 5.284 ± 0.161 | 8.224 ± 0.755 |
| str_mps_varying_inner_product_200 | 15.417 ± 5.640 | 17.712 ± 5.773 | 9.840 ± 0.021 | 14.167 ± 0.066 | 19.372 ± 5.262 |
| str_nw_mera_closed_120 | 384.184 ± 2.145 | 359.499 ± 6.435 | 262.954 ± 1.490 | 233.187 ± 8.547 | 468.168 ± 36.532 |
| str_nw_mera_open_26 | 455.975 ± 6.457 | 432.567 ± 40.124 | 224.839 ± 2.295 | 290.107 ± 7.740 | 706.364 ± 46.942 |
| tensornetwork_permutation_focus_step409_316 | 233.983 ± 15.852 | 274.506 ± 12.049 | 128.458 ± 0.885 | 277.987 ± 3.846 | 334.694 ± 38.522 |
| tensornetwork_permutation_light_415 | 218.170 ± 2.015 | 229.150 ± 2.323 | 126.197 ± 0.933 | 286.035 ± 6.460 | 326.374 ± 34.140 |