-
Notifications
You must be signed in to change notification settings - Fork 14.7k
Description
When doing a 3 stage bootstrap build on top of GCC-14.2.0
I encounter the following errorsin the test suite
Most of the new failures seems to be coming from llvm-libc++-shared.cfg.in :: benchmarks
Notes
- Using a recipe that works for LLVM-20.1.8 (just changing the sources)
- OS: Ubuntu 22.04.5 LTS
- CPU: 13th Gen Intel(R) Core(TM) i9-13900K
Failing/timed out tests
- Test timeout set to 5 minute
-DLLVM_LIT_ARGS="-j 8 -v --timeout 300"
Would like to check for the timedout tests if they are actually hanging or if increasing the timeout from 5 min could solve the problem.
Not sure if these tests are oversubscribing my CPU (it has 24 real cores and 32 with the hyperthreaded ones) without respecting the neither the -j
passed to lit
nor the one to make -j 1 check-all
and this is what is causing hte problem
2 warning(s) in tests
********************
Timed Out Tests (15):
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/lower_bound.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/make_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/make_heap_then_sort_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/min.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/push_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/ranges_make_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/ranges_make_heap_then_sort_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/ranges_push_heap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/set_intersection.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/containers/associative/flat_map.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/containers/associative/flat_multimap.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/containers/string.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/format/format_to.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/format/format_to_n.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/format/formatter_float.bench.cpp
********************
Failed Tests (11):
Clang :: Analysis/z3/crosscheck-statistics.c
lldb-shell :: Commands/command-disassemble-riscv32-bytes.s
lldb-unit :: DAP/./DAPTests/DisconnectRequestHandlerTest/DisconnectTriggersTerminateCommands
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/modifying/unique.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/modifying/unique_copy.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_1_waiter_1_notifier.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_N_waiter_N_notifier.bench.cpp
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_multi_waiter_1_notifier.bench.cpp
Details of the failures
The timed out errors fails with outputs of the kind
# .---command stderr------------
# | 2025-08-04T14:48:39+02:00
# | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/algorithms/Output/make_heap.bench.cpp.dir/t.tmp.exe
# | Run on (32 X 5500 MHz CPU s)
# | CPU Caches:
# | L1 Data 48 KiB (x16)
# | L1 Instruction 32 KiB (x16)
# | L2 Unified 2048 KiB (x16)
# | L3 Unified 36864 KiB (x1)
# | Load Average: 11.00, 12.52, 10.36
# | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead.
# `-----------------------------
# error: command failed with exit status: -9
# error: command reached timeout: True
-
Clang :: Analysis/z3/crosscheck-statistics.c
Command Output (stderr): -- /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/clang -cc1 -internal-isystem /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/lib/clang/21/include -nostdsysteminc -analyze -setup-static-analyzer -analyzer-checker=core -verify /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c -analyzer-config crosscheck-with-z3=true -analyzer-stats 2>&1 | /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c # RUN: at line 1 + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/clang -cc1 -internal-isystem /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/lib/clang/21/include -nostdsysteminc -analyze -setup-static-analyzer -analyzer-checker=core -verify /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c -analyzer-config crosscheck-with-z3=true -analyzer-stats + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c:25:11: error: CHECK: expected string not found in input // CHECK: 1 BugReporter - Number of times all reports of an equivalence class was refuted ^ <stdin>:1:1: note: scanning from here ===-------------------------------------------------------------------------=== ^ Input file: <stdin> Check file: /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/clang/test/Analysis/z3/crosscheck-statistics.c -dump-input=help explains the following input dump. Input was: <<<<<< 1: ===-------------------------------------------------------------------------=== check:25 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found 2: Analyzer timers check:25 ~~~~~~~~~~~~~~~~~ 3: ===-------------------------------------------------------------------------=== check:25 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 4: Total Execution Time: 0.0245 seconds (0.0245 wall clock) check:25 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 5: check:25 ~ 6: ---User Time--- --System Time-- --User+System-- ---Wall Time--- --- Name --- check:25 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ . . . >>>>>>
-
lldb-shell :: Commands/command-disassemble-riscv32-bytes.s
Command Output (stderr): -- /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/llvm-mc -filetype=obj -mattr=+c --triple=riscv32-unknown-unknown /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s -o /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp # RUN: at line 12 + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/llvm-mc -filetype=obj -mattr=+c --triple=riscv32-unknown-unknown /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s -o /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/lldb --no-lldbinit -S /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet -b /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp "-o" "disassemble -b -n main" | /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s # RUN: at line 13 + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/lldb --no-lldbinit -S /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet -b /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp -o 'disassemble -b -n main' + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/lldb --no-lldbinit -S /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet -b /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp -o "command script import /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/../../../examples/python/filter_disasm.py" -o "fdis set /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/Inputs/dis_filt.py" -o "fdis -n main" | /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck --check-prefix=FILTER /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s # RUN: at line 14 + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/lldb --no-lldbinit -S /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet -b /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp -o 'command script import /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/../../../examples/python/filter_disasm.py' -o 'fdis set /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/Inputs/dis_filt.py' -o 'fdis -n main' + /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/bin/FileCheck --check-prefix=FILTER /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s error: module importing failed: This script interpreter does not support importing modules. /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s:31:11: error: FILTER: expected string not found in input # FILTER: Disassembly filter command (fdis) loaded ^ <stdin>:1:1: note: scanning from here (lldb) command source -s 0 '/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet' ^ <stdin>:4:149: note: possible intended match here (lldb) target create "/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp" ^ Input file: <stdin> Check file: /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/command-disassemble-riscv32-bytes.s -dump-input=help explains the following input dump. Input was: <<<<<< 1: (lldb) command source -s 0 '/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet' check:31'0 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found 2: Executing commands in '/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/lit-lldb-init-quiet'. check:31'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 3: (lldb) command source -C --silent-run true lit-lldb-init check:31'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 4: (lldb) target create "/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp" check:31'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ check:31'1 ? possible intended match 5: Current executable set to '/home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/tools/lldb/test/Shell/Commands/Output/command-disassemble-riscv32-bytes.s.tmp' (riscv32). check:31'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 6: (lldb) command script import /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/lldb/test/Shell/Commands/../../../examples/python/filter_disasm.py check:31'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ >>>>>>
-
lldb-unit :: DAP/./DAPTests/DisconnectRequestHandlerTest/DisconnectTriggersTerminateCommands
No details in the logs
-
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/modifying/unique.bench.cpp
# .---command stdout------------ # | ------------------------------------------------------------------------------------------- # | Benchmark Time CPU Iterations # | ------------------------------------------------------------------------------------------- # | std::unique(vector<int>) (contiguous)/32 299 ns 299 ns 2373580 # | std::unique(vector<int>) (contiguous)/50 427 ns 427 ns 1636290 # | std::unique(vector<int>) (contiguous)/1024 7380 ns 7380 ns 94440 # | std::unique(vector<int>) (contiguous)/8192 59912 ns 59913 ns 11710 # | std::unique(deque<int>) (contiguous)/32 294 ns 295 ns 2376800 # | std::unique(deque<int>) (contiguous)/50 408 ns 408 ns 1715110 # | std::unique(deque<int>) (contiguous)/1024 6615 ns 6615 ns 106060 # | std::unique(deque<int>) (contiguous)/8192 53990 ns 53967 ns 13080 # | std::unique(list<int>) (contiguous)/32 389 ns 390 ns 1796700 # | std::unique(list<int>) (contiguous)/50 563 ns 563 ns 1244520 # | std::unique(list<int>) (contiguous)/1024 10371 ns 10370 ns 67270 # | std::unique(list<int>) (contiguous)/8192 81583 ns 81581 ns 8570 # | rng::unique(vector<int>) (contiguous)/32 222 ns 222 ns 3171400 # | rng::unique(vector<int>) (contiguous)/50 294 ns 294 ns 2377600 # | rng::unique(vector<int>) (contiguous)/1024 5282 ns 5281 ns 100000 # | rng::unique(vector<int>) (contiguous)/8192 37347 ns 37337 ns 18720 # | rng::unique(deque<int>) (contiguous)/32 299 ns 299 ns 2338700 # | rng::unique(deque<int>) (contiguous)/50 415 ns 415 ns 1689030 # | rng::unique(deque<int>) (contiguous)/1024 6761 ns 6760 ns 103510 # | rng::unique(deque<int>) (contiguous)/8192 53006 ns 52999 ns 13180 # | rng::unique(list<int>) (contiguous)/32 371 ns 371 ns 1915460 # | rng::unique(list<int>) (contiguous)/50 536 ns 536 ns 1306700 # | rng::unique(list<int>) (contiguous)/1024 9693 ns 9692 ns 71860 # | rng::unique(list<int>) (contiguous)/8192 75054 ns 75052 ns 9460 # | std::unique(vector<int>, pred) (contiguous)/32 297 ns 297 ns 2347900 # | std::unique(vector<int>, pred) (contiguous)/50 426 ns 426 ns 1636720 # | std::unique(vector<int>, pred) (contiguous)/1024 7344 ns 7344 ns 95710 # | std::unique(vector<int>, pred) (contiguous)/8192 58896 ns 58897 ns 11850 # | std::unique(deque<int>, pred) (contiguous)/32 230 ns 230 ns 3041190 # | std::unique(deque<int>, pred) (contiguous)/50 298 ns 298 ns 2341830 # | std::unique(deque<int>, pred) (contiguous)/1024 4381 ns 4381 ns 159420 # | std::unique(deque<int>, pred) (contiguous)/8192 32958 ns 32957 ns 22110 # | std::unique(list<int>, pred) (contiguous)/32 412 ns 412 ns 1691350 # | std::unique(list<int>, pred) (contiguous)/50 605 ns 605 ns 1153120 # | std::unique(list<int>, pred) (contiguous)/1024 11116 ns 11117 ns 62870 # | std::unique(list<int>, pred) (contiguous)/8192 88051 ns 88029 ns 7970 # | rng::unique(vector<int>, pred) (contiguous)/32 269 ns 269 ns 3067620 # | rng::unique(vector<int>, pred) (contiguous)/50 414 ns 414 ns 2273990 # | rng::unique(vector<int>, pred) (contiguous)/1024 4971 ns 4971 ns 140990 # | rng::unique(vector<int>, pred) (contiguous)/8192 39898 ns 39898 ns 17750 # | rng::unique(deque<int>, pred) (contiguous)/32 335 ns 334 ns 2224950 # | rng::unique(deque<int>, pred) (contiguous)/50 359 ns 360 ns 1960390 # | rng::unique(deque<int>, pred) (contiguous)/1024 4196 ns 4196 ns 140550 # | rng::unique(deque<int>, pred) (contiguous)/8192 33024 ns 33024 ns 21330 # | rng::unique(list<int>, pred) (contiguous)/32 389 ns 390 ns 1725930 # | rng::unique(list<int>, pred) (contiguous)/50 589 ns 590 ns 1240950 # | rng::unique(list<int>, pred) (contiguous)/1024 10074 ns 10074 ns 69510 # | rng::unique(list<int>, pred) (contiguous)/8192 79604 ns 79602 ns 8810 # | std::unique(vector<int>) (sprinkled)/32 346 ns 346 ns 2017330 # `----------------------------- # .---command stderr------------ # | 2025-08-04T14:54:12+02:00 # | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/algorithms/modifying/Output/unique.bench.cpp.dir/t.tmp.exe # | Run on (32 X 5500 MHz CPU s) # | CPU Caches: # | L1 Data 48 KiB (x16) # | L1 Instruction 32 KiB (x16) # | L2 Unified 2048 KiB (x16) # | L3 Unified 36864 KiB (x1) # | Load Average: 9.83, 10.97, 10.33 # | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead. # | t.tmp.exe: /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/libcxx/test/benchmarks/algorithms/modifying/unique.bench.cpp:117: auto main(int, char **)::(anonymous class)::operator()(std::string, (lambda at /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/libcxx/test/benchmarks/algorithms/modifying/unique.bench.cpp:23:26))::(anonymous class)::operator()(benchmark::State &)::(anonymous class)::operator()(std::vector<int> &) const: Assertion `cont.size() % 4 == 0' failed. # `----------------------------- # error: command failed with exit status: 250
-
llvm-libc++-shared.cfg.in :: benchmarks/algorithms/modifying/unique_copy.bench.cpp
# .---command stdout------------ # | ------------------------------------------------------------------------------------------------ # | Benchmark Time CPU Iterations # | ------------------------------------------------------------------------------------------------ # | std::unique_copy(vector<int>) (contiguous)/32 270 ns 270 ns 2611831 # | std::unique_copy(vector<int>) (contiguous)/1024 5032 ns 5032 ns 139603 # | std::unique_copy(vector<int>) (contiguous)/8192 39287 ns 39285 ns 17810 # | std::unique_copy(deque<int>) (contiguous)/32 235 ns 235 ns 2967677 # | std::unique_copy(deque<int>) (contiguous)/1024 4017 ns 4016 ns 174468 # | std::unique_copy(deque<int>) (contiguous)/8192 30689 ns 30686 ns 22825 # | std::unique_copy(list<int>) (contiguous)/32 343 ns 343 ns 2044372 # | std::unique_copy(list<int>) (contiguous)/1024 9194 ns 9194 ns 76389 # | std::unique_copy(list<int>) (contiguous)/8192 73932 ns 73930 ns 9458 # | rng::unique_copy(vector<int>) (contiguous)/32 265 ns 265 ns 2630741 # | rng::unique_copy(vector<int>) (contiguous)/1024 4798 ns 4798 ns 145683 # | rng::unique_copy(vector<int>) (contiguous)/8192 37373 ns 37371 ns 18739 # | rng::unique_copy(deque<int>) (contiguous)/32 228 ns 228 ns 3175859 # | rng::unique_copy(deque<int>) (contiguous)/1024 4067 ns 4066 ns 178917 # | rng::unique_copy(deque<int>) (contiguous)/8192 30607 ns 30607 ns 22903 # | rng::unique_copy(list<int>) (contiguous)/32 363 ns 363 ns 1910688 # | rng::unique_copy(list<int>) (contiguous)/1024 10476 ns 10476 ns 67166 # | rng::unique_copy(list<int>) (contiguous)/8192 85256 ns 85254 ns 8318 # | std::unique_copy(vector<int>, pred) (contiguous)/32 223 ns 223 ns 3083133 # | std::unique_copy(vector<int>, pred) (contiguous)/1024 4960 ns 4960 ns 139570 # | std::unique_copy(vector<int>, pred) (contiguous)/8192 39240 ns 39240 ns 17813 # | std::unique_copy(deque<int>, pred) (contiguous)/32 198 ns 198 ns 3542494 # | std::unique_copy(deque<int>, pred) (contiguous)/1024 4463 ns 4463 ns 157075 # | std::unique_copy(deque<int>, pred) (contiguous)/8192 36019 ns 36018 ns 19764 # | std::unique_copy(list<int>, pred) (contiguous)/32 363 ns 363 ns 1897778 # | std::unique_copy(list<int>, pred) (contiguous)/1024 10297 ns 10297 ns 67603 # | std::unique_copy(list<int>, pred) (contiguous)/8192 81912 ns 81912 ns 8555 # | rng::unique_copy(vector<int>, pred) (contiguous)/32 308 ns 308 ns 2259767 # | rng::unique_copy(vector<int>, pred) (contiguous)/1024 8256 ns 8256 ns 85383 # | rng::unique_copy(vector<int>, pred) (contiguous)/8192 66380 ns 66376 ns 10615 # | rng::unique_copy(deque<int>, pred) (contiguous)/32 199 ns 199 ns 3511438 # | rng::unique_copy(deque<int>, pred) (contiguous)/1024 4489 ns 4489 ns 156257 # | rng::unique_copy(deque<int>, pred) (contiguous)/8192 35471 ns 35471 ns 19752 # | rng::unique_copy(list<int>, pred) (contiguous)/32 341 ns 341 ns 2050531 # | rng::unique_copy(list<int>, pred) (contiguous)/1024 9512 ns 9512 ns 73396 # | rng::unique_copy(list<int>, pred) (contiguous)/8192 76112 ns 76111 ns 9310 # | std::unique_copy(vector<int>) (sprinkled)/32 324 ns 324 ns 2138476 # `----------------------------- # .---command stderr------------ # | 2025-08-04T14:54:13+02:00 # | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/algorithms/modifying/Output/unique_copy.bench.cpp.dir/t.tmp.exe # | Run on (32 X 5500 MHz CPU s) # | CPU Caches: # | L1 Data 48 KiB (x16) # | L1 Instruction 32 KiB (x16) # | L2 Unified 2048 KiB (x16) # | L3 Unified 36864 KiB (x1) # | Load Average: 9.76, 10.94, 10.32 # | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead. # | t.tmp.exe: /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/libcxx/test/benchmarks/algorithms/modifying/unique_copy.bench.cpp:97: auto main(int, char **)::(anonymous class)::operator()(std::string, (lambda at /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm-project-21.1.0-rc2.src/libcxx/test/benchmarks/algorithms/modifying/unique_copy.bench.cpp:23:31))::(anonymous class)::operator()(benchmark::State &)::(anonymous class)::operator()(std::vector<int> &) const: Assertion `cont.size() % 4 == 0' failed. # `----------------------------- # error: command failed with exit status: 250
-
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_1_waiter_1_notifier.bench.cpp
# .---command stdout------------ # | ------------------------------------------------------------------------------------------------------------------------- # | Benchmark Time CPU Iterations # | ------------------------------------------------------------------------------------------------------------------------- # | BM_1_atomic_1_waiter_1_notifier<KeepNotifying, NumHighPrioTasks<0>>/65536 4853171 ns 4851429 ns 143 # | BM_1_atomic_1_waiter_1_notifier<KeepNotifying, NumHighPrioTasks<0>>/131072 9647562 ns 9642837 ns 72 # | BM_1_atomic_1_waiter_1_notifier<KeepNotifying, NumHighPrioTasks<0>>/262144 19405378 ns 19390426 ns 36 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<50>, NumHighPrioTasks<0>>/1024 51356298 ns 6313706 ns 111 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<50>, NumHighPrioTasks<0>>/2048 102817543 ns 12741905 ns 56 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<50>, NumHighPrioTasks<0>>/4096 207387506 ns 26635381 ns 27 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<100>, NumHighPrioTasks<0>>/1024 106653307 ns 6986692 ns 100 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<100>, NumHighPrioTasks<0>>/2048 266858893 ns 13819589 ns 10 # | BM_1_atomic_1_waiter_1_notifier<NotifyEveryNus<100>, NumHighPrioTasks<0>>/4096 470271542 ns 27333079 ns 10 # `----------------------------- # .---command stderr------------ # | 2025-08-04T15:03:03+02:00 # | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/Output/atomic_wait_1_waiter_1_notifier.bench.cpp.dir/t.tmp.exe # | Run on (32 X 5500 MHz CPU s) # | CPU Caches: # | L1 Data 48 KiB (x16) # | L1 Instruction 32 KiB (x16) # | L2 Unified 2048 KiB (x16) # | L3 Unified 36864 KiB (x1) # | Load Average: 8.65, 9.14, 9.70 # | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead. # | libc++abi: terminating due to uncaught exception of type std::runtime_error: failed to create thread # `----------------------------- # error: command failed with exit status: 250
-
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_N_waiter_N_notifier.bench.cpp
# .---command stdout------------ # | ---------------------------------------------------------------------------------------------------------------------------------------------- # | Benchmark Time CPU Iterations # | ---------------------------------------------------------------------------------------------------------------------------------------------- # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<2>, NumHighPrioTasks<0>>/4096 1151443 ns 1151426 ns 578 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<2>, NumHighPrioTasks<0>>/8192 2253417 ns 2253372 ns 294 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<2>, NumHighPrioTasks<0>>/16384 3890336 ns 3890113 ns 134 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<3>, NumHighPrioTasks<0>>/1024 442763 ns 442711 ns 4198 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<3>, NumHighPrioTasks<0>>/2048 961972 ns 961593 ns 1222 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<3>, NumHighPrioTasks<0>>/4096 2043202 ns 2040602 ns 663 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<5>, NumHighPrioTasks<0>>/1024 529418 ns 499398 ns 1289 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<5>, NumHighPrioTasks<0>>/2048 1068415 ns 1001100 ns 603 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<5>, NumHighPrioTasks<0>>/4096 1687797 ns 1684771 ns 377 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<7>, NumHighPrioTasks<0>>/256 191765 ns 191732 ns 3640 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<7>, NumHighPrioTasks<0>>/512 371671 ns 370769 ns 1766 # | BM_N_atomics_N_waiter_N_notifier<KeepNotifying, NumberOfAtomics<7>, NumHighPrioTasks<0>>/1024 882973 ns 882937 ns 704 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/1024 51221852 ns 51219261 ns 14 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/2048 110242050 ns 109765215 ns 7 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/4096 228077409 ns 227658912 ns 3 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/256 17759285 ns 17750988 ns 45 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/512 26291793 ns 26291081 ns 25 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/1024 52690405 ns 52033329 ns 13 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/256 15950896 ns 15788564 ns 49 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/512 42077901 ns 41673047 ns 20 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/1024 83965579 ns 83890525 ns 9 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/64 9376106 ns 9172947 ns 67 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/128 14712871 ns 14533282 ns 48 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<50>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/256 27955577 ns 27563066 ns 23 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/256 26894941 ns 26872706 ns 27 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/512 55124314 ns 55122616 ns 12 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<2>, NumHighPrioTasks<0>>/1024 103852716 ns 103843835 ns 7 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/256 25841938 ns 25840778 ns 27 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/512 53004039 ns 52994918 ns 12 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<3>, NumHighPrioTasks<0>>/1024 108399505 ns 108398313 ns 7 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/128 14032730 ns 14011711 ns 52 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/256 26452955 ns 26450124 ns 24 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<5>, NumHighPrioTasks<0>>/512 54166120 ns 54147682 ns 14 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/64 7358714 ns 7354523 ns 71 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/128 16423888 ns 15874979 ns 41 # | BM_N_atomics_N_waiter_N_notifier<NotifyEveryNus<100>, NumberOfAtomics<7>, NumHighPrioTasks<0>>/256 39662329 ns 39546404 ns 16 # `----------------------------- # .---command stderr------------ # | 2025-08-04T15:03:19+02:00 # | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/Output/atomic_wait_N_waiter_N_notifier.bench.cpp.dir/t.tmp.exe # | Run on (32 X 5500 MHz CPU s) # | CPU Caches: # | L1 Data 48 KiB (x16) # | L1 Instruction 32 KiB (x16) # | L2 Unified 2048 KiB (x16) # | L3 Unified 36864 KiB (x1) # | Load Average: 8.72, 9.13, 9.69 # | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead. # | libc++abi: terminating due to uncaught exception of type std::runtime_error: failed to create thread # `----------------------------- # error: command failed with exit status: 250
-
llvm-libc++-shared.cfg.in :: benchmarks/atomic_wait_multi_waiter_1_notifier.bench.cpp
# .---command stdout------------ # | --------------------------------------------------------------------------------------------------------------------------------------------------- # | Benchmark Time CPU Iterations # | --------------------------------------------------------------------------------------------------------------------------------------------------- # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<3>, NumHighPrioTasks<0>>/16384 2655839 ns 2655688 ns 267 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<3>, NumHighPrioTasks<0>>/32768 4623772 ns 4623781 ns 110 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<3>, NumHighPrioTasks<0>>/65536 11635356 ns 11632809 ns 60 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<7>, NumHighPrioTasks<0>>/4096 1023152 ns 1023118 ns 703 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<7>, NumHighPrioTasks<0>>/8192 2217248 ns 2217211 ns 401 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<7>, NumHighPrioTasks<0>>/16384 3649101 ns 3649107 ns 206 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<15>, NumHighPrioTasks<0>>/1024 339018 ns 337629 ns 2206 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<15>, NumHighPrioTasks<0>>/2048 734601 ns 704198 ns 1042 # | BM_1_atomic_multi_waiter_1_notifier<KeepNotifying, NumWaitingThreads<15>, NumHighPrioTasks<0>>/4096 1543397 ns 1426624 ns 466 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/1024 51362314 ns 51360204 ns 14 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/2048 103360548 ns 103356961 ns 7 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/4096 205088996 ns 205065697 ns 3 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/256 12967279 ns 12963259 ns 54 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/512 25696120 ns 25694950 ns 27 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/1024 58055860 ns 57960707 ns 12 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/64 5113220 ns 4982889 ns 125 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/128 10005361 ns 9793086 ns 73 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<50>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/256 18165988 ns 17781230 ns 37 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/256 27058433 ns 27016669 ns 27 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/512 53440642 ns 53326046 ns 14 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<3>, NumHighPrioTasks<0>>/1024 115741597 ns 115660558 ns 7 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/64 8389108 ns 8106180 ns 74 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/128 16851964 ns 16653886 ns 41 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<7>, NumHighPrioTasks<0>>/256 35111067 ns 34684518 ns 17 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/16 4326957 ns 4183690 ns 201 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/32 4627273 ns 4575537 ns 135 # | BM_1_atomic_multi_waiter_1_notifier<NotifyEveryNus<100>, NumWaitingThreads<15>, NumHighPrioTasks<0>>/64 8174414 ns 8097613 ns 77 # `----------------------------- # .---command stderr------------ # | 2025-08-04T15:03:20+02:00 # | Running /home/crivella/.local/easybuild/build/LLVM/21.1.0-rc2/GCCcore-14.2.0/llvm.obj.3/runtimes/runtimes-bins/libcxx/test/benchmarks/Output/atomic_wait_multi_waiter_1_notifier.bench.cpp.dir/t.tmp.exe # | Run on (32 X 5500 MHz CPU s) # | CPU Caches: # | L1 Data 48 KiB (x16) # | L1 Instruction 32 KiB (x16) # | L2 Unified 2048 KiB (x16) # | L3 Unified 36864 KiB (x1) # | Load Average: 8.72, 9.13, 9.69 # | ***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead. # | libc++abi: terminating due to uncaught exception of type std::runtime_error: failed to create thread # `----------------------------- # error: command failed with exit status: 250