2f69c82cec
Add a new --order option to choose between available test orders: the default "smart" order, predictable "lexical" order or "random" order. Default to using lexical order and one job in the lit test suite. Differential Revision: https://reviews.llvm.org/D107695
24 lines
977 B
Python
24 lines
977 B
Python
## Check that we can reorder test runs.
|
|
|
|
# RUN: cp %{inputs}/reorder/.lit_test_times.txt %{inputs}/reorder/.lit_test_times.txt.orig
|
|
# RUN: %{lit-no-order-opt} %{inputs}/reorder > %t.out
|
|
# RUN: cp %{inputs}/reorder/.lit_test_times.txt %{inputs}/reorder/.lit_test_times.txt.new
|
|
# RUN: cp %{inputs}/reorder/.lit_test_times.txt.orig %{inputs}/reorder/.lit_test_times.txt
|
|
# RUN: not diff %{inputs}/reorder/.lit_test_times.txt.new %{inputs}/reorder/.lit_test_times.txt.orig
|
|
# RUN: FileCheck --check-prefix=TIMES --implicit-check-not= < %{inputs}/reorder/.lit_test_times.txt.new %s
|
|
# RUN: FileCheck < %t.out %s
|
|
# END.
|
|
|
|
# TIMES: not-executed.txt
|
|
# TIMES-NEXT: subdir/ccc.txt
|
|
# TIMES-NEXT: bbb.txt
|
|
# TIMES-NEXT: aaa.txt
|
|
# TIMES-NEXT: new-test.txt
|
|
|
|
# CHECK: -- Testing: 4 tests, 1 workers --
|
|
# CHECK-NEXT: PASS: reorder :: subdir/ccc.txt
|
|
# CHECK-NEXT: PASS: reorder :: bbb.txt
|
|
# CHECK-NEXT: PASS: reorder :: aaa.txt
|
|
# CHECK-NEXT: PASS: reorder :: new-test.txt
|
|
# CHECK: Passed: 4
|