b8355b7126
For example, I need this lately in my CI config: LIT_XFAIL_NOT='libomptarget :: nvptx64-nvidia-cuda :: unified_shared_memory/api.c' That test specifies an XFAIL directive, but I get an XPASS result. Reviewed By: jhenderson Differential Revision: https://reviews.llvm.org/D106022
40 lines
1.8 KiB
Python
40 lines
1.8 KiB
Python
# Check that XFAILing works via command line or env var.
|
|
|
|
# RUN: %{lit} --xfail 'false.txt;false2.txt;top-level-suite :: b :: test.txt' \
|
|
# RUN: --xfail-not 'true-xfail.txt;top-level-suite :: a :: test-xfail.txt' \
|
|
# RUN: %{inputs}/xfail-cl \
|
|
# RUN: | FileCheck --check-prefix=CHECK-FILTER %s
|
|
|
|
# RUN: env LIT_XFAIL='false.txt;false2.txt;top-level-suite :: b :: test.txt' \
|
|
# RUN: LIT_XFAIL_NOT='true-xfail.txt;top-level-suite :: a :: test-xfail.txt' \
|
|
# RUN: %{lit} %{inputs}/xfail-cl \
|
|
# RUN: | FileCheck --check-prefix=CHECK-FILTER %s
|
|
|
|
# Check that --xfail-not and LIT_XFAIL_NOT always have precedence.
|
|
|
|
# RUN: env LIT_XFAIL=true-xfail.txt \
|
|
# RUN: %{lit} --xfail true-xfail.txt --xfail-not true-xfail.txt \
|
|
# RUN: --xfail true-xfail.txt %{inputs}/xfail-cl/true-xfail.txt \
|
|
# RUN: | FileCheck --check-prefix=CHECK-OVERRIDE %s
|
|
|
|
# RUN: env LIT_XFAIL_NOT=true-xfail.txt LIT_XFAIL=true-xfail.txt \
|
|
# RUN: %{lit} --xfail true-xfail.txt %{inputs}/xfail-cl/true-xfail.txt \
|
|
# RUN: | FileCheck --check-prefix=CHECK-OVERRIDE %s
|
|
|
|
# END.
|
|
|
|
# CHECK-FILTER: Testing: 10 tests, {{[0-9]*}} workers
|
|
# CHECK-FILTER-DAG: {{^}}PASS: top-level-suite :: a :: test.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: b :: test.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: a :: false.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: b :: false.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: false.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: false2.txt
|
|
# CHECK-FILTER-DAG: {{^}}PASS: top-level-suite :: true.txt
|
|
# CHECK-FILTER-DAG: {{^}}PASS: top-level-suite :: true-xfail.txt
|
|
# CHECK-FILTER-DAG: {{^}}PASS: top-level-suite :: a :: test-xfail.txt
|
|
# CHECK-FILTER-DAG: {{^}}XFAIL: top-level-suite :: b :: test-xfail.txt
|
|
|
|
# CHECK-OVERRIDE: Testing: 1 tests, {{[0-9]*}} workers
|
|
# CHECK-OVERRIDE: {{^}}PASS: top-level-suite :: true-xfail.txt
|