shylie/llvm-project
1
0
Fork 0
Code Issues Pull Requests Actions 6 Packages Projects Releases Wiki Activity
llvm-project/compiler-rt/test/fuzzer
History
Dan Blackwell ed1a1eda0f
[compiler-rt][Fuzzer] Relax reduce_inputs.test to account for non-determinism (#182495) 
I have seen that very occasionally this test is failing on a bot, with
only 3 files in the corpus. After running the test in a loop 4000+
times, I witnessed this same failure twice.

In both cases the first corpus member was some string not containing a
'F'; the second corpus member was 'F[' or 'FZ'; and the final corpus
member 'FUZ'.

In a normal run there is an intermediate corpus member 'FU.' - so this
test is failing in very rare cases where the fuzzer gets lucky and
matches 2 branch conditions in one mutation.

This patch allows the FileCheck condition to match 3 or 4 corpus files.
It may be possible for the fuzzer to reach the target in 2 files, but I
think that if that is possible, it will be exceptionally rare.

rdar://170440934
2026-02-25 10:55:41 -08:00
..
unit
…
AbsNegAndConstant64Test.cpp
…
AbsNegAndConstantTest.cpp
…
AccumulateAllocationsTest.cpp
…
acquire-crash-state.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
AcquireCrashStateTest.cpp
…
afl-driver-close-fd-mask.test
[compiler-rt][test] Change tests to remove the use of unset command in lit internal shell (#104880)
2024-08-22 14:39:23 -07:00
afl-driver-stderr.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
afl-driver.test
…
AFLDriverTest.cpp
…
AlignmentAssumptionTest.cpp
…
bad-strcmp.test
…
BadStrcmpTest.cpp
…
bcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
big-file-copy.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
BigFileCopy.cpp
[fuzzer] Use puts() rather than printf() in CopyFileToErr()
2023-03-28 14:19:35 -07:00
Bingo.h
…
bogus-initialize.test
…
BogusInitializeTest.cpp
…
buffer-overflow-on-input.test
…
BufferOverflowOnInput.cpp
…
caller-callee.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
CallerCalleeTest.cpp
…
cleanse.test
…
CleanseTest.cpp
…
CMakeLists.txt
[NFCI] [Darwin] Add APPLE_TARGET_IS_HOST lit option to compiler-rt (#174522)
2026-01-06 09:10:16 -08:00
compressed.test
[Fuzzer] Passthrough zlib CMake paths into the test (#107926)
2024-09-09 19:21:59 -07:00
CompressedTest.cpp
…
counters.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
CounterTest.cpp
[fuzzer][test] Add #include <cstdint> for gcc-13
2022-11-10 13:44:11 +08:00
coverage.test
[Fuzzer][Test-Only][Darwin] Mark coverage.test and exit_on_src_pos.test unsupported (#165408)
2025-10-31 08:15:23 +00:00
cross_over_copy.test
…
cross_over_insert.test
…
cross_over_uniform_dist.test
…
cross_over.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
CrossOverTest.cpp
[fuzzer] Fix-forward fix-forward CrossOverTest.cpp
2025-08-29 21:28:33 +00:00
custom-allocator.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
CustomAllocator.cpp
…
CustomCrossOverAndMutateTest.cpp
…
CustomCrossOverTest.cpp
…
CustomMutatorTest.cpp
…
CustomMutatorWithLongSequencesTest.cpp
…
cxxstring.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
CxxStringEqTest.cpp
…
dataflow.test
Add test for Flags.data_flow_trace
2023-03-07 22:18:29 -08:00
dead-stripping.test
…
deep-recursion.test
…
DeepRecursionTest.cpp
…
deprecated-instrumentation.test
…
dict1.txt
…
disable-leaks.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
DivTest.cpp
…
DSO1.cpp
…
DSO2.cpp
…
dso-cov-input.txt
…
dso.test
Reapply "[compiler-rt] Remove %T from shared object substitutions (#155302)"
2025-09-21 19:49:08 +00:00
DSOTestExtra.cpp
…
DSOTestMain.cpp
…
empty-module.test
Fix libFuzzer array alignment with empty modules (#159661)
2025-09-19 00:10:15 +00:00
EmptyTest.cpp
…
equivalence-signals.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
equivalence.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
EquivalenceATest.cpp
…
EquivalenceBTest.cpp
…
exit_on_src_pos.test
[Fuzzer][Test-Only][Darwin] Mark coverage.test and exit_on_src_pos.test unsupported (#165408)
2025-10-31 08:15:23 +00:00
exit-report.test
…
ExplodeDFSanLabelsTest.cpp
…
extra-counters.test
…
features_dir.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
FlagsTest.cpp
[fuzzer][test] Add #include <cstdint> for gcc-13
2022-11-10 13:44:11 +08:00
focus-function.test
[compiler-rt] Update fuzzer/focus-function.test to not require shell. (#157967)
2025-09-10 19:35:59 -07:00
fork_corpus_groups.test
[test][fuzzer] Deflake fork_corpus_groups.test
2023-09-01 01:11:58 -07:00
fork-sigusr.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
fork-ubsan.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
fork.test
[test][fuzzer] Deflake fork.test
2023-09-01 00:57:35 -07:00
FourIndependentBranchesTest.cpp
…
full-coverage-set.test
…
full-coverage.test
Reapply "[compiler-rt] Remove %T from shared object substitutions (#155302)"
2025-09-21 19:49:08 +00:00
FullCoverageSetTest.cpp
…
fuzzer-alignment-assumption.test
…
fuzzer-customcrossover.test
…
fuzzer-customcrossoverandmutate.test
…
fuzzer-custommutator.test
[fuzzer] Relax the FileCheck string for test fuzzer-custommutator.test (#66343)
2023-09-20 15:19:25 -07:00
fuzzer-dict.test
…
fuzzer-dirs.test
…
fuzzer-fdmask.test
…
fuzzer-finalstats.test
[libfuzzer] Fix -runs=X flaky test (fuzzer-finalstats.test) (#96914)
2024-07-09 11:23:49 +02:00
fuzzer-flags.test
…
fuzzer-implicit-integer-sign-change.test
…
fuzzer-implicit-signed-integer-truncation-or-sign-change.test
…
fuzzer-implicit-signed-integer-truncation.test
…
fuzzer-implicit-unsigned-integer-truncation.test
…
fuzzer-leak.test
[compiler-rt][Fuzzer] Disable fuzzer-leak test
2024-07-04 11:04:13 +00:00
fuzzer-oom-with-profile.test
…
fuzzer-oom.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
fuzzer-printcovpcs.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
fuzzer-runs.test
…
fuzzer-seed.test
…
fuzzer-segv.test
[test][fuzzer] XFAIL tvOS tests pending investigation. (rdar://99981102)
2022-09-15 13:40:28 -07:00
fuzzer-singleinputs.test
…
fuzzer-threaded.test
…
fuzzer-timeout.test
…
fuzzer-ubsan.test
[Fuzzer][Test-Only] Re-enable fuzzer-ubsan.test on Darwin (#165403)
2025-10-28 15:00:21 +00:00
gc-sections.test
[fuzzer] Fix UNSUPPORTED criteria for two tests
2022-12-16 12:48:16 -08:00
GcSectionsTest.cpp
…
hi.txt
…
ImplicitIntegerSignChangeTest.cpp
…
ImplicitSignedIntegerTruncationOrSignChangeTest.cpp
…
ImplicitSignedIntegerTruncationTest.cpp
…
ImplicitUnsignedIntegerTruncationTest.cpp
…
initialize.test
…
InitializeTest.cpp
…
IntegerOverflowTest.cpp
…
keep-seed.test
…
KeepSeedTest.cpp
…
Labels20Test.cpp
…
large.test
…
LargeTest.cpp
…
LeakTest.cpp
…
LeakTimeoutTest.cpp
…
len_control.test
…
libcxx.test
…
lit.cfg.py
Rename config.host_os to config.target_os.
2025-07-17 11:12:29 -07:00
lit.site.cfg.py.in
[NFCI] [Darwin] Add APPLE_TARGET_IS_HOST lit option to compiler-rt (#174522)
2026-01-06 09:10:16 -08:00
LoadTest.cpp
…
magic-separator.test
…
MagicSeparatorTest.cpp
…
max-number-of-runs.test
…
memcmp64.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
Memcmp64BytesTest.cpp
…
memcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
MemcmpTest.cpp
…
merge_two_step.test
…
merge-control-file.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
merge-posix.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
merge-sigusr.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
merge.test
…
minimize_crash.test
…
minimize_timeout.test
…
minimize_two_crashes.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
msan-custom-mutator.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
msan-param-unpoison.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
msan.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
MsanCustomMutator.cpp
…
MsanParamUnpoison.cpp
…
MultipleConstraintsOnSmallInputTest.cpp
…
mutation-graph.test
…
noasan-bcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
noasan-memcmp64.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
noasan-memcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
noasan-strcmp.test
[fuzzer][test] Disable noasan-strcmp test for AArch64
2024-12-31 00:52:03 +05:00
noasan-strncmp.test
[fuzzer][test] Disable noasan-strncmp test for AArch64
2023-04-14 15:33:11 +00:00
noasan-strstr.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
not-instrumented.test
…
NotinstrumentedTest.cpp
…
NthRunCrashTest.cpp
…
null-deref-on-empty.test
…
null-deref.test
[test][fuzzer] XFAIL tvOS tests pending investigation. (rdar://99981102)
2022-09-15 13:40:28 -07:00
NullDerefOnEmptyTest.cpp
…
NullDerefTest.cpp
…
OneHugeAllocTest.cpp
…
only-some-bytes-fork.test
…
only-some-bytes.test
…
OnlySomeBytesTest.cpp
…
out-of-process-fuzz.test
[compiler-rt][tests] Fix env command not found errors with lit internal shell (#105879)
2024-08-26 15:56:22 -07:00
OutOfMemorySingleLargeMallocTest.cpp
…
OutOfMemoryTest.cpp
…
OutOfProcessFuzzTarget.cpp
…
overwrite-input.test
…
OverwriteInputTest.cpp
…
print-func.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
PrintFuncTest.cpp
…
read-binary.test
…
ReadBinaryTest.cpp
…
recommended-dictionary.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
reduce_inputs.test
[compiler-rt][Fuzzer] Relax reduce_inputs.test to account for non-determinism (#182495)
2026-02-25 10:55:41 -08:00
Reject.cpp
…
reject.test
…
reload.test
…
ReloadTest.cpp
…
repeated-bytes.test
…
RepeatedBytesTest.cpp
…
RepeatedMemcmp.cpp
…
SanCovDump.cpp
…
seed_inputs.test
[compiler-rt] [Darwin] Add darwin-remote feature for remote darwin test targets (#174905)
2026-01-08 10:03:30 -08:00
set_cover_merge.test
…
ShallowOOMDeepCrash.cpp
…
shrink.test
…
ShrinkControlFlowSimpleTest.cpp
…
ShrinkControlFlowTest.cpp
…
ShrinkValueProfileTest.cpp
…
sig-trap.test
[compiler-rt] Fix sig-trap.test to work with lit internal shell. (#157966)
2025-09-10 19:29:22 -07:00
sigint.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
SignedIntOverflowTest.cpp
…
SigTrapTest.cpp
[compiler-rt][libFuzzer] Add support for capturing SIGTRAP exits. (#149120)
2025-07-28 07:46:48 -07:00
sigusr.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
simple-cmp.test
…
simple.test
…
SimpleCmpTest.cpp
…
SimpleDictionaryTest.cpp
…
SimpleHashTest.cpp
…
SimpleTest.cpp
…
SimpleTestStdio.cpp
…
SimpleThreadedTest.cpp
…
SimulateEmptyModuleTest.cpp
Fix libFuzzer array alignment with empty modules (#159661)
2025-09-19 00:10:15 +00:00
SingleByteInputTest.cpp
…
SingleMemcmpTest.cpp
…
SingleStrcmpTest.cpp
…
SingleStrncmpTest.cpp
…
SleepOneSecondTest.cpp
…
SpamyTest.cpp
…
stack-overflow-with-asan.test
[test][fuzzer] XFAIL tvOS tests pending investigation. (rdar://99981102)
2022-09-15 13:40:28 -07:00
StackOverflowTest.cpp
…
standalone.test
…
strcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
StrcmpTest.cpp
…
strncmp-oob.test
…
strncmp.test
fuzzer/strncmp.test: Increase iteration to 20M.
2024-10-14 18:34:36 +09:00
StrncmpOOBTest.cpp
…
StrncmpTest.cpp
…
strstr.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
StrstrTest.cpp
…
swap-cmp.test
…
SwapCmpTest.cpp
…
Switch2Test.cpp
…
Switch3Test.cpp
…
SwitchTest.cpp
…
symbolize-deadlock.test
…
SymbolizeDeadlock.cpp
…
TableLookupTest.cpp
…
ThreadedLeakTest.cpp
…
ThreadedTest.cpp
…
three-bytes.test
…
ThreeBytes.cpp
…
ThreeFunctionsTest.cpp
…
TimeoutEmptyTest.cpp
…
TimeoutTest.cpp
…
trace-malloc-2.test
…
trace-malloc-threaded.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
trace-malloc-unbalanced.test
…
trace-malloc.test
…
TraceMallocTest.cpp
…
TraceMallocThreadedTest.cpp
…
TwoDifferentBugsTest.cpp
…
ulimit.test
[compiler-rt] Remove REQUIRES: shell lines (#173338)
2025-12-23 12:04:13 -08:00
uncaught-exception.test
Fix uncaught-exception.test. (#146190)
2025-06-27 22:23:51 -04:00
UncaughtException.cpp
…
UninitializedStrlen.cpp
…
UseAfterDtor.cpp
…
value-profile-cmp2.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
value-profile-cmp3.test
…
value-profile-cmp4.test
…
value-profile-cmp.test
…
value-profile-div.test
[test] Make fuzzer/value-profile-div.test x86 specific
2023-07-18 22:11:27 -07:00
value-profile-load.test
…
value-profile-mem.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
value-profile-set.test
…
value-profile-strcmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
value-profile-strncmp.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
value-profile-switch.test
[fuzzer] Convert tests to check 'target=...'
2022-12-16 11:41:53 -08:00
windows-opt-ref.test
…