shylie/llvm-project
1
0
Fork 0
Code Issues Pull Requests Actions 6 Packages Projects Releases Wiki Activity
llvm-project/llvm/test/Transforms/LoopVectorize/X86
History
Anna Thomas 3cf24dbbdd [LV] Complete load groups and release store groups. Try 2. 
This is a complete fix for CompleteLoadGroups introduced in
D154309. We need to check for dependency between A and every member of
the load Group of B.
This patch also fixes another miscompile seen when we incorrectly sink stores
below a depending load (see testcase in
interleaved-accesses-sink-store-across-load.ll). This is fixed by
releasing store groups correctly.

This change was previously reverted (e85fd3cbdd68) due to Asan failure with
use-after-free error. A testcase is added and the bug is fixed in this
version of the patch.

Differential Revision: https://reviews.llvm.org/D155520
2023-08-08 18:10:23 -04:00
..
already-vectorized.ll
[LV] Disable runtime unrolling for vectorized loops.
2023-01-06 10:56:17 +00:00
avx1.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
avx512.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
consecutive-ptr-cg-bug.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
consecutive-ptr-uniforms.ll
[LoopVectorize] Convert most tests to opaque pointers (NFC)
2023-06-12 13:10:22 +02:00
constant-fold.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
constant-vector-operand.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
conversion-cost.ll
[LV] Optimize trip count SCEV.
2023-04-12 16:17:58 -07:00
cost-model-assert.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
cost-model.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
drop-poison-generating-flags.ll
[LoopVectorize] Convert most tests to opaque pointers (NFC)
2023-06-12 13:10:22 +02:00
epilog-vectorization-inductions.ll
Recommit "[LV] Re-use existing broadcast value for live-ins."
2023-08-01 15:54:02 +01:00
fixed-order-recurrence.ll
Revert "[VPlan] Mark recurrence recipes as not having side-effects."
2023-06-06 11:35:26 +02:00
float-induction-x86.ll
[ValueTracking] Add logic for isKnownNonZero(smin/smax X, Y)
2023-04-30 10:06:46 -05:00
fneg-cost.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
fp32_to_uint32-cost-model.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
fp64_to_uint32-cost-model.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
fp80-widest-type.ll
[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax
2022-12-05 22:17:30 +03:00
fp_to_sint8-cost-model.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
funclet.ll
[LV] Check for vector instruction in main vector loop.
2023-07-03 14:16:47 +01:00
gather_scatter.ll
[LV] Skip VFs > # iterations remaining for epilogue vectorization.
2023-07-07 21:43:51 +01:00
gather-cost.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
gather-vs-interleave.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
gcc-examples.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
i1-reg-usage.ll
[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax
2022-12-05 22:17:30 +03:00
illegal-parallel-loop-uniform-write.ll
[LV] Optimize trip count SCEV.
2023-04-12 16:17:58 -07:00
imprecise-through-phis.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
int128_no_gather.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
interleave_short_tc.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
interleave-opaque-pointers.ll
[LV] Keep track of cost-based ScalarAfterVec in VPWidenPointerInd.
2022-09-19 18:14:35 +01:00
interleaved-accesses-hoist-load-across-store.ll
[LV] Complete load groups and release store groups. Try 2.
2023-08-08 18:10:23 -04:00
interleaved-accesses-large-gap.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
interleaved-accesses-sink-store-across-load.ll
[LV] Complete load groups and release store groups. Try 2.
2023-08-08 18:10:23 -04:00
interleaved-accesses-waw-dependency.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
interleaving.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
intrinsiccost.ll
Recommit "[LV] Re-use existing broadcast value for live-ins."
2023-08-01 15:54:02 +01:00
invariant-load-gather.ll
[LV] Disable runtime unrolling for vectorized loops.
2023-01-06 10:56:17 +00:00
invariant-store-vectorization.ll
[LV] Disable runtime unrolling for vectorized loops.
2023-01-06 10:56:17 +00:00
libm-vector-calls-finite.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
libm-vector-calls-VF2-VF8.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
libm-vector-calls.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
limit-vf-by-tripcount.ll
[LV] Skip VFs > # iterations remaining for epilogue vectorization.
2023-07-07 21:43:51 +01:00
lit.local.cfg
[NFC][Py Reformat] Reformat lit.local.cfg python files in llvm
2023-05-17 17:03:15 +02:00
load-deref-pred.ll
Recommit "[LV] Re-use existing broadcast value for live-ins."
2023-08-01 15:54:02 +01:00
masked_load_store.ll
[LV] Disable runtime unrolling for vectorized loops.
2023-01-06 10:56:17 +00:00
max-mstore.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
metadata-enable.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00
min-trip-count-switch.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
mul_slm_16bit.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
no_fpmath_with_hotness.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
no_fpmath.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
no-vector.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
nontemporal.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
optsize.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00
outer_loop_test1_no_explicit_vect_width.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00
parallel-loops-after-reg2mem.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
parallel-loops.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
pointer-runtime-checks-unprofitable.ll
[LoopVectorize] Convert most tests to opaque pointers (NFC)
2023-06-12 13:10:22 +02:00
powof2div.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
pr23997.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
pr34438.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
pr35432.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
pr36524.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2023-01-04 17:25:42 +01:00
pr39160.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
pr42674.ll
[InstCombine] Set dead phi inputs to poison in more cases
2023-08-01 11:53:47 +02:00
pr47437.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
pr48340.ll
[LV] Add users for loads to make tests more robust.
2023-02-04 20:42:57 +00:00
pr51366-sunk-instruction-used-outside-of-loop.ll
[LoopVectorize] Convert most tests to opaque pointers (NFC)
2023-06-12 13:10:22 +02:00
pr54413-select-interleave-count-loop-with-cost-zero.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
pr54634.ll
Recommit "[LV] Re-use existing broadcast value for live-ins."
2023-08-01 15:54:02 +01:00
pr55096-scalarize-add.ll
[LV] Add crashing test from #55096.
2022-05-12 22:40:28 +01:00
pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll
[LV] Consider if scalar epilogue is required in getMaximizedVFForTarget.
2023-07-06 13:35:35 +01:00
propagate-metadata.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2023-01-04 17:25:42 +01:00
ptr-indvar-crash.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2023-01-04 17:25:42 +01:00
rauw-bug.ll
[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax
2022-12-05 22:17:30 +03:00
reduction-crash.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
reduction-fastmath.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
reduction-small-size.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
redundant-vf2-cost.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
reg-usage-debug.ll
[LV] Reland "Update logic for calculating register usage due to invariants"
2023-02-28 17:32:39 +05:30
reg-usage.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
register-assumption.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
runtime-limit.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
scatter_crash.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2023-01-04 17:25:42 +01:00
slm-no-vectorize.ll
[LoopVectorize][X86] Regenerate slm-no-vectorize.ll
2023-06-13 14:15:37 +01:00
small-size.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2023-04-06 09:38:47 +02:00
strided_load_cost.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:27:31 +01:00
struct-store.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
svml-calls-finite.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
svml-calls.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
tail_folding_and_assume_safety.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
tail_loop_folding.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00
tripcount.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
uint64_to_fp64-cost-model.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
uniform_load.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
uniform_mem_op.ll
[LV] Use SCEV for uniformity analysis across VF
2023-05-31 16:01:00 +01:00
uniform-phi.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
uniformshift.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
unroll_selection.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
unroll-pm.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
unroll-small-loops.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
veclib-calls.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vect.omp.force.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vect.omp.force.small-tc.ll
[LV] Use the known trip count when costing non-tail folded VFs
2023-04-24 22:02:30 +01:00
vector_max_bandwidth.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vector_ptr_load_store.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vector-scalar-select-cost.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vectorization-remarks-loopid-dbg.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vectorization-remarks-missed.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vectorization-remarks-profitable.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vectorization-remarks.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
vectorize-interleaved-accesses-gap.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00
vectorize-only-for-real.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
x86_fp80-interleaved-access.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
x86_fp80-vector-store.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
x86-interleaved-accesses-masked-group.ll
[InstCombine] Don't reassociate GEPs for loop invariance
2023-04-18 12:17:07 +02:00
x86-interleaved-store-accesses-with-gaps.ll
[IR] Change shufflevector undef mask to poison
2023-04-27 14:41:10 +01:00
x86-pr39099.ll
[LoopVectorize] Convert some tests to opaque pointers (NFC)
2022-12-14 15:16:59 +01:00
x86-predication.ll
[IRBuilder] Use canonical i64 type for insertelement index used by vector splats.
2023-01-11 14:08:06 +00:00