Florian Hahn f69ac9a22d

[LV] Support widened induction variables in epilogue vectorization. ...

Code generation now uses the start VPValue of induction recipes.

This makes it possible to adjust the start value of the epilogue
vector loop to use the 'resume' value of the main vector loop.

Fixes #59459.

Reviewed By: Ayal

Differential Revision: https://reviews.llvm.org/D92132

2022-12-21 13:58:50 +00:00

..

already-vectorized.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

avx1.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

avx512.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

consecutive-ptr-cg-bug.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

consecutive-ptr-uniforms.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

constant-fold.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

constant-vector-operand.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

conversion-cost.ll

[LV] Support widened induction variables in epilogue vectorization.

2022-12-21 13:58:50 +00:00

cost-model-assert.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

cost-model.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

drop-poison-generating-flags.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

epilog-vectorization-inductions.ll

[LV] Support widened induction variables in epilogue vectorization.

2022-12-21 13:58:50 +00:00

fixed-order-recurrence.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

float-induction-x86.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

fneg-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

fp32_to_uint32-cost-model.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

fp64_to_uint32-cost-model.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

fp80-widest-type.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

fp_to_sint8-cost-model.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

funclet.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gather_scatter.ll

[LV] Support widened induction variables in epilogue vectorization.

2022-12-21 13:58:50 +00:00

gather-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gather-vs-interleave.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gcc-examples.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

i1-reg-usage.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

illegal-parallel-loop-uniform-write.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

imprecise-through-phis.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

int128_no_gather.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

interleave_short_tc.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

interleave-opaque-pointers.ll

[LV] Keep track of cost-based ScalarAfterVec in VPWidenPointerInd.

2022-09-19 18:14:35 +01:00

interleaved-accesses-large-gap.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

interleaved-accesses-waw-dependency.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

interleaving.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

intrinsiccost.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

invariant-load-gather.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

invariant-store-vectorization.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

libm-vector-calls-finite.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

libm-vector-calls-VF2-VF8.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

libm-vector-calls.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

limit-vf-by-tripcount.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

lit.local.cfg

…

load-deref-pred.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

masked_load_store.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

max-mstore.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

metadata-enable.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

min-trip-count-switch.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

mul_slm_16bit.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

no_fpmath_with_hotness.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

no_fpmath.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

no-vector.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

nontemporal.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

optsize.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

outer_loop_test1_no_explicit_vect_width.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

parallel-loops-after-reg2mem.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

parallel-loops.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pointer-runtime-checks-unprofitable.ll

[TTI] Recognize fp constants in getOperandInfo

2022-09-21 14:34:34 -07:00

powof2div.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr23997.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr34438.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

pr35432.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

pr36524.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

pr39160.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr42674.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr47437.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

pr48340.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

pr51366-sunk-instruction-used-outside-of-loop.ll

[VPlan] Model first exit values using VPLiveOut.

2022-05-21 16:01:38 +01:00

pr54413-select-interleave-count-loop-with-cost-zero.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr54634.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

pr55096-scalarize-add.ll

[LV] Add crashing test from #55096.

2022-05-12 22:40:28 +01:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[LV] Don't optimize exit cond during epilogue vectorization.

2022-07-01 13:48:38 +01:00

propagate-metadata.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

ptr-indvar-crash.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

rauw-bug.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

reduction-crash.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

reduction-fastmath.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

reduction-small-size.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

redundant-vf2-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

reg-usage-debug.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

reg-usage.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

register-assumption.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

runtime-limit.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

scatter_crash.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

slm-no-vectorize.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

small-size.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

strided_load_cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

struct-store.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

svml-calls-finite.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

svml-calls.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

tail_folding_and_assume_safety.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

tail_loop_folding.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

tripcount.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uint64_to_fp64-cost-model.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uniform_load.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uniform_mem_op.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

uniform-phi.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uniformshift.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll_selection.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll-pm.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll-small-loops.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

veclib-calls.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vect.omp.force.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vect.omp.force.small-tc.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

vector_max_bandwidth.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vector_ptr_load_store.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vector-scalar-select-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks-loopid-dbg.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks-missed.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks-profitable.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorize-interleaved-accesses-gap.ll

[LV] Use separate index to access StoredValues in vectorizeInterleave.

2022-11-25 15:28:05 +00:00

vectorize-only-for-real.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86_fp80-interleaved-access.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86_fp80-vector-store.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86-interleaved-accesses-masked-group.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86-interleaved-store-accesses-with-gaps.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86-pr39099.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86-predication.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00