shylie/llvm-project
1
0
Fork 0
Code Issues Pull Requests Actions 6 Packages Projects Releases Wiki Activity
llvm-project/llvm/test/Transforms/LoopVectorize/X86
History
Florian Hahn 0b61cd39e4
[LV] Add epilogue minimum iteration check in VPlan as well. (#189372) 
Update LV to also use the VPlan-based addMinimumIterationCheck for the
iteration count check for the epilogue.

As the VPlan-based addMinimumIterationCheck uses VPExpandSCEV, those
need to be placed in the entry block for now, moving vscale * VF * IC to
the entry for scalable vectors.

The new logic also fails to simplify some checks involving PtrToInt,
because they were only simplified when going through generated IR, then
folding some PtrToInt in IR, then constructing SCEVs again. But those
should be cleaned up by later combines, and there is not really much we
can do other than trying to go through IR.

PR: https://github.com/llvm/llvm-project/pull/189372
2026-04-01 15:47:41 +01:00
..
CostModel
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
already-vectorized.ll
…
amdlibm-calls-finite.ll
[LIBM][AMDLIBM] - Add new vector call support for fveclib=AMDLIBM (#180896)
2026-03-12 13:24:11 +00:00
amdlibm-calls.ll
[LIBM][AMDLIBM] - New vector calls for cdfnorm and round scalar calls (#187232)
2026-03-25 10:03:00 +00:00
avx1.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
avx512.ll
…
cast-costs.ll
[VPlan] Handle non-free bitcasts in getCostForRecipeWithOpcode.
2026-01-02 18:04:13 +00:00
cleanup-runtime-checks.ll
…
clmul.ll
[Analysis] isTriviallyVectorizable - add Intrinsic::clmul along with vectorisation tests (#180014)
2026-03-07 10:26:45 +00:00
conditional-scalar-assignment.ll
[IVDescriptors] Remove single-use constraint from FindLast comparisons (#186096)
2026-03-13 14:27:19 +00:00
consecutive-ptr-cg-bug.ll
[LV][NFC] Remove undef values in some test cases (#164401)
2025-11-05 09:18:02 +00:00
consecutive-ptr-uniforms.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
constant-fold.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
constant-vector-operand.ll
…
conversion-cost.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
cost-any-of.ll
[VPlan] Account for any-of costs in legacy cost model
2026-03-12 21:51:23 +00:00
cost-conditional-branches.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
cost-constant-known-via-scev.ll
[VPlan] Add nuw to unrolled canonical IVs (#183716)
2026-02-27 11:46:29 +00:00
cost-divisor-overflow.ll
[LoopVectorize] Fix an integer narrowing conversion in getPredBlockCostDivisor(...) (#187605)
2026-03-23 17:22:05 +00:00
cost-model-assert.ll
[LV][NFC] Remove undef values in some test cases (#164401)
2025-11-05 09:18:02 +00:00
cost-model-i386.ll
…
cost-model.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
divs-with-tail-folding.ll
Revert "[VPlan] Don't drop NUW flag on tail folded canonical IVs (#183301)" (#183698)
2026-02-27 09:13:33 +00:00
drop-inbounds-flags-for-reverse-vector-pointer.ll
[VPlan] Directly unroll VectorEndPointerRecipe (#172372)
2026-02-16 09:59:55 +00:00
drop-poison-generating-flags.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
end-pointer-signed.ll
[VPlan] Directly unroll VectorEndPointerRecipe (#172372)
2026-02-16 09:59:55 +00:00
ephemeral-recipes.ll
…
epilog-vectorization-inductions.ll
Reapply "[LV] Simplify and unify resume value handling for epilogue vec." (#187504)
2026-03-23 22:09:40 +00:00
epilog-vectorization-ordered-reduction.ll
[LV] Refine tripcount estimate using minimum iteration count rt check. (#188135)
2026-03-26 20:48:53 +00:00
fixed-order-recurrence.ll
[VPlan] Fix wrap-flags on WidenInduction unroll (#187710)
2026-03-27 13:26:04 +00:00
float-induction-x86.ll
Reapply "[LV] Simplify and unify resume value handling for epilogue vec." (#187504)
2026-03-23 22:09:40 +00:00
fminimumnum.ll
[LAA] Use SCEVPtrToAddr in tryToCreateDiffChecks. (#178861)
2026-02-11 11:51:51 +00:00
fneg-cost.ll
…
fold-tail-low-trip-count.ll
Revert "[VPlan] Don't drop NUW flag on tail folded canonical IVs (#183301)" (#183698)
2026-02-27 09:13:33 +00:00
fp32_to_uint32-cost-model.ll
…
fp64_to_uint32-cost-model.ll
…
fp80-widest-type.ll
[LV][NFC] Remove undef from phi incoming values (#163762)
2025-10-21 10:49:27 +01:00
fp_to_sint8-cost-model.ll
…
funclet.ll
…
gather_scatter.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
gather-cost.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
gather-vs-interleave.ll
…
gcc-examples.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
gep-use-outside-loop.ll
[IR] Replace alignment argument with attribute on masked intrinsics (#163802)
2025-10-20 08:50:09 +00:00
i1-reg-usage.ll
…
illegal-parallel-loop-uniform-write.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
imprecise-through-phis.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
induction-costs.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
induction-step.ll
[LV] Teach m_One, m_ZeroInt patterns to look through broadcasts (#170159)
2026-01-07 10:35:08 +00:00
int128_no_gather.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
interleave_short_tc.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
interleave-cost.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
interleave-opaque-pointers.ll
[VPlan] Remove PtrIV::IsScalarAfterVectorization, use VPlan analysis. (#168289)
2025-11-20 18:58:25 +00:00
interleave-ptradd-with-replicated-operand.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
interleaved-accesses-hoist-load-across-store.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
interleaved-accesses-large-gap.ll
[LV][NFC] Remove undef values in some test cases (#164401)
2025-11-05 09:18:02 +00:00
interleaved-accesses-sink-store-across-load.ll
Reland [VPlan] Expand WidenInt inductions with nuw/nsw (#168354)
2025-11-17 13:44:25 +00:00
interleaved-accesses-use-after-free.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
interleaved-accesses-waw-dependency.ll
…
interleaving.ll
[InstCombine] Canonicalize GEP source element types (#180745)
2026-03-06 14:48:01 +00:00
intrinsiccost.ll
Reapply "[LV] Simplify and unify resume value handling for epilogue vec." (#187504)
2026-03-23 22:09:40 +00:00
invariant-load-gather.ll
[VPlan] Sink recipes from the vector loop region in licm. (#168031)
2026-02-03 07:57:15 +00:00
invariant-store-vectorization.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
iv-live-outs.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
libm-vector-calls-finite.ll
…
libm-vector-calls-VF2-VF8.ll
…
libm-vector-calls.ll
…
limit-vf-by-tripcount.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
lit.local.cfg
…
load-deref-pred.ll
Reapply "[VPlan] Remove manual region removal when simplifying for VF and UF. (#181252)" (#188589)
2026-03-26 10:14:10 +00:00
masked_load_store.ll
Revert "[VPlan] Extract reverse mask from reverse accesses" (#189637)
2026-03-31 15:53:01 +01:00
masked-store-cost.ll
[VPlan] Add nuw to unrolled canonical IVs (#183716)
2026-02-27 11:46:29 +00:00
max-mstore.ll
…
metadata-enable.ll
[InstCombine] Canonicalize GEP source element types (#180745)
2026-03-06 14:48:01 +00:00
min-trip-count-switch.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
mul_slm_16bit.ll
…
multi-exit-cost.ll
[VPlan] Directly unroll VectorEndPointerRecipe (#172372)
2026-02-16 09:59:55 +00:00
narrow-to-single-scalar.ll
[VPlan] Fix assert in store-user in narrowToSingleScalars (#167686)
2025-11-12 17:53:24 +00:00
no_fpmath_with_hotness.ll
…
no_fpmath.ll
…
no-vector.ll
…
nontemporal.ll
…
optsize.ll
Reland [VPlan] Expand WidenInt inductions with nuw/nsw (#168354)
2025-11-17 13:44:25 +00:00
outer_loop_test1_no_explicit_vect_width.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
parallel-loops-after-reg2mem.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
parallel-loops.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
pointer-runtime-checks-unprofitable.ll
…
powof2div.ll
…
pr23997.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
pr34438.ll
…
pr35432.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
pr36524.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
pr39160.ll
[LV][NFC] Remove remaining uses of undef in tests (#169357)
2025-11-26 11:24:10 +00:00
pr42674.ll
…
pr47437.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
pr48340.ll
[IR] Replace alignment argument with attribute on masked intrinsics (#163802)
2025-10-20 08:50:09 +00:00
pr51366-sunk-instruction-used-outside-of-loop.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
pr54413-select-interleave-count-loop-with-cost-zero.ll
…
pr54634.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
pr55096-scalarize-add.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll
…
pr72969.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
pr81872.ll
[VPlan] Directly unroll VectorEndPointerRecipe (#172372)
2026-02-16 09:59:55 +00:00
pr109581-unused-blend.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
pr131359-dead-for-splice.ll
[VPlan] Add nuw to unrolled canonical IVs (#183716)
2026-02-27 11:46:29 +00:00
pr141968-instsimplifyfolder.ll
[VPlan] Run initial recipe simplification on VPlan0. (#176828)
2026-02-13 12:01:22 +00:00
predicate-switch.ll
[VPlan] Explicitly reassociate header mask in logical and (#180898)
2026-02-12 14:56:15 +00:00
predicated-instruction-cost.ll
[VPlan] Skip gather/scatters in useEmulatedMaskMemRefHack.
2026-02-16 21:01:16 +00:00
predicated-udiv.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
propagate-metadata.ll
…
ptr-indvar-crash.ll
…
rauw-bug.ll
[LV][NFC] Remove undef from phi incoming values (#163762)
2025-10-21 10:49:27 +01:00
reduction-crash.ll
Reapply "[VPlan] Detect and create partial reductions in VPlan. (NFCI) (#167851)"
2026-02-01 16:27:27 +00:00
reduction-fastmath.ll
[IVDescriptors] Remove function FMF attribute check for FP min/max reduction (#183523)
2026-03-02 08:31:46 +00:00
reduction-small-size.ll
[VPlan] Include flags in VectorPointerRecipe::printRecipe (#169466)
2025-11-25 10:26:51 +00:00
redundant-vf2-cost.ll
…
reg-usage-debug.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
reg-usage.ll
…
register-assumption.ll
…
replicate-recipe-with-only-first-lane-used.ll
[VPlan] Sink recipes from the vector loop region in licm. (#168031)
2026-02-03 07:57:15 +00:00
replicate-uniform-call.ll
Reapply "[VPlan] Remove legacy costing inside VPBlendRecipe::computeCost (#171846)" (#172261)
2025-12-16 06:30:54 +00:00
replicating-load-store-costs-max-bandwidth.ll
[VPlan] Match legacy behavior w.r.t. using pointer phis as scalar addrs.
2025-10-20 11:09:25 +01:00
replicating-load-store-costs.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
runtime-limit.ll
[LV][NFC] Remove undef from function return values (#163578)
2025-10-16 09:49:38 +01:00
scatter_crash.ll
Reapply "[LV] Simplify and unify resume value handling for epilogue vec." (#187504)
2026-03-23 22:09:40 +00:00
scev-checks-unprofitable.ll
[VPlan] Don't preserve LCSSA in expandSCEVs. (#165505)
2025-10-29 18:25:46 +00:00
slm-no-vectorize.ll
…
small-size.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
strided_load_cost.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
struct-store.ll
…
svml-calls-finite.ll
…
svml-calls.ll
…
tail_folding_and_assume_safety.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
tail_loop_folding.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
transform-narrow-interleave-to-widen-memory-epilogue-vec.ll
[LV] Add epilogue minimum iteration check in VPlan as well. (#189372)
2026-04-01 15:47:41 +01:00
transform-narrow-interleave-to-widen-memory-gaps.ll
Reland [VPlan] Expand WidenInt inductions with nuw/nsw (#168354)
2025-11-17 13:44:25 +00:00
transform-narrow-interleave-to-widen-memory-live-outs.ll
[VPlan] Materialize VectorTripCount in narrowInterleaveGroups. (#182146)
2026-03-10 12:33:30 +00:00
transform-narrow-interleave-to-widen-memory.ll
Reapply "[LV] Simplify and unify resume value handling for epilogue vec." (#187504)
2026-03-23 22:09:40 +00:00
tripcount.ll
…
uint64_to_fp64-cost-model.ll
…
uniform_load.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
uniform_mem_op.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
uniform-phi.ll
…
uniformshift.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
unroll_selection.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
unroll-pm.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
unroll-small-loops.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
veclib-calls.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
vect.omp.force.ll
…
vect.omp.force.small-tc.ll
[VPlan] Use DL index type consistently for GEPs (#169396)
2025-11-26 12:25:55 +00:00
vector_max_bandwidth.ll
…
vector_ptr_load_store.ll
…
vector-scalar-select-cost.ll
[VPlan] Remove VPWidenSelectRecipe, use VPWidenRecipe instead (NFCI). (#174234)
2026-01-05 22:33:37 +00:00
vectorization-remarks-loopid-dbg.ll
…
vectorization-remarks-missed.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
vectorization-remarks-profitable.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
vectorization-remarks.ll
…
vectorize-force-tail-with-evl.ll
Revert "[VPlan] Don't drop NUW flag on tail folded canonical IVs (#183301)" (#183698)
2026-02-27 09:13:33 +00:00
vectorize-interleaved-accesses-gap.ll
[IR] Replace alignment argument with attribute on masked intrinsics (#163802)
2025-10-20 08:50:09 +00:00
vectorize-only-for-real.ll
…
vplan-native-inner-loop-only.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
vplan-single-bit-ind-var-width-4.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
vplan-single-bit-ind-var.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
widened-value-used-as-scalar-and-first-lane.ll
[VPlan] Add nuw to unrolled canonical IVs (#183716)
2026-02-27 11:46:29 +00:00
x86_fp80-interleaved-access.ll
[LV][NFC] Remove undef from phi incoming values (#163762)
2025-10-21 10:49:27 +01:00
x86_fp80-vector-store.ll
[VPlan] Replicate VPScalarIVStepsRecipe by VF outside replicate regions. (#170053)
2026-03-05 12:42:20 +00:00
x86-interleaved-accesses-masked-group.ll
Reapply "[VPlan] Explicitly unroll replicate-regions without live-outs by VF." (#188947)
2026-03-27 12:19:58 +00:00
x86-interleaved-store-accesses-with-gaps.ll
[LV][NFC] Remove more function attributes from tests (#188185)
2026-03-31 09:56:17 +01:00
x86-pr39099.ll
[LV][NFC] Remove some unused attributes from tests (#188091)
2026-03-24 06:52:31 +00:00
x86-predication.ll
Reland [VPlan] Expand WidenInt inductions with nuw/nsw (#168354)
2025-11-17 13:44:25 +00:00