Florian Hahn 6a8d5f22ff

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute. ...

This updates VPWidenPointerInductionRecipe::execute to not use the
canonical IV to determine the insert point. Instead, it relies on the
current recipe position. In cases where this is not sufficient, set the
insert point to the first non-phi instruction, to ensure phis are
created together.

2025-03-15 21:32:48 +00:00

..

CostModel

[LV][X86] Regenerate interleaved load/store costs. NFC.

2025-02-09 15:02:41 +00:00

already-vectorized.ll

…

amdlibm-calls-finite.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

amdlibm-calls.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

avx1.ll

…

avx512.ll

…

consecutive-ptr-cg-bug.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

consecutive-ptr-uniforms.ll

[LV] Use IVUpdateMayOverflow to set HasNUW. (#111758)

2024-11-28 10:12:41 +00:00

constant-fold.ll

[VPlan] Remove loop region in optimizeForVFAndUF. (#108378)

2025-01-05 15:50:42 +00:00

constant-vector-operand.ll

…

conversion-cost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

cost-constant-known-via-scev.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

cost-model-assert.ll

…

cost-model.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

divs-with-tail-folding.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

drop-inbounds-flags-for-reverse-vector-pointer.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

drop-poison-generating-flags.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

ephemeral-recipes.ll

[VPlan] Don't add live-outs for IV phis.

2024-07-14 20:49:03 +01:00

epilog-vectorization-inductions.ll

[VPlan] Also introduce explicit broadcasts for values from entry VPBB.

2025-03-12 22:03:19 +00:00

fixed-order-recurrence.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

float-induction-x86.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

fneg-cost.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

fp32_to_uint32-cost-model.ll

…

fp64_to_uint32-cost-model.ll

…

fp80-widest-type.ll

…

fp_to_sint8-cost-model.ll

…

funclet.ll

…

gather_scatter.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

gather-cost.ll

…

gather-vs-interleave.ll

…

gcc-examples.ll

…

gep-use-outside-loop.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

i1-reg-usage.ll

…

illegal-parallel-loop-uniform-write.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

imprecise-through-phis.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

induction-costs.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

induction-step.ll

[VPlan] Also introduce explicit broadcasts for values from entry VPBB.

2025-03-12 22:03:19 +00:00

int128_no_gather.ll

…

interleave_short_tc.ll

…

interleave-cost.ll

[LAA] Always require non-wrapping pointers for runtime checks. (#127543)

2025-02-20 19:00:23 +01:00

interleave-opaque-pointers.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleave-ptradd-with-replicated-operand.ll

[VPlan] Request lane 0 for pointer arg in PtrAdd.

2024-10-09 13:18:54 +01:00

interleaved-accesses-hoist-load-across-store.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved-accesses-large-gap.ll

…

interleaved-accesses-sink-store-across-load.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

interleaved-accesses-use-after-free.ll

…

interleaved-accesses-waw-dependency.ll

…

interleaving.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

intrinsiccost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invariant-load-gather.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invariant-store-vectorization.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

iv-live-outs.ll

[VPlan] Unify mayWriteToMemory and mayHaveSideEffects logic for VPInst.

2024-09-26 19:16:43 +01:00

libm-vector-calls-finite.ll

…

libm-vector-calls-VF2-VF8.ll

…

libm-vector-calls.ll

…

limit-vf-by-tripcount.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

lit.local.cfg

…

load-deref-pred.ll

[VPlan] Use State.get to extract lane mask for BranchOnMask.

2025-01-27 21:35:36 +00:00

masked_load_store.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

masked-store-cost.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

max-mstore.ll

…

metadata-enable.ll

[VPlan] Propagate all GEP flags (#119899)

2024-12-17 13:48:50 +01:00

min-trip-count-switch.ll

…

mul_slm_16bit.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

multi-exit-cost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

no_fpmath_with_hotness.ll

…

no_fpmath.ll

…

no-vector.ll

…

nontemporal.ll

…

optsize.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

outer_loop_test1_no_explicit_vect_width.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

parallel-loops-after-reg2mem.ll

…

parallel-loops.ll

…

pointer-runtime-checks-unprofitable.ll

[LV] Add uses of result to pointer-runtime-checks-unprofitable.ll test.

2024-07-15 09:59:46 +01:00

powof2div.ll

…

pr23997.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr34438.ll

[VPlan] Remove loop region in optimizeForVFAndUF. (#108378)

2025-01-05 15:50:42 +00:00

pr35432.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr36524.ll

[LV] Strip unreachable SCEV-check blocks (#130079)

2025-03-06 19:30:25 +00:00

pr39160.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

pr42674.ll

[ConstantFolding] Infer getelementptr nuw flag (#119214)

2024-12-09 16:44:05 +01:00

pr47437.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr48340.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

pr51366-sunk-instruction-used-outside-of-loop.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

pr54413-select-interleave-count-loop-with-cost-zero.ll

…

pr54634.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

pr55096-scalarize-add.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr72969.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr81872.ll

[LV] Use IVUpdateMayOverflow to set HasNUW. (#111758)

2024-11-28 10:12:41 +00:00

pr109581-unused-blend.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

predicate-switch.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

predicated-instruction-cost.ll

[LV] Generalize predication checks from 2c8836c899 for operands.

2024-10-02 20:16:41 +01:00

propagate-metadata.ll

…

ptr-indvar-crash.ll

…

rauw-bug.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

reduction-crash.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

reduction-fastmath.ll

[LV][VPlan] Add fast flags for selectRecipe (#121023)

2025-01-15 10:10:11 +08:00

reduction-small-size.ll

[VPlan] Remove stray space when printing VPWidenCastRecipe.

2024-12-24 20:23:48 +00:00

redundant-vf2-cost.ll

Fix test failures introduced by PR #113697 (#116941)

2024-11-20 09:10:51 +00:00

reg-usage-debug.ll

…

reg-usage.ll

…

register-assumption.ll

…

replicate-recipe-with-only-first-lane-used.ll

[VPlan] Only generate first lane for VPPredInstPHI if no others used.

2024-10-05 19:15:05 +01:00

replicate-uniform-call.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

runtime-limit.ll

…

scatter_crash.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

scev-checks-unprofitable.ll

[VPlan] Only skip expansion for SCEVUnknown if it isn't an instruction. (#125235)

2025-02-11 13:03:12 +01:00

slm-no-vectorize.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

small-size.ll

[VPlan] Create IR basic block for middle.block in VPlan.

2025-02-15 21:54:16 +01:00

strided_load_cost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

struct-store.ll

…

svml-calls-finite.ll

…

svml-calls.ll

…

tail_folding_and_assume_safety.ll

…

tail_loop_folding.ll

[LV] Use IVUpdateMayOverflow to set HasNUW. (#111758)

2024-11-28 10:12:41 +00:00

transform-narrow-interleave-to-widen-memory-gaps.ll

[LV] Add additional tests for narrowing interleave groups.

2025-03-15 21:13:49 +00:00

transform-narrow-interleave-to-widen-memory.ll

[LV] Precommit tests for #106441.

2025-01-10 18:49:44 +00:00

tripcount.ll

…

uint64_to_fp64-cost-model.ll

[VPlan] Remove stray space when printing VPWidenCastRecipe.

2024-12-24 20:23:48 +00:00

uniform_load.ll

…

uniform_mem_op.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

uniform-phi.ll

[LV] Don't consider IV increments uniform if exit value is used outside.

2025-01-12 22:03:21 +00:00

uniformshift.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

unroll_selection.ll

…

unroll-pm.ll

…

unroll-small-loops.ll

…

veclib-calls.ll

[X86][LoopVectorize] Add support for arc and hyperbolic trig functions (#99383)

2024-07-28 20:57:43 -04:00

vect.omp.force.ll

…

vect.omp.force.small-tc.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

vector_max_bandwidth.ll

…

vector_ptr_load_store.ll

…

vector-scalar-select-cost.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

vectorization-remarks-loopid-dbg.ll

…

vectorization-remarks-missed.ll

[LV] Only check isVectorizableEarlyExitLoop with multiple exits. (#121994)

2025-01-09 12:05:19 +00:00

vectorization-remarks-profitable.ll

…

vectorization-remarks.ll

…

vectorize-force-tail-with-evl.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

vectorize-interleaved-accesses-gap.ll

[LV] Use IVUpdateMayOverflow to set HasNUW. (#111758)

2024-11-28 10:12:41 +00:00

vectorize-only-for-real.ll

…

vplan-native-inner-loop-only.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

vplan-vp-intrinsics.ll

[VPlan] Use VPInstruction::Name when assigning names (NFCI).

2024-10-18 05:52:35 +01:00

widened-value-used-as-scalar-and-first-lane.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

x86_fp80-interleaved-access.ll

…

x86_fp80-vector-store.ll

Revert "[InstCombine] Infer nuw for gep inbounds from base of object" (#120460)

2024-12-18 19:06:34 +01:00

x86-interleaved-accesses-masked-group.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

x86-interleaved-store-accesses-with-gaps.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

x86-pr39099.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

x86-predication.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00