Florian Hahn 6a8d5f22ff

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute. ...

This updates VPWidenPointerInductionRecipe::execute to not use the
canonical IV to determine the insert point. Instead, it relies on the
current recipe position. In cases where this is not sufficient, set the
insert point to the first non-phi instruction, to ensure phis are
created together.

2025-03-15 21:32:48 +00:00

..

aarch64-predication.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

aarch64-unroll.ll

…

arbitrary-induction-step.ll

[VPlan] Implement unrolling as VPlan-to-VPlan transform. (#95842)

2024-09-21 19:47:37 +01:00

arith-fp-frem-costs.ll

[LoopVectorize][NFC] Fix arith-fp-frem-costs.ll test to use new vplan cost model (#120742)

2025-01-06 10:26:51 +00:00

arm64-unroll.ll

…

backedge-overflow.ll

…

blend-costs.ll

[AArch64][CostModel] Alter sdiv/srem cost where the divisor is constant (#123552)

2025-03-09 22:26:39 -07:00

call-costs.ll

[VPlan] Remove loop region in optimizeForVFAndUF. (#108378)

2025-01-05 15:50:42 +00:00

clamped-trip-count.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

conditional-branches-cost.ll

[LV] Strip unreachable SCEV-check blocks (#130079)

2025-03-06 19:30:25 +00:00

cost-no-valid-vplans-built.ll

…

deterministic-type-shrinkage.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

divs-with-scalable-vfs.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

drop-poison-generating-flags.ll

[VPlan] Check VPWidenIntrinsicSC in VPRecipeWithIRFlags::classof.

2025-02-01 21:42:19 +00:00

early_exit_costs.ll

[LV][NFC] Refactor code for extracting first active element (#131118)

2025-03-14 11:14:09 +00:00

eliminate-tail-predication.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

epilog-vectorization-factors.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

epilog-vectorization-widen-inductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

extend-vectorization-factor-for-unprofitable-memops.ll

…

extractvalue-no-scalarization-required.ll

[VPlan] Restrict hoisting of broadcast operations using VPDominatorTree (#117138)

2025-03-13 07:16:04 -07:00

first-order-recurrence-fold-tail.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

first-order-recurrence.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

fixed-order-recurrence.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

force-target-instruction-cost.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

fully-unrolled-cost.ll

[AArch64] Improve getPartialReductionCost for fixed-width VFs (#126538)

2025-02-11 15:10:39 +00:00

gather-cost.ll

…

gather-do-not-vectorize-addressing.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

i1-reg-usage.ll

…

induction-costs-sve.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

induction-costs.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

induction-trunc.ll

…

interleave_count_for_estimated_tc.ll

[LoopUtils] Don't wrap in getLoopEstimatedTripCount (#129080)

2025-03-04 08:43:08 +00:00

interleave_count_for_known_tc.ll

…

interleave-allocsize-not-equal-typesize.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

interleaved_cost.ll

[LoopVectorize] Make needsExtract notice scalarized instructions (#119720)

2025-01-02 14:31:36 +00:00

interleaved-store-of-first-order-recurrence.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved-vs-scalar.ll

[LV] Assign cost to all interleave members when not interleaving.

2024-09-11 21:04:34 +01:00

interleaving-load-store.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

interleaving-reduction.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

intrinsiccost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invalid-costs.ll

[VPlan] Return cost of PHI for scalar VFs in computeCost for FORs.

2024-11-21 21:11:21 +00:00

invariant-replicate-region.ll

[VPlan] Use State.get to extract lane mask for BranchOnMask.

2025-01-27 21:35:36 +00:00

lit.local.cfg

…

loop-vectorization-factors.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

loopvectorize_pr33804_double.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

low_trip_count_predicates.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

low_trip_memcheck_cost.ll

[LoopUtils] Saturate at INT_MAX when estimating TC (#129683)

2025-03-05 18:19:39 +00:00

masked-call.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

masked-op-cost.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

max-vf-for-interleaved.ll

…

maximize-bandwidth-invalidate.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

mul-simplification.ll

[VPlan] Only use SCEV for live-ins in tryToWiden. (#125436)

2025-02-03 17:01:02 +00:00

multiple-result-intrinsics.ll

[LV] Teach the vectorizer to cost and vectorize modf and sincospi intrinsics (#129064)

2025-02-28 12:56:12 +00:00

neon-gather-cost.ll

…

neoverse-epilogue-vect.ll

[AArch64][LV] Set MaxInterleaving to 4 for Neoverse V2 and V3 (#100385)

2024-11-20 09:33:39 +00:00

no_vector_instructions.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

nontemporal-load-store.ll

…

optsize_minsize.ll

[LV] Fix tests after 8150ab93f741.

2025-02-27 12:15:24 +00:00

outer_loop_prefer_scalable.ll

[VPlan] Omit zero add in VPWidenIntOrFpInductionRecipe (#119668)

2024-12-16 11:55:48 +08:00

outer_loop_test1_no_explicit_vect_width.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

Oz-and-forced-vectorize.ll

…

partial-reduce-chained.ll

[LoopVectorizer][AArch64] Add support for partial reduce subtraction (#123636)

2025-02-13 10:35:45 +00:00

partial-reduce-dot-product-epilogue.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

partial-reduce-dot-product-mixed.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

partial-reduce-dot-product-neon.ll

[LoopVectorizer] Allow partial reductions to be made in predicated loops (#124268)

2025-02-07 09:09:10 +00:00

partial-reduce-dot-product.ll

[AArch64] Improve getPartialReductionCost for fixed-width VFs (#126538)

2025-02-11 15:10:39 +00:00

partial-reduce-no-dotprod.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

partial-reduce-sub.ll

[LoopVectorizer][AArch64] Add support for partial reduce subtraction (#123636)

2025-02-13 10:35:45 +00:00

pr31900.ll

…

pr33053.ll

…

pr36032.ll

…

pr46950-load-cast-context-crash.ll

…

pr56627.ll

…

pr60831-sve-inv-store-crash.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr73894.ll

[VPlan] Remove VPPredInstPHIRecipes without users after region merging.

2024-07-20 13:21:32 +01:00

predication_costs.ll

…

prefer-fixed-if-equal-to-scalable.ll

[AArch64] Enable UseFixedOverScalableIfEqualCost for more Cortex-x cpus. (#122807)

2025-01-20 15:05:15 +00:00

reduction-recurrence-costs-sve.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

reduction-small-size.ll

…

reg-usage.ll

…

runtime-check-size-based-threshold.ll

…

runtime-check-trip-count-decisions.ll

…

scalable-alloca.ll

[VPlan] Port invalid cost remarks to VPlan. (#99322)

2024-07-27 12:52:12 +01:00

scalable-avoid-scalarization.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

scalable-call.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

scalable-fp-ext-trunc-illegal-type.ll

[VPlan] Propagate all GEP flags (#119899)

2024-12-17 13:48:50 +01:00

scalable-predicate-instruction.ll

…

scalable-reduction-inloop-cond.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

scalable-reductions-tf.ll

…

scalable-reductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

scalable-strict-fadd.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

scalable-struct-return.ll

[LV] Add initial support for vectorizing literal struct return values (#109833)

2025-02-17 09:51:35 +00:00

scalable-vectorization-cost-tuning.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

scalable-vectorization.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

scalable-vf-hint.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

scalar_interleave.ll

…

scalarize-store-with-predication.ll

…

sdiv-pow2.ll

…

select-costs.ll

Recommit "[LV][VPlan] Remove any-of reduction from precomputeCost. NFC (#117109)" (#117289)

2024-11-28 15:07:36 +08:00

simple_early_exit.ll

[LoopVectorize] Further improve cost model for early exit loops (#126235)

2025-03-11 11:48:55 +00:00

smallest-and-widest-types.ll

…

sme-vectorize.ll

…

store-costs-sve.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

streaming-compatible-sve-no-maximize-bandwidth.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

streaming-vectorization.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

strict-fadd-cost.ll

…

strict-fadd-vf1.ll

…

strict-fadd.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

struct-return-cost.ll

[LV] Add initial support for vectorizing literal struct return values (#109833)

2025-02-17 09:51:35 +00:00

sve2-histcnt-epilogue.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve2-histcnt-no-scalar-interleave.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve2-histcnt-outerloop-scevaddrec.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

sve2-histcnt-too-many-deps.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve2-histcnt-vplan.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

sve2-histcnt.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-basic-vec.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-cond-inv-loads.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve-epilog-vect-inloop-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-strict-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-vscale-tune.ll

[AArch64][LV] Set MaxInterleaving to 4 for Neoverse V2 and V3 (#100385)

2024-11-20 09:33:39 +00:00

sve-epilog-vect.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-extract-last-veclane.ll

…

sve-fneg.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-gather-scatter-cost.ll

[LAA] Don't require Stride == 1/-1 for inbounds pointer AddRecs nowrap. (#113126)

2024-11-05 22:45:56 +01:00

sve-gather-scatter.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve-illegal-type.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

sve-inductions-unusual-types.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-inductions.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

sve-interleaved-accesses-cost.ll

[LV] Add test showing cost-model difference after 9491f75e1d9.

2025-01-21 21:37:51 +00:00

sve-interleaved-accesses.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

sve-interleaved-masked-accesses.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

sve-inv-loads.ll

[VPlan] Add initial loop-invariant code motion transform. (#107894)

2024-09-20 11:22:03 +01:00

sve-inv-store.ll

…

sve-invalid-costs.ll

…

sve-large-strides.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-live-out-pointer-induction.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-low-trip-count.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-masked-loadstore.ll

…

sve-multiexit.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-runtime-check-size-based-threshold.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-scalable-load-in-loop.ll

…

sve-select-cmp.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

sve-strict-fadd-cost.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

sve-tail-folding-cost.ll

…

sve-tail-folding-forced.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-tail-folding-option.ll

Prefer use of 0.0 over -0.0 for fadd reductions w/nsz (in IR) (#106770)

2024-09-03 09:16:37 -07:00

sve-tail-folding-optsize.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-overflow-checks.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-reductions.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-unroll.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

sve-type-conv.ll

…

sve-vector-reverse-mask4.ll

…

sve-vector-reverse.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-vfabi.ll

…

sve-widen-extractvalue.ll

[VPlan] Restrict hoisting of broadcast operations using VPDominatorTree (#117138)

2025-03-13 07:16:04 -07:00

sve-widen-gep.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

sve-widen-phi.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

synthesize-mask-for-call.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

tail-fold-uniform-memops.ll

Revert "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-03-07 21:18:49 +00:00

tail-folding-styles.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

transform-narrow-interleave-to-widen-memory-constant-ops.ll

[LV] Add additional tests for narrowing interleave groups.

2025-03-15 21:13:49 +00:00

transform-narrow-interleave-to-widen-memory.ll

[LV] Add more tests for narrowing interleave groups for AArch64.

2025-01-26 13:52:18 +00:00

type-shrinkage-insertelt.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

type-shrinkage-zext-costs.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

uniform-args-call-variants.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

unsafe-vf-hint-remark.ll

…

veclib-calls-libsystem-darwin.ll

[aarch64] atan2 intrinsic lowering (p5) (#112611)

2024-10-24 17:53:12 -07:00

veclib-function-calls.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

veclib-intrinsic-calls.ll

[aarch64] atan2 intrinsic lowering (p5) (#112611)

2024-10-24 17:53:12 -07:00

vector-call-linear-args.ll

[LAA] Don't assume libcalls with output/input pointers can be vectorized (#108980)

2024-09-23 16:05:55 +01:00

vector-reverse-mask4.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

vector-reverse.ll

…

vplan-printing.ll

[VPlan] Use VPInstruction for VPScalarPHIRecipe. (NFCI) (#129767)

2025-03-13 18:35:07 +00:00

widen-call-with-intrinsic-or-libfunc.ll

[FMF] Set all bits if needed when setting individual flags. (#131321)

2025-03-15 18:46:26 +00:00

wider-VF-for-callinst.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00