David Sherwood 13d8ba7dea

[LV][TTI] Calculate cost of extracting last index in a scalable vector (#144086) ...

There are a couple of places in the loop vectoriser where we
want to calculate the cost of extracting the last lane in a
vector. However, we wrongly assume that asking for the cost
of extracting lane (VF.getKnownMinValue() - 1) is an accurate
representation of the cost of extracting the last lane. For
SVE at least, this is non-trivial as it requires the use of
whilelo and lastb instructions.

To solve this problem I have added a new
getReverseVectorInstrCost interface where the index is used
in reverse from the end of the vector. Suppose a vector has
a given ElementCount EC, the extracted/inserted lane would be
EC - 1 - Index. For scalable vectors this index is unknown at
compile time. I've added a AArch64 hook that better represents
the cost, and also a RISCV hook that maintains compatibility
with the behaviour prior to this PR.

I've also taken the liberty of adding support in vplan for
calculating the cost of VPInstruction::ExtractLastElement.

2025-08-19 09:31:37 +01:00

..

AArch64

[LV][TTI] Calculate cost of extracting last index in a scalable vector (#144086)

2025-08-19 09:31:37 +01:00

AMDGPU

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

ARM

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

Hexagon

[IR] Remove size argument from lifetime intrinsics (#150248)

2025-08-08 11:09:34 +02:00

LoongArch

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

PowerPC

[IR] Remove size argument from lifetime intrinsics (#150248)

2025-08-08 11:09:34 +02:00

RISCV

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

SystemZ

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

VE

…

WebAssembly

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

X86

[LV] Emit all remarks for unvectorizable instructions (#153833)

2025-08-18 18:04:53 +01:00

XCore

…

12-12-11-if-conv.ll

…

2012-10-20-infloop.ll

…

2012-10-22-isconsec.ll

…

2016-07-27-loop-vec.ll

…

alias-set-with-uncomputable-bounds.ll

…

align.ll

…

as_cast.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

assume.ll

[LV] Improve a test; get rid of runtime checks (#152182)

2025-08-05 18:48:10 +01:00

blend-in-header.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

branch-weights.ll

[LV] Fix branch weights in epilogue min iteration check block (#152534)

2025-08-11 09:52:54 +01:00

bsd_regex.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

bzip_reverse_loops.ll

…

calloc.ll

…

cast-induction.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

check-no-vectorize.ll

…

check-prof-info.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

conditional-assignment.ll

…

consec_no_gep.ll

…

consecutive-ptr-uniforms.ll

[InstCombine] Strip trailing zero GEP indices (#151338)

2025-07-30 17:55:00 +02:00

constantfolder-infer-correct-gepty.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

constantfolder.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

control-flow.ll

…

cpp-new-array.ll

…

create-induction-resume.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

dbg-outer-loop-vect.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

dbg.value.ll

…

dead_instructions.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

debugloc-optimize-vfuf-term.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

debugloc.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

demanded-bits-of-pointer-instruction.ll

…

dereferenceable-info-from-assumption-constant-size.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

dereferenceable-info-from-assumption-variable-size.ll

[Loads] Precommit tests for #149551. NFC

2025-08-06 15:43:51 -04:00

diag-missing-instr-debug-loc.ll

…

diag-with-hotness-info-2.ll

…

diag-with-hotness-info.ll

…

disable_nonforced_enable.ll

…

disable_nonforced.ll

…

discriminator.ll

[Verifier] Require that dbg.declare variable is a ptr (#134355)

2025-04-04 15:34:45 +02:00

dont-fold-tail-for-const-TC.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

dont-fold-tail-for-divisible-TC.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

early_exit_legality.ll

[LV] Enable auto-vectorisation of loops with uncountable exits (#133099)

2025-06-27 10:39:33 +01:00

early_exit_store_legality.ll

[Loads] Support dereferenceable assumption with variable size. (#128436)

2025-07-14 08:17:33 +01:00

ee-crash.ll

…

epilog-iv-select-cmp.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

epilog-vectorization-any-of-reductions.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

epilog-vectorization-reductions.ll

[VPlan] Ensure that IV resume phi for epilogue is always first. (NFCI)

2025-08-05 21:06:41 +01:00

epilog-vectorization-trunc-induction-steps.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

epilog-vectorization-vector-trip-count-zero.ll

…

exact.ll

…

expand-scev-after-invoke.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

explicit_outer_detection.ll

…

explicit_outer_nonuniform_inner.ll

…

explicit_outer_uniform_diverg_branch.ll

…

extract-from-end-vector-constant.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

extract-last-veclane.ll

…

fcmp-vectorize.ll

…

first-order-recurrence-chains-vplan.ll

[VPlan] Use regular phi printing for resume phis.

2025-06-07 21:49:54 +01:00

first-order-recurrence-chains.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

first-order-recurrence-complex.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

first-order-recurrence-dead-instructions.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

first-order-recurrence-interleave-only.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

first-order-recurrence-multiply-recurrences.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

first-order-recurrence-scalable-vf1.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

first-order-recurrence-sink-replicate-region.ll

[LV] Replace redundant ExtractLastElement of reduction result (NFC).

2025-06-24 21:48:58 +01:00

first-order-recurrence.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

fix-reduction-dbg.ll

…

fixed-order-recurrences-memory-instructions.ll

…

flags.ll

…

float-induction.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

float-minmax-instruction-flag.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

float-reduction.ll

…

fmax-without-fast-math-flags-interleave.ll

[LV] Generate scalar xor for VPInstruction::Not if possible. (#152628)

2025-08-11 16:35:21 +08:00

fmax-without-fast-math-flags.ll

[LV] Generate scalar xor for VPInstruction::Not if possible. (#152628)

2025-08-11 16:35:21 +08:00

fmin-without-fast-math-flags.ll

[LV] Generate scalar xor for VPInstruction::Not if possible. (#152628)

2025-08-11 16:35:21 +08:00

fneg.ll

…

followup.ll

…

forked-pointers.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

fpsat.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

funcall.ll

…

gcc-examples.ll

…

gep_with_bitcast.ll

…

global_alias.ll

Reapply "[LAA] Remove loop-invariant check added in 234cc40adc61."

2025-07-14 21:21:22 +01:00

hints-trans.ll

…

histograms.ll

[CostModel] Provide a default model for histogram intrinsics (#149348)

2025-08-08 11:00:00 +01:00

hoist-loads.ll

…

i8-induction.ll

…

icmp-uniforms.ll

[VPlan] Connect Entry to scalar preheader during initial construction. (#140132)

2025-05-27 16:07:56 +01:00

if-conv-crash.ll

…

if-conversion-edgemasks.ll

…

if-conversion-nest.ll

[VPlan] Use VPlan operand order for VPBlendRecipes. (#139475)

2025-05-14 14:56:35 +01:00

if-conversion-reduction.ll

…

if-conversion.ll

…

if-pred-non-void.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

if-pred-not-when-safe.ll

…

if-pred-stores.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

if-reduction.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

incorrect-dom-info.ll

…

increment.ll

…

induction_plus.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

induction-multiple-uses-in-same-instruction.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

induction-ptrcasts.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

induction-step.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

induction-unroll-novec.ll

[LV] Regen a test with UTC (#134076)

2025-04-02 17:23:00 +01:00

induction.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

infiniteloop.ll

…

instruction-only-used-outside-of-loop.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

int_sideeffect.ll

…

interleave-and-scalarize-only.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

interleave-with-i65-induction.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

interleaved-accesses-1.ll

…

interleaved-accesses-2.ll

…

interleaved-accesses-3.ll

…

interleaved-accesses-different-insert-position.ll

[VPlan] Preserve nusw in createInBoundsPtrAdd (#151549)

2025-08-18 17:48:42 +01:00

interleaved-accesses-gep-nowrap-flags.ll

[VPlan] Preserve nusw in createInBoundsPtrAdd (#151549)

2025-08-18 17:48:42 +01:00

interleaved-accesses-masked-group.ll

…

interleaved-accesses-max-dependences.ll

…

interleaved-accesses-metadata.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

interleaved-accesses-pred-stores.ll

[InstCombine] Strip trailing zero GEP indices (#151338)

2025-07-30 17:55:00 +02:00

interleaved-accesses-uniform-load.ll

…

interleaved-accesses.ll

[InstCombine] Strip trailing zero GEP indices (#151338)

2025-07-30 17:55:00 +02:00

interleaved-acess-with-remarks.ll

…

intrinsic.ll

Reland [VectorUtils] Trivially vectorize ldexp, [l]lround (#152476)

2025-08-07 12:07:29 +01:00

invalidate-scev-at-scope-after-vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

invariant-store-vectorization-2.ll

[VPlan] Unroll VPReplicateRecipe by VF. (#142433)

2025-06-26 11:19:09 +01:00

invariant-store-vectorization.ll

…

irregular_type.ll

…

is_fpclass.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

iv_outside_user.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

iv-select-cmp-blend.ll

…

iv-select-cmp-decreasing.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

iv-select-cmp-nested-loop.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

iv-select-cmp-no-wrap.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

iv-select-cmp-non-const-iv-start.ll

…

iv-select-cmp-trunc.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

iv-select-cmp.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

lcssa-crashes.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

libcall-remark.ll

…

lifetime.ll

[IR] Remove size argument from lifetime intrinsics (#150248)

2025-08-08 11:09:34 +02:00

load-deref-pred-align.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

load-deref-pred-neg-off.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

load-deref-pred-poison-ub-ops-feeding-pointer.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

load-of-struct-deref-pred.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

loop-form.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

loop-legality-checks.ll

…

loop-scalars.ll

…

loop-vect-memdep.ll

…

loop-vect-option.ll

…

loop-with-constant-exit-condition.ll

…

make-followup-loop-id.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

memdep-fold-tail.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

memdep.ll

…

memory-dep-remarks.ll

…

metadata-unroll.ll

…

metadata-width.ll

…

metadata.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

middle-block-dbg.ll

…

min-trip-count-known-via-scev.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

minimumnum-maximumnum-reductions.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

miniters.ll

…

minmax_reduction.ll

[LV] Vectorize maxnum/minnum w/o fast-math flags. (#148239)

2025-07-18 21:58:19 +01:00

mixed-precision-remarks.ll

…

multi_early_exit_live_outs.ll

[LV] Enable auto-vectorisation of loops with uncountable exits (#133099)

2025-06-27 10:39:33 +01:00

multi_early_exit.ll

[LV] Enable auto-vectorisation of loops with uncountable exits (#133099)

2025-06-27 10:39:33 +01:00

multi-use-reduction-bug.ll

…

multiple-address-spaces.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

multiple-exits-versioning.ll

…

multiple-result-intrinsics.ll

…

multiple-strides-vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

narrow-to-single-scalar.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

no_array_bounds_scalable.ll

…

no_array_bounds.ll

…

no_idiv_reduction.ll

…

no_int_induction.ll

…

no_outside_user.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

no_switch_disable_vectorization.ll

…

no_switch.ll

…

no-fold-tail-by-masking-iv-external-uses.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

no-interleave-up-front.ll

…

noalias-md-licm.ll

…

noalias-md.ll

…

noalias-scope-decl.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

nofloat-report.ll

…

nofloat.ll

…

non-const-n.ll

…

nontemporal.ll

…

nounroll.ll

…

novect-lcssa-cfg-invalidation.ll

…

nsw-crash.ll

…

nuw.ll

…

opaque-ptr.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

opt.ll

…

optimal-epilog-vectorization-limitations.ll

…

optimal-epilog-vectorization-liveout.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

optimal-epilog-vectorization-scalable.ll

…

optimal-epilog-vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

optsize.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

outer_loop_early_exit.ll

…

outer_loop_hcfg_construction.ll

…

outer_loop_scalable.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

outer_loop_test1.ll

[LV] Regen some tests with UTC (#152128)

2025-08-05 18:01:02 +01:00

outer_loop_test2.ll

…

outer-loop-inner-latch-successors.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

outer-loop-vec-phi-predecessor-order.ll

[VPlan] Use scalar VPPhi instead of VPWidenPHIRecipe in createPlainCFG. (#150847)

2025-08-06 14:43:03 +01:00

outer-loop-wide-phis.ll

…

partial-lcssa.ll

…

phi-cost.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

phi-hang.ll

…

pointer-induction-index-width-smaller-than-iv-width.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pointer-induction-unroll.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pointer-induction.ll

[VPlan] Support VPWidenPointerInductionRecipes with EVL tail folding (#152110)

2025-08-07 10:54:24 +08:00

pointer-select-runtime-checks.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

pr25281.ll

…

pr28541.ll

…

pr30654-phiscev-sext-trunc.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr30806.ll

…

pr31098.ll

…

pr31190.ll

…

pr32859.ll

…

pr33706.ll

…

pr34681.ll

…

pr35743.ll

…

pr35773.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr36311.ll

…

pr36983-multiple-lcssa.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

pr37248.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

pr37515.ll

…

pr38697.ll

…

pr38800.ll

…

pr39099.ll

…

pr39417-optsize-scevchecks.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr43166-fold-tail-by-masking.ll

…

pr44488-predication.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

pr45259.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr45525.ll

[LV] Regenerate some more tests.

2025-08-14 21:21:03 +01:00

pr45679-fold-tail-by-masking.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

pr46525-expander-insertpoint.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

pr47343-expander-lcssa-after-cfg-update.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pr48832.ll

…

pr50686.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr51614-fold-tail-by-masking.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

pr55100-expand-scev-predicate-used.ll

…

pr55167-fold-tail-live-out.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

pr58811-scev-expansion.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pr59319-loop-access-info-invalidation.ll

…

pr66616.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

pr87407-trunc-with-intrinsic.ll

[LV] Fix MinBWs in WidenIntrinsic case (#137005)

2025-04-29 09:47:38 +01:00

pr125278.ll

[LV] Strip unmaintainable MinBWs assert (#136858)

2025-05-08 11:49:54 +01:00

pr154045-dont-fold-extractelement-livein.ll

[VPlan] Don't fold live ins with both scalar and vector operands (#154067)

2025-08-19 04:10:53 +00:00

predicate-switch.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

predicatedinst-loop-invariant.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

preserve-dbg-loc-and-loop-metadata.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

preserve-dbg-loc-reduction-inloop.ll

…

preserve-or-disjoint.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pseudoprobe.ll

…

ptr_loops.ll

…

ptr-induction.ll

…

read-only.ll

…

reduction-align.ll

…

reduction-inloop-cond.ll

[LV][NFCI] Swap reduction recipe operand order

2025-07-31 14:35:10 +01:00

reduction-inloop-min-max.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

reduction-inloop-pred.ll

[LV][NFCI] Swap reduction recipe operand order

2025-07-31 14:35:10 +01:00

reduction-inloop-uf4.ll

[LV][NFCI] Swap reduction recipe operand order

2025-07-31 14:35:10 +01:00

reduction-inloop.ll

[LV] Create in-loop sub reductions (#147026)

2025-08-12 10:22:41 +01:00

reduction-odd-interleave-counts.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

reduction-order.ll

…

reduction-predselect.ll

[InstCombine] Handle "add like" in ADD+GEP->GEP+GEP rewrites (#135156)

2025-04-14 17:11:13 +02:00

reduction-ptr.ll

…

reduction-small-size.ll

[VPlan] Truncate/Extend ComputeReductionResult at construction (NFC). (#141860)

2025-06-30 22:39:17 +01:00

reduction-with-invariant-store.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

reduction.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

remarks-multi-exit-loops.ll

…

remarks-reduction-inloop.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

remove_metadata.ll

…

reuse-lcssa-phi-scev-expansion.ll

[SCEV] Allow adds of constants in tryToReuseLCSSAPhi. (#150693)

2025-07-31 16:33:25 +01:00

reverse_induction.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

reverse_iter.ll

…

runtime-check-address-space.ll

…

runtime-check-known-true.ll

[LV] Handle known-false mem runtime checks in GeneratedRTChecks.

2025-07-26 15:39:21 +01:00

runtime-check-needed-but-empty.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

runtime-check-pointer-element-type.ll

…

runtime-check-readonly-address-space.ll

…

runtime-check-readonly.ll

[LV] Regenerate some more tests.

2025-08-14 21:21:03 +01:00

runtime-check-small-clamped-bounds.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

runtime-check.ll

[VPlan] Materialize vector trip count using VPInstructions. (#151925)

2025-08-08 11:44:32 +01:00

runtime-checks-difference-simplifications.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

runtime-checks-difference.ll

[LV] Exercise type-mismatch with RT-check conflict rdx (#130295)

2025-04-02 17:22:40 +01:00

runtime-checks-hoist.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

runtime-drop-crash.ll

…

safegep.ll

…

same-base-access.ll

…

scalable-assume.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-first-order-recurrence.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

scalable-inductions.ll

[VPlan] Materialize VF and VFxUF using VPInstructions. (#152879)

2025-08-12 14:13:13 +01:00

scalable-iv-outside-user.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-lifetime.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-loop-unpredicated-body-scalar-tail.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-noalias-scope-decl.ll

…

scalable-predication.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-reduction-inloop.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-trunc-min-bitwidth.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

scalable-vf-hint.ll

…

scalar_after_vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

scalar-select.ll

…

scalarize-masked-call.ll

…

scalarized-bitcast.ll

…

scev-during-mutation.ll

…

scev-exit-phi-invalidation.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

scev-exitlim-crash.ll

…

scev-invalidation.ll

…

scev-predicate-reasoning.ll

[VPlan] Support VPWidenPointerInductionRecipes with EVL tail folding (#152110)

2025-08-07 10:54:24 +08:00

select-cmp-multiuse.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

select-cmp-predicated.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

select-cmp.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

select-index-interleaving.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-neg-cond.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

select-reduction-start-value-may-be-undef-or-poison.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

select-reduction.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

select-smax-last-index.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-smin-last-index.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-umax-last-index.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-umin-first-index.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-umin-last-index.ll

[LV] Reorganize index select tests (NFC).

2025-06-08 22:34:07 +01:00

select-with-fastflags.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

simple-unroll.ll

…

single_early_exit_live_outs.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

single_early_exit_unsafe_ptrs.ll

…

single_early_exit_with_outer_loop.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

single_early_exit.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

single-early-exit-cond-poison.ll

[LV] Add test for #153946.

2025-08-16 21:19:20 +01:00

single-early-exit-deref-assumptions.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

single-early-exit-interleave-hint.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

single-early-exit-interleave.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

single-scalar-cast-minbw.ll

[VPlan] Update type of cloned instruction in scalarizeInstruction.

2025-08-02 19:49:59 +01:00

single-value-blend-phis.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

skeleton-lcssa-crash.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

skip-iterations.ll

…

small-loop.ll

…

smax-idx.ll

…

start-non-zero.ll

…

store-reduction-results-in-tail-folded-loop.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

store-shuffle-bug.ll

…

strict-fadd-interleave-only.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

strided-accesses-interleave-only.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

struct_access.ll

…

struct-return-replicate.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

struct-return.ll

[LV] Add additional tests for replicating calls returning structs.

2025-06-22 13:48:25 +01:00

tail-folding-alloca-in-loop.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

tail-folding-counting-down.ll

[VPlan] Use VPlan operand order for VPBlendRecipes. (#139475)

2025-05-14 14:56:35 +01:00

tail-folding-optimize-vector-induction-width.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

tail-folding-switch.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

tail-folding-vectorization-factor-1.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

tbaa-nodep.ll

…

trip-count-expansion-may-introduce-ub.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

tripcount.ll

…

trunc-extended-icmps.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

trunc-loads-p16.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

trunc-reductions.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

trunc-shifts.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

uitofp-preserve-nneg.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

uncountable-early-exit-vplan.ll

[LV] Enable auto-vectorisation of loops with uncountable exits (#133099)

2025-06-27 10:39:33 +01:00

uncountable-single-exit-loops.ll

…

undef-inst-bug.ll

…

uniform_across_vf_induction1_and.ll

[LV] Fix missing CHECK lines in a test using UTC (#151504)

2025-07-31 14:03:08 +01:00

uniform_across_vf_induction1_div_urem.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

uniform_across_vf_induction1_lshr.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

uniform_across_vf_induction1.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

uniform_across_vf_induction2.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

uniform-args-call-variants.ll

…

uniform-blend.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

unroll_nonlatch.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

unroll_novec.ll

…

unroll-novec-memcheck-metadata.ll

…

unroll.ll

…

unsafe-dep-remark.ll

…

unsafe-vf-hint-remark.ll

…

unsupported_early_exit.ll

[LV] Enable auto-vectorisation of loops with uncountable exits (#133099)

2025-06-27 10:39:33 +01:00

unused-blend-mask-for-first-operand.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

use-iv-start-value.ll

…

use-scalar-epilogue-if-tp-fails.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

value-ptr-bug.ll

…

vect-phiscev-sext-trunc.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vect.omp.persistence.ll

Revert "[PGO] Add llvm.loop.estimated_trip_count metadata" (#151585)

2025-07-31 15:56:31 -04:00

vect.stats.ll

[VPlan] Skip disconnected exit blocks in hasEarlyExit. (#151718)

2025-08-04 11:31:00 +01:00

vector-freeze.ll

…

vector-geps.ll

…

vector-intrinsic-call-cost.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

vector-loop-backedge-elimination-branch-weights.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

vector-loop-backedge-elimination-early-exit.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

vector-loop-backedge-elimination-outside-iv-users.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

vector-loop-backedge-elimination.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

vector-no-scevcheck.ll

…

vector-to-scalar-cast.ll

…

vectorize-force-tail-with-evl.ll

[LV] Use shl for ((VF * Step) * vscale) in createStepForVF. (#153495)

2025-08-14 19:27:51 +01:00

vectorize-once.ll

…

vectorize-pointer-phis.ll

…

vectorizeVFone.ll

…

version-mem-access.ll

…

version-stride-with-integer-casts.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

vplan_hcfg_stress_test.ll

[VPlan] Move plain CFG construction to VPlanConstruction. (NFC)

2025-04-18 21:52:05 +01:00

vplan-dot-printing.ll

[VPlan] Use regular phi printing for resume phis.

2025-06-07 21:49:54 +01:00

vplan-force-tail-with-evl.ll

…

vplan-incomplete-cases.ll

…

vplan-iv-transforms.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

vplan-native-path-inner-loop-with-runtime-checks.ll

…

vplan-outer-loop-uncomputable-trip-count.ll

…

vplan-predicate-switch.ll

[VPlan] Materialize VF and VFxUF using VPInstructions. (#152879)

2025-08-12 14:13:13 +01:00

vplan-printing-before-execute.ll

[VPlan] Materialize VF and VFxUF using VPInstructions. (#152879)

2025-08-12 14:13:13 +01:00

vplan-printing-outer-loop.ll

[VPlan] Use scalar VPPhi instead of VPWidenPHIRecipe in createPlainCFG. (#150847)

2025-08-06 14:43:03 +01:00

vplan-printing-reductions.ll

[VPlan] Add VPExpressionRecipe, replacing extended reduction recipes. (#144281)

2025-07-01 20:44:50 +01:00

vplan-printing.ll

[VPlan] Simplify exituser handling by generating all extracts first(NFCI)

2025-07-16 08:14:12 +01:00

vplan-sink-scalars-and-merge-vf1.ll

[VPlan] Use regular phi printing for resume phis.

2025-06-07 21:49:54 +01:00

vplan-sink-scalars-and-merge.ll

[VPlan] Use regular phi printing for resume phis.

2025-06-07 21:49:54 +01:00

vplan-stress-test-no-explict-vf.ll

…

vplan-unused-interleave-group.ll

[VPlan] Connect Entry to scalar preheader during initial construction. (#140132)

2025-05-27 16:07:56 +01:00

vplan-vectorize-inner-loop-reduction.ll

…

vplan-widen-call-instruction.ll

[VPlan] Bail out on non-intrinsic calls in VPlanNativePath.

2025-03-19 21:35:15 +00:00

vplan-widen-select-instruction.ll

[LV] Regenerate some more check lines. (NFC)

2025-08-15 15:53:19 +01:00

vplan-widen-struct-return.ll

[VPlan] Connect Entry to scalar preheader during initial construction. (#140132)

2025-05-27 16:07:56 +01:00

widen-gep-all-indices-invariant.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

widen-intrinsic.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

write-only.ll

…