Florian Hahn 1a850279c5

[LV] Re-compute cost of scalarized load users. ...

If there are direct memory op users of the newly scalarized load,
their cost may have changed because there's no scalarization
overhead for the operand. Update it.

This ensures assigning consistent costs to scalarized memory
instructions that themselves have scalarized memory instructions as
operands.

2025-10-01 22:30:18 +01:00

..

CostModel

[LoopVectorizer] Prune VFs based on plan register pressure (#132190)

2025-05-19 13:27:17 +01:00

already-vectorized.ll

Revert "[PGO] Add llvm.loop.estimated_trip_count metadata" (#151585)

2025-07-31 15:56:31 -04:00

amdlibm-calls-finite.ll

…

amdlibm-calls.ll

…

avx1.ll

…

avx512.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

cleanup-runtime-checks.ll

[LV] Don't preserve LCSSA in SCEVExpander for runtime checks. (#159556)

2025-09-30 10:03:55 +00:00

consecutive-ptr-cg-bug.ll

…

consecutive-ptr-uniforms.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

constant-fold.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

constant-vector-operand.ll

…

conversion-cost.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

cost-conditional-branches.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

cost-constant-known-via-scev.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

cost-model-assert.ll

[llvm] Regenerate test checks including TBAA semantics (NFC)

2025-09-12 20:01:17 +02:00

cost-model-i386.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

cost-model.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

divs-with-tail-folding.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

drop-inbounds-flags-for-reverse-vector-pointer.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

drop-poison-generating-flags.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

ephemeral-recipes.ll

…

epilog-vectorization-inductions.ll

[VPlan] Mark VPInstruction::Broadcast as not reading/writing memory.

2025-09-27 20:48:42 +01:00

fixed-order-recurrence.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

float-induction-x86.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

fminimumnum.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

fneg-cost.ll

…

fp32_to_uint32-cost-model.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

fp64_to_uint32-cost-model.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

fp80-widest-type.ll

…

fp_to_sint8-cost-model.ll

…

funclet.ll

…

gather_scatter.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

gather-cost.ll

…

gather-vs-interleave.ll

…

gcc-examples.ll

…

gep-use-outside-loop.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

i1-reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

illegal-parallel-loop-uniform-write.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

imprecise-through-phis.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

induction-costs.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

induction-step.ll

[VPlan] Mark VPInstruction::Broadcast as not reading/writing memory.

2025-09-27 20:48:42 +01:00

int128_no_gather.ll

…

interleave_short_tc.ll

…

interleave-cost.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

interleave-opaque-pointers.ll

…

interleave-ptradd-with-replicated-operand.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

interleaved-accesses-hoist-load-across-store.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

interleaved-accesses-large-gap.ll

…

interleaved-accesses-sink-store-across-load.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

interleaved-accesses-use-after-free.ll

…

interleaved-accesses-waw-dependency.ll

…

interleaving.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

intrinsiccost.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

invariant-load-gather.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

invariant-store-vectorization.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

iv-live-outs.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

libm-vector-calls-finite.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls-VF2-VF8.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

limit-vf-by-tripcount.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

lit.local.cfg

…

load-deref-pred.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

masked_load_store.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

masked-store-cost.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

max-mstore.ll

…

metadata-enable.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

min-trip-count-switch.ll

…

mul_slm_16bit.ll

…

multi-exit-cost.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

no_fpmath_with_hotness.ll

…

no_fpmath.ll

…

no-vector.ll

…

nontemporal.ll

…

optsize.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

outer_loop_test1_no_explicit_vect_width.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

parallel-loops-after-reg2mem.ll

…

parallel-loops.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

pointer-runtime-checks-unprofitable.ll

…

powof2div.ll

…

pr23997.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

pr34438.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

pr35432.ll

Reapply "[SCEVExp] Add helper to clean up dead instructions after expansion. (#157308)"

2025-09-09 09:47:41 +01:00

pr36524.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

pr39160.ll

…

pr42674.ll

…

pr47437.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

pr48340.ll

[VPlan] Expand VPWidenPointerInductionRecipe into separate recipes (#148274)

2025-08-05 16:54:02 +08:00

pr51366-sunk-instruction-used-outside-of-loop.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

pr54413-select-interleave-count-loop-with-cost-zero.ll

…

pr54634.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

pr55096-scalarize-add.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr72969.ll

[VPlan] Mark VPFirstOrderRecurrencePHI as not reading/writing memory.

2025-06-15 22:00:47 +01:00

pr81872.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

pr109581-unused-blend.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

pr131359-dead-for-splice.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

pr141968-instsimplifyfolder.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

predicate-switch.ll

[VPlan] Reassociate (x & y) & z -> x & (y & z) (#155383)

2025-09-03 01:09:19 +00:00

predicated-instruction-cost.ll

…

propagate-metadata.ll

…

ptr-indvar-crash.ll

…

rauw-bug.ll

…

reduction-crash.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

reduction-fastmath.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

reduction-small-size.ll

[VPlan] Add ReductionStartVector VPInstruction. (#142290)

2025-06-09 20:59:12 +01:00

redundant-vf2-cost.ll

…

reg-usage-debug.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

register-assumption.ll

…

replicate-recipe-with-only-first-lane-used.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

replicate-uniform-call.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

replicating-load-store-costs.ll

[LV] Re-compute cost of scalarized load users.

2025-10-01 22:30:18 +01:00

runtime-limit.ll

…

scatter_crash.ll

[VPlan] Create epilogue minimum iteration check in VPlan. (#157545)

2025-09-25 07:13:38 +00:00

scev-checks-unprofitable.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

slm-no-vectorize.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

small-size.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

strided_load_cost.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

struct-store.ll

…

svml-calls-finite.ll

…

svml-calls.ll

…

tail_folding_and_assume_safety.ll

…

tail_loop_folding.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

transform-narrow-interleave-to-widen-memory-gaps.ll

[LV] Add additional tests for narrowing interleave groups.

2025-03-15 21:13:49 +00:00

transform-narrow-interleave-to-widen-memory.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

tripcount.ll

…

uint64_to_fp64-cost-model.ll

…

uniform_load.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

uniform_mem_op.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

uniform-phi.ll

[LV] Don't consider IV increments uniform if exit value is used outside.

2025-01-12 22:03:21 +00:00

uniformshift.ll

…

unroll_selection.ll

…

unroll-pm.ll

…

unroll-small-loops.ll

…

veclib-calls.ll

…

vect.omp.force.ll

…

vect.omp.force.small-tc.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

vector_max_bandwidth.ll

…

vector_ptr_load_store.ll

…

vector-scalar-select-cost.ll

…

vectorization-remarks-loopid-dbg.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

vectorization-remarks-missed.ll

[LV] Emit all remarks for unvectorizable instructions (#153833)

2025-08-18 18:04:53 +01:00

vectorization-remarks-profitable.ll

…

vectorization-remarks.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

vectorize-force-tail-with-evl.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

vectorize-interleaved-accesses-gap.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

vectorize-only-for-real.ll

…

vplan-native-inner-loop-only.ll

[VPlan] Simplify Plan's entry in removeBranchOnConst. (#154510)

2025-09-18 19:25:05 +01:00

vplan-vp-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

widened-value-used-as-scalar-and-first-lane.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00

x86_fp80-interleaved-access.ll

…

x86_fp80-vector-store.ll

[LV] Pass operand info to getMemoryOpCost in getMemInstScalarizationCost.

2025-09-19 21:03:38 +01:00

x86-interleaved-accesses-masked-group.ll

[VPlan] Also materialize broadcasts for backedge-taken-counts (NFC).

2025-03-18 22:35:18 +00:00

x86-interleaved-store-accesses-with-gaps.ll

…

x86-pr39099.ll

…

x86-predication.ll

[VPlan] Remove original loop blocks if dead. (#155497)

2025-10-01 16:53:59 +00:00