Joel E. Denny 0e3c5566c0

[PGO] Add llvm.loop.estimated_trip_count metadata (#152775) ...

This patch implements the `llvm.loop.estimated_trip_count` metadata
discussed in [[RFC] Fix Loop Transformations to Preserve Block
Frequencies](https://discourse.llvm.org/t/rfc-fix-loop-transformations-to-preserve-block-frequencies/85785).
As the RFC explains, that metadata enables future patches, such as PR
#128785, to fix block frequency issues without losing estimated trip
counts.

2025-09-11 15:55:18 -04:00

..

CostModel

[LoopVectorizer] Prune VFs based on plan register pressure (#132190)

2025-05-19 13:27:17 +01:00

already-vectorized.ll

Revert "[PGO] Add llvm.loop.estimated_trip_count metadata" (#151585)

2025-07-31 15:56:31 -04:00

amdlibm-calls-finite.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

amdlibm-calls.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

avx1.ll

…

avx512.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

consecutive-ptr-cg-bug.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

consecutive-ptr-uniforms.ll

[InstCombine] Split GEPs with multiple non-zero offsets (#151333)

2025-09-10 16:51:58 +02:00

constant-fold.ll

[VPlan] Simplify x && false -> false, x | 0 -> x (#156345)

2025-09-04 10:29:59 +01:00

constant-vector-operand.ll

…

conversion-cost.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

cost-conditional-branches.ll

[LV] Don't consider second op as invariant in getDivRemSpeculationCost.

2025-09-06 14:06:04 +01:00

cost-constant-known-via-scev.ll

[VPlan] Fold BinaryAnd x, 0 -> 0 in simplifyRecipe.

2025-08-27 22:35:08 +01:00

cost-model-assert.ll

…

cost-model-i386.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

cost-model.ll

Reapply "[SCEVExp] Add helper to clean up dead instructions after expansion. (#157308)"

2025-09-09 09:47:41 +01:00

divs-with-tail-folding.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

drop-inbounds-flags-for-reverse-vector-pointer.ll

[VPlan] Fold common edges away in convertPhisToBlends (#150368)

2025-09-01 07:03:33 +00:00

drop-poison-generating-flags.ll

[VPlan] Allow folding not (cmp eq) -> icmp ne with other select users (#154497)

2025-08-22 07:59:14 +08:00

ephemeral-recipes.ll

…

epilog-vectorization-inductions.ll

[LV] Refine check to find epilogue IV resume value.

2025-08-01 20:54:39 +01:00

fixed-order-recurrence.ll

[VPlan] Handle stores to single-scalar addr in narrowToSingleScalars.

2025-09-10 21:58:29 +01:00

float-induction-x86.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-08 12:01:37 +01:00

fminimumnum.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

fneg-cost.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

fp32_to_uint32-cost-model.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

fp64_to_uint32-cost-model.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

fp80-widest-type.ll

…

fp_to_sint8-cost-model.ll

…

funclet.ll

…

gather_scatter.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

gather-cost.ll

…

gather-vs-interleave.ll

…

gcc-examples.ll

…

gep-use-outside-loop.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

i1-reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

illegal-parallel-loop-uniform-write.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

imprecise-through-phis.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

induction-costs.ll

[LV] Regenerate checks for missing branch weights.

2025-09-03 21:37:52 +01:00

induction-step.ll

[VPlan] Use SCEV to check subtract in getOptimizableIVOf.

2025-08-23 22:00:01 +01:00

int128_no_gather.ll

…

interleave_short_tc.ll

…

interleave-cost.ll

Reapply "[SCEVExp] Add helper to clean up dead instructions after expansion. (#157308)"

2025-09-09 09:47:41 +01:00

interleave-opaque-pointers.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleave-ptradd-with-replicated-operand.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

interleaved-accesses-hoist-load-across-store.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleaved-accesses-large-gap.ll

…

interleaved-accesses-sink-store-across-load.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleaved-accesses-use-after-free.ll

…

interleaved-accesses-waw-dependency.ll

…

interleaving.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

intrinsiccost.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

invariant-load-gather.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

invariant-store-vectorization.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-08 12:01:37 +01:00

iv-live-outs.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

libm-vector-calls-finite.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls-VF2-VF8.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

limit-vf-by-tripcount.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

lit.local.cfg

…

load-deref-pred.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

masked_load_store.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

masked-store-cost.ll

[LV] Regenerate checks for missing branch weights.

2025-09-03 21:37:52 +01:00

max-mstore.ll

…

metadata-enable.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

min-trip-count-switch.ll

…

mul_slm_16bit.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

multi-exit-cost.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

no_fpmath_with_hotness.ll

…

no_fpmath.ll

…

no-vector.ll

…

nontemporal.ll

…

optsize.ll

[LV] Add additional test with SCEV predicate.

2025-09-07 16:14:52 +01:00

outer_loop_test1_no_explicit_vect_width.ll

[VPlan] Introduce CSE pass (#151872)

2025-09-02 12:23:29 +01:00

parallel-loops-after-reg2mem.ll

…

parallel-loops.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pointer-runtime-checks-unprofitable.ll

…

powof2div.ll

…

pr23997.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

pr34438.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

pr35432.ll

Reapply "[SCEVExp] Add helper to clean up dead instructions after expansion. (#157308)"

2025-09-09 09:47:41 +01:00

pr36524.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr39160.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

pr42674.ll

[ConstantFolding] Infer getelementptr nuw flag (#119214)

2024-12-09 16:44:05 +01:00

pr47437.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr48340.ll

[VPlan] Expand VPWidenPointerInductionRecipe into separate recipes (#148274)

2025-08-05 16:54:02 +08:00

pr51366-sunk-instruction-used-outside-of-loop.ll

[VPlan] Allow folding not (cmp eq) -> icmp ne with other select users (#154497)

2025-08-22 07:59:14 +08:00

pr54413-select-interleave-count-loop-with-cost-zero.ll

…

pr54634.ll

[LV] Remove instcombine,simplifycfg and dce from some tests.

2025-09-07 10:28:25 +01:00

pr55096-scalarize-add.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

pr72969.ll

[VPlan] Mark VPFirstOrderRecurrencePHI as not reading/writing memory.

2025-06-15 22:00:47 +01:00

pr81872.ll

[PGO] Add llvm.loop.estimated_trip_count metadata (#152775)

2025-09-11 15:55:18 -04:00

pr109581-unused-blend.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pr131359-dead-for-splice.ll

[VPlan] Materialize constant vector trip counts before final opts. (#142309)

2025-07-26 17:16:36 +01:00

pr141968-instsimplifyfolder.ll

[VPlan] Slightly extend ExtractLastElement fold to single-scalars.

2025-09-09 22:08:08 +01:00

predicate-switch.ll

[VPlan] Reassociate (x & y) & z -> x & (y & z) (#155383)

2025-09-03 01:09:19 +00:00

predicated-instruction-cost.ll

[LV] Generalize predication checks from 2c8836c899 for operands.

2024-10-02 20:16:41 +01:00

propagate-metadata.ll

…

ptr-indvar-crash.ll

…

rauw-bug.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117112)

2024-11-21 08:06:56 +00:00

reduction-crash.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

reduction-fastmath.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

reduction-small-size.ll

[VPlan] Add ReductionStartVector VPInstruction. (#142290)

2025-06-09 20:59:12 +01:00

redundant-vf2-cost.ll

Fix test failures introduced by PR #113697 (#116941)

2024-11-20 09:10:51 +00:00

reg-usage-debug.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

register-assumption.ll

…

replicate-recipe-with-only-first-lane-used.ll

[VPlan] Let Not preserve uniformity in isSingleScalar (#156676)

2025-09-04 11:27:14 +01:00

replicate-uniform-call.ll

[VPlan] Introduce CSE pass (#151872)

2025-09-02 12:23:29 +01:00

runtime-limit.ll

…

scatter_crash.ll

[VPlan] Keep common flags during CSE. (#157664)

2025-09-10 10:20:48 +00:00

scev-checks-unprofitable.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

slm-no-vectorize.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

small-size.ll

[InstCombine] Strip leading zero indices from GEP (#155415)

2025-09-01 09:58:11 +02:00

strided_load_cost.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

struct-store.ll

…

svml-calls-finite.ll

…

svml-calls.ll

…

tail_folding_and_assume_safety.ll

…

tail_loop_folding.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

transform-narrow-interleave-to-widen-memory-gaps.ll

[LV] Add additional tests for narrowing interleave groups.

2025-03-15 21:13:49 +00:00

transform-narrow-interleave-to-widen-memory.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

tripcount.ll

…

uint64_to_fp64-cost-model.ll

[VPlan] Remove stray space when printing VPWidenCastRecipe.

2024-12-24 20:23:48 +00:00

uniform_load.ll

[VPlan] Remove VPVectorPointer for part 0 after unrolling. (#149735)

2025-07-27 13:53:26 +01:00

uniform_mem_op.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

uniform-phi.ll

[LV] Don't consider IV increments uniform if exit value is used outside.

2025-01-12 22:03:21 +00:00

uniformshift.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

unroll_selection.ll

…

unroll-pm.ll

…

unroll-small-loops.ll

…

veclib-calls.ll

…

vect.omp.force.ll

…

vect.omp.force.small-tc.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

vector_max_bandwidth.ll

…

vector_ptr_load_store.ll

…

vector-scalar-select-cost.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

vectorization-remarks-loopid-dbg.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

vectorization-remarks-missed.ll

[LV] Emit all remarks for unvectorizable instructions (#153833)

2025-08-18 18:04:53 +01:00

vectorization-remarks-profitable.ll

…

vectorization-remarks.ll

[LV] Remove use of llc from vectoriser tests (#154759)

2025-08-26 09:59:06 +01:00

vectorize-force-tail-with-evl.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

vectorize-interleaved-accesses-gap.ll

[VPlan] Add dedicated user for resume phi with epilogue vectorization.

2025-08-10 21:21:16 +01:00

vectorize-only-for-real.ll

…

vplan-native-inner-loop-only.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

vplan-vp-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

widened-value-used-as-scalar-and-first-lane.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00

x86_fp80-interleaved-access.ll

…

x86_fp80-vector-store.ll

[InstCombine] Strip leading zero indices from GEP (#155415)

2025-09-01 09:58:11 +02:00

x86-interleaved-accesses-masked-group.ll

[VPlan] Also materialize broadcasts for backedge-taken-counts (NFC).

2025-03-18 22:35:18 +00:00

x86-interleaved-store-accesses-with-gaps.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

x86-pr39099.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

x86-predication.ll

[VPlan] Run final VPlan simplifications before codegen.

2025-08-16 18:54:27 +01:00