Luke Lau 6afe5e5d1a

[LV][EVL] Peek through combination tail-folded + predicated masks (#133430) ...

If a recipe was predicated and tail folded at the same time, it will
have a mask like

    EMIT vp<%header-mask> = icmp ule canonical-iv, backedge-tc
    EMIT vp<%mask> = logical-and vp<%header-mask>, vp<%pred-mask>

When converting to an EVL recipe, if the mask isn't exactly just the
header-mask we copy the whole logical-and.
We can remove this redundant logical-and (because it's now covered by
EVL) and just use vp<%pred-mask> instead.

This lets us remove the widened canonical IV in more places.

2025-03-31 21:28:39 +01:00

..

bf16.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

blend-any-of-reduction-cost.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

blocks-with-dead-instructions.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

dead-ops-cost.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

defaults.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

divrem.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

evl-compatible-loops.ll

…

f16.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

first-order-recurrence-scalable-vf1.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

force-vect-msg.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

illegal-type.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

induction-costs.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

inloop-reduction.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleaved-accesses-zve32x.ll

…

interleaved-accesses.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

interleaved-cost.ll

[RISCV] Add +optimized-nfN-segment-load-store (#114414)

2024-11-04 06:43:58 +08:00

lit.local.cfg

…

lmul.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

low-trip-count.ll

[RISCV] Don't vectorize for loops with small trip count (#132176)

2025-03-28 15:51:29 +08:00

mask-index-type.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

masked_gather_scatter.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

only-compute-cost-for-vplan-vfs.ll

[VPlan] Don't compute costs if there are no vector VPlans.

2024-06-24 08:38:31 +01:00

ordered-reduction.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

pr87378-vpinstruction-or-drop-poison-generating-flags.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

pr88802.ll

[RISCV] Don't vectorize for loops with small trip count (#132176)

2025-03-28 15:51:29 +08:00

preserve-dbg-loc.ll

[VPlan] Set debug location for VPReduction/VPWidenIntrinsicRecipe. (#120054)

2024-12-27 10:37:21 +08:00

reg-usage-bf16.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

reg-usage-f16.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

reg-usage.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

remark-reductions.ll

[LV] Prevent query the computeCost() when VF=1 in emitInvalidCostRemarks(). (#117288)

2025-02-10 08:40:28 +08:00

riscv-interleaved.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

riscv-unroll.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

riscv-vector-reverse-output.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

riscv-vector-reverse.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

safe-dep-distance.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

scalable-basics.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

scalable-reductions.ll

[RISCV] Enable scalable loop vectorization for fmax/fmin reductions with f16/bf16 type for zvfhmin/zvfbfmin (#129629)

2025-03-04 16:49:24 +08:00

scalable-tailfold.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

scalable-vf-hint.ll

…

select-cmp-reduction.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

select-invariant-cond-cost.ll

[VPlan] Also check if plan for best legacy VF contains simplifications.

2024-11-08 20:53:03 +00:00

short-trip-count.ll

[RISCV] Don't vectorize for loops with small trip count (#132176)

2025-03-28 15:51:29 +08:00

strided-accesses.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

tail-folding-cost.ll

[LoopVectorize] Add cost of generating tail-folding mask to the loop (#130565)

2025-03-21 09:24:56 +00:00

truncate-to-minimal-bitwidth-cost.ll

[RISCV] Don't vectorize for loops with small trip count (#132176)

2025-03-28 15:51:29 +08:00

truncate-to-minimal-bitwidth-evl-crash.ll

[RISCV] Don't vectorize for loops with small trip count (#132176)

2025-03-28 15:51:29 +08:00

type-info-cache-evl-crash.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

uniform-load-store.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

unroll-in-loop-vectorizer.ll

…

veclib-function-calls.ll

[RISCV][SLEEF]: Support SLEEF vector library for RISC-V target. (#114014)

2024-11-26 12:25:54 +03:00

vectorize-force-tail-with-evl-bin-unary-ops-args.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-call-intrinsics.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-cast-intrinsics.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-cond-reduction.ll

[LV][EVL] Peek through combination tail-folded + predicated masks (#133430)

2025-03-31 21:28:39 +01:00

vectorize-force-tail-with-evl-div.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-fixed-order-recurrence.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-gather-scatter.ll

…

vectorize-force-tail-with-evl-inloop-reduction.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

vectorize-force-tail-with-evl-interleave.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

vectorize-force-tail-with-evl-intermediate-store.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-iv32.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-known-no-overflow.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-masked-loadstore.ll

[LV][EVL] Peek through combination tail-folded + predicated masks (#133430)

2025-03-31 21:28:39 +01:00

vectorize-force-tail-with-evl-no-masking.ll

…

vectorize-force-tail-with-evl-ordered-reduction.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-reduction-cost.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

vectorize-force-tail-with-evl-reduction.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

vectorize-force-tail-with-evl-reverse-load-store.ll

[LV][EVL] Peek through combination tail-folded + predicated masks (#133430)

2025-03-31 21:28:39 +01:00

vectorize-force-tail-with-evl-safe-dep-distance.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-force-tail-with-evl-uniform-store.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vectorize-vp-intrinsics.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

vf-will-not-generate-any-vector-insts.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

vplan-vp-call-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

vplan-vp-cast-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

vplan-vp-intrinsics-fixed-order-recurrence.ll

[VPlan] Move FOR splice cost into VPInstruction::FirstOrderRecurrenceSplice (#129645)

2025-03-14 15:33:32 +08:00

vplan-vp-intrinsics-reduction.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

vplan-vp-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

vplan-vp-select-intrinsics.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

zvl32b.ll

[RISCV] Disable fixed length vectors with Zve32* without Zvl64b. (#102405)

2024-08-08 09:17:43 -07:00