llvm-project

History

[GVN] Load-store forwaring of scalable store to fixed load. (#124748 )

When storing a scalable vector and loading a fixed-size vector, where
the
scalable vector is known to be larger based on vscale_range, perform
store-to-load forwarding through temporary @llvm.vector.extract calls.
InstCombine then folds the insert/extract pair away.

The usecase is shown in https://godbolt.org/z/KT3sMrMbd, which shows
that clang generates IR that matches this pattern when the
"arm_sve_vector_bits" attribute is used:

```c
typedef svfloat32_t svfloat32_fixed_t
__attribute__((arm_sve_vector_bits(512)));

struct svfloat32_wrapped_t {
  svfloat32_fixed_t v;
};

static inline svfloat32_wrapped_t
add(svfloat32_wrapped_t a, svfloat32_wrapped_t b) {
  return {svadd_f32_x(svptrue_b32(), a.v, b.v)};
}

svfloat32_wrapped_t
foo(svfloat32_wrapped_t a, svfloat32_wrapped_t b) {
  // The IR pattern this patch matches is generated for this return:
  return add(a, b);
}
```

2025-01-30 11:49:42 +01:00

2007-07-25-DominatedLoop.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-25-InfiniteLoop.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-25-Loop.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-25-NestedLoop.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-25-SinglePredecessor.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-26-InterlockingLoops.ll

[ConstantFold] Remove notional over-indexing fold (#93697 )

2024-05-30 08:36:44 +02:00

2007-07-26-NonRedundant.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-26-PhiErasure.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-30-PredIDom.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2007-07-31-NoDomInherit-xfail.ll

…

2007-07-31-RedundantPhi.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-02-12-UndefLoad-xfail.ll

…

2008-02-13-NewPHI.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-07-02-Unreachable.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-12-09-SelfRemove.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-12-12-RLE-Crash.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-12-14-rle-reanalyze.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2008-12-15-CacheVisited.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2009-01-21-SortInvalidation.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2009-01-22-SortInvalidation.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2009-03-10-PREOnVoid.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2009-07-13-MemDepSortFail.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2009-11-12-MemDepMallocBitCast.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2010-03-31-RedundantPHIs.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

2010-05-08-OneBit.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

2010-11-13-Simplify.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2011-04-27-phioperands.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

2011-07-07-MatchIntrinsicExtract.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2011-09-07-TypeIdFor.ll

[Clang][CodeGen] Start migrating away from assuming the Default AS is 0 (#88182 )

2024-05-19 14:59:03 +01:00

2012-05-22-PreCrash.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

2016-08-30-MaskedScatterGather-xfail-inseltpoison.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

2016-08-30-MaskedScatterGather-xfail.ll

…

addrspacecast.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

assume_dominating_icmp.ll

…

assume-equal-xfail.ll

…

assume-equal.ll

…

assumes.ll

…

basic-cyclic-opt.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

basic-undef-test.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

basic.ll

…

big-endian.ll

…

bitcast-of-call.ll

…

br-identical.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

cache-safe-phiofops.ll

[NewGVN] Fix caching for OpIsSafeForPhiOfOps (#98340 )

2024-07-12 11:17:45 +01:00

calloc-load-removal.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

calls-nonlocal-xfail.ll

…

calls-readonly.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

commute.ll

…

compare-condition-changes.ll

…

completeness.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

cond_br2-xfail.ll

…

cond_br.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

condprop-xfail.ll

…

condprop.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

convergent.ll

…

crash-no-aa.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

crash-usecounts.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

crash.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

cyclic-phi-handling.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

dbg-redundant-load.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

deadstore.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

debugloc-xfail.ll

…

edge.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

eliminate-callsite-inline.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

eliminate-ssacopy.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

equivalent-phi.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

fence-xfail.ll

…

flags-simplify.ll

…

flags.ll

…

fold-const-expr.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

fpmath.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

freeze.ll

…

funclet.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

int_sideeffect.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

invariant.group.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

invariant.start.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

lifetime-simple.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

load-constant-mem.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

load-from-unreachable-predecessor.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

loadforward.ll

[ConstantFolding] Infer getelementptr nuw flag (#119214 )

2024-12-09 16:44:05 +01:00

malloc-load-removal.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

MemdepMiscompile.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

memory-handling.ll

[IR] Convert from nocapture to captures(none) (#123181 )

2025-01-29 16:56:47 +01:00

metadata-nonnull.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

metadata-simplify.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

no_speculative_loads_with_asan.ll

…

noalias.ll

[Local] Only intersect alias.scope,noalias & parallel_loop if inst moves (#117716 )

2024-11-26 20:39:53 +00:00

nomemlocation.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

non-integral-pointers.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

non-local-offset.ll

…

nonescaping-malloc-xfail.ll

…

null-aliases-nothing.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

opt-remarks-xfail.ll

…

pair_jumpthread.ll

…

phi-edge-handling.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

phi-of-ops-loads.ll

…

phi-of-ops-move-block.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

phi-of-ops-simplification-dependencies.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

phi-of-ops-simplified-to-existing-value-then-changes-again.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

phi-translate-partial-alias.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr10820-xfail.ll

…

pr12979.ll

…

pr14166-xfail.ll

…

pr17732.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr17852.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr24397.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr24426.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr25440.ll

[IR] Convert from nocapture to captures(none) (#123181 )

2025-01-29 16:56:47 +01:00

pr28562.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr31472.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr31483.ll

[CodeGen][LLVM] Make the va_list related intrinsics generic. (#85460 )

2024-03-27 11:41:34 +00:00

pr31491.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr31501.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr31573.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr31594.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr31613_2.ll

…

pr31613.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr31682.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr31758.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr32403.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr32607.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr32836.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr32838.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr32845.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr32852.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr32897.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr32934.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr32945.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr32952.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr33014.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33086.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33116.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33165-distribute-undef.ll

…

pr33185.ll

…

pr33187.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33196.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr33204.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33305.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr33367.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr33432.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr33461.ll

…

pr33720.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr34135.ll

…

pr34430.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr34452.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pr35074-phi-of-ops.ll

…

pr35074.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr35125.ll

[ValueTracking] Extend LHS/RHS with matching operand to work without constants.

2024-07-03 20:18:51 +08:00

pr36335-phi-undef.ll

[NewGVN] Prevent cyclic dependencies by ensuring Leader has min RPO number (#82110 )

2024-08-14 08:18:33 +01:00

pr37121-seens-this-value-a-lot.ll

…

pr42422-phi-of-ops.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr43441.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

pr113997.ll

[GVN][NewGVN] Take call attributes into account in expressions (#114545 )

2024-11-08 16:00:48 +08:00

pre-compare.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

pre-new-inst-xfail.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

predicates.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

preserve-metadata-for-predicate-replacements.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

propagate-ir-flags.ll

…

range.ll

…

readattrs.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

refine-stores.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

rle-must-alias-xfail.ll

…

rle-no-phi-translate-xfail.ll

…

rle-nonlocal.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

rle.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

simp-to-self.ll

[NewGVN] Prevent cyclic dependencies by ensuring Leader has min RPO number (#82110 )

2024-08-14 08:18:33 +01:00

sq-ctxi.ll

…

stale-loop-info.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

storeoverstore.ll

…

tbaa.ll

[Local] Only intersect tbaa metadata if instr moves. (#116682 )

2024-11-20 19:31:16 +00:00

unreachable_block_infinite_loop.ll

[llvm] Remove br i1 undef from some regression tests [NFC] (#117292 )

2024-11-26 20:50:54 +00:00

verify-memoryphi.ll

[NewGVN][NFC]Regenerate test checks (#85280 )

2024-03-14 21:49:45 +00:00

volatile-nonvolatile.ll

[IR] Convert from nocapture to captures(none) (#123181 )

2025-01-29 16:56:47 +01:00

vscale.ll

[GVN] Load-store forwaring of scalable store to fixed load. (#124748 )

2025-01-30 11:49:42 +01:00