0ab67ec191
When we enable EVL-based loop vectorization w/ predicated tail-folding, each vectorized loop has effectively two induction variables: one calculates the step using (VF x vscale) and the other one increases the IV by values returned from experiment.get.vector.length. The former, also known as canonical IV, is more favorable for analyses as it's "countable" in the sense of SCEV; the latter (EVL-based IV), however, is more favorable to codegen, at least for those that support scalable vectors like AArch64 SVE and RISC-V. The idea is that we use canonical IV all the way until the end of all vectorizers, where we replace it with EVL-based IV using EVLIVSimplify introduced here. Such that we can have the best from both worlds. This Pass is enabled by default in RISC-V. However, since we haven't really vectorize loops with predicate tail-folding by default, this Pass is no-op at this moment.
50 lines
1.3 KiB
CMake
50 lines
1.3 KiB
CMake
add_llvm_component_library(LLVMVectorize
|
|
EVLIndVarSimplify.cpp
|
|
LoadStoreVectorizer.cpp
|
|
LoopIdiomVectorize.cpp
|
|
LoopVectorizationLegality.cpp
|
|
LoopVectorize.cpp
|
|
SandboxVectorizer/DependencyGraph.cpp
|
|
SandboxVectorizer/InstrMaps.cpp
|
|
SandboxVectorizer/Interval.cpp
|
|
SandboxVectorizer/Legality.cpp
|
|
SandboxVectorizer/Passes/BottomUpVec.cpp
|
|
SandboxVectorizer/Passes/RegionsFromBBs.cpp
|
|
SandboxVectorizer/Passes/RegionsFromMetadata.cpp
|
|
SandboxVectorizer/Passes/SeedCollection.cpp
|
|
SandboxVectorizer/Passes/TransactionAcceptOrRevert.cpp
|
|
SandboxVectorizer/Passes/TransactionSave.cpp
|
|
SandboxVectorizer/SandboxVectorizer.cpp
|
|
SandboxVectorizer/SandboxVectorizerPassBuilder.cpp
|
|
SandboxVectorizer/Scheduler.cpp
|
|
SandboxVectorizer/SeedCollector.cpp
|
|
SandboxVectorizer/VecUtils.cpp
|
|
SLPVectorizer.cpp
|
|
Vectorize.cpp
|
|
VectorCombine.cpp
|
|
VPlan.cpp
|
|
VPlanAnalysis.cpp
|
|
VPlanConstruction.cpp
|
|
VPlanRecipes.cpp
|
|
VPlanSLP.cpp
|
|
VPlanTransforms.cpp
|
|
VPlanUnroll.cpp
|
|
VPlanVerifier.cpp
|
|
VPlanUtils.cpp
|
|
|
|
ADDITIONAL_HEADER_DIRS
|
|
${LLVM_MAIN_INCLUDE_DIR}/llvm/Transforms
|
|
${LLVM_MAIN_INCLUDE_DIR}/llvm/Transforms/Vectorize
|
|
${LLVM_MAIN_INCLUDE_DIR}/llvm/Transforms/Vectorize/SandboxVectorizer
|
|
|
|
DEPENDS
|
|
intrinsics_gen
|
|
|
|
LINK_COMPONENTS
|
|
Analysis
|
|
Core
|
|
Support
|
|
TransformUtils
|
|
SandboxIR
|
|
)
|