2738828c0e
This is an attempt to reland #151660 by including a missing STL header found by a buildbot failure. The stable function map could be huge for a large application. Fully loading it is slow and consumes a significant amount of memory, which is unnecessary and drastically slows down compilation especially for non-LTO and distributed-ThinLTO setups. This patch introduces an opt-in lazy loading support for the stable function map. The detailed changes are: - `StableFunctionMap` - The map now stores entries in an `EntryStorage` struct, which includes offsets for serialized entries and a `std::once_flag` for thread-safe lazy loading. - The underlying map type is changed from `DenseMap` to `std::unordered_map` for compatibility with `std::once_flag`. - `contains()`, `size()` and `at()` are implemented to only load requested entries on demand. - Lazy Loading Mechanism - When reading indexed codegen data, if the newly-introduced `-indexed-codegen-data-lazy-loading` flag is set, the stable function map is not fully deserialized up front. The binary format for the stable function map now includes offsets and sizes to support lazy loading. - The safety of lazy loading is guarded by the once flag per function hash. This guarantees that even in a multi-threaded environment, the deserialization for a given function hash will happen exactly once. The first thread to request it performs the load, and subsequent threads will wait for it to complete before using the data. For single-threaded builds, the overhead is negligible (a single check on the once flag). For multi-threaded scenarios, users can omit the flag to retain the previous eager-loading behavior.
42 lines
1.7 KiB
Plaintext
42 lines
1.7 KiB
Plaintext
# Test various error cases
|
|
|
|
# Synthesize a header only cgdata.
|
|
# struct Header {
|
|
# uint64_t Magic;
|
|
# uint32_t Version;
|
|
# uint32_t DataKind;
|
|
# uint64_t OutlinedHashTreeOffset;
|
|
# uint64_t StableFunctionMapOffset;
|
|
# }
|
|
RUN: touch %t_empty.cgdata
|
|
RUN: not llvm-cgdata --show %t_empty.cgdata 2>&1 | FileCheck %s --check-prefix=EMPTY
|
|
EMPTY: {{.}}cgdata: empty codegen data
|
|
|
|
# Not a magic.
|
|
RUN: printf '\xff' > %t_malformed.cgdata
|
|
RUN: not llvm-cgdata --show %t_malformed.cgdata 2>&1 | FileCheck %s --check-prefix=MALFORMED
|
|
MALFORMED: {{.}}cgdata: malformed codegen data
|
|
|
|
# The minimum header size is 24.
|
|
RUN: printf '\xffcgdata\x81' > %t_corrupt.cgdata
|
|
RUN: not llvm-cgdata --show %t_corrupt.cgdata 2>&1 | FileCheck %s --check-prefix=CORRUPT
|
|
CORRUPT: {{.}}cgdata: invalid codegen data (file header is corrupt)
|
|
|
|
# The current version 4 while the header says 5.
|
|
RUN: printf '\xffcgdata\x81' > %t_version.cgdata
|
|
RUN: printf '\x05\x00\x00\x00' >> %t_version.cgdata
|
|
RUN: printf '\x00\x00\x00\x00' >> %t_version.cgdata
|
|
RUN: printf '\x20\x00\x00\x00\x00\x00\x00\x00' >> %t_version.cgdata
|
|
RUN: printf '\x20\x00\x00\x00\x00\x00\x00\x00' >> %t_version.cgdata
|
|
RUN: not llvm-cgdata --show %t_version.cgdata 2>&1 | FileCheck %s --check-prefix=BAD_VERSION
|
|
BAD_VERSION: {{.}}cgdata: unsupported codegen data version
|
|
|
|
# Header says an outlined hash tree, but the file ends after the header.
|
|
RUN: printf '\xffcgdata\x81' > %t_eof.cgdata
|
|
RUN: printf '\x02\x00\x00\x00' >> %t_eof.cgdata
|
|
RUN: printf '\x01\x00\x00\x00' >> %t_eof.cgdata
|
|
RUN: printf '\x20\x00\x00\x00\x00\x00\x00\x00' >> %t_eof.cgdata
|
|
RUN: printf '\x20\x00\x00\x00\x00\x00\x00\x00' >> %t_eof.cgdata
|
|
RUN: not llvm-cgdata --show %t_eof.cgdata 2>&1 | FileCheck %s --check-prefix=EOF
|
|
EOF: {{.}}cgdata: end of File
|