SHA256SUMS holds their hashes (sha256sum -c SHA256SUMS in evidence/mainnet-scan/).
What was scanned
- Ledgers 2 to 65,505,999 of pubnet, every one, read from the public data lake (the SEP-54 layout that
xdrcheck-corpus scan run --httpreads over HTTPS). The upper end was fixed before the run; it lies before the protocol 30 upgrade, so the scanned headers carry protocol versions 1 to 29 (pubnet has no protocol 14 ledger). - Run on 2026-11-16, as 32,753 scan units of at most 2,000 consecutive ledgers.
- 65,505,998 ledgers and 10,869,626,939 transactions (
chain-summary.txt;census-facts.tsvsums to the same two numbers).
What was checked on every ledger, and the result
scan run decodes each ledger object and refuses the ledger, recording why, when any of these fails: the zstd
frame, the decode of the LedgerCloseMetaBatch and its byte-exact re-encode, the walk of every byte against the
pinned XDR definitions, the header’s stored hash against the SHA-256 of the header, and the join of every
transaction result to an envelope under the pubnet passphrase. It also records, per ledger, whether the header’s
transaction-set hash and result-set hash match the hashes of the transaction set and results it carries, whether
the lake object’s metadata (protocol-version, start-ledger) matches the header, and whether the object’s MD5
equals its ETag. scan chain-check then reads every ledger in sequence order and checks that each header’s
previous-ledger hash equals the hash of the ledger before it, across unit boundaries too.
chain-groups.tsv splits the same ledgers by the core-version metadata of the lake object (the stellar-core
that wrote it), the protocol the ledger’s transactions were applied under, and the LedgerCloseMeta arm (40
rows).
What the census counts
The scan cuts every transaction into components and walks each against the pinned definitions, turning it into a set of tokens. Grammarxcc.shape/v1, implemented in crates/xdrcheck-corpus/src/cmd/scan/shape.rs:
- A token is one string
<kind>|<class>|<body>from a finite grammar: a union arm, optional or enum value at a type or at a field path, a length class, a value class, a summary of a recursive value (SCValand the like), an event signature, a ledger-entry change, or what an operation asked for against what the meta shows. No token holds bytes taken from the ledger (keys, addresses, amounts, contract ids), apart from two closed vocabularies of event names and data-map keys. - A component is one part of a transaction:
Ethe envelope without its operations,Aits authorization entries,Oone operation with its result and its meta,Rthe result without the operation results,Fthe fee processing,Mthe transaction meta frame; plusL, the ledger-level part (header, upgrades, transaction set structure), one per ledger. - A component shape is the hash of a component’s sorted token set. A whole-transaction shape is the hash of the transaction’s E, R, F and M component shapes, its A shape if it has one, the set of its distinct O shapes each with a class of how often it repeats, and a class of its operation count. The order of operations is not part of it, and their exact repetition only as a class.
- Four levels keep more token kinds each: G0 keeps the type-level tokens (union arms, optional states and enum values, wherever they occur), G1 adds where each arm, optional and enum value sits, G2 adds value classes, length classes, recursive-value summaries, the first arm and arm set of union vectors, and event signatures, and G3 adds ledger-entry changes and operation-versus-effect relations. G3 is the finest; the coarser levels are projections of the same tokens.
census-summary.tsv, column distinct):
The files
L); occurrences of a whole-transaction shape count transactions. The two protocol
tables group the same ledgers differently: census-facts.tsv by the header’s protocol version, chain-groups.tsv
by the protocol the transactions were applied under. On an upgrade ledger the header already carries the new
version while its transactions apply under the old one, so per-protocol counts differ slightly between the two;
the totals are equal. A cover is greedy: asc takes the first carrier in ledger order, rare starts from the
rarest shapes. At G3 the ascending cover holds every transaction-level component shape in 3,229,456
transactions from 2,718,654 ledgers, and every component shape in 2,748,376 whole ledgers.
Reproducing it
Every step is a subcommand ofxdrcheck-corpus scan in this tree (docs/cli.md lists them; --help gives every
option). The files here were written by earlier development builds of the same subcommands; the commands below
describe the procedure, not a promise of byte-identical output from today’s tree. The whole-run steps stream
unit by unit and keep memory bounded.
What is not claimed
- The pipelines were not replayed over all of mainnet. The scan computes shapes, tokens and the checks above; it does not run wallet-backend, stellar-etl, Horizon or any SDK. Those ran on the corpus and on selected ledgers only.
- Shapes are those of the lake as it is served today. The lake’s older ledgers were regenerated by a recent
stellar-core (see the
corecolumn ofchain-groups.tsv), so their transaction meta is a recent version: a meta arm that only older stellar-core versions emitted is absent from the census even where the network once produced it. - The per-ledger output is not in this repository. The scan’s per-ledger records and the census’s per-shape lists are tens of gigabytes; only the aggregate files above are kept here. The lists of individual example transactions (the covers themselves) and the locate index are not here either.
- An entry’s mainnet count is that of its rarest token, not of the entry.
entry-prevalence.json(below) says how often the rarest part of an entry’s shape occurs on mainnet; it does not say that a transaction with the entry’s whole shape occurred, nor anything about what a pipeline did with such a transaction.
Per-entry prevalence (entry-prevalence.json)
How common each corpus entry’s distinguishing shape is on mainnet, counted per token. It is generated, not
copied, so it is not in SHA256SUMS; make results-prevalence TOKEN_TABLE=… writes it and make results-check
(part of make repo-checks) checks that it is consistent with the corpus.
xdrcheck-corpus scan entry-tokenswalks everyLedgerCloseMetavariant ofcorpus/index.jsonwith the scan’s own emitter and rules (scan run’s cut into components, grammarxcc.shape/v1) and lists the tokens of the variant’s focus transaction (its E, A, R, F, M and O components), or of the ledger component L when the focus is the ledger itself. Variants of other XDR types are not walked (walked: false): the scan has no component of that type.- Each token is looked up in the scan’s token table (
scan token-census: per token, its occurrences, first and last ledger; not in this repository, see “What is not claimed”). A token the table does not hold occurs nowhere in the scanned range: 0. - Per variant, the rarest token is the one with the fewest occurrences. Per entry, the variant whose rarest
token is the most common is kept (the form of the entry closest to what mainnet carries; a protocol 30 variant
of an entry that also has a protocol 28 one is not held against it, since the scan ends before protocol 30).
rarest_tokenslists that variant’s rarest tokens (up to five;rarest_tokens_totalsays how many share the count) with occurrences, first and last ledger;variantsgives every walked variant’s rarest count. - The walk is checked against the scan itself: for every variant taken from a scanned pubnet ledger, each of its
tokens must be in the token table with that ledger inside the token’s first..last range, or nothing is written
(
totals.mainnet_variants_checked_against_the_scan). never_seen_on_mainnet: truemeans even the best variant holds a token that never occurs in the scanned range: a shape mainnet has not produced, which is what generating ledgers on a local stellar-core is for.
occurrences is the token table’s count: the sum, over the distinct components that carry the token, of the
transactions holding each component (ledgers for L), so a transaction with two different components carrying
the same token counts twice. The file holds only these aggregates per token; it lists no transactions.
Prevalence by CAP
Fromentry-prevalence.json: 439 entries, 326 of them walked (they have a LedgerCloseMeta variant), 117 of those with a shape token that never occurs on pubnet in ledgers 2 to 65,505,999; 77 variants taken from scanned pubnet ledgers were checked token by token against the scan before the file was written. Per entry, the count is that of the entry’s rarest token (see “What is not claimed” above), not a count of transactions with the entry’s whole shape.
How to read a row: Walked entries have a LedgerCloseMeta variant the scan’s emitter can walk (an entry that is only an SDK call or a lone XDR value is not walked). Never seen on mainnet counts the walked entries holding a token that occurs nowhere in the scanned range: an indexer has not met that shape on pubnet yet, and the corpus is the only place to test it before it does. The last column is the range of the seen entries’ rarest-token counts; a low number means a shape a reader can run for years without meeting.
Prevalence by entry
One table per row, walked entries only. Best variant is the variant whose rarest token is the most common (network@protocol); occurrences, first and last ledger are that token’s. The tokens themselves are in evidence/mainnet-scan/entry-prevalence.json.
CAP-1: 3 walked entries
CAP-1: 3 walked entries
CAP-3: 2 walked entries
CAP-3: 2 walked entries
CAP-5: 1 walked entry
CAP-5: 1 walked entry
CAP-15: 10 walked entries
CAP-15: 10 walked entries
CAP-18: 1 walked entry
CAP-18: 1 walked entry
CAP-21: 3 walked entries
CAP-21: 3 walked entries
CAP-23: 6 walked entries
CAP-23: 6 walked entries
CAP-24: 1 walked entry
CAP-24: 1 walked entry
CAP-26: 1 walked entry
CAP-26: 1 walked entry
CAP-27: 4 walked entries
CAP-27: 4 walked entries
CAP-28: 1 walked entry
CAP-28: 1 walked entry
CAP-30: 6 walked entries
CAP-30: 6 walked entries
CAP-33: 6 walked entries
CAP-33: 6 walked entries
CAP-34: 3 walked entries
CAP-34: 3 walked entries
CAP-35: 5 walked entries
CAP-35: 5 walked entries
CAP-38: 14 walked entries
CAP-38: 14 walked entries
CAP-40: 5 walked entries
CAP-40: 5 walked entries
CAP-42: 4 walked entries
CAP-42: 4 walked entries
CAP-46: 40 walked entries
CAP-46: 40 walked entries
CAP-54: 2 walked entries
CAP-54: 2 walked entries
CAP-58: 6 walked entries
CAP-58: 6 walked entries
CAP-62: 4 walked entries
CAP-62: 4 walked entries
CAP-63: 6 walked entries
CAP-63: 6 walked entries
CAP-66: 12 walked entries
CAP-66: 12 walked entries
CAP-67: 29 walked entries
CAP-67: 29 walked entries
CAP-70: 2 walked entries
CAP-70: 2 walked entries
CAP-71: 2 walked entries
CAP-71: 2 walked entries
CAP-73: 8 walked entries
CAP-73: 8 walked entries
CAP-76: 1 walked entry
CAP-76: 1 walked entry
CAP-77: 4 walked entries
CAP-77: 4 walked entries
CAP-84: 5 walked entries
CAP-84: 5 walked entries
CAP-85: 6 walked entries
CAP-85: 6 walked entries
CAP-87: 1 walked entry
CAP-87: 1 walked entry
CAP-88: 6 walked entries
CAP-88: 6 walked entries
classic: 85 walked entries
classic: 85 walked entries
ledger: 16 walked entries
ledger: 16 walked entries
protocol-01: 1 walked entry
protocol-01: 1 walked entry
protocol-02: 1 walked entry
protocol-02: 1 walked entry
protocol-09: 1 walked entry
protocol-09: 1 walked entry
protocol-13: 1 walked entry
protocol-13: 1 walked entry
protocol-15: 3 walked entries
protocol-15: 3 walked entries
protocol-18: 1 walked entry
protocol-18: 1 walked entry
protocol-20: 2 walked entries
protocol-20: 2 walked entries
protocol-23: 2 walked entries
protocol-23: 2 walked entries
protocol-24: 1 walked entry
protocol-24: 1 walked entry
protocol-29: 1 walked entry
protocol-29: 1 walked entry
corpus/COVERAGE.md lists them.
Mainnet tier: token coverage
Mainnet transaction-level token coverage: 15,186 of 15,186 in the mainnet tier; 2,422 of 15,186 in the curated corpus. The mainnet tier (corpus/mainnet/) lists 6,158 real pubnet transactions from 6,150 ledgers, each located in its public-lake object by ledger, apply index, hash and the sha256 of the object and of every part. Together they hold every transaction-level shape token the scan found (15,186; the TOK row of cover-summary.tsv above): this is the scan’s rare-first token cover. make mainnet-fetch fetches the objects (about 1 GB) and make verify-mainnet checks the tier from them: every part’s hash chain to its lake object, its round trip through rs-stellar-xdr, and the tokens recomputed with the scan’s own emitter. The curated count is the tokens of the curated entries’ focus transactions, walked the same way.
What it does not claim: shapes of meta that only older stellar-core versions wrote (the lake’s older ledgers were regenerated by a recent one), or tokens after ledger 65,505,999; the ledger-level tokens; whole-transaction shapes; any SDK, conformance or pipeline result (the tier reports none). corpus/mainnet/README.md states the claim in full. Source: evidence/results/mainnet-coverage.json.
Related
- CAPs, patterns and ledgers: each CAP’s entries, and union-arm prevalence where it joins exactly
- find and Dataset: the commands that read the scan’s outputs