corpus/manifest/, the XDR bytes
under corpus/blobs/, the decoded values under corpus/decoded/. Any SDK’s or indexer’s CI can read it without
this kit’s tools. Counts on this page are from corpus/COVERAGE.md and corpus/index.json (corpus 30.0.0-dev).
Entries
446 entries (corpus/COVERAGE.md). An entry is one pattern; its bytes exist per network and protocol as
variants.
Source:
corpus/index.json, field kind.
Where the bytes come from
Source:
corpus/index.json, field sources (an entry with variants from two sources counts in both). 111 entries
carry synthetic: true: the 33 recipe entries plus strkey and api entries, which have no stellar-core bytes by
nature.
Local stellar-core runs
xdrcheck-corpus gen <scenario> (crates/xdrcheck-gen):
- Writes a stellar-core configuration with
RUN_STANDALONE=true,MANUAL_CLOSE=true, the network passphrase, no peers, an HTTP port on loopback, andMETADATA_OUTPUT_STREAMpointing to a file in the run directory. The meta flags are the lake profile: the flags the public data lake’s objects were written with (EMIT_CLASSIC_EVENTS, Soroban meta extension v1). - Starts the release binary pinned in
pins.toml(stellar_core.binary_sha256) from genesis. - Brings the chain up to the target protocol: ledger 2 upgrades
protocolversion=N; from Protocol 20, ledgers 3 to 12 install Soroban settings through twoConfigUpgradeSets with fixed salts. Scenario steps start at ledger 13. - For each step: builds the transaction from its SEP-51 JSON template, signs it with keys derived from public
labels, submits it with
tx?blob=, arms upgrades if any, and closes the ledger withmanualclose. A step markedsimulate: trueis simulated first with the pinned soroban-env-host against the node’s own state; no stellar-rpc is involved. - Reads each
LedgerCloseMetafrom the record-marked meta stream and writes it as a blob named by its sha256, with the SEP-51 sidecar, the manifest variant and a chain index (corpus/chains/<scenario>/).
LedgerTxn::Impl::getChanges) and diagnostic events carry timings. make verify-generate regenerates the
scenarios in corpus/scenarios/pr.list with the network cut and requires equal ledger header hashes, transaction
hashes and results, and equal bytes after stellar-core’s own --check-lcm normalisation (sorted change lists,
zeroed core_metrics timing values). Each local-core variant records this as
reproducibility: normalised-identical.
Public data lake objects
xdrcheck-corpus capture <network> <ledger> --tx <hash> --entry <id> copies the object at its original key with
its sha256, its decompressed sha256, the lake’s object metadata and the stellar-core version that wrote it. The blob
relation is fixed: the object is a zstd LedgerCloseMetaBatch, so the blob is the decompressed bytes from offset
12 (startSequence, endSequence, array length) to the end. The replay harness serves the original object, byte
for byte. Testnet objects carry perishable: true (the next reset is 2026-12-16, pins.toml); after it the
vendored copy is the only one.
The lake’s older ledgers were rewritten by a recent stellar-core, so a Protocol 1 to 22 ledger there carries
TransactionMeta v4 with backfilled events. Such entries record regenerated: true.
How expected values are established
Three layers, in the manifest of each entry (docs/manifest.md section 6.1, Manifest):
expect holds: whole-ledger receipts (expect.ledger: transactions, operations, events, entry changes), every
transaction’s hash, result code and fee (expect.transactions), pinpoints (expect.values[]: a JSON Pointer into the
decoded value and the value it must equal), participants, state changes, movements, stored addresses, and
explicit negative facts (must_not_include).
The reference extractor (xdrcheck-corpus extract, crates/xdrcheck-meta) derives participants, state
changes and movements from what stellar-core changed:
- It reads ledger-entry changes (fee processing, before and after changes, operation changes) and consensus events. It never reads diagnostic events.
- It uses the envelope for two things only: to label a change with its operation type, and to attach a muxed alias to a participant the meta already established. It never adds a participant from the envelope.
- A failed transaction’s participants are its fee payer and source only. Every other address in its envelope
becomes a
must_not_includecandidate. - A token-shaped event yields a movement keyed on the emitting contract. Only a contract whose ID equals the Stellar Asset Contract ID of a classic asset counts as that asset.
expect; verify requires every stated value to be one the extractor derives. A value no
ledger field carries is marked unverified: "<reason>" instead of being guessed. Pinpoints are hand-written, so
they check the oracle independently of the fact that the oracle shares rs-stellar-xdr with the Rust SDK column.
What make verify-corpus checks
xdrcheck-corpus verify runs these checks on every variant (docs/manifest.md section 11):
- Schema, ID and registry: the file path equals
id; the ID is incorpus/plan.json. - Blob: exists, its name is its sha256,
blob.bytesmatches. - Round trip: decode with explicit limits, re-encode, identical bytes; JSON to XDR reproduces the blob. A
negative
xdrentry must instead be refused with the entry’s reason class. - Pinpoints resolve and equal;
derived.ledger_hashequals the header hash;derived.tx_hashis recomputed from the envelope under the stated passphrase. - Receipts and the transaction list match the blob.
- Source: a golden frame equals the golden file’s record; a lake variant’s decompressed sha256 and offset hold.
- The reference extractor agrees with
expect. - Golden agreement (below).
- Nothing left over: every blob and sidecar belongs to a variant.
stellar-xdr CLI at 30.0.0
(cargo install --locked stellar-xdr --version 30.0.0 --features cli); the commands are in
Manifest.
Agreement with stellar-core’s goldens
stellar-core checks its ownLedgerCloseMeta goldens (test-lcm-current) in CI with --check-lcm.
--check-lcm re-runs core’s own tests and cannot check anyone else’s bytes, so agreement is three mechanical
checks:
The golden mirror, exactly. For each local-core variant, two measures of the focus transaction are recomputed
from its blob and from the golden on every run:
- The profile-free skeleton: every union arm, enum value, boolean, array length and
Symbolkept, every other leaf replaced by its type name, and the parts that exist only because a meta flag is set removed (diagnostic events, transaction-level and classic-operation events,soroban_meta.ext). - The reduced shape tokens of the mainnet scan’s grammar (
xcc.shape/v1): optional presence, the fields each updated entry changed, flag transitions, operation-versus-effect relations, event signatures. Type-level tokens, meta-flag parts andseqLedger/seqTimeare removed.
corpus/mirrors.json
(written by xdrcheck-corpus verify --checks ag4 --write-mirrors) records the mapping:
Source:
corpus/mirrors.json, counts. Agreement is of shape. It never compares values or bytes: a local entry
and a golden come from different runs, accounts and ledgers.
One entry walked through: cap-0040/signed-payload-signer-added
File: corpus/manifest/cap-0040/signed-payload-signer-added.json.
Check the bytes yourself:
stellar/wallet-backend, both at level replay:
At the fixed commits (
2c873353, bb0b162b) the same entry must pass. How that is asserted: Replay.
Limits
- 118 of 138 local-core entries have no golden transaction of the same shape.
- 33 entries are recipe-built (
synthetic);strkeyandapientries have no ledger bytes by nature. - The reference extractor proposes; an author decides. Its rules are documented in
docs/manifest.mdsection 6.11, not proved complete.