| Safe Haskell | None |
|---|---|
| Language | Haskell2010 |
Ouroboros.Consensus.Ledger.Tables
Description
This module defines the LedgerTables, a portion of the Ledger notion of a
ledger state (not to confuse with our
LedgerState) that together with it,
conforms a complete Ledger ledger state.
LedgerTables are parametrized by two types: keys and values. For now, their
only current instantiation is to hold the UTxO set, but future features will
extend this to hold other parts of the ledger state that now live in memory.
However, LedgerTables don't necessarily have to contain maps from keys to
values, and the particular instantiation might choose to ignore some of those
types (as phantom types). See KeysMK for an example.
This type is used for two main purposes. Firstly, we use ledger tables to extract data from the ledger state and store it on secondary storage (eg a solid-state hard-drive). Secondly, when we load data from disk onto memory, we use ledger tables to inject data into the ledger state. This mechanism allows us to keep most of the data on disk, which is rarely used, reducing the memory usage of the Consensus layer.
Example
As an example, consider a LedgerState that contains a Ledger ledger state
(such as the NewEpochState) and a UTxO set:
data instanceLedgerState(Block era) mk = LedgerState { theLedgerLedgerState :: NewEpochState era , theTables ::LedgerTables(Block era) mk }
The Ledger ledger state contains a UTxO set as well, and with
stowLedgerTables and unstowLedgerTables we move those between the Ledger
ledger state and the LedgerTables, for example:
unstowLedgerTables(LedgerState { theLedgerLedgerState = NewEpochState { ... , utxoSet = Map.fromList [('a', 100), ('b', 100), ...] } , theTables =EmptyMK}) == LedgerState { theLedgerLedgerState = NewEpochState { ... , utxoSet = Map.empty } , theTables =ValuesMK(Map.fromList [('a', 100), ('b', 100), ...]) })
stowLedgerTables(LedgerState { theLedgerLedgerState = NewEpochState { ... , utxoSet = Map.empty } , theTables =ValuesMK(Map.fromList [('a', 100), ('b', 100), ...]) }) == LedgerState { theLedgerLedgerState = NewEpochState { ... , utxoSet = Map.fromList [('a', 100), ('b', 100), ...] } , theTables =EmptyMK})
Using these functions we can extract the data from the Ledger ledger state for us Consensus to manipulate, and we can then inject it back so that we provide the expected data to the ledger. Note that the Ledger rules for applying a block are defined in a way that it only needs the subset of the UTxO set that the block being applied will consume.
Now using calculateDifference, we
can compare two (successive) LedgerStates
to produce differences:
calculateDifference(LedgerState { ... , theTables =ValuesMK(Map.fromList [('a', 100), ('b', 100)]) }) (LedgerState { ... , theTables =ValuesMK(Map.fromList [('a', 100), ('c', 200)]) }) ==TrackingMK(Map.fromList [('a', 100), ('c', 200)]) (Map.fromList [('b', Delete), ('c', Insert 200)])
This operation provided a TrackingMK which is in fact just a ValuesMK and
DiffMK put together.
We can then use those differences to forward a collection of values, so for example (taking the example above):
let tables1 =ValuesMK(Map.fromList [('a', 100), ('b', 100)]) tables2 =ValuesMK(Map.fromList [('a', 100), ('c', 200)]) diffs =rawForgetTrackingValues$rawCalculateDifferencetables1 tables2 inrawApplyDiffstables1 diffs == tables2
Note: we usually don't call the raw* methods directly but instead call the
corresponding function that operates on
LedgerStates. See
Ouroboros.Consensus.Ledger.Tables.Utils.
Also when applying a block that contains some transactions, we can produce
LedgerTables of KeysMK, by gathering the txins required by the
transactions:
getBlockKeySets(Block {..., txs = [Tx { input = ['a', 'b'], outputs = ['c', 'd'] }]}) ==KeysMK(Set.fromList ['a', 'b'])
We shall use those later on to read the txouts from some storage.
We call those types ending in "MK" mapkinds. They model the different types of collections and contained data in the tables. This example already covered most of the standard mapkinds, in particular:
Synopsis
- module Ouroboros.Consensus.Ledger.Tables.Basics
- module Ouroboros.Consensus.Ledger.Tables.MapKind
- module Ouroboros.Consensus.Ledger.Tables.Combinators
- class (NoThunks (TxIn blk), NoThunks (TxOut blk), LedgerTableConstraints blk) ⇒ HasLedgerTables (l ∷ StateKind) blk where
- projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk
- withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk any → LedgerTables blk mk → l blk mk
- class CanStowLedgerTables (l ∷ LedgerStateKind) where
- stowLedgerTables ∷ l ValuesMK → l EmptyMK
- unstowLedgerTables ∷ l EmptyMK → l ValuesMK
- class CanUpgradeLedgerTables (l ∷ StateKind) blk where
- upgradeTables ∷ ∀ (mk1 ∷ MapKind) (mk2 ∷ MapKind). l blk mk1 → l blk mk2 → LedgerTables blk ValuesMK → LedgerTables blk ValuesMK
- class SerializeTablesWithHint (l ∷ Type → (Type → Type → Type) → Type) blk where
- encodeTablesWithHint ∷ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding
- decodeTablesWithHint ∷ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK)
- defaultDecodeTablesWithHint ∷ (Ord (TxIn blk), MemPack (TxIn blk), MemPack (TxOut blk)) ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK)
- defaultEncodeTablesWithHint ∷ (MemPack (TxIn blk), MemPack (TxOut blk)) ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding
- valuesMKDecoder ∷ SerializeTablesWithHint l blk ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK)
- valuesMKEncoder ∷ SerializeTablesWithHint l blk ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding
- class (TxIn blk ~ Void, TxOut blk ~ Void) ⇒ LedgerTablesAreTrivial (l ∷ StateKind) blk where
- convertMapKind ∷ ∀ (mk ∷ MapKind) (mk' ∷ MapKind). l blk mk → l blk mk'
- trivialProjectLedgerTables ∷ ∀ l blk (mk ∷ MapKind). (LedgerTablesAreTrivial l blk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk
- trivialWithLedgerTables ∷ ∀ l blk (any ∷ MapKind) (mk ∷ MapKind). LedgerTablesAreTrivial l blk ⇒ l blk any → LedgerTables blk mk → l blk mk
- trivialStowLedgerTables ∷ LedgerTablesAreTrivial l blk ⇒ l blk ValuesMK → l blk EmptyMK
- trivialUnstowLedgerTables ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → l blk ValuesMK
- trivialEncodeTablesWithHint ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding
- trivialDecodeTablesWithHint ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK)
- trivialLedgerTables ∷ ∀ (mk ∷ MapKind) (l ∷ StateKind) blk. (ZeroableMK mk, LedgerTablesAreTrivial l blk) ⇒ Proxy l → LedgerTables blk mk
Core
Utilities
Basic LedgerState classes
Extracting and injecting ledger tables
class (NoThunks (TxIn blk), NoThunks (TxOut blk), LedgerTableConstraints blk) ⇒ HasLedgerTables (l ∷ StateKind) blk where Source #
Extracting from LedgerTablesl mk (which will share the same mk),
or replacing the associated to a particular LedgerTablesl.
Methods
projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk Source #
Extract the ledger tables from a ledger state
The constraints on mk are necessary because the CardanoBlock instance
uses them.
withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk any → LedgerTables blk mk → l blk mk Source #
Overwrite the tables in the given ledger state.
The contents of the tables should not be younger than the content of the
ledger state. In particular, for a
HardForkBlock ledger, the
tables argument should not contain any data from eras that succeed the
current era of the ledger state argument.
The constraints on mk are necessary because the CardanoBlock instance
uses them.
Instances
Stowing ledger tables
class CanStowLedgerTables (l ∷ LedgerStateKind) where Source #
LedgerTables are projections of data from a LedgerState and as such they can be injected back into a LedgerState. This is necessary because the Ledger rules are currently unaware of UTxO-HD changes. Thus, by stowing the ledger tables, we are able to provide a Ledger State with a restricted UTxO set that is enough to execute the Ledger rules.
In particular, HardForkBlock LedgerStates are never given diretly to the ledger but rather unwrapped and then it is the inner ledger state the one we give to the ledger. This means that all the single era blocks must be an instance of this class, but HardForkBlocks might avoid doing so.
Methods
stowLedgerTables ∷ l ValuesMK → l EmptyMK Source #
unstowLedgerTables ∷ l EmptyMK → l ValuesMK Source #
Instances
Upgrading ledger tables
class CanUpgradeLedgerTables (l ∷ StateKind) blk where Source #
When pushing differences on InMemory Ledger DBs, we will sometimes need to update ledger tables to the latest era. For unary blocks this is a no-op, but for the Cardano block, we will need to upgrade all TxOuts in memory.
No correctness property relies on this, as Consensus can work with TxOuts from multiple eras, but the performance depends on it as otherwise we will be upgrading the TxOuts every time we consult them.
Methods
Arguments
| ∷ ∀ (mk1 ∷ MapKind) (mk2 ∷ MapKind). l blk mk1 | The original ledger state before the upgrade. This will be the tip before applying the block. |
| → l blk mk2 | The ledger state after the upgrade, which might be in a different era than the one above. |
| → LedgerTables blk ValuesMK | The tables we want to maybe upgrade. |
| → LedgerTables blk ValuesMK |
Instances
Serialization
class SerializeTablesWithHint (l ∷ Type → (Type → Type → Type) → Type) blk where Source #
When decoding the tables and in particular the UTxO set we want
to share data in the TxOuts in the same way the Ledger did (see the
Share (TxOut era) instances). We need to provide the state in the
HFC case so that we can call eraDecoder and also to extract the
interns from the state.
As we will decode with eraDecoder we also need to use such era
for the encoding thus we need the hint also in the encoding.
See SerializeTablesWithHint (LedgerState (HardForkBlock
(CardanoBlock c))) for a good example, the rest of the instances
are somewhat degenerate.
Methods
encodeTablesWithHint ∷ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding Source #
decodeTablesWithHint ∷ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK) Source #
Instances
| SerializeTablesWithHint LedgerState blk ⇒ SerializeTablesWithHint ExtLedgerState blk Source # | |
Defined in Ouroboros.Consensus.Ledger.Extended Methods encodeTablesWithHint ∷ ExtLedgerState blk EmptyMK → LedgerTables blk ValuesMK → Encoding Source # decodeTablesWithHint ∷ ExtLedgerState blk EmptyMK → Decoder s (LedgerTables blk ValuesMK) Source # | |
| (Ord (TxIn m), MemPack (TxIn m), MemPack (TxOut m)) ⇒ SerializeTablesWithHint LedgerState (DualBlock m a) Source # | |
Defined in Ouroboros.Consensus.Ledger.Dual Methods encodeTablesWithHint ∷ LedgerState (DualBlock m a) EmptyMK → LedgerTables (DualBlock m a) ValuesMK → Encoding Source # decodeTablesWithHint ∷ LedgerState (DualBlock m a) EmptyMK → Decoder s (LedgerTables (DualBlock m a) ValuesMK) Source # | |
defaultDecodeTablesWithHint ∷ (Ord (TxIn blk), MemPack (TxIn blk), MemPack (TxOut blk)) ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK) Source #
defaultEncodeTablesWithHint ∷ (MemPack (TxIn blk), MemPack (TxOut blk)) ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding Source #
valuesMKDecoder ∷ SerializeTablesWithHint l blk ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK) Source #
Default decoder of to be used by the
in-memory backing store.LedgerTables l 'ValuesMK
valuesMKEncoder ∷ SerializeTablesWithHint l blk ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding Source #
Default encoder of to be used by the
in-memory backing store.LedgerTables l 'ValuesMK
Special classes
class (TxIn blk ~ Void, TxOut blk ~ Void) ⇒ LedgerTablesAreTrivial (l ∷ StateKind) blk where Source #
For some ledger states we won't be defining LedgerTables and instead the
ledger state will be fully stored in memory, as before UTxO-HD. The ledger
states that are defined this way can be made instances of this class which
allows for easy manipulation of the types of mk required at any step of the
program.
Methods
convertMapKind ∷ ∀ (mk ∷ MapKind) (mk' ∷ MapKind). l blk mk → l blk mk' Source #
If the ledger state is always in memory, then l mk will be isomorphic
to l mk' for all mk, mk'. As a result, we can convert between ledgers
states indexed by different map kinds.
This function is useful to combine functions that operate on functions that
transform the map kind on a ledger state (eg applyChainTickLedgerResult).
Instances
| LedgerTablesAreTrivial LedgerState blk ⇒ LedgerTablesAreTrivial ExtLedgerState blk Source # | |
Defined in Ouroboros.Consensus.Ledger.Extended Methods convertMapKind ∷ ∀ (mk ∷ MapKind) (mk' ∷ MapKind). ExtLedgerState blk mk → ExtLedgerState blk mk' Source # | |
trivialProjectLedgerTables ∷ ∀ l blk (mk ∷ MapKind). (LedgerTablesAreTrivial l blk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk Source #
trivialWithLedgerTables ∷ ∀ l blk (any ∷ MapKind) (mk ∷ MapKind). LedgerTablesAreTrivial l blk ⇒ l blk any → LedgerTables blk mk → l blk mk Source #
trivialStowLedgerTables ∷ LedgerTablesAreTrivial l blk ⇒ l blk ValuesMK → l blk EmptyMK Source #
trivialUnstowLedgerTables ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → l blk ValuesMK Source #
trivialEncodeTablesWithHint ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → LedgerTables blk ValuesMK → Encoding Source #
trivialDecodeTablesWithHint ∷ LedgerTablesAreTrivial l blk ⇒ l blk EmptyMK → Decoder s (LedgerTables blk ValuesMK) Source #
trivialLedgerTables ∷ ∀ (mk ∷ MapKind) (l ∷ StateKind) blk. (ZeroableMK mk, LedgerTablesAreTrivial l blk) ⇒ Proxy l → LedgerTables blk mk Source #