ouroboros-consensus
Safe HaskellNone
LanguageHaskell2010

Ouroboros.Consensus.Ledger.Tables

Description

This module defines the LedgerTables, a portion of the Ledger notion of a ledger state (not to confuse with our LedgerState) that together with it, conforms a complete Ledger ledger state.

LedgerTables are parametrized by two types: keys and values. For now, their only current instantiation is to hold the UTxO set, but future features will extend this to hold other parts of the ledger state that now live in memory. However, LedgerTables don't necessarily have to contain maps from keys to values, and the particular instantiation might choose to ignore some of those types (as phantom types). See KeysMK for an example.

This type is used for two main purposes. Firstly, we use ledger tables to extract data from the ledger state and store it on secondary storage (eg a solid-state hard-drive). Secondly, when we load data from disk onto memory, we use ledger tables to inject data into the ledger state. This mechanism allows us to keep most of the data on disk, which is rarely used, reducing the memory usage of the Consensus layer.

Example

Expand

As an example, consider a LedgerState that contains a Ledger ledger state (such as the NewEpochState) and a UTxO set:

data instance LedgerState (Block era) mk = LedgerState {
    theLedgerLedgerState :: NewEpochState era
  , theTables            :: LedgerTables (Block era) mk
}

The Ledger ledger state contains a UTxO set as well, and with stowLedgerTables and unstowLedgerTables we move those between the Ledger ledger state and the LedgerTables, for example:

unstowLedgerTables (LedgerState {
                        theLedgerLedgerState = NewEpochState {
                            ...
                          , utxoSet = Map.fromList [('a', 100), ('b', 100), ...]
                        }
                      , theTables = EmptyMK
                    })
 ==
 LedgerState {
     theLedgerLedgerState = NewEpochState {
         ...
       , utxoSet = Map.empty
       }
   , theTables = ValuesMK (Map.fromList [('a', 100), ('b', 100), ...])
   })
stowLedgerTables (LedgerState {
                      theLedgerLedgerState = NewEpochState {
                          ...
                        , utxoSet = Map.empty
                      }
                    , theTables = ValuesMK (Map.fromList [('a', 100), ('b', 100), ...])
                  })
 ==
 LedgerState {
     theLedgerLedgerState = NewEpochState {
         ...
       , utxoSet = Map.fromList [('a', 100), ('b', 100), ...]
       }
   , theTables = EmptyMK
   })

Using these functions we can extract the data from the Ledger ledger state for us Consensus to manipulate, and we can then inject it back so that we provide the expected data to the ledger. Note that the Ledger rules for applying a block are defined in a way that it only needs the subset of the UTxO set that the block being applied will consume.

Now using calculateDifference, we can compare two (successive) LedgerStates to produce differences:

calculateDifference
  (LedgerState {
      ...
    , theTables = ValuesMK (Map.fromList [('a', 100), ('b', 100)])
    })
  (LedgerState {
      ...
    , theTables = ValuesMK (Map.fromList [('a', 100), ('c', 200)])
    })
==
 TrackingMK
   (Map.fromList [('a', 100),    ('c', 200)])
   (Map.fromList [('b', Delete), ('c', Insert 200)])

This operation provided a TrackingMK which is in fact just a ValuesMK and DiffMK put together.

We can then use those differences to forward a collection of values, so for example (taking the example above):

let tables1 = ValuesMK (Map.fromList [('a', 100), ('b', 100)])
    tables2 = ValuesMK (Map.fromList [('a', 100), ('c', 200)])
    diffs = rawForgetTrackingValues
          $ rawCalculateDifference tables1 tables2
in
  rawApplyDiffs tables1 diffs == tables2

Note: we usually don't call the raw* methods directly but instead call the corresponding function that operates on LedgerStates. See Ouroboros.Consensus.Ledger.Tables.Utils.

Also when applying a block that contains some transactions, we can produce LedgerTables of KeysMK, by gathering the txins required by the transactions:

getBlockKeySets (Block {..., txs = [Tx { input = ['a', 'b'], outputs = ['c', 'd'] }]})
 == KeysMK (Set.fromList ['a', 'b'])

We shall use those later on to read the txouts from some storage.

We call those types ending in "MK" mapkinds. They model the different types of collections and contained data in the tables. This example already covered most of the standard mapkinds, in particular:

EmptyMK
A nullary data constructor, an empty table.
ValuesMK
Contains a Data.Map from txin to txouts.
DiffMK
Contains a Data.Map from txin to a change on the value.
TrackingMK
Contains both a ValuesMK and DiffMK.
KeysMK
Contains a Data.Set of txins.
SeqDiffMK
A fingertree of DiffMKs.
Synopsis

Core

Utilities

Basic LedgerState classes

Extracting and injecting ledger tables

class (NoThunks (TxIn blk), NoThunks (TxOut blk), LedgerTableConstraints blk) ⇒ HasLedgerTables (l ∷ StateKind) blk where Source #

Extracting LedgerTables from l mk (which will share the same mk), or replacing the LedgerTables associated to a particular l.

Methods

projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk Source #

Extract the ledger tables from a ledger state

The constraints on mk are necessary because the CardanoBlock instance uses them.

withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ l blk any → LedgerTables blk mk → l blk mk Source #

Overwrite the tables in the given ledger state.

The contents of the tables should not be younger than the content of the ledger state. In particular, for a HardForkBlock ledger, the tables argument should not contain any data from eras that succeed the current era of the ledger state argument.

The constraints on mk are necessary because the CardanoBlock instance uses them.

Instances

Instances details
(NoThunks (TxIn blk), NoThunks (TxOut blk), HasLedgerTables LedgerState blk) ⇒ HasLedgerTables ExtLedgerState blk Source # 
Instance details

Defined in Ouroboros.Consensus.Ledger.Extended

Methods

projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ ExtLedgerState blk mk → LedgerTables blk mk Source #

withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ ExtLedgerState blk any → LedgerTables blk mk → ExtLedgerState blk mk Source #

(CanHardFork xs, HasCanonicalTxIn xs, HasHardForkTxOut xs) ⇒ HasLedgerTables LedgerState (HardForkBlock xs) Source #

Warning: projectLedgerTables and withLedgerTables are prohibitively expensive when using big tables or when used multiple times. See the TxOut instance for the HardForkBlock for more information.

Instance details

Defined in Ouroboros.Consensus.HardFork.Combinator.Ledger

(Bridge m a, HasLedgerTables LedgerState m) ⇒ HasLedgerTables LedgerState (DualBlock m a) Source # 
Instance details

Defined in Ouroboros.Consensus.Ledger.Dual

Methods

projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ LedgerState (DualBlock m a) mk → LedgerTables (DualBlock m a) mk Source #

withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ LedgerState (DualBlock m a) any → LedgerTables (DualBlock m a) mk → LedgerState (DualBlock m a) mk Source #

(NoThunks (TxIn blk), NoThunks (TxOut blk), HasLedgerTables (Ticked LedgerState) blk) ⇒ HasLedgerTables (Ticked ExtLedgerState) blk Source # 
Instance details

Defined in Ouroboros.Consensus.Ledger.Extended

Methods

projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ Ticked ExtLedgerState blk mk → LedgerTables blk mk Source #

withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ Ticked ExtLedgerState blk any → LedgerTables blk mk → Ticked ExtLedgerState blk mk Source #

(CanHardFork xs, HasCanonicalTxIn xs, HasHardForkTxOut xs) ⇒ HasLedgerTables (Ticked LedgerState) (HardForkBlock xs) Source # 
Instance details

Defined in Ouroboros.Consensus.HardFork.Combinator.Ledger

(Bridge m a, HasLedgerTables (Ticked LedgerState) m) ⇒ HasLedgerTables (Ticked LedgerState) (DualBlock m a) Source # 
Instance details

Defined in Ouroboros.Consensus.Ledger.Dual

Methods

projectLedgerTables ∷ ∀ (mk ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ Ticked LedgerState (DualBlock m a) mk → LedgerTables (DualBlock m a) mk Source #

withLedgerTables ∷ ∀ (mk ∷ MapKind) (any ∷ MapKind). (CanMapMK mk, CanMapKeysMK mk, ZeroableMK mk) ⇒ Ticked LedgerState (DualBlock m a) any → LedgerTables (DualBlock m a) mk → Ticked LedgerState (DualBlock m a) mk Source #

Stowing ledger tables

class CanStowLedgerTables (l ∷ LedgerStateKind) where Source #

LedgerTables are projections of data from a LedgerState and as such they can be injected back into a LedgerState. This is necessary because the Ledger rules are currently unaware of UTxO-HD changes. Thus, by stowing the ledger tables, we are able to provide a Ledger State with a restricted UTxO set that is enough to execute the Ledger rules.

In particular, HardForkBlock LedgerStates are never given diretly to the ledger but rather unwrapped and then it is the inner ledger state the one we give to the ledger. This means that all the single era blocks must be an instance of this class, but HardForkBlocks might avoid doing so.

Upgrading ledger tables

class CanUpgradeLedgerTables (l ∷ StateKind) blk where Source #

When pushing differences on InMemory Ledger DBs, we will sometimes need to update ledger tables to the latest era. For unary blocks this is a no-op, but for the Cardano block, we will need to upgrade all TxOuts in memory.

No correctness property relies on this, as Consensus can work with TxOuts from multiple eras, but the performance depends on it as otherwise we will be upgrading the TxOuts every time we consult them.

Methods

upgradeTables Source #

Arguments

∷ ∀ (mk1 ∷ MapKind) (mk2 ∷ MapKind). l blk mk1

The original ledger state before the upgrade. This will be the tip before applying the block.

→ l blk mk2

The ledger state after the upgrade, which might be in a different era than the one above.

LedgerTables blk ValuesMK

The tables we want to maybe upgrade.

LedgerTables blk ValuesMK 

Serialization

class SerializeTablesWithHint (l ∷ Type → (TypeTypeType) → Type) blk where Source #

When decoding the tables and in particular the UTxO set we want to share data in the TxOuts in the same way the Ledger did (see the Share (TxOut era) instances). We need to provide the state in the HFC case so that we can call eraDecoder and also to extract the interns from the state.

As we will decode with eraDecoder we also need to use such era for the encoding thus we need the hint also in the encoding.

See SerializeTablesWithHint (LedgerState (HardForkBlock (CardanoBlock c))) for a good example, the rest of the instances are somewhat degenerate.

valuesMKDecoderSerializeTablesWithHint l blk ⇒ l blk EmptyMKDecoder s (LedgerTables blk ValuesMK) Source #

Default decoder of LedgerTables l 'ValuesMK to be used by the in-memory backing store.

valuesMKEncoderSerializeTablesWithHint l blk ⇒ l blk EmptyMKLedgerTables blk ValuesMKEncoding Source #

Default encoder of LedgerTables l 'ValuesMK to be used by the in-memory backing store.

Special classes

class (TxIn blk ~ Void, TxOut blk ~ Void) ⇒ LedgerTablesAreTrivial (l ∷ StateKind) blk where Source #

For some ledger states we won't be defining LedgerTables and instead the ledger state will be fully stored in memory, as before UTxO-HD. The ledger states that are defined this way can be made instances of this class which allows for easy manipulation of the types of mk required at any step of the program.

Methods

convertMapKind ∷ ∀ (mk ∷ MapKind) (mk' ∷ MapKind). l blk mk → l blk mk' Source #

If the ledger state is always in memory, then l mk will be isomorphic to l mk' for all mk, mk'. As a result, we can convert between ledgers states indexed by different map kinds.

This function is useful to combine functions that operate on functions that transform the map kind on a ledger state (eg applyChainTickLedgerResult).

Instances

Instances details
LedgerTablesAreTrivial LedgerState blk ⇒ LedgerTablesAreTrivial ExtLedgerState blk Source # 
Instance details

Defined in Ouroboros.Consensus.Ledger.Extended

Methods

convertMapKind ∷ ∀ (mk ∷ MapKind) (mk' ∷ MapKind). ExtLedgerState blk mk → ExtLedgerState blk mk' Source #

trivialProjectLedgerTables ∷ ∀ l blk (mk ∷ MapKind). (LedgerTablesAreTrivial l blk, ZeroableMK mk) ⇒ l blk mk → LedgerTables blk mk Source #

trivialWithLedgerTables ∷ ∀ l blk (any ∷ MapKind) (mk ∷ MapKind). LedgerTablesAreTrivial l blk ⇒ l blk any → LedgerTables blk mk → l blk mk Source #

trivialLedgerTables ∷ ∀ (mk ∷ MapKind) (l ∷ StateKind) blk. (ZeroableMK mk, LedgerTablesAreTrivial l blk) ⇒ Proxy l → LedgerTables blk mk Source #