Multi-Pass Full Materialization

Kind: technique

Layer: Execution Core

Record: lexicon:multi-pass-full-materialization

Canonical: Lexicon

Loading a full dataset into memory and traversing it in multiple passes, rather than in a single streaming pass.

Listed in Lexicon terms, after Global Optimization and before Error Propagation/Debugging.

Category

• Streaming / Pipeline / Dataflow Processing

In tension with

• Single-Pass Processing
• Single-Pass Processing / Multi-Pass Full Materialization

Linked from

• Streaming / Pipeline / Dataflow Processing
• The resolutions