Single-Pass Processing

Kind: principle

Layer: Execution Core

Record: architecture:single-pass-processing

Severity: contextual

Scope: algorithm, stream, parser

Canonical: Ontology

A design rule that large input is read once, with every result it feeds computed in that one pass.

Listed in Architecture principles, after Streaming Architecture and before Pipeline Architecture.

Requires

• Forward-Only State Model

Reinforces

• Memory Efficiency

Enables

• Large Input Handling

In tension with

• Global Optimization
• Multi-Pass Full Materialization

Tensions

• Single-Pass Processing / Global Optimization
• Single-Pass Processing / Multi-Pass Full Materialization

Violated by

• Repeated Full Scan

Refactored by

• Fuse Passes
• Iterator Pattern

Severity

• contextual

Category

• Streaming / Pipeline / Dataflow Processing

Reinforced by

• Streaming Architecture
• Forward-Only Processing

Linked from

• Scalability / Performance / Optimization
• Streaming / Pipeline / Dataflow Processing
• Core Vocabulary
• Streaming / Pipeline / Dataflow Processing
• Severity levels
• The resolutions