Pipeline Architecture

Kind: pattern

Layer: Execution Core

Record: architecture:pipeline-architecture

Severity: recommended

Scope: processing, dataflow, build

Canonical: Ontology

A design pattern that splits processing into ordered stages, each with a declared input and output contract.

Listed in Architecture principles, after Single-Pass Processing and before Lazy Evaluation.

Requires

• Stage Contracts

Reinforces

• Composability
• Streaming

Enables

• Stepwise Transformation

Conflicts with

• Monolithic Processing Function

In tension with

• Error Propagation/Debugging

Tensions

• Pipeline Architecture / Error Propagation/Debugging

Violated by

• Monolithic Processing Function

Refactored by

• Define Contract

Severity

• recommended

Category

• Streaming / Pipeline / Dataflow Processing

Reinforced by

• Dataflow Architecture

Refactors

• Dataflow Architecture
• Pipes and Filters

Linked from

• One chain
• Core Modular Design
• Streaming / Pipeline / Dataflow Processing
• Codebase / System Architecture Styles
• Contracts / Interfaces / Compatibility
• Streaming / Pipeline / Dataflow Processing
• Severity levels
• The resolutions

in this codebase

• stagesFor
• runStages