Batch-vs-Stream

Kind: approach

Layer: Execution Core

Record: architecture:batch-vs-stream

Severity: contextual

Scope: data processing, latency, architecture

Canonical: Ontology

An approach in which the processing model, periodic batch or continuous stream, is chosen by how fresh the data must be.

Listed in Architecture principles, after Fan-out/Fan-in and before Plugin Architecture.

Requires

• Latency Requirement Clarity

Reinforces

• Fitness for Purpose

Enables

• Latency-Appropriate Processing Model

Conflicts with

• One-Size-Fits-All Processing

In tension with

• Operational Duplication

Tensions

• Batch-vs-Stream / Operational Duplication

Violated by

• One-Size-Fits-All Processing

Severity

• contextual

Category

• Streaming / Pipeline / Dataflow Processing

Linked from

• Streaming / Pipeline / Dataflow Processing
• Severity levels
• The resolutions