Streaming / Pipeline / Dataflow Processing

Kind: category

Record: architecture-category:streaming-pipeline-dataflow-processing

Canonical: Ontology

The Streaming / Pipeline / Dataflow Processing category holds 11 architecture principles.

Listed in Principle categories, after Scalability / Performance / Optimization and before Plugin / Extensibility / IoC.

Principle

Layer

Execution Core

Linked from

Streaming / Pipeline / Dataflow Processing

Every principle in this category is listed as a record. Each record carries its kind, its severity, the scopes it applies at and the layer it lives in, then the edge relations that join it to other records, the records that point back at it, the contracts that answer to it and the tensions it takes part in. The descriptors say how it is violated, detected, measured, repaired and enforced. Where the record carries one, an exemplar shows the shape before and after the principle is applied.

Relations diagram

The relations inside this category.

flowchart LR
    n_streaming_architecture["Streaming Architecture"]
    n_single_pass_processing["Single-Pass Processing"]
    n_pipeline_architecture["Pipeline Architecture"]
    n_lazy_evaluation["Lazy Evaluation"]
    n_sequential_access["Sequential Access"]
    n_forward_only_processing["Forward-Only Processing"]
    n_dataflow_architecture["Dataflow Architecture"]
    n_stateless_processing["Stateless Processing"]
    n_windowing["Windowing"]
    n_fan_out_fan_in["Fan-out/Fan-in"]
    n_batch_vs_stream["Batch-vs-Stream"]
    n_streaming_architecture --> n_single_pass_processing
    n_forward_only_processing --> n_single_pass_processing
    n_dataflow_architecture --> n_pipeline_architecture
    n_windowing --> n_streaming_architecture