Benchmarking

Kind: activity

Layer: Performance Core

Record: architecture:benchmarking

Severity: recommended

Scope: function, service, system

Canonical: Ontology

The activity of timing a fixed workload repeatedly in a controlled environment, so results can be compared across changes.

Listed in Architecture principles, after Profiling and before Bottleneck Analysis.

Requires

• Repeatable Test Environment

Reinforces

• Reproducibility
• Performance Engineering

Enables

• Regression Detection

Conflicts with

• Anecdotal Timing

In tension with

• Environment Drift

Tensions

• Benchmarking / Environment Drift

Violated by

• Anecdotal Performance Claims

Refactored by

• Immutable Infrastructure

Severity

• recommended

Category

• Scalability / Performance / Optimization

Linked from

• Correctness / Determinism / Verification
• Scalability / Performance / Optimization
• Scalability / Performance / Optimization
• Severity levels
• The resolutions