Reproducibility

Kind: quality-attribute

Layer: Computation Core

Record: architecture:reproducibility

Severity: recommended

Scope: build, test, deployment, ML

Canonical: Ontology

The degree to which a build, test or training run gives the same output from the same pinned inputs on another machine.

Listed in Architecture principles, after Immutability and before Repeatability.

Requires

• Determinism
• Versioned Inputs

Reinforces

• Auditability

Enables

• Debugging
• Compliance

Conflicts with

• Floating Dependencies
• Flaky Test Normalization

In tension with

• Continuous Updates

Tensions

• Reproducibility / Continuous Updates

Violated by

• Floating Dependencies

Refactored by

• Pin Versions

Severity

• recommended

Category

• Correctness / Determinism / Verification

Enforced by

• runtime/entrypoints/validation.entrypoint.ts
• runtime/entrypoints/report.entrypoint.ts

Reinforced by

• Environment Parity
• Infrastructure as Code
• Immutable Infrastructure
• Machine Learning Architecture
• Prompt Engineering
• Benchmarking

Linked from

• Limits
• A report, not a checkbox
• One correct answer
• Computation and resource
• Anti-patterns
• Correctness / Determinism / Verification
• Portability / Infrastructure / Deployment
• Model Architecture
• Observability / Auditability / Traceability
• Scalability / Performance / Optimization
• Security / Privacy / Compliance / Governance
• Core Vocabulary
• Correctness / Determinism / Verification
• Severity levels
• The resolutions