# Self-Healing / Recovery / Deployment Safety

> Every principle in this category is listed as a record.

Page: Ontology · Principles
Canonical: https://banes-lab.com/ontology#arch-category-self-healing-recovery-deployment-safety

Every principle in this category is listed as a record. Each record carries its kind, its severity, the scopes it applies at and the layer it lives in, then the edge relations that join it to other records, the records that point back at it, the contracts that answer to it and the tensions it takes part in. The descriptors say how it is violated, detected, measured, repaired and enforced. Where the record carries one, an exemplar shows the shape before and after the principle is applied.

Relations diagram

The relations inside this category.

```mermaid
flowchart LR
n_self_healing_architecture["Self-Healing Architecture"]
n_autonomous_recovery["Autonomous Recovery"]
n_health_checks["Health Checks"]
n_failover["Failover"]
n_redundancy["Redundancy"]
n_replication["Replication"]
n_auto_scaling["Auto-Scaling"]
n_auto_remediation["Auto-Remediation"]
n_rollback["Rollback"]
n_blue_green_deployment["Blue-Green Deployment"]
n_canary_deployment["Canary Deployment"]
n_chaos_engineering["Chaos Engineering"]
n_graceful_shutdown["Graceful Shutdown"]
n_raid_redundancy["RAID Redundancy"]
n_self_healing_architecture --> n_health_checks
n_self_healing_architecture --> n_autonomous_recovery
n_failover --> n_redundancy
n_redundancy --> n_failover
n_replication --> n_failover
n_blue_green_deployment --> n_rollback
n_chaos_engineering --> n_self_healing_architecture
n_raid_redundancy --> n_redundancy
```

### Self-Healing Architecture

- Kind: [capability](https://banes-lab.com/records/kind/capability.md)
- Severity: contextual
- Scope: system, infrastructure, runtime
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Observability](https://banes-lab.com/records/arch/observability.md), [Health Checks](https://banes-lab.com/records/arch/health-checks.md), [Automation](https://banes-lab.com/records/lex/automation.md)

Reinforces
[Resilience](https://banes-lab.com/records/arch/resilience.md)

Enables
[Autonomous Recovery](https://banes-lab.com/records/arch/autonomous-recovery.md)

In tension with
[Automation Risk](https://banes-lab.com/records/lex/automation-risk.md)

Conflicts with
[Manual-Only Recovery](https://banes-lab.com/records/lex/manual-only-recovery.md)

Referenced by
[Chaos Engineering](https://banes-lab.com/records/arch/chaos-engineering.md)

Tensions
[Self-Healing Architecture Automation Risk](https://banes-lab.com/records/tension/automation-risk-self-healing-architecture.md)

Violated by
detectable failure without automated remediation

Detected by
recurring manual recovery steps

Measured by
MTTR, auto-recovery success

Refactored by
Add Health Checks, Add Restart/Remediation Policy

Enforced by
orchestration policy, runbooks

Before

```typescript
process.on("error", error => fooLog.record(error));
```

After

```typescript
supervisor.watch("foo-worker", {
start: startFooWorker,
health: fooWorkerHealth,
restart: { maxAttempts: 5, backoffMs: 1000 },
});
```

### Autonomous Recovery

- Kind: [capability](https://banes-lab.com/records/kind/capability.md)
- Severity: contextual
- Scope: service, infrastructure
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Health Signal](https://banes-lab.com/records/lex/health-signal.md), [Remediation Action](https://banes-lab.com/records/lex/remediation-action.md)

Reinforces
[Self-Healing](https://banes-lab.com/records/lex/self-healing.md)

Enables
[Reduced Mean Time to Recovery](https://banes-lab.com/records/lex/reduced-mean-time-to-recovery.md)

In tension with
[False Recovery Actions](https://banes-lab.com/records/lex/false-recovery-actions.md)

Conflicts with
[Manual Intervention Dependency](https://banes-lab.com/records/lex/manual-intervention-dependency.md)

Referenced by
[Self-Healing Architecture](https://banes-lab.com/records/arch/self-healing-architecture.md)

Tensions
[Autonomous Recovery False Recovery Actions](https://banes-lab.com/records/tension/autonomous-recovery-false-recovery-actions.md)

Violated by
known remediable failure requiring human action

Detected by
incidents resolved by repetitive manual restart/rollback

Measured by
auto-remediation success rate

Refactored by
Add Auto-Restart, Add Remediation Workflow

Enforced by
orchestration automation

Before

```typescript
if (fooProjection.failed) runbook.rebuildByHand(fooProjection);
```

After

```typescript
fooProjection.onFailure(async checkpoint => {
await fooProjection.reset(checkpoint.lastValidOffset);
await fooProjection.replay();
});
```

### Health Checks

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: mandatory for services
- Scope: service, deployment, runtime
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Observable Health Criteria](https://banes-lab.com/records/lex/observable-health-criteria.md)

Reinforces
[Self-Healing](https://banes-lab.com/records/lex/self-healing.md), [Load Balancing](https://banes-lab.com/records/arch/load-balancing.md)

Enables
[Readiness/Liveness Routing](https://banes-lab.com/records/lex/readiness-liveness-routing.md)

In tension with
[False Positives](https://banes-lab.com/records/lex/false-positives.md)

Conflicts with
[Blind Routing](https://banes-lab.com/records/lex/blind-routing.md)

Referenced by
[Service Discovery](https://banes-lab.com/records/arch/service-discovery.md), [Load Balancing](https://banes-lab.com/records/arch/load-balancing.md), [Self-Healing Architecture](https://banes-lab.com/records/arch/self-healing-architecture.md)

Tensions
[Health Checks False Positives](https://banes-lab.com/records/tension/false-positives-health-checks.md)

Violated by
traffic routed to unhealthy instance

Detected by
missing or shallow health endpoint

Measured by
health-check accuracy

Refactored by
Add Liveness/Readiness/Dependency Checks

Enforced by
deployment policy

Before

```typescript
app.get("/health", () => "ok");
```

After

```typescript
app.get("/health", async () => {
const fooStoreOk = await fooStore.ping();
const eventBusOk = await eventBus.ping();
return {
state: fooStoreOk && eventBusOk ? "ready" : "blocked",
checks: { fooStore: fooStoreOk, eventBus: eventBusOk },
};
});
```

### Failover

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: contextual
- Scope: service, infrastructure, data
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Redundancy](https://banes-lab.com/records/arch/redundancy.md), [Health Detection](https://banes-lab.com/records/lex/health-detection.md)

Reinforces
[Availability](https://banes-lab.com/records/lex/availability.md)

Enables
[Continuity During Failure](https://banes-lab.com/records/lex/continuity-during-failure.md)

In tension with
[Consistency](https://banes-lab.com/records/arch/consistency.md)

Conflicts with
[Single Instance Dependency](https://banes-lab.com/records/lex/single-instance-dependency.md)

Referenced by
[Service Discovery](https://banes-lab.com/records/arch/service-discovery.md), [Redundancy](https://banes-lab.com/records/arch/redundancy.md), [Replication](https://banes-lab.com/records/arch/replication.md)

Tensions
[Failover Consistency](https://banes-lab.com/records/tension/consistency-failover.md)

Violated by
no alternate instance/path for critical dependency

Detected by
single active dependency with no failover

Measured by
failover time, [availability](https://banes-lab.com/records/lex/availability.md)

Refactored by
Add Replica, Add Failover Routing

Enforced by
disaster recovery tests

Before

```typescript
const foo = await primaryFooStore.find(id);
```

After

```typescript
const foo = await failover.read([
primaryFooStore,
secondaryFooStore,
], store => store.find(id));
```

### Redundancy

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: contextual
- Scope: infrastructure, service, data
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Replication or Alternate Capacity](https://banes-lab.com/records/lex/replication-or-alternate-capacity.md)

Reinforces
[Fault Tolerance](https://banes-lab.com/records/arch/fault-tolerance.md)

Enables
[Failover](https://banes-lab.com/records/arch/failover.md)

In tension with
[Cost](https://banes-lab.com/records/lex/cost.md)

Conflicts with
[Single Point of Failure](https://banes-lab.com/records/lex/single-point-of-failure.md)

Referenced by
[Fault Tolerance](https://banes-lab.com/records/arch/fault-tolerance.md), [Failover](https://banes-lab.com/records/arch/failover.md), [RAID Redundancy](https://banes-lab.com/records/arch/raid-redundancy.md)

Tensions
[Redundancy Cost](https://banes-lab.com/records/tension/cost-redundancy.md)

Violated by
critical singleton dependency

Detected by
SPOF analysis

Measured by
redundancy factor

Refactored by
Add Replica, Add Backup Path

Enforced by
[architecture review](https://banes-lab.com/records/arch/architecture-review.md)

Before

```typescript
const fooService = deploy({ replicas: 1 });
```

After

```typescript
const fooService = deploy({ replicas: 3, spreadAcross: ["zone-a", "zone-b", "zone-c"] });
```

### Replication

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: contextual
- Scope: database, service, cache
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Consistency Policy](https://banes-lab.com/records/lex/consistency-policy.md)

Reinforces
[Scalability](https://banes-lab.com/records/arch/scalability.md), [Availability](https://banes-lab.com/records/lex/availability.md)

Enables
[Read Scaling](https://banes-lab.com/records/lex/read-scaling.md), [Failover](https://banes-lab.com/records/arch/failover.md)

In tension with
[Consistency Lag](https://banes-lab.com/records/lex/consistency-lag.md)

Conflicts with
[Single Copy State](https://banes-lab.com/records/lex/single-copy-state.md)

Referenced by
[Read Replica](https://banes-lab.com/records/arch/read-replica.md)

Tensions
[Replication Consistency Lag](https://banes-lab.com/records/tension/consistency-lag-replication.md)

Violated by
unreplicated critical state

Detected by
SPOF data stores

Measured by
replication lag, replica count

Refactored by
Add Replica, Define Consistency Model

Enforced by
infrastructure policy

Before

```typescript
await primaryFooStore.save(foo);
```

After

```typescript
await replicatedFooStore.save(foo, { replicas: 3, writeQuorum: 2 });
```

### Auto-Scaling

- Kind: [capability](https://banes-lab.com/records/kind/capability.md)
- Severity: contextual
- Scope: deployment, service, infrastructure
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Horizontal Scalability](https://banes-lab.com/records/lex/horizontal-scalability.md), [Metrics](https://banes-lab.com/records/lex/metrics.md)

Reinforces
[Elasticity](https://banes-lab.com/records/arch/elasticity.md)

Enables
[Demand-Based Capacity](https://banes-lab.com/records/lex/demand-based-capacity.md)

In tension with
[Cost/Cold Start](https://banes-lab.com/records/lex/cost-cold-start.md), [Fixed Capacity](https://banes-lab.com/records/lex/fixed-capacity.md)

Conflicts with
none

Referenced by
[Elasticity](https://banes-lab.com/records/arch/elasticity.md), [Statelessness](https://banes-lab.com/records/arch/statelessness.md)

Tensions
[Auto-Scaling Cost/Cold Start](https://banes-lab.com/records/tension/auto-scaling-cost-cold-start.md), [Auto-Scaling Fixed Capacity](https://banes-lab.com/records/tension/auto-scaling-fixed-capacity.md)

Violated by
manual-only scaling for variable load

Detected by
saturation under load without scale policy

Measured by
scaling latency, saturation rate

Refactored by
Add Scaling Policy, Make Service Stateless

Enforced by
infrastructure-as-code policy

Before

```typescript
deployFooWorkers({ replicas: 4 });
```

After

```typescript
deployFooWorkers({
minReplicas: 2,
maxReplicas: 20,
scaleOn: { queueDepthPerWorker: 100 },
scaleInCooldownSeconds: 300,
});
```

### Auto-Remediation

- Kind: [capability](https://banes-lab.com/records/kind/capability.md)
- Severity: contextual
- Scope: runtime, infrastructure
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Detection Signal](https://banes-lab.com/records/lex/detection-signal.md), [Remediation Workflow](https://banes-lab.com/records/lex/remediation-workflow.md)

Reinforces
[Self-Healing](https://banes-lab.com/records/lex/self-healing.md)

Enables
[Incident Reduction](https://banes-lab.com/records/lex/incident-reduction.md)

In tension with
[Unsafe Automation](https://banes-lab.com/records/lex/unsafe-automation.md), [Manual Remediation](https://banes-lab.com/records/lex/manual-remediation.md)

Conflicts with
[Manual Runbook Dependency](https://banes-lab.com/records/arch/manual-runbook-dependency.md)

Tensions
[Auto-Remediation Unsafe Automation](https://banes-lab.com/records/tension/auto-remediation-unsafe-automation.md), [Auto-Remediation Manual Remediation](https://banes-lab.com/records/tension/auto-remediation-manual-remediation.md)

Violated by
repeatable failure with no automated response

Detected by
repeated manual runbook actions

Measured by
remediation success, false action rate

Refactored by
Automate Runbook, Add Guardrails

Enforced by
operations policy

Before

```typescript
alert.on("FooDiskFull", pageOnCall);
```

After

```typescript
alert.on("FooDiskFull", async event => {
await fooStorage.compact(event.volumeId);
await fooStorage.verify(event.volumeId);
});
```

### Rollback

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: mandatory
- Scope: deployment, release
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Versioned Artifact](https://banes-lab.com/records/lex/versioned-artifact.md), [Reversible Deployment](https://banes-lab.com/records/lex/reversible-deployment.md)

Reinforces
[Resilience](https://banes-lab.com/records/arch/resilience.md), [Recovery](https://banes-lab.com/records/lex/recovery.md)

Enables
[Fast Failure Recovery](https://banes-lab.com/records/lex/fast-failure-recovery.md)

In tension with
[Data Migration Compatibility](https://banes-lab.com/records/lex/data-migration-compatibility.md)

Conflicts with
[Irreversible Deployment](https://banes-lab.com/records/lex/irreversible-deployment.md), [Irreversible Migration](https://banes-lab.com/records/arch/irreversible-migration.md)

Referenced by
[Blue-Green Deployment](https://banes-lab.com/records/arch/blue-green-deployment.md)

Tensions
[Rollback Data Migration Compatibility](https://banes-lab.com/records/tension/data-migration-compatibility-rollback.md)

Violated by
deployment cannot be reverted

Detected by
no rollback path

Measured by
rollback success time

Refactored by
Add Rollback Plan, Make Migration Backward-Compatible

Enforced by
release gates

Before

```typescript
deploy(fooVersion);
```

After

```typescript
const release = await deploy(fooVersion);
if (!(await release.verify())) await release.rollback(previousFooVersion);
```

### Blue-Green Deployment

- Kind: [pattern](https://banes-lab.com/records/kind/pattern.md)
- Severity: contextual
- Scope: deployment, release
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Parallel Environments](https://banes-lab.com/records/lex/parallel-environments.md)

Reinforces
[Rollback](https://banes-lab.com/records/arch/rollback.md), [Availability](https://banes-lab.com/records/lex/availability.md)

Enables
[Low-Risk Cutover](https://banes-lab.com/records/lex/low-risk-cutover.md)

In tension with
[Infrastructure Cost](https://banes-lab.com/records/lex/infrastructure-cost.md)

Conflicts with
[In-Place Mutation Only](https://banes-lab.com/records/lex/in-place-mutation-only.md)

Tensions
[Blue-Green Deployment Infrastructure Cost](https://banes-lab.com/records/tension/blue-green-deployment-infrastructure-cost.md)

Violated by
high-risk in-place production deploys

Detected by
no parallel release environment

Measured by
cutover failure rate

Refactored by
Add Blue/Green Environments

Enforced by
deployment pipeline

Before

```typescript
routeAllTraffic(deployFoo("v2"));
```

After

```typescript
const green = await deployFoo("v2");
await verify(green);
await router.switch({ from: "blue", to: "green" });
```

### Canary Deployment

- Kind: [pattern](https://banes-lab.com/records/kind/pattern.md)
- Severity: contextual
- Scope: deployment, release
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Traffic Splitting](https://banes-lab.com/records/lex/traffic-splitting.md), [Observability](https://banes-lab.com/records/arch/observability.md)

Reinforces
[Progressive Delivery](https://banes-lab.com/records/lex/progressive-delivery.md)

Enables
[Controlled Exposure](https://banes-lab.com/records/lex/controlled-exposure.md)

In tension with
[Rollout Complexity](https://banes-lab.com/records/lex/rollout-complexity.md)

Conflicts with
[Big-Bang Deployment](https://banes-lab.com/records/lex/big-bang-deployment.md), [Big-Bang Release](https://banes-lab.com/records/arch/big-bang-release.md)

Tensions
[Canary Deployment Rollout Complexity](https://banes-lab.com/records/tension/canary-deployment-rollout-complexity.md)

Violated by
full rollout without health/error guard

Detected by
no staged traffic policy

Measured by
canary error budget, rollback trigger rate

Refactored by
Add Canary Stage, Add Automated Guardrails

Enforced by
deployment pipeline

Before

```typescript
await router.route("foo-v2", 100);
```

After

```typescript
await router.route("foo-v2", 5);
await verifyCanary({ errorRate: 0.01, latencyP95Ms: 200 });
await router.progressiveShift("foo-v2", [25, 50, 100]);
```

### Chaos Engineering

- Kind: [activity](https://banes-lab.com/records/kind/activity.md)
- Severity: contextual
- Scope: system, resilience, operations
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Observability](https://banes-lab.com/records/arch/observability.md)

Reinforces
[Self-Healing Architecture](https://banes-lab.com/records/arch/self-healing-architecture.md), [Fault Tolerance](https://banes-lab.com/records/arch/fault-tolerance.md)

Enables
[Empirical Resilience Verification](https://banes-lab.com/records/lex/empirical-resilience-verification.md)

In tension with
[Production Risk](https://banes-lab.com/records/lex/production-risk.md)

Conflicts with
[Untested Failure Assumptions](https://banes-lab.com/records/lex/untested-failure-assumptions.md)

Tensions
[Chaos Engineering Production Risk](https://banes-lab.com/records/tension/chaos-engineering-production-risk.md)

Violated by
resilience assumed but never exercised

Detected by
no fault-injection testing of recovery paths

Measured by
unverified failure-mode count

Refactored by
Introduce Controlled Fault Injection

Enforced by
resilience review

Before

```typescript
assumeFooSurvivesZoneLoss();
```

After

```typescript
chaos.experiment("foo-zone-loss", {
inject: () => killZone("zone-a"),
hypothesis: () => fooHealth.available(),
});
```

### Graceful Shutdown

- Kind: [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- Severity: mandatory for production systems
- Scope: service, runtime, resilience
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Lifecycle Signals](https://banes-lab.com/records/lex/lifecycle-signals.md)

Reinforces
[Reliability](https://banes-lab.com/records/lex/reliability.md), [Data Integrity](https://banes-lab.com/records/lex/data-integrity.md)

Enables
[In-Flight Work Drain](https://banes-lab.com/records/lex/in-flight-work-drain.md), [Connection Cleanup](https://banes-lab.com/records/lex/connection-cleanup.md)

In tension with
[Shutdown Latency](https://banes-lab.com/records/lex/shutdown-latency.md)

Conflicts with
[Hard Process Kill](https://banes-lab.com/records/lex/hard-process-kill.md)

Tensions
[Graceful Shutdown Shutdown Latency](https://banes-lab.com/records/tension/graceful-shutdown-shutdown-latency.md)

Violated by
processes terminated mid-request with no drain

Detected by
dropped in-flight work on deploy/restart

Measured by
requests lost per restart

Refactored by
Implement Graceful Drain on Shutdown

Enforced by
operations review

Before

```typescript
process.on("SIGTERM", () => process.exit(0));
```

After

```typescript
process.on("SIGTERM", async () => {
server.stopAccepting();
await fooQueue.drain();
await server.close();
process.exit(0);
});
```

### RAID Redundancy

- Kind: [technique](https://banes-lab.com/records/kind/technique.md)
- Severity: mandatory for managed infrastructure
- Scope: storage, redundancy, infrastructure
- Layer: [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)

Details

Requires
[Multiple Physical Disks](https://banes-lab.com/records/lex/multiple-physical-disks.md)

Reinforces
[Redundancy](https://banes-lab.com/records/arch/redundancy.md), [Fault Tolerance](https://banes-lab.com/records/arch/fault-tolerance.md)

Enables
[Disk-Failure Survival](https://banes-lab.com/records/lex/disk-failure-survival.md), [Parity-Based Recovery](https://banes-lab.com/records/lex/parity-based-recovery.md)

In tension with
[Write Amplification](https://banes-lab.com/records/lex/write-amplification.md)

Conflicts with
[Single-Disk Point of Failure](https://banes-lab.com/records/lex/single-disk-point-of-failure.md)

Tensions
[RAID Redundancy Write Amplification](https://banes-lab.com/records/tension/raid-redundancy-write-amplification.md)

Violated by
durable data written to a single disk with no physical redundancy

Detected by
total data loss when one drive fails

Measured by
tolerated simultaneous disk failures

Refactored by
Place data on a mirrored or parity RAID array (RAID 1/5/10)

Enforced by
storage architecture review

Before

```typescript
const store = new SingleDiskFooStore("/dev/sda");
```

After

```typescript
const store = new FooStore({
volume: raidArray({ level: 10, disks: ["/dev/sda", "/dev/sdb", "/dev/sdc", "/dev/sdd"] }),
});
```

## Links to

- [capability](https://banes-lab.com/records/kind/capability.md)
- [Correctness Core](https://banes-lab.com/records/layer/correctness-core.md)
- [Observability](https://banes-lab.com/records/arch/observability.md)
- [Health Checks](https://banes-lab.com/records/arch/health-checks.md)
- [Automation](https://banes-lab.com/records/lex/automation.md)
- [Resilience](https://banes-lab.com/records/arch/resilience.md)
- [Autonomous Recovery](https://banes-lab.com/records/arch/autonomous-recovery.md)
- [Automation Risk](https://banes-lab.com/records/lex/automation-risk.md)
- [Manual-Only Recovery](https://banes-lab.com/records/lex/manual-only-recovery.md)
- [Chaos Engineering](https://banes-lab.com/records/arch/chaos-engineering.md)
- [Self-Healing Architecture / Automation Risk](https://banes-lab.com/records/tension/automation-risk-self-healing-architecture.md)
- [Health Signal](https://banes-lab.com/records/lex/health-signal.md)
- [Remediation Action](https://banes-lab.com/records/lex/remediation-action.md)
- [Self-Healing](https://banes-lab.com/records/lex/self-healing.md)
- [Reduced Mean Time to Recovery](https://banes-lab.com/records/lex/reduced-mean-time-to-recovery.md)
- [False Recovery Actions](https://banes-lab.com/records/lex/false-recovery-actions.md)
- [Manual Intervention Dependency](https://banes-lab.com/records/lex/manual-intervention-dependency.md)
- [Self-Healing Architecture](https://banes-lab.com/records/arch/self-healing-architecture.md)
- [Autonomous Recovery / False Recovery Actions](https://banes-lab.com/records/tension/autonomous-recovery-false-recovery-actions.md)
- [mechanism](https://banes-lab.com/records/kind/mechanism.md)
- [Observable Health Criteria](https://banes-lab.com/records/lex/observable-health-criteria.md)
- [Load Balancing](https://banes-lab.com/records/arch/load-balancing.md)
- [Readiness/Liveness Routing](https://banes-lab.com/records/lex/readiness-liveness-routing.md)
- [False Positives](https://banes-lab.com/records/lex/false-positives.md)
- [Blind Routing](https://banes-lab.com/records/lex/blind-routing.md)
- [Service Discovery](https://banes-lab.com/records/arch/service-discovery.md)
- [Health Checks / False Positives](https://banes-lab.com/records/tension/false-positives-health-checks.md)
- [Redundancy](https://banes-lab.com/records/arch/redundancy.md)
- [Health Detection](https://banes-lab.com/records/lex/health-detection.md)
- [Availability](https://banes-lab.com/records/lex/availability.md)
- [Continuity During Failure](https://banes-lab.com/records/lex/continuity-during-failure.md)
- [Consistency](https://banes-lab.com/records/arch/consistency.md)
- [Single Instance Dependency](https://banes-lab.com/records/lex/single-instance-dependency.md)
- [Replication](https://banes-lab.com/records/arch/replication.md)
- [Failover / Consistency](https://banes-lab.com/records/tension/consistency-failover.md)
- [Replication or Alternate Capacity](https://banes-lab.com/records/lex/replication-or-alternate-capacity.md)
- [Fault Tolerance](https://banes-lab.com/records/arch/fault-tolerance.md)
- [Failover](https://banes-lab.com/records/arch/failover.md)
- [Cost](https://banes-lab.com/records/lex/cost.md)
- [Single Point of Failure](https://banes-lab.com/records/lex/single-point-of-failure.md)
- [RAID Redundancy](https://banes-lab.com/records/arch/raid-redundancy.md)
- [Redundancy / Cost](https://banes-lab.com/records/tension/cost-redundancy.md)
- [Architecture Review](https://banes-lab.com/records/arch/architecture-review.md)
- [Consistency Policy](https://banes-lab.com/records/lex/consistency-policy.md)
- [Scalability](https://banes-lab.com/records/arch/scalability.md)
- [Read Scaling](https://banes-lab.com/records/lex/read-scaling.md)
- [Consistency Lag](https://banes-lab.com/records/lex/consistency-lag.md)
- [Single Copy State](https://banes-lab.com/records/lex/single-copy-state.md)
- [Read Replica](https://banes-lab.com/records/arch/read-replica.md)
- [Replication / Consistency Lag](https://banes-lab.com/records/tension/consistency-lag-replication.md)
- [Horizontal Scalability](https://banes-lab.com/records/lex/horizontal-scalability.md)
- [Metrics](https://banes-lab.com/records/lex/metrics.md)
- [Elasticity](https://banes-lab.com/records/arch/elasticity.md)
- [Demand-Based Capacity](https://banes-lab.com/records/lex/demand-based-capacity.md)
- [Cost/Cold Start](https://banes-lab.com/records/lex/cost-cold-start.md)
- [Fixed Capacity](https://banes-lab.com/records/lex/fixed-capacity.md)
- [Statelessness](https://banes-lab.com/records/arch/statelessness.md)
- [Auto-Scaling / Cost/Cold Start](https://banes-lab.com/records/tension/auto-scaling-cost-cold-start.md)
- [Auto-Scaling / Fixed Capacity](https://banes-lab.com/records/tension/auto-scaling-fixed-capacity.md)
- [Detection Signal](https://banes-lab.com/records/lex/detection-signal.md)
- [Remediation Workflow](https://banes-lab.com/records/lex/remediation-workflow.md)
- [Incident Reduction](https://banes-lab.com/records/lex/incident-reduction.md)
- [Unsafe Automation](https://banes-lab.com/records/lex/unsafe-automation.md)
- [Manual Remediation](https://banes-lab.com/records/lex/manual-remediation.md)
- [Manual Runbook Dependency](https://banes-lab.com/records/arch/manual-runbook-dependency.md)
- [Auto-Remediation / Unsafe Automation](https://banes-lab.com/records/tension/auto-remediation-unsafe-automation.md)
- [Auto-Remediation / Manual Remediation](https://banes-lab.com/records/tension/auto-remediation-manual-remediation.md)
- [Versioned Artifact](https://banes-lab.com/records/lex/versioned-artifact.md)
- [Reversible Deployment](https://banes-lab.com/records/lex/reversible-deployment.md)
- [Recovery](https://banes-lab.com/records/lex/recovery.md)
- [Fast Failure Recovery](https://banes-lab.com/records/lex/fast-failure-recovery.md)
- [Data Migration Compatibility](https://banes-lab.com/records/lex/data-migration-compatibility.md)
- [Irreversible Deployment](https://banes-lab.com/records/lex/irreversible-deployment.md)
- [Irreversible Migration](https://banes-lab.com/records/arch/irreversible-migration.md)
- [Blue-Green Deployment](https://banes-lab.com/records/arch/blue-green-deployment.md)
- [Rollback / Data Migration Compatibility](https://banes-lab.com/records/tension/data-migration-compatibility-rollback.md)
- [pattern](https://banes-lab.com/records/kind/pattern.md)
- [Parallel Environments](https://banes-lab.com/records/lex/parallel-environments.md)
- [Rollback](https://banes-lab.com/records/arch/rollback.md)
- [Low-Risk Cutover](https://banes-lab.com/records/lex/low-risk-cutover.md)
- [Infrastructure Cost](https://banes-lab.com/records/lex/infrastructure-cost.md)
- [In-Place Mutation Only](https://banes-lab.com/records/lex/in-place-mutation-only.md)
- [Blue-Green Deployment / Infrastructure Cost](https://banes-lab.com/records/tension/blue-green-deployment-infrastructure-cost.md)
- [Traffic Splitting](https://banes-lab.com/records/lex/traffic-splitting.md)
- [Progressive Delivery](https://banes-lab.com/records/lex/progressive-delivery.md)
- [Controlled Exposure](https://banes-lab.com/records/lex/controlled-exposure.md)
- [Rollout Complexity](https://banes-lab.com/records/lex/rollout-complexity.md)
- [Big-Bang Deployment](https://banes-lab.com/records/lex/big-bang-deployment.md)
- [Big-Bang Release](https://banes-lab.com/records/arch/big-bang-release.md)
- [Canary Deployment / Rollout Complexity](https://banes-lab.com/records/tension/canary-deployment-rollout-complexity.md)
- [activity](https://banes-lab.com/records/kind/activity.md)
- [Empirical Resilience Verification](https://banes-lab.com/records/lex/empirical-resilience-verification.md)
- [Production Risk](https://banes-lab.com/records/lex/production-risk.md)
- [Untested Failure Assumptions](https://banes-lab.com/records/lex/untested-failure-assumptions.md)
- [Chaos Engineering / Production Risk](https://banes-lab.com/records/tension/chaos-engineering-production-risk.md)
- [Lifecycle Signals](https://banes-lab.com/records/lex/lifecycle-signals.md)
- [Reliability](https://banes-lab.com/records/lex/reliability.md)
- [Data Integrity](https://banes-lab.com/records/lex/data-integrity.md)
- [In-Flight Work Drain](https://banes-lab.com/records/lex/in-flight-work-drain.md)
- [Connection Cleanup](https://banes-lab.com/records/lex/connection-cleanup.md)
- [Shutdown Latency](https://banes-lab.com/records/lex/shutdown-latency.md)
- [Hard Process Kill](https://banes-lab.com/records/lex/hard-process-kill.md)
- [Graceful Shutdown / Shutdown Latency](https://banes-lab.com/records/tension/graceful-shutdown-shutdown-latency.md)
- [technique](https://banes-lab.com/records/kind/technique.md)
- [Multiple Physical Disks](https://banes-lab.com/records/lex/multiple-physical-disks.md)
- [Disk-Failure Survival](https://banes-lab.com/records/lex/disk-failure-survival.md)
- [Parity-Based Recovery](https://banes-lab.com/records/lex/parity-based-recovery.md)
- [Write Amplification](https://banes-lab.com/records/lex/write-amplification.md)
- [Single-Disk Point of Failure](https://banes-lab.com/records/lex/single-disk-point-of-failure.md)
- [RAID Redundancy / Write Amplification](https://banes-lab.com/records/tension/raid-redundancy-write-amplification.md)

## Linked from

- [The layer topology](https://banes-lab.com/ontology/schema/the-layer-topology.md)
- [The membership](https://banes-lab.com/ontology/schema/the-membership.md)