Incident Library?

API · MCP 한국어

Incident Library?

API · MCP 한국어

Symptom ?

Data loss

데이터 유실 · data-loss

2 cases · 2020 to 2021

Root cause ?Cloud provider outage 1 Software defect 1

Component ?Application database 2 Helm 1 Container memory limit 1 Persistent volumes and stateful sets 1

Contributing factor ?Unverified assumption 2 Excessive blast radius 1 No staged rollout 1 Single point of failure 1

Cases

IL-0172 An AWS Tokyo data centre cooling failure took down 6 of 60 CockroachDB nodes on Kubernetes within 22 minutes, and ranges lost quorum because the Helm-deployed cluster had no availability zone locality configuredDevsisters · 2021
Root cause Cloud provider outage
IL-0196 Adding a second Redis replica and lowering memory limits in one RedisFailover change restarted the only Redis pod that held data, and Sentinel promoted the empty new replica, erasing the dataPalark · 2020
Root cause Software defect

View on the graph