Incident Library?

Incident Library?

Component ?

Kubernetes API server 쿠버네티스 API 서버 · `kube-apiserver`

4 cases · 2017 to 2024

Root cause ?Configuration change 2 Capacity exhaustion 1 Software defect 1

Contributing factor ?Single point of failure 2 Excessive blast radius 1 Unreviewed defaults 1 Cache-masked failure 1 Harmful manual action 1 Monitoring blind spot 1 No alert on limit 1 No health probes 1 No staged rollout 1 Unrepresentative staging 1

Symptom ?Service outage 3 Control plane unresponsive 2 High error rate 2 Control plane lag 1 Credentials unavailable 1 DNS resolution failures 1 Node recreation loop 1 Stale endpoint routing 1 Upgrade stall 1

Cases, by severity

IL-0005 Telemetry rollout overloaded the control planes and broke service discovery — OpenAI, 2024, sev1
Root cause Configuration change
IL-0008 A validating webhook with a dead backend stalled a GKE master upgrade — Jetstack, 2019, sev1
Root cause Configuration change
IL-0003 Payment failures that grew into a full platform outage — Monzo, 2017, sev1
Root cause Software defect
IL-0002 Builder pods lost IAM credentials when kubelet fell behind the API rate limit — Zalando, 2019
Root cause Capacity exhaustion

View on the graph