High error rate 오류율 상승 · high-error-rate

Cases

1. IL-0009 A generated name collision made Argo CD delete the production environment — InfluxData, 2023, sev1

   Root cause Configuration change

2. IL-0010 A dropped template delimiter made Argo CD delete every service worldwide — Skyscanner, 2021, sev1

   Root cause Configuration change

3. IL-0012 CPU limits and a kernel scheduler bug stalled multi-threaded services — Omio, 2020, sev3

   Root cause Software defect

4. IL-0013 Connection resets from a full conntrack table on GKE nodes — loveholidays, 2020

   Root cause Capacity exhaustion

5. IL-0002 Builder pods lost IAM credentials when kubelet fell behind the API rate limit — Zalando, 2019

   Root cause Capacity exhaustion

6. IL-0001 Cluster-wide DNS outage after CoreDNS ran out of memory — Zalando, 2019

   Root cause Capacity exhaustion

7. IL-0003 Payment failures that grew into a full platform outage — Monzo, 2017, sev1

   Root cause Software defect