Incident Library?

Incident Library?

Contributing factor ?

No safeguard on destructive change 파괴적 변경 보호 장치 부재 · `no-safeguard-on-destructive-change`

2 cases · 2019 to 2023

Root cause ?Cloud provider outage 1 Configuration change 1

Component ?Argo CD 1 Cluster autoscaler 1 GKE control plane 1 Horizontal pod autoscaler 1 Ingress controller 1 Node pool 1 Persistent volumes and stateful sets 1

Symptom ?Service outage 2 Autoscaler misbehaviour 1 High error rate 1 Resources deleted 1 Upgrade stall 1

Cases

IL-0009 A generated name collision made Argo CD delete the production environment — InfluxData, 2023, sev1
Root cause Configuration change
IL-0014 A GKE upgrade that stalled, left zombie nodes and broke an ingress — loveholidays, 2019
Root cause Cloud provider outage

View on the graph