Incident Library?

Incident Library?

Symptom ?

Node NotReady 노드 NotReady · `node-not-ready`

2 cases · 2023 to 2024

Root cause ?Capacity exhaustion 1 Dependency failure 1

Component ?Node pool 2 GPU driver 1 Container memory limit 1 Node operating system image 1 Prometheus 1

Contributing factor ?Automation amplification 1 No alert on limit 1

Cases

IL-0021 GKE GPU nodes came up without a working NVIDIA driver — Google Cloud, 2024, sev2
Root cause Dependency failure
IL-0016 Prometheus on the live cluster killed by memory exhaustion — UK Ministry of Justice, 2023, sev3
Root cause Capacity exhaustion

View on the graph