← Recipes

阅读中文版本

Guarantee Drain Safety with a Pod Disruption Budget

Set a Pod Disruption Budget so a voluntary drain like a node upgrade cannot evict the last replica and cause downtime.

~15 minkubernetespdbdrain

Task

Configure kubectl create pdb api-pdb --min-available=1 --selector=app=api so the cluster enforces the policy at admission time instead of relying on manual review.

When to use this

A developer deploys a pod without kubectl create pdb api-pdb --min-available=1 --selector=app=api and it disrupts a node, causing evictions on a production cluster.

Prerequisites

  • A Kubernetes cluster with kubectl access
  • Cluster admin or namespace edit RBAC

Steps

1. Configure kubectl create pdb api-pdb --min-available=1 --selector=app=api in the project configuration file with the recommended defaults.

kubectl create pdb api-pdb --min-available=1 --selector=app=api

Expected output: The configuration is accepted and kubectl create pdb api-pdb --min-available=1 --selector=app=api runs without errors on the first invocation.

2. Run the check locally to verify kubectl create pdb api-pdb --min-available=1 --selector=app=api produces the expected result before pushing.

pnpm test

Expected output: Local run matches CI behavior; no surprises after push.

3. Add the gate to the CI pipeline so kubectl create pdb api-pdb --min-available=1 --selector=app=api blocks merge on failure.

- name: Run add pdb drain safety
  run: pnpm test

Expected output: Pull requests with failing kubectl create pdb api-pdb --min-available=1 --selector=app=api are blocked from merging.

Troubleshooting

Problem

The check passes locally but fails in CI

Solution

Pin dependency versions and the runtime to match CI exactly; reproduce with the same Docker image or act.

Problem

Configuration is rejected with a schema error

Solution

Check the tool version matches the config schema; older versions may not support newer fields.

Limitations

  • The gate only runs on events that trigger the workflow; locally pushed commits bypass it.
  • Configuration drift is possible if someone edits settings outside version control.

Enforce at admission

Start by measuring the problem. Set a Pod Disruption Budget so a voluntary drain like a node upgrade cannot evict the last replica and cause downtime. The most common mistake is adding the gate without first confirming it catches the issue you care about. Run kubectl create pdb api-pdb –min-available=1 –selector=app=api against the current codebase and inspect the output before wiring it into CI.

kubectl create pdb api-pdb --min-available=1 --selector=app=api

Verify the policy

Once the gate is in place, make failures actionable. A failing kubectl create pdb api-pdb –min-available=1 –selector=app=api should point to the exact file and line, not a generic error. Pin the tool version in the lockfile so a upstream release does not silently change behavior. Review the gate output in every pull request just like a test result.