Workflows

Repeatable engineering workflows with explicit verification.

364 published

Page 3 of 11

Chaos Experiment Workflow

Define a steady state hypothesis, inject a failure in a blast-radius-bounded way, observe the system, and abort on SLO breach so the experiment never harms users.

advanced~70 min
chaos · resilience · testing

Cold Start Mitigation Workflow

Measure the cold-start latency of a serverless function, identify whether it is import or init bound, and apply the right mitigation from provisioned concurrency to lazy imports.

intermediate~45 min
serverless · cold-start · performance

Connection Pool Exhaustion Workflow

Diagnose and resolve connection pool exhaustion by measuring pool utilization, identifying leaks, tuning the pool size, and adding a circuit breaker on the downstream.

advanced~50 min
connection-pool · diagnosis · resilience

Contract Testing Workflow with Pact

Have the consumer write a pact for the expected interactions, publish it to a broker, and let the provider verify against the pact so a breaking change fails the provider build.

intermediate~55 min
pact · contract-testing · integration

Database Sharding Workflow

Pick a shard key with even distribution, route writes through a shard-aware driver, and migrate rows shard by shard while a dual-write window keeps the old and new in sync.

advanced~90 min
sharding · database · migration

Deadlock Diagnosis Workflow

Diagnose a deadlock by capturing the lock wait graph at the moment of deadlock, identifying the cycle, and breaking it by ordering lock acquisition.

advanced~45 min
deadlock · diagnosis · concurrency

Disaster Recovery Drill Workflow

Declare a region failed, fail over to the standby using the runbook, measure the recovery time and data loss, and feed the gaps back into the runbook before the next drill.

advanced~120 min
dr · failover · drill

Feature Flag Rollout Workflow

Ship a change behind a flag off, ramp the percentage in steps while watching the SLO, and kill the flag instantly if the error rate rises, then clean up once stable.

intermediate~40 min
feature-flag · rollout · release

Hot Key Rebalancing Workflow

Identify a hot key that overloads one shard, split it across replicas or sub-keys, and verify the load is balanced without changing the application semantics.

advanced~40 min
hot-key · sharding · rebalancing

Hotfix Deployment Workflow

Branch from production, make the minimal fix, run the targeted test suite, ship straight to production, and cherry-pick back to main so the fix is not lost on the next release.

intermediate~30 min
hotfix · release · incident

Incident Postmortem Workflow

Run a blameless review within a week, reconstruct the timeline from alerts and logs, find the contributing factors, and track actions with owners and dates.

beginner~60 min
incident · postmortem · learning

Load Shedding Workflow

Classify requests by criticality, shed the lowest tier first when saturation rises, and shed progressively so the system stays available for the most important traffic.

intermediate~45 min
load-shedding · resilience · overload

Migration Cutover Workflow

Run old and new in parallel with a dual-write gate, shift read traffic by percentage, verify parity on a canary, then cut over and keep the old on standby for rollback.

intermediate~60 min
migration · cutover · parity

Observability Onboarding Workflow

Add the three pillars to a service in order, start with logs that answer who and what, add metrics that answer how much, and finish with traces that answer where.

beginner~50 min
observability · logging · tracing

Postmortem Action Item Verification Workflow

Track action items with owners and dates, verify they actually reduce the risk, test that they work, and close them only with evidence.

intermediate~90 min
incident · reliability · process

Alert Noise Reduction Workflow

Measure which alerts fire most and how many are actionable, suppress or fix the noisy ones, and reserve paging for conditions that need a human now.

intermediate~90 min
observability · oncall · operations

Contract-First API Design Workflow

Write the OpenAPI or protobuf contract first, review it with consumers, generate stubs and docs from it, and treat the contract as the source of truth.

intermediate~120 min
api · design · ci

API Deprecation and Sunset Workflow

Announce a deprecation, emit sunset and deprecation headers, measure remaining usage, and remove the endpoint only after consumers migrate.

intermediate~90 min
api · lifecycle · communication

API Error Format Standardization Workflow

Define an error schema with code, message, and details, map status codes consistently, document it, and migrate endpoints to it over time.

intermediate~90 min
api · error-handling · consistency

API Gateway Configuration Review Workflow

Review routes, auth, timeouts, and rate limits at the gateway, remove unused routes, and confirm the gateway does not silently weaken backend protections.

intermediate~90 min
api · gateway · security

API Key Rotation Workflow

Issue a new key alongside the old, support an overlap window, monitor usage on both keys, and revoke the old key once traffic has moved.

intermediate~60 min
security · secrets · api

API Pagination Standardization Workflow

Choose one pagination style across the API, define cursor or page semantics, document limits and errors, and migrate inconsistent endpoints gradually.

intermediate~90 min
api · design · consistency

Architecture Decision Record Workflow

Record significant decisions with context, options, and consequences, review them, and supersede rather than delete when they change.

beginner~60 min
architecture · documentation · process

Artifact Retention and Cleanup Workflow

Classify artifacts by retention need, apply lifecycle rules to expire them, and clean up storage and indexes so old artifacts do not accumulate cost.

beginner~60 min
ci · operations · cost

Authorization Model Review Workflow

Document the authorization model, test role and permission boundaries, look for privilege creep, and adjust the model before it drifts from reality.

intermediate~120 min
security · authorization · governance

Backup Encryption Audit Workflow

Verify backups are encrypted at rest and in transit, keys are separate from the data, access is restricted, and restores still work with the keys.

intermediate~90 min
backup · security · encryption

Bot Mitigation Tuning Workflow

Baseline legitimate traffic, tune detection rules against real data, measure false positives, and escalate responses gradually instead of blocking broadly.

intermediate~120 min
security · anti-abuse · operations

Breaking Change Deprecation Workflow

Classify a change as breaking, offer a compatible path during a transition, communicate a timeline, and remove the old behavior only after migration.

intermediate~120 min
api · versioning · communication

Build Time Reduction Workflow

Profile where build time goes, parallelize independent work, cache expensive steps, and drop unnecessary work so CI feedback gets fast.

intermediate~120 min
ci · performance · dx

Changelog Automation Workflow

Capture change notes with each contribution, generate a human-readable changelog at release, and keep breaking changes prominent for consumers.

beginner~60 min
release · documentation · ci

CI Pipeline Secrets Hygiene Workflow

Store CI secrets in the platform secret store, scope them per environment, mask them in logs, and rotate and audit access regularly.

intermediate~90 min
ci · security · secrets

Cloud IAM Policy Review Workflow

List principals and their policies, find wildcard and unused permissions, right-size to least privilege, and keep an owner for every access grant.

advanced~150 min
security · iam · cloud

Cloud Spend Review Workflow

Break down spend by service and owner, find idle and oversized resources, act on the biggest wins, and track savings realized not just identified.

intermediate~90 min
cost · cloud · operations

Configuration-as-Code Audit Workflow

Find configuration changed outside the pipeline, reconcile drift back into code, add controls to prevent it, and ensure the code is the source of truth.

intermediate~120 min
iac · config · operations

Container Image Supply Chain Workflow

Pin base images by digest, scan layers, sign images, verify signatures at deploy, and record provenance so only trusted images run.

advanced~150 min
security · containers · supply-chain

Currency Precision Review Workflow

Represent money in minor units or decimal types, avoid floating point, define rounding to the currency, and centralize formatting and arithmetic.

intermediate~90 min
correctness · finance · quality