✍️ Engineering Blog & Thought Leadership

Engineering Blog & War Stories

Architectural patterns, production war stories, and engineering philosophy across 18+ years of infrastructure operations.

🚨 Interactive Post-Mortem Outage Simulator

Production Incident Command Simulator

Select a real-world enterprise incident scenario, evaluate telemetry diagnostics, and choose the correct architectural fix.

STATUS:CRITICAL_SEV_1
COMMAND_LEVEL:L1_ROOKIE (0/6)
SRE COMMAND XP & RANK PROGRESSION0 / 600 XP
πŸ† No Badges Unlocked
πŸ€–FunctionGemma AI Incident Commander
100% OFFLINE WEBGPU

Issue diagnostic voice or quick action commands to FunctionGemma to analyze packet traces, check local-pref steering, or diagnose MTU drops.

TELEMETRY DIAGNOSTIC REPORTSYSTEM: UNKNOWN

Choose Engineering Action:
πŸ“š
Career Arc Reading Progress
Track your journey through 18+ years of infrastructure war stories
0 / 124 (0%)
πŸ”
Showing 124 Articles
Domains:
FILTER BY ERA:
Jul 19, 2026⏱️ 7 min read

I Learned BGP on a Delhi Rooftop, Not in a Lab

How aligning WiMAX antennas at -82 dBm in 45Β°C heat taught me more about network fundamentals than any certification course ever did β€” and why infrastructure engineers are better prepared for AI than they think.

Read Post →
Mar 10, 2025⏱️ 5 min read

The Agentic System That Worked Perfectly β€” Until It Didn't

We deployed a multi-agent AI pipeline to automate cloud infrastructure provisioning requests. For three weeks it performed flawlessly. Then it provisioned 47 Azure resource groups it was never supposed to create. A post-mortem on what happens when stateful agent FSMs meet ambiguous instructions.

Read Post →
Sep 12, 2024⏱️ 5 min read

Blameless Post-Mortems: Fixing Systems, Not People

Why punitive engineering cultures encourage technicians to hide mistakes, and how establishing a blameless post-mortem framework restored delivery velocity after a major outage.

Read Post →
Jun 18, 2024⏱️ 5 min read

The BGP Steering Incident That Killed Our Low-Latency Guarantee

A misconfigured Azure ExpressRoute BGP local-preference attribute silently rerouted production AI inference traffic through a secondary circuit β€” increasing latency from 18ms to 340ms for 72 hours before anyone noticed. Here is why it happened and how we fixed the detection gap permanently.

Read Post →
Feb 14, 2024⏱️ 5 min read

The Pull Request That Blocked $47K/Month in Cloud Spend

How a single Checkov policy gate in a GitHub Actions CI pipeline stopped a Terraform plan that would have quietly provisioned $47,000/month in idle Azure infrastructure β€” and why the real story is about what we missed for six months before it.

Read Post →
Nov 14, 2022⏱️ 6 min read

The Kubernetes CNI Bug That Isolated 140 Production Pods at Midnight

How a subtle NSX Container Plugin (NCP) CNI translation bug silently corrupted Kubernetes NetworkPolicy rules across enterprise SDDC clusters β€” and how we rebuilt the NetDevOps automation pipeline to catch CNI state drift before production rollouts.

Read Post →
Nov 22, 2021⏱️ 6 min read

The Ansible Tower Pipeline That Wiped the Wrong Environment

How an Ansible Tower Zero-Touch Provisioning pipeline ran a full teardown workflow against production NSX-T segments instead of the staging cluster β€” and the idempotency and environment isolation controls we should have built on day zero.

Read Post →
⚑ Theme Adaptive Shift
Switching layouts matching domain reading affinity...