8
Had a brutal outage day last Tuesday that made me rethink our whole backup setup
We lost connectivity for about 4 hours straight across 3 offices in Phoenix. Turns out our secondary fiber line shared the same physical conduit as the primary for a 2 mile stretch. A construction crew hit both lines at once with a backhoe. My boss asked why we even pay for redundant links if they run together. Now I'm mapping out all our fiber paths this month. Has anyone else found dumb single points of failure in their supposedly redundant setups?
2 comments
Log in to join the discussion
Log In2 Comments
benb215d agoMost Upvoted
Respectfully, I see it a bit different. Redundancy plans can only catch what you know to check, and you found this one the hard way.
1
rowanbennett5d ago
Saw a piece the other day about how most backup failures come from the stuff nobody thinks to test, and that's exactly what @benb21 is getting at here. Feels like one of those lessons you gotta learn the messy way.
6