▲ 33 ▼ Optus says changes after a 'routine software upgrade' to blame for nationwide service outage (www.abc.net.au) submitted 2 years ago by Nath@aussie.zone [M] to c/australia@aussie.zone 12 comments fedilink hide all child comments So it turns out that the cause was indeed a rogue change they couldn't roll back as we had been speculating. Weird that whatever this issue is didn't occur in their test environment before they deployed into Production. I wonder why that is.
[–] No1@aussie.zone 11 points 2 years ago* (last edited 2 years ago) (1 child) Change Manager who approved this is gonna be sweating bullets lol "Let's take a look at the change request. Now, see here, this section for Contingencies and Rollback process? Why is it blank?" permalink fedilink source hideshow 2 child comments replies: [–] zurohki@aussie.zone 3 points 2 years ago (1 child) I'm sure there was a rollback process, it just didn't work. permalink fedilink source parent hideshow 2 child comments replies: [–] MalReynolds@slrpnk.net 0 points 2 years ago If you don't test a restored backup, you don't have a backup, same applies here. permalink fedilink source parent
[–] zurohki@aussie.zone 3 points 2 years ago (1 child) I'm sure there was a rollback process, it just didn't work. permalink fedilink source parent hideshow 2 child comments replies: [–] MalReynolds@slrpnk.net 0 points 2 years ago If you don't test a restored backup, you don't have a backup, same applies here. permalink fedilink source parent
[–] MalReynolds@slrpnk.net 0 points 2 years ago If you don't test a restored backup, you don't have a backup, same applies here. permalink fedilink source parent