As a sysadmin that's pretty much my worst nightmare. I really feel for those trying to pick the pieces back up again after that.
post
Wow. this is one of the biggest instances of IT incompetence that I've heard of in recent years. Hosting a server farm without remote backups? Sound like the London Magnetic Tape Incident.
The LMTI: One employee was sent to the other end of London with the magnetic backup tapes every day. He got money to take a taxi, but saved it and took the tube. His favourite seat was right above one of the motors, where he sat the bag with the tapes on the floor for the journey. The tapes were just stored at the destination, and not checked in any way. Guess what they learned the first time they had to rely on those tapes?
Korean government's
South.
(Just in case anybody else isn't a clairvoyant either)
I'll be honest, I assumed it was the South because I would be honestly shocked if the North ever reported anything bad happening to itself.
The north doesn't need backups because errors do not happen there /s
“Cloud storage” in the North is just a drawer full of usb sticks confiscated from people smuggling K-dramas in from the South.
The DPRK has their own intranet called kwangmyong, which needs its own storage and servers. Citizens use it regularly, access to the broader global internet however is more controlled and limited to specific jobs and positions as far as I know.
Hmm a system that stored government documents caught fire and they have no backups? Hmm, this carries the same energy of registry offices catching fire "spontaneously" in the past.
Always have two backups in different places than the original. If not, the least you can do is have one backup copy. How does the government don't have such thing?
Government people get jobs by schmoozing and making deals, not by merit or skill.
Pournelle's Law always seems relevant.
Ooh, ooh! I'm in that law! I'm in the (to paraphrase) "competent and devoted to the goal but unempowered" group!
I have one backup but keep legacy things so that in a massive disaster I still have archives that have some of my important long term type documents. So figure one up to date backup and in a disaster I have stuff from last year.
This is a clear example where 'the cloud' really is a physical place.
What else would it be? What do people think the cloud is?
For a long while, I had hoped it was at least 6 physical places, with various redundancies. A few billion small-ish servers at internet network hubs.
That or the magical floating bits that go over hackers heads in the movies. Those also look like the cloud. Not very secure, but quite convenient.
Perhaps contained evidence against the former PM who tried to do a military coup and this is the way of getting rid of it? Perhaps protecting co-conspirators if not the top guy.
At least they saved the Internet box. Otherwise, we'll have to bother the elders of the Internet again.
Disaster Recovery Concepts:
- Recovery time objective (RTO): maximum time to restore system function.
- Recovery point objective (RPO): maximum age of data needed to resume operations.
- Recovery consistency objective (RCO): how many inconsistent entries are allowed in recovered data.
- Sierra Madre objective (SMO): We don't need no stinkin' backups.
Get disaster insurance, wait for failure, collect a big c-suite payout and move to the next company.
Everyone else gets to find new exciting jobs.
Too slow storage to back up? What a stupid, false reason. I assume nobody works at night. Do something else than full backups and you at least have something. A simple differential update replication would have saved them here.
Or do it by priority. Files that change often or are very important are copied fully often, maybe daily. A differential update of all files could follow daily or who knows weekly. Its the government, they should have money to add more storage, so that shouldn't be the problem. At least some strategy to manage slow speed, instead not having ANY backup its the dumbest thing I've read from governments in a while.
Even though they historically used to have a great backup system for their historians and government records.
see link: https://en.wikipedia.org/wiki/Veritable_Records_of_the_Joseon_Dynasty
Weird how there is a rising MAGA party in KR and an aligned former pm who attempted a coup. What a weird coincidence.
It's too bad it wasn't a rain cloud or it would have destroyed the fire and not the other way around
saw a sticker recently that said "there is no cloud, just other people's computers"
Great talk that touches on this from CCC
https://www.youtube.com/watch?v=0dMzlw-qSZI
TLDR it was to destroy evidence the day before a government investigation.
top 50 comments