A Backup Horror Story
My second job (starting 1992) was for a company named Falcon Information Services, and my task was to rewrite a DOS based technical analysis program written in TP – for TPW for Windows. Incidentally, my first development task ever for Windows.
It was a small company, only 15 people, but with a significant market share in the financial market, and it was an awesome place to work.
One day, my boss told me the story of the backup system they bought a few years before I started. At the time, their backbone data delivery was all done on Unix (Solaris), and the operations machine was the development machine as well. So, one day, they have a discussion: “Perhaps we should get a backup system? We are a bit vulnerable”. So, they bought a high end backup system, installed it, and made a full disk backup.
“We should try a restore too, so that we know that it works”.
They did, and it didn’t. It was Friday evening, and the disk partitions were all blank.
My boss ended up on the front page of Norway’s biggest business magazine “Kapital” with the headline “Lost Everything”. Inside was the story of how he and the three Unix developers rewrote the distribution system from scratch and memory in a single weekend.
On a side note – In Falcon, I got my first “partner in crime” Delphi developer – Hallvard Vassbotn – and I learned a lot!
Two years after I joined, Reuters bought Falcon, and the the core parts of that Unix based system was still in use when I left Reuters in 2007, and remained there until it was replaced by a Reuters system in 2011 – so at least they did a good job!
Hire good programmers that can rewrite software in a weekend?
Make sure you can survive that your backup restore fails!
Keep making backups. You just never know.