On-Prem

Storage

Sysadmin's favorite collection of infallible utilities failed … foully

Unnecessary 'maintenance' turned into a fragging foul-up


who, me? Brace yourselves, gentle readers, for we have good news and bad news. The bad news is that the weekend is over, and you have to be back at work. The good news is that Monday brings an instalment of Who, Me? in which Reg readers entertain with tales of technical misfires.

This week, the hero of our tale is "Duke" (not his real name) who, despite dropping out of university, landed a job as a technician at a small PC shop. To give you an idea of the time period, "a Pentium 133 running Office 97 on Windows 95 was the height of business computing, but most of our business clients were still running DOS applications on '486 and earlier PCs" according to Duke.

One of the PC shop's regular clients was an architectural firm that would regularly send its PCs in for "servicing" – much as you would a car. But a PC isn't like a car – there's no published service schedule in the manual. So it was basically left to each tech to decide what to do. For most, this meant "manually running through a bunch of basic health checks, correcting any problems that might be found, and giving the case a wipe down with some industrial cleaning solvents to remove the nicotine stains and restore it to the original factory beige."

Duke would take it a bit further, "running scandisk (or chkdsk if it wasn't available) and accepting the inevitable repairs, making sure there was enough free disk space, emptying C:\TMP, defragging the disk and finally setting the antivirus to run a Full Disk Scan." Crucially, if any of those tools weren't installed on the machines, he'd grab a boot disk from the workshop and run it.

Defragging isn't a big deal anymore – partly because OSes have got much better at disk management and partly because disks are so fast these days that a bit of fragmentation doesn't create the performance hit it once did. But in those days, defragging a disk could make a huge difference, so customers felt like they were getting great value for their service dollar.

One day the architects brought in the server that ran their accounting app for service. As far as Duke could see it was just like any other PC – even the interface looked just like Windows 3.1. He tried to run defrag.exe on it, but it refused to run. So he booted up from his trusty floppy and ran it.

He saw the single most fragmented disk he'd ever seen in his life. Where PCs often came back saying they were ten percent fragmented, this machine was beyond 50 percent fragged. Duke told the utility to fix the disk and headed off to lunch.

Some of you will already have figured out Duke's error here. This was a server, after all, and just because it looked like Windows 3.1 that didn't mean it was Windows 3.1.

It was, in fact, Windows NT 3.5. And the reason his usual defragging tool didn't want to run was because defrag.exe was written for the FAT file system that underpinned DOS, which in turn underpinned Windows 3.1. This machine was using NTFS.

So when Duke returned from lunch to find that the defragger had finished its task, he tested the machine and found that – surprise, surprise – it would not boot. There was only the plaintive error: "Operating System Not Found."

Duke's decision to defragment the hard drive had employed a tool that knew nothing about how NTFS liked to store files. He had, therefore, tossed the contents of the server's drive as if it were a data-based salad from Hell. It was completely scrambled and unrecoverable.

Thankfully, the customer had kept a full set of very recent backups (as you might expect from a firm that sends its PCs off for regular service) and the boss (who knew less about NT than Duke did) forgave the error. Duke gained some valuable experience and a doozy of a "what was the worst mistake you ever made" anecdote to whip out at job interviews.

What's your go-to "worst mistake" anecdote for job interviews? Share the wealth of your experience in an email to Who, Me? and enrich the lives of your fellow readers on some future Monday morn. ®

Send us news
55 Comments

Enterprising techie took the bumpy road to replacing vintage hardware

Nice ridiculously redundant drive you've got there – what a pity if something …happened to it

IT sent the intern to sort out the nasty VP who was too important to bother with backups

Kid escaped from the executive suite without screwing things up

Why have just one firewall when you can fire <em>all</em> the walls?

'Support monkey' turned network isolation job into a banana skin

Bright spark techie knew the drill and used it to install a power line, but couldn't outsmart an odd electrician

Shocking problem turned out to be a frame-up

Shock horror – and there goes the network neighborhood

Curious tech learned an important lesson about keeping a grip in tight situations

After nine servers he worked on failed, techie imagined next career as beach vendor

Sadly (?) that idyllic outcome didn't eventuate even after some very risky repairs

That script I wrote three years ago is now doing what? How many times?

Whipping up a RAID repair nearly produced data doom

One door opens, another one closes, and this one kills a mainframe

The Reg brings you balanced coverage of retro-tech

Scripted shortcut caused double-click disaster of sysadmin's own making

Tech remembers why those safeguards were there there to start with

Lost your luggage? That's nothing – we just lost your whole flight!

Tech's second day on the job nearly saw his high-flying career grounded

No, no, no! Disco joke hit bum note in the rehab center

Techie tried to dunk on a co-worker, and found himself absolutely soaking wet

Chap blew up critical equipment on his first day – but it wasn't his volt

Where there’s smoke, there’s ire