Monthly Archives: November 2011

Disk Drill

Drills deep. Works, too.

The best-laid schemes o’ mice an’ men
Gang aft agley

Robert Burns

Update January 1, 2023:

Disa Drill is very much NOT recommended if you are on an older version of OS X – I’m on High Sierra 10.13 – as it will not run and the latest version requires an OS update which many older Macs will not support. You can read the whole sad story here which provides an excellent alternative which works.

* * * * *

You don’t need to be a long dead Scottish poet to know that disk drives are like motorcyclists. There are those who have crashed, and those who will. And while those of the two wheeled persuasion can only hope for the best, users of the other population can do an awful lot to avoid serious injury by backing up. Onsite and offsite. On portable drives, flash drives, in the cloud, you name it. The choices have never been greater or the cost of this essential insurance lower.

Like all those who have learned the hard way, backing up is second nature to my use of computers. The thought of losing a lifetime’s pictures is not one I want to think about.

When it comes to movies on my large capacity fan cooled enclosures, each accommodates two 1tB hard drives, main and backup. These devices enjoy an easy life and after some five years’ use none of the 10 1tB Samsung HDDs has yet failed. Yet, the other day, I was nastily reminded of the dangers of complacency. As I turned one of the drive enclosures on it replied with an ominous clicking sound. The drives refused to mount (meaning they did not appear in Finder in OS Lion) and the drive head could be heard flying back and forth, hunting hopelessly. A moment later the box was apart and one of the drives mounted in that handy Aluratek external USB drive cradle. Same result, with the drive refusing to appear in Finder. So I fired up Disk Utility, and the drive was there, confirming what I suspected. The drive was fine, making no untoward sounds and not overheating, but the file directory on it was trashed. I went back to the enclosure and confirmed that other drives exhibited the same clicking symptoms, confirming that the circuitry in the enclosure was shot and had taken the directories on both movie drives with it.

Data storage on hard drives only seems like magic. A directory points to files just like an index in a book (remember books? Made from rain forests, they were an affectation of the last 600 years, now largely ended). Lose the directory and the files may still be there, but the operating system does not know where to look. Indeed, when you ‘erase’ a drive all you are doing is erasing the directory. To erase every sector takes ages and extra effort – just try that using ‘Securely erase trash” on your Mac someday.

If you go to the Paso Robles public library in lovely central coastal California’s wine country, you will find it exceptionally well stocked with classic movie DVDs. Those are the result of my gift after all were ripped and saved to hard drives. I have not owned a DVD in ages, and fail to understand how any DVD collection can be easily accessed with traditional physical storage. Plus, a bunch of drives takes up a lot less space. At an average uncompressed file size of 5gB that makes for 200 movies on a 1tB HDD, so the prospect of reacquiring 200 ‘lost’ movies and re-ripping them was not one I wanted to think about. I hunted around for disk recovery software and found myself in a mine field. Most of the applications out there come in a free download test version, allowing a disk scan to be performed but prohibiting saving of any files ‘discovered’ until you pony up for the app. Fair enough, but some of these vendors are asking $1,000 or more to capitalize on human misery. Reminds me of American health care. Worse, the level of English in many of these apps, which look suspiciously similar, suggests Eastern European provenance, a heritage more associated with software theft than file recovery. No thanks.

First I tried the Big Name file recovery app (I won’t name it here) and found yet again that it is useless. I cannot recall this app having ever done anything for me other than debiting my bank account. I looked at many other apps and settled on two to test, primarily judging on the strength of their user manuals. The more technical and detailed, the better I felt. I did the so called ‘deep scans’ on my disk, which typically take 8-10 hours (!) with the first app ($1,000) finding 40 movies, the second ($195) finding 35. Simply not good enough, and the UIs of these apps were shockingly bad – like using Windows. No meaningful progress indicators and one conked out after 8+ hours of grinding away. At least I didn’t get a blue screen. So I put the drive aside for a few weeks to allow me to do more research. Then, the other day, I was idling through the AppStore (as big and as poorly indexed a mess as iTunes) and came across Disk Drill in the Utilities section. It too offers a ‘deep scan’ option whereby the trashed directory is bypassed and the beginnings and ends of files are determined and temporarily indexed. That index then acts as a reference base for the recovery step.

Disk Drill has no detailed manual, nor is any needed, as there’s an excellent tutorial when you start the app and the maker has a fine site, written in clear grammatically correct English, complete with a forum and evidencing a very professional approach. Good English may not make for good apps, but I have rarely known bad English associated with good code. If you can’t spell, why should I think you can code?.

Well, guess what? On its 9 hour deep scan Disk Drill found all 202 files. The lot! The whole megillah. And the progress reporting is meaningful and outstanding, showing file by file detail as files are located and updating a running percentage and time remaining indicator.

The deep scan under way. VOB files are reported as ‘mpg’ which is what they really are. However, they are mercifully not Quicktime files!

Some of the file sizes looked awry, being way too large, but this looked encouraging. I decided to buy the app, which is discounted on the AppStore for $30 right now, but I went directly to the vendor’s site for the $90 Pro version. That puts more money in the developer’s pocket, requiring no payola to greedy Apple, and offers one additional key feature of which more below.

At the conclusion of the deep scan I formatted the backup drive and inserted it in a separate cradle – you don’t want to try writing recovered files back to the source drive! This is what I now saw – the funky large files had disappeared and all 202 movies were pointed to the backup drive to be retrieved and saved. Before starting the restore, I unchecked the original files found, the ones with the odd sizes under the ‘Video’ directory, leaving just the original movie files, as I knew them on my drive, checked. I suspect that the original scan is combining more than one movie file in arriving at the large file sizes, whereas the recovery choices do it right, segregating these into their component parts.

Ready to recover and save.

The scan results can be saved so that the recovery process, which can be time consuming, can be restarted later. If you have just the one Mac available that may be good idea. Run recovery at night when your machine is otherwise idle.

Amazingly, even the original directory structure had been recreated, suggesting that, as in a book, not only does the directory point to the files, but unlike in tomes of old, the files also have pointers to the directory. That’s significant as it obviates a large amount of labor in not having to recreate the original directory structure. Without this structure finding anything is virtually impossible.

I started the retrieval and save process and the app said it would take 17 hours. Heck, it would take weeks to re-rerip those movies to say nothing of the capital and opportunity costs, as I like to think that my time is still worth something! In the above snap you can see the results of the deep scan at the bottom of the screenshot where every file shows recovery possibilities as only ‘average’ – the list being Excellent, Good, Average and Poor. Not that encouraging, but I paid up, entered the registration information and started the recovery process, fingers crossed. This is what I saw a few hours later:

Well into the recovery process. The files are properly identified and broken into constituent parts.

Recovery completed.

I hopped into the restore drive, tried a few of the movies and each played perfectly, with no beginning or ending glitches. The movies were back in business. The faulty OWC dual drive enclosure was recycled, being well out of warranty, and as they only make empty enclosures now with RAID, and as I prefer simple dual drives as I do not understand RAID technology well enough to trust it, I switched to an inexpensive Vantec which has the two attributes I seek. Drives can be set up to be seen as individual disks by OS X and there’s a fan to keep things cool. And at half the price of the OWC drive, what’s not to like? Despite customer comments at Amazon, I have not found the fan noise objectionable. Then again, I don’t sit 2 feet from the enclosure.

Why the Pro version of the software? Because it comes with a feature named Recovery Vault and I’ll let Cleverfiles explain, quoting from their web site:

Why is Recovery Vault important?

To be short: recovery vault is the technology that helps you prevent data losses on HFS/HFS+ and FAT disks/partitions.

Why?

Unlike other file systems, HFS and HFS+ developed by Apple don’t have an effective way to restore deleted data. Once the data is gone, the only way to recover it is binary reading of hard drive sectors. While this is exactly what recovery algorithms in Disk Drill do, as a result you can only recover the file itself, but all its properties are gone: no original filename, no location, etc. However, the original names of the files you deleted may be the main criteria to identify your data without reading the contents. So losing this info may be crucial. Recovery vault addresses exactly this issue and helps you recover everything in HFS/HFS+ partitions exactly as it was there before.

How?

Recovery vault by CleverFiles is an integral part of Disk Drill. You may enable this technology on per-disk/per-partition basis. Disks and partitions protected with recovery vault will be monitored by the special background service of Disk Drill for data changes. When something’s deleted, recovery vault remembers all the original properties of the deleted items and makes it possible to easily recover this data later on.

Important!

Recovery vault is not a panacea, while it makes data recovery algorithms much more effective, it doesn’t provide you with 100% guarantee that ANYTHING can be recovered ANY TIME in future. Internal Mac OS algorithms extremely complex, and nobody knows or can predict when certain data is overwritten by the file system drivers.

Think of Recovery vault as a second file directory separate from the regular one, residing on the protected data disk.. It’s a nice feature and I’m installing it on all my drives.

In the following example, I have switched Recovery vault on for one of the two SSDs (SSD Bak) in my computer:

Disk drive SSD Bak in the process of being enabled for Recovery vault.

SSD Bak enabled for Recovery vault, denoted by the blue shield icon.
This took some 20 minutes on the 120gB 3gb/s SATA2 SSD.

The 170mB file created by Disk Drill resides – as a hidden file – in the root directory of the protected drive, thus:

Invisible file – exposed here – for Recovery vault on SSD Bak.

That’s a very modest overhead for the benefit gained.

I have not turned on Guaranteed Recovery as I also use a TimeMachine backup – not shown above – for versioned backups of all my drives.

Cleverfiles says that their app works for a broad variety of storage media, including flash drives, iPods, and so on. I have not tested that (and am in no hurry to do so!) but my excellent experience with this large recovery project described here makes be believe them. A great product and one to have in your armory to plan for that inevitable day all motorcyclists expect. Unlike everything else I tried it works and is reasonably priced.

Meanwhile, I’m pleased to report that my 200 ‘lost’ movie files are back online, and that I am celebrating with Frankenheimer’s 1966 classic ‘Grand Prix’ made when men died at the wheel, computers and aerodynamics were unknown and mechanical engineers ruled the world of motor racing. Great days. (OK, not the dying bit).

Update December 15, 2011:

In the spirit of full disclosure, after I paid for the app, used it and and wrote the above, the maker contacted me with a free offer of lifetime upgrades. As I wrote this well before that event, which accordingly could not color my assessment, I was pleased to accept their offer and reproduce the related email thread below:

7 Pleasures

A hint of the eastern Mediterranean.

G3, kit lens @30mm, 1/500, f/4.5, ISO 320

Insane dynamic range here. One of those cases where a larger sensor would have better withstood the need for selective processing of the shadows. Exposure was for the highlights – once those burn there’s no way of bringing them back.

At Commercial and Leidesdorff Streets in SF’s financial district.

The HackMini

Keeping it cool.

When I bought the Mac Mini as a home theater PC, I knew it was but a temporary solution until time to make my own became available. I named it the Mac Fry and so it has proved, with CPU temperature soaring to 168F when ripping/compressing a movie with Handbrake. The service limit is 176F for the C2D CPU and all that thermal cycling so close to the limit is not consonant with a long life.

So when the opportunity arose, I procured the parts to make my own, and the Mini will move to a less demanding home for near zero net outlay. But first I will have to replace the slot loading DVD drive because, like every other Mac slot loading drive I have owned, it has just failed.

As before, ace builder TU Steve writes what follows:

To keep things simple, I used the same parts as in the HP10, my utility machine which runs super cool and has performance comparable to all but the fastest iMacs at a fraction of the cost. The only thing which would change is that an elegant case would be used, as the HackMini is very much on show below the TV screen.

Well, I thought I was using the same parts, but the restless people at Gigabyte conspired to change the audio chip used on their mini H67M-D2-B3 motherboard from the Realtec ALC888b in HP10 (v1.0) to the ALC889 in the HackMini (v1.1), meaning the build started with no sound until I applied the fix here. Then OS Lion refused to allow login to the AppStore – essential for software updates – and a few seconds here quashed that little bug.

As I had a couple of small notebook drives in a drawer, remaindered from fried Apple laptops, I used those doubled up on a Silverstone adapter plate, allowing installation in a 3.5″ slot.

I spent a long time choosing a case, wanting something less than full sized but not so small that cooling would be an issue. This machine is going to be worked hard, and must have front USB slots for sneakernet movement of movie VOB files. I finally decided on the Silverstone LC03S in unpainted alumin(i)um, as I really dislike black, with neat front flaps covering the USB sockets and the full size tray loading Sony DVD reader/burner. I have never had one of the latter fail and they are dirt cheap.

The build was dead easy, taking just two hours from box opening to start up, and I had prepped the drives using HP10 while waiting for the parts. The case is premium priced but you get rolled steel edges inside, meaning no injuries when building.

There are two small, silent case fans, so I had to procure a two-into-one connector as the mobo sports but two fan connectors, the other used by the CPU cooler. Another $2 was blown on a small beeper speaker which announces itself with a single beep at power-on, indicating all is well. Just like in a crappy Windows machine. As you can see, there’s tons of room in there, with space for another 3.5″ device – I will likely add an SDHC card reader – and several more drives. Many build their HTPC Hacks with micro ITX mobos but that makes for small boxes and hosts of issues. This case will actually accommodate a full size ATX mobo, but that would be overkill for the intended use. As it is, the Gigabyte mobo used sports no fewer than eight rear and two front USB sockets, including USB3 if desired, so it’s not like connectivity is an issue.

Finally, the motherboard includes two SATA3 sockets which will support the latest 6gb/s fast HDDs and SSDs. The two notebook drives are ancient SATA2 devices, and as disc access is infrequent in this application, that’s just fine.

As you can see, space is abundant inside:

The over-spec’d Thermaltake PSU, at 430 watts, will not break a sweat and I like the brand for it’s neat cloth covered cable sheaths.

And that’s about it. Here it is in place, happily replacing the awful Mac Mini which may just be the worst designed computer I have ever owned.


The ugly small black ‘wires’ are optical fiber cables for an IR blaster.

Here’s the parts cost – I used the awesome Intel Core i3 Sandybridge CPU:

Case $86
Wifi card 38
GT430 GPU 75 (EVGA with HDMI/VGA/DVI)
Motherboard 96
Drive plates 16
RAM/DVD/CPU/PSU 237 (8gB Corsair 1333mHz)
Beeper 2
Y fan cable 3
EVGA rebate (15)

Total $538

To be fair, the cost of an HDD has to be added to strike a comparison with the MacMini which is certainly price competitive. Until it fries, that is. And the current Mini no longer includes a DVD burner.

Performance is everything you would expect of the Core i3 and the outstanding GPU:

Start-up and Geekbench run, using the stock Intel CPU cooler.

While the machine is used as an HTPC, it would also make an excellent desktop. I will likely replace the poor stock Intel CPU cooler with something better once I figure out sizing ($30) and will also add an internal multi-format card reader ($15). For a machine which is never switched off, an SSD makes little sense.

The HackMini is controlled with an RF Microsoft Mobile Mouse 6000, RF being far superior to Bluetooth in range and stability, not to mention battery life, and with Mobile Mouse on the iPad when typing names of movies into the DVDpedia database. This has interactive, clickable links to movie files residing on 10 tBs worth of external disc storage.

Audio is 2.1, with sound output from the motherboard routed to an ancient Sony receiver and thence to even older B&W DM4 speakers. With a little more hacking 5.1 surround sound using the multiple sockets on the motherboard would be easily added.

Want to add BluRay playback? Swap the regular Sony DVD burner for a BluRay SATA one ($60) and add this $50 software, and enjoy something Apple does not provide on any of its hardware.

Factory warranties are three years on the CPU, motherboard and graphics card and lifetime on the RAM, with only the Mobo being a pain to remove. No money wasted on AppleCare here. It should be added that of the many Hackintoshes in which I have had a hand, several used hard in professional settings, the sole failure over the past five years has been to one 1tB Samsung HDD, which was still within its three year warranty.

As befits an HTPC, the Hack Mini computer is silent as the grave.

* * * *

Thank you, TU Steve!

There are many reasons to avoid the poorly designed MacMini, even more so in its latest guise where the DVD burner has been deleted (though, arguably, that’s an improvement over the awful slot loader in mine); for the full scoop just click here. Hint: It’s nowhere near as cheap as you think.

Bluetooth update: To learn how to really get this fragile, wireless technology working well with the HackMini in its rôle as a keyboard-less home theatre computer, please click here.