16
Tue, Apr
5 New Articles

Trying to Fix Humpty Dumpty? Use Open-Source Data Recovery Tools

High Availability / Disaster Recovery
Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

A number of free Linux tools can recover data from even the most damaged disk drives.

 

I've been riding bicycles a long time, but the funniest thing happened on the way home from cappuccino-land last Sunday: I cracked up.

 

I don't know if I was more worried about my $1,000 bike or the blood that was trickling down my jaw when I finally dragged myself out of the intersection, but I'll tell you one thing: I was extremely surprised it occurred, and I want to make darn sure it never happens again.

 

How does such a thing happen to an experienced rider? Who knows? It just happens. It's like data loss. You take precautions, but suddenly, you realize a critical file has been deleted--permanently--and there is no backup. Or the drive is corrupted from a virus or hardware malfunction. Hopefully, you have a recent backup or mirrored partition--but not always. This is particularly true for those laptop warriors who think that their Dells are never going to fail. Airport security let mine drop on the hard floor after it came rolling out of the X-ray machine at John Wayne Airport in Orange County , California, a couple years back. It was in its carrying case that, I suppose, looked like a carry-on, so what the heck. Fortunately, it was an HP and built like a tank.

 

But data loss can--and does--happen, so what are your options if it does? One route is to use open-source data recovery tools to try to recover the lost files or partition. There are different scenarios, and your approach may vary depending on what happened. Accidental data deletion--a boo-boo--is the single most common reason for files getting up and flying away. On a PC or laptop, you generally can use the Undelete button or go to the trash bin to recover the files. However, once I was syncing the files on two drives, and I got the settings wrong, and the application deleted all the extra files present on the C drive that were missing from the D drive. I tried everything, but they were gone for good. You might sometimes force a hard delete, or you might delete a file from a volume that doesn't have recovery functions enabled. Recovery of these files is generally possible with a number of the open-source tools mentioned below.

 

More-complex recoveries include situations such as when a whole partition is missing along with everything on board, including the boot files. You can either try to recover whatever data you can find on the partition without attempting to reconstruct it or try to reconstruct the partition's metadata and remount the partition. Though easier, chances of success with the first approach may be slim indeed. There probably will be fragments (like Humpty Dumpty) but maybe not enough to put together for a boot. The second approach will likely give you a better chance for a complete recovery, but that will depend upon how much data is recoverable.

 

A third area of concern comes when you lose data from a removable storage device, such as a USB flash drive, or from optical media, such as a CD or DVD. You should be able to use tools to recover the data from all three of these drives. Your drive may play a role in this, so you should compare how well one drive creates an image versus another and which has better error-correction.

 

Where you can really run into problems recovering data is from encrypted media. If you're trying to recover something as important as your encryption key from an encrypted volume that is inaccessible, well, good luck; it's probably not going to happen. You will want to take extra, special precautions with encrypted volumes and back up the volume headers and keep them in a safe place--encrypted too.

 

As a general rule, whenever you are beginning to do a recovery, make sure the media is mounted as read-only. Better to make an image file of the media and save it to another drive while working from there. That way, nothing will start to perform read/write functions on the drive that has the recoverable data on it. Puppy Linux and DSL, both very small Linux distributions, can be used for mounting a volume and copying files.

 

Following are a few tools recommended by Serdar Yegulalp of InformationWeek that you can try out and practice with before the need arises. These are all Linux distributions, but some of them will also work on Windows data.

 

SystemRescueCD is a Gentoo-based distribution that has a large number of tools in a relatively small .iso file that you can boot from a CD or USB drive for recovery functions. Some Linux knowledge is required. Parted Magic boots directly into an x-Desktop and provides GUI access to many of the tools. Both of these are Linux distros specifically for data recovery and contain a variety of tools in one place. They both provide the ability to run the full spectrum of Linux applications and connect to the Internet, though they don't come with as many tools as do some distributions.

 

If a GUI isn't a requirement and you want a lot of heavy-duty forensic data recovery applications as well as security-oriented tools that will run from a CD, you can try BackTrack or the Knoppix-based Security Tools Distribution (STD) and Helix. The latter, also a live CD, will not mount any file systems unless told to do so.

 

Another data recovery tool is dd, which you can use to generate an image file from any mounted file system or device. The generic version of dd comes with most Linux distributions, but there are a couple of variations. Use dd_rhelp on top of dd_rescue to make using it simpler. Be aware that dd can also be used to destroy data, so practice a bit before doing something silly.

 

Other tools include TestDisk, which can do a number of whole-disk recovery operations. If you have a VMware product running, you can boot an image from within a virtual machine. The Live View tool allows you to turn any dd image into a VMware virtual machine. It caches all changes made to the image so the original stays intact.

 

Having these tools readily available and knowing how to use them can go a long way in recovering data after your computer takes a tumble and you wonder if all the king's horses and all the king's men are really going to ever put Humpty together again.

Chris Smith

Chris Smith was the Senior News Editor at MC Press Online from 2007 to 2012 and was responsible for the news content on the company's Web site. Chris has been writing about the IBM midrange industry since 1992 when he signed on with Duke Communications as West Coast Editor of News 3X/400. With a bachelor's from the University of California at Berkeley, where he majored in English and minored in Journalism, and a master's in Journalism from the University of Colorado, Boulder, Chris later studied computer programming and AS/400 operations at Long Beach City College. An award-winning writer with two Maggie Awards, four business books, and a collection of poetry to his credit, Chris began his newspaper career as a reporter in northern California, later worked as night city editor for the Rocky Mountain News in Denver, and went on to edit a national cable television trade magazine. He was Communications Manager for McDonnell Douglas Corp. in Long Beach, Calif., before it merged with Boeing, and oversaw implementation of the company's first IBM desktop publishing system there. An editor for MC Press Online since 2007, Chris has authored some 300 articles on a broad range of topics surrounding the IBM midrange platform that have appeared in the company's eight industry-leading newsletters. He can be reached at This email address is being protected from spambots. You need JavaScript enabled to view it..

BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$0.00 Raised:
$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: