Data recovery: Difference between revisions
Line 115: | Line 115: | ||
*[http://www.hdd-data.jp Data Recovery Japan] - Japanese Data Recovery Services and Hard disk type information |
*[http://www.hdd-data.jp Data Recovery Japan] - Japanese Data Recovery Services and Hard disk type information |
||
*[http://www.datatechlab.com Data Recovery Services] - Cost Effective Data Recovery Services and Information |
*[http://www.datatechlab.com Data Recovery Services] - Cost Effective Data Recovery Services and Information |
||
*[http://www.mjmdatarecovery.co.uk/hard-drives/hard-drive-head-crash-repairs.html Head Crash] Article on Head Crash |
|||
*[http://www.easyrecovery.co.uk Data Recovery Services] - UK Data Recovery Services and Information |
*[http://www.easyrecovery.co.uk Data Recovery Services] - UK Data Recovery Services and Information |
||
*[http://www.microsoft.com/technet/prodtechnol/winxppro/support/dataprot.mspx Data Recovery and protection strategies] - A guide from Microsoft on Data Recovery and best practices and procedures |
*[http://www.microsoft.com/technet/prodtechnol/winxppro/support/dataprot.mspx Data Recovery and protection strategies] - A guide from Microsoft on Data Recovery and best practices and procedures |
Revision as of 08:06, 31 October 2008
Data recovery is the process of salvaging data from damaged, failed, corrupted, or inaccessible secondary storage media when it cannot be accessed normally. Often the data are being salvaged from storage media formats such as hard disk drives, storage tapes, CDs, DVDs, RAID, and other electronics. Recovery may be required due to physical damage to the storage device or logical damage to the file system that prevents it from being mounted by the host operating system. Although there is some confusion as to the term, data recovery can also be the process of retrieving and securing deleted information from a storage media for forensic purposes or spying.
Recovering data after physical damage
A wide variety of failures can cause physical damage to storage media. CD-ROMs can have their metallic substrate or dye layer scratched off; hard disks can suffer any of several mechanical failures, such as head crashes and failed motors; tapes can simply break. Physical damage always causes at least some data loss, and in many cases the logical structures of the file system are damaged as well. This causes logical damage that must be dealt with before any files can be salvaged from the failed media.
Most physical damage cannot be repaired by end users. For example, opening a hard disk in a normal environment can allow airborne dust to settle on the platter and become caught between the platter and the read/write head, causing new head crashes that further damage the platter and thus compromise the recovery process. Furthermore, end users generally do not have the hardware or technical expertise required to make these repairs. Consequently, costly data recovery companies are often employed to salvage important data. These firms often use "Class 100" / ISO-5 cleanroom facilities to protect the media while repairs are being made. (Any data recovery firm without a pass certificate of IS0-5 or better will not be accepted by hard drive manufacturers for warranty purposes.)
Despite this, there are many accounts of users getting a bad disk going long enough to pull their data off, often via slightly bizarre tricks. These include making the drive cold (in the freezer) or spinning it manually on the ground, both actions being used to unstick a jammed platter. Most data recovery professionals deprecate the use of tricks such as these, since they can cause additional physical damage to the drive if the existing damage is such that further harm will be caused if the drive is operated before first being repaired.
Recovery techniques
Recovering data from physically-damaged hardware can involve multiple techniques. Some damage can be repaired by replacing parts in the hard disk. This alone may make the disk usable, but there may still be logical damage. A specialized disk-imaging procedure is used to recover every readable bit from the surface. Once this image is acquired and saved on a reliable medium, the image can be safely analyzed for logical damage and will possibly allow for much of the original file system to be reconstructed.
Hardware repair
Examples of physical recovery procedures are: removing a damaged PCB (printed circuit board) and replacing it with a matching PCB from a healthy drive (this often entails the movement of a microchip from the original board to the replacement), changing the original damaged read/write head assembly with matching parts from a healthy drive, removing the hard disk platters from the original damaged drive and installing them into a healthy drive, and often a combination of all of these procedures. Some data recovery companies have procedures that are highly technical in nature and are not recommended for an untrained individual. Any of them will almost certainly void the manufacturer's warranty.
Disk imaging
The extracted raw image can be used to reconstruct usable data after any logical damage has been repaired. Once that is complete, the files may be in usable form although recovery is often incomplete.
Open source tools such as DCFLdd v1.3.4-1 can usually recover data from all but the physically-damaged sectors. A 2007 Defense Cyber Crime Institute study shows that the DCFLdd v1.3.4-1 installed on a Linux 2.4 Kernel system produces extra "bad sectors", resulting in the loss of information that is actually available. The study states that when installed on a FreeBSD Kernel system, only the bad sectors are lost. Another tool that can correctly image damaged media is ILook IXImager, a tool available only to government and Law Enforcement.[1]
Typically, Hard Disk Drive data recovery imaging have the following abilities[2]: (1) Communicating with the hard drive bypassing the BIOS and operating system that are very limited in their abilities to deal with drives that have "bad sectors" or take a long time to read. (2) Reading data from “bad sectors” rather than skipping them (using various read commands and ECC to recreate damaged data). (3) Handling issues of unstable drives, such as resetting/repowering the drive when it stops responding or skipping sectors that take too long time to read (read instability can be caused by minute mechanical wear and other issues). and (4) Pre-configuring drives by disabling certain features, such a SMART and G-List re-mapping, to minimize imaging time and the possibility of further drive degradation.
Recovering data after logical damage
Logical damage is primarily caused by power outages that prevent file system structures from being completely written to the storage medium, but problems with hardware (especially RAID controllers) and drivers, as well as system crashes, can have the same effect. The result is that the file system is left in an inconsistent state. This can cause a variety of problems, such as strange behavior (e.g., infinitely recursing directories, drives reporting negative amounts of free space), system crashes, or an actual loss of data. Various programs exist to correct these inconsistencies, and most operating systems come with at least a rudimentary repair tool for their native file systems. Linux, for instance, comes with the fsck utility, Mac OS X has Disk Utility and Microsoft Windows provides chkdsk. Third-party utilities such as The Coroners Toolkit and The Sleuth Kit are also available, and some can produce superior results by recovering data even when the disk cannot be recognized by the operating system's repair utility. Utilities such as TestDisk can be useful for reconstructing corrupted partition tables.
Some kinds of logical damage can be mistakenly attributed to physical damage. For instance, when a hard drive's read/write head begins to click, most end-users will associate this with internal physical damage. This is not always the case, however. Another possibility is that the firmware of the drive or its controller needs to be rebuilt in order to make the data accessible again.[citation needed]
Preventing logical damage
The increased use of journaling file systems, such as NTFS 5.0, ext3, and XFS, is likely to reduce the incidence of logical damage. These file systems can always be "rolled back" to a consistent state, which means that the only data likely to be lost is what was in the drive's cache at the time of the system failure. However, regular system maintenance should still include the use of a consistency checker. This can protect both against bugs in the file system software and latent incompatibilities in the design of the storage hardware. One such incompatibility is the result of the disk controller reporting that file system structures have been saved to the disk when it has not actually occurred. This can often occur if the drive stores data in its write cache, then claims it has been written to the disk. If power is lost, and this data contains file system structures, the file system may be left in an inconsistent state such that the journal itself is damaged or incomplete. One solution to this problem is to use hardware that does not report data as written until it actually is written. Another is using disk controllers equipped with a battery backup so that the waiting data can be written when power is restored. Finally, the entire system can be equipped with a battery backup that may make it possible to keep the system on in such situations, or at least to give enough time to shut down properly.
Recovery techniques
Two common techniques used to recover data from logical damage are consistency checking and data carving. While most logical damage can be either repaired or worked around using these two techniques, data recovery software can never guarantee that no data loss will occur. For instance, in the FAT file system, when two files claim to share the same allocation unit ("cross-linked"), data loss for one of the files is essentially guaranteed.
Consistency checking
The first, consistency checking, involves scanning the logical structure of the disk and checking to make sure that it is consistent with its specification. For instance, in most file systems, a directory must have at least two entries: a dot (.) entry that points to itself, and a dot-dot (..) entry that points to its parent. A file system repair program can read each directory and make sure that these entries exist and point to the correct directories. If they do not, an error message can be printed and the problem corrected. Both chkdsk and fsck work in this fashion. This strategy suffers from two major problems. First, if the file system is sufficiently damaged, the consistency check can fail completely. In this case, the repair program may crash trying to deal with the mangled input, or it may not recognize the drive as having a valid file system at all. The second issue that arises is the disregard for data files. If chkdsk finds a data file to be out of place or unexplainable, it may delete the file without asking. This is done so that the operating system may run smoother, but the files deleted are often important user files which cannot be replaced. Similar issues arise when using system restore disks (often provided with proprietary systems like Dell and Compaq), which restore the operating system by removing the previous installation. This problem can often be avoided by installing the operating system on a separate partition from your user data.
Data carving
Data Carving is a data recovery technique that allows for data with no file system allocation information to be extracted by identifying sectors and clusters belonging to the file. Data Carving usually searches through raw sectors looking for specific desired file signatures. The fact that there is no allocation information means that the investigator must specify a block size of data to carve out upon finding a matching file signature. This presents the challenge that the beginning of the file is still present and that there is (depending on how common the file signature is) a risk of many false hits. Also, data carving requires that the files recovered be located in sequential sectors (rather than fragmented) as there is no allocation information to point to fragmented file portions. This method can be time and resource intensive.[3]
Recovering overwritten data
When data has been physically overwritten on a hard disk it is generally assumed that the previous data is no longer possible to recover. In 1996, Peter Gutmann, a respected computer scientist, presented a paper that suggested overwritten data could be recovered through the use of Scanning transmission electron microscopy.[4] In 2001, he presented another paper on a similar topic.[5] Substantial criticism has followed, primarily dealing with the lack of any concrete examples of significant amounts of overwritten data being recovered.[6][7] To guard against this type of data recovery, he and Colin Plumb designed the Gutmann method, which is used by several disk scrubbing software packages.
Although Gutmann's theory may not be wrong, there's no practical evidence that overwritten data can be recovered. Moreover, there are good reasons to think that it cannot.[8]
Tools
Boot media
It is often the case that data recovery and forensics operations cannot be done on a running system. As a result, it is common to use a specialized boot disk, Live CD, Live USB, or any other type of Live Distro containing a minimal operating system and a set of repair tools. When floppy drives were still common, the boot disk was typically a very minimal Live Distro on a floppy disk (such as the Mac OS Classic Disk Tools disk, standard with every system release). However, as operating system complexity has increased, it has become more common for developers to include recovery tools on the same media as the OS installer. There are also many purpose-built Live Distros that include advanced data recovery and forensics tools.
- Knoppix
- The original Linux Live CD. It contains many useful utilities for data recovery.
- Ubuntu Rescue Remix
- A GNU/Linux live system that runs from CD or USB pen drive that includes free-libre, open source data recovery and forensics tools. [9]
Specialized software
Consistency checkers
- CHKDSK
- A consistency checker for DOS and Windows systems.
- Disk First Aid
- A consistency checker for Mac OS 9.
- Disk Utility
- A consistency checker for Mac OS X.
- fsck
- A consistency checker for UNIX file systems.
File recovery tools
- Foremost
- A program to recover files based on their headers, footers, and internal data structures.
- PhotoRec
- A multiplatform console program used to recover files.
- R-Studio
- A Windows program capable of recovering data locally or on a network, regardless of OS.
Forensic Suites
- The Coroner's Toolkit
- A suite of utilities aimed at assisting in forensic analysis of a UNIX system after a break-in.
- The Sleuth Kit
- Also known as TSK, The Sleuth Kit is suite of forensic analysis tools developed by Brian Carrier for UNIX, Linux and Windows systems. TSK includes the Autopsy forensic browser.
- EnCase
- A suite of forensic tools developed by Guidance Software that is used for imaging and forensic analysis for UNIX, Linux, and Windows systems.
- Forensic Tool Kit
- Also known as FTK, Forensic Tool Kit is a forensic analysis suite developed by AccessData.
Imaging tools
- SpinRite
- A well-known imager written in x86 assembly language.
Partition recovery tools
- GParted
- A program for creating, destroying, resizing, checking, and copying partitions.
- TestDisk
- A utility designed to recover lost or damaged partitions on a wide variety of systems.
See also
- Computer forensics
- Data loss
- Backup
- Continuous Data Protection
- Error detection and correction
- Hidden file and hidden directory
- Undeletion
- SystemRescueCD
References
- ^ IXImager Bad Sector Drive Imaging Study. Cyrus Robinson, Defense Cyber Crime Institute Cyber Files Reports and studies are available upon request.
- ^ 'Disk Imaging: A Vital Step in Data Recovery' - This white paper describes disk-level issues that must be handled during a hard disk data recovery imaging.
- ^ Advanced Data Carving. Special Agent Daniel Dickerman, IRS criminal Investigation, Electronic Crimes Program
- ^ Secure Deletion of Data from Magnetic and Solid-State Memory, Peter Gutmann, Department of Computer Science, University of Auckland
- ^ Data Remanence in Semiconductor Devices, Peter Gutmann, IBM T.J. Watson Research Center
- ^ Feenberg, Daniel (14 May 2004). "Can Intelligence Agencies Read Overwritten Data? A response to Gutmann". National Bureau of Economic Research. Retrieved 2008-05-21.
- ^ Data Removal and Erasure from Hard Disk Drives
- ^ Erasing hard disk drive data: How many passes are needed?
- ^ Ubuntu-rescue-remix
Further reading
- Tanenbaum, A. & Woodhull, A. S. (1997). Operating Systems: Design And Implementation, 2nd ed. New York: Prentice Hall.
- What To Do When Windows Vista Crashes: Little-Known Recovery Strategies, from InformationWeek
External links
- Data Recovery Japan - Japanese Data Recovery Services and Hard disk type information
- Data Recovery Services - Cost Effective Data Recovery Services and Information
- Head Crash Article on Head Crash
- Data Recovery Services - UK Data Recovery Services and Information
- Data Recovery and protection strategies - A guide from Microsoft on Data Recovery and best practices and procedures
- Why Cheap Data Recovery Can Cost You More Money and Your Data - Things to avoid when choosing a data recovery professional
- Data recovery at Curlie
- Hard Drive Data Recovery Methods A guide on free data recovery methods in Windows XP/Vista.
- Computer data recovery: A guide for IT professionals - A guide from Computer Weekly on best practices for data recovery