Summary: Once a flash drive starts to show wear by having errors, you shouldn't treat it like a hard disk. You'll be much safer replacing it.
I have a flash drive and I found that some files on it were corrupted. When I recopied them from a backup, these files were corrupted again, sometimes immediately, but sometimes only after a few days or weeks.
Some folks have suggested I simply "buy a new one". But I think that this might be more or less the nature of flash memory, similar to dead pixels on an LCD display. So I'm thinking that a better way might be to mark bad clusters and keep using the drive.
I tried "chkdsk /R" and the result is "Windows has checked the file system and found no problems". Then I tried the old Windows 98 scandisk, and tried Write/Read test. I know that I shortened the flash memory's life by doing this? Again no error was detected.
I filled the disk with files exactly 32768 bytes long - the size of a FAT cluster on this drive - with random data content. I then checked the CRC for these files. I also overwrite these files with inverted data a few times and checked the CRC again. I found a few files where this failed from time to time, so I changed the attributes of these files to read-only and hidden. As long as no mechanism moves these files, this then prevents those bad clusters from being used again.
Is this a reasonable approach?
•
Let me put it this way: "buy a new one".
Your approach might be reasonable, sort of, but I don't agree with some of the assumptions you've made that lead you down this path.
And I can pretty much guarantee that it simply won't work on many newer flash drives.
•
My biggest disagreement is your statement that it's the nature of flash memory to have bad or "weak" spots. The short answer is that if it does, you should never see it. Most flash memory chips have error detection and correction built in, using a variety of techniques to avoid you ever seeing any defects on the device.
Well, that is until the device has so many problems that the error correction logic simply can't compensate any more.
What that means is that if you are seeing simple read/write errors, CRC errors and the like - either from the operating system or your own tests, then the device is much worse off than you think. In my opinion you're on the verge of serious failure and data loss.
Hence: buy a new one.
Unfortunately tools like chkdsk, scandisk and the like are unreliable when it comes to scanning flash drives for what on a hard disk would be called a "surface error". Flash drives aren't hard drives, and don't live, or die, by the same rules.
The technique you outline is a very valid technique when working on hard disks. In fact, I have to admit I've done something very similar myself in the past. When a disk maintenance utility refused to remove an obviously bad sector from my hard disk, once I found that it had been allocated to a file, I renamed and hid the file, so that the bad sector would never be used for something else later.
But flash memory is different.
As I've mentioned before, flash drives wear out. One of the advanced techniques that flash drive manufacturers now use is called "wear levelling". This means that while you or the operating system might think you're writing to a specific location on the device, the device itself is randomly re-mapping the actual physical location. For example, you might think you're writing to sector #23 over and over again, but in order to balance the wear across the entire device to maximize longevity the flash drive circuitry is moving where, exactly, sector #23 lives each time you write to it.
That means the file that you think has the bad sector today might not have it tomorrow - it could show up somewhere else entirely.
A lot depends on exactly how each specific flash drive is designed as well. Some have wear leveling and some do not. Most have error correction. Exactly how the error correction might happen, and how or when errors become visible, will vary a great deal not only on the specific error, but also on the specific manufacturer and design.
Your device could fail massively tomorrow. Or, having used your technique, it might last for years.
I just don't think you can predict which, or when.
The only data you have is that it does have visible errors, and that's probably not good.
Buy a new one.
Article C3373 - May 6, 2008
My memory stick has falled; bad sector. Is there any way I can retrive the data I have on it before I through it out?
Posted by: Markk at November 23, 2008 7:24 PMI am facing the quite similar problem with my FlashDrive.
In my case, whenever I copy any data it gets copied properly. But after sometime, the files get corrupted. Names of the files in the folder gets changed to something random.
I don't think its a virus as I have checked that.
Is it because of bad sectors? Is my problem exactly the same?
04-Dec-2008
i hav got the bad sectors prob in ma flash drive.....does any one knows about the free utility to recover it....
Posted by: Younas Khan at May 22, 2009 10:37 PMIf like me you don't want to let go of your flash drive and you know theres bad sectors on there somewhere maybe sourcing where these are specifically and partitioning the drive so the partition with the bad sectors you don't use, would that work im no techy expert so im asking you guys?
Posted by: Amzy at October 21, 2009 11:30 AMHigh end type probably have wear levelling, but then again they are probably quite reliable being high end. For these, it's likely the drive will become obsolete due to it's size long before the drive physically fails. We're talking here about low end stuff, not so great quality but cheap, and I'm sure that for the guys who produce it wear levelling is the last thing on their mind, but rather how to make it cheaper and reliable enough and get it out on the market ASAP so they can make some bucks before they need to produce a bigger size. So I think the issue is valid, for low end type of sticks that most likely don't have wear levelling, I'm sure you can mark the bad sectors and use quite safely what's left. And besides, without theorizing whether it has or not wear levelling, you can just go ahead and mark whatever bad sects you see, and if they keep popping up afterwards it means the stick does have wear levelling and this approach won't work. On the other hand, if I'm right, it will just work, and you'll get a reasonably reliable stick.
Posted by: HiRo at December 26, 2009 5:26 PM