Summary: Hard disks continue to increase in size, as does what we're storing on them. There are limits, but not limits that most people need to worry about.
Could you tell me if there is a size limit on a single folder? For example a folder with movies or music in it could end up with quite a few gigabytes! Is there a limit?
•
There are limits, of course. The limit most people run into first is the size of their hard disk, but assuming that you have a big enough disk for everything, then other limits can come into play.
I will say this right away though: the size of the files in a single folder is not one of them.
•
There's no practical limit on the combined sizes of all the files in a folder, though there may be limits on the number of files in a folder. More importantly, there are limits on individual file size that depend on what filesystem you're using on your hard disk. (The "filesystem" is nothing more than the specification of exactly how files are store on disk.)
Let's break this down by file system:
FAT aka FAT16
FAT, for File Allocation Table, is the successor to the original FAT12 filesystem that shipped with MS-DOS many, many years ago.
Maximum disk size: 4 gigabytes
Maximum file size: 4 gigabytes
Maximum number of files on disk: 65,517
Maximum number of files in a single folder: 512 (if I recall correctly, the root folder "/" had a lower limit of 128).
FAT32
FAT32 was introduced to overcome some of the limitations of FAT16.
Maximum disk size: 2 terabytes
Maximum file size: 4 gigabytes
Maximum number of files on disk: 268,435,437
Maximum number of files in a single folder: 65,534
NTFS
NTFS, or "New Technology File System" introduced with Windows NT, is a completely redesigned file system.
Maximum disk size: 256 terabytes
Maximum file size: 256 terabytes
Maximum number of files on disk: 4,294,967,295
Maximum number of files in a single folder: 4,294,967,295
Note that when I say "disk" above, I'm really talking about "logical" disks, not necessarily physical. No one makes a 256 terabyte disk drive, but using NTFS you can treat an array of disk drives as a single logical disk. Presumably if you have enough of them, you can build a huge logical drive.
Also note that the NTFS's 256 terabyte limitation may well simply be an implementation restriction - I've read that the NTFS format can support disks up to 16 exabytes (16 times 1,152,921,504,606,846,976 bytes).
•
So there are two important take-aways from all that data as it relates to the original question:
Nowhere was there a limit of the size of the contents of a folder. Limits on the number of files, yes, but nothing size related.
You probably want to make sure your disk is formatted NTFS. FAT32's 4 gigabytes for a single file just isn't enough any more, especially if you're collecting video or other storage-intensive media.
Related:
Ask Leo! - Can I adjust some master NTFS table size to handle large number of files better?
Ask Leo! - Should I use Windows File Compression?
Microsoft - A Brief and Incomplete History of FAT32
Microsoft - Maximum Size Limitations
Article C3024 - May 14, 2007
I back up to an external hard drive. I can only back up 4 gb in one folder. I think it could be formatted with Fat32. Is their a way to reformat this drive to NTFS?
Posted by: Chris Ottaway at May 19, 2007 3:15 AM-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Yes. Look into the "Convert" command. It's a commandline tool that will convert
a drive from FAT to NTFS. It's included with Windows XP.
Leo
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (MingW32)
iD8DBQFGT7XBCMEe9B/8oqERAvnVAJ9CSZsW4wgjI6DKMkhKFigFUGkhAwCcDg42
Posted by: Leo A. Notenboom at May 19, 2007 7:43 PMSslIOJQtTkR8/bpxSZRKBG0=
=F57s
-----END PGP SIGNATURE-----
Hi! Actually I'm keeping incurring in a folder size limit of 102 GB. I have several external drives, all of them NTFS, and there is no way to store more than 102 GB in a single folder. Any suggestion?
Posted by: Emidio at March 17, 2008 10:12 AMThanks
Cracking site and I've been trying to find out why I can only store a few Divx files in a folder before its full. No I know why and how to fix it. Cheers
Posted by: Ansy at July 24, 2008 9:13 AMI am creating an archive. Currently we are putting all of our files in one folder and have accumulated over 6,000 files. Is there a utility or piece of software that might have an inbox and place the files in automatically created directories with a maximum of 500 files to improve access performance.
Posted by: Dwarner at December 8, 2008 1:53 PMIs it possible to put 1-2 thousand files in a folder in windows 2003 server and share it so that other users (more than 200) can directly execute exes from it. Or its a better idea to divide those files into sub folders inside the main folder. Thanks in advance.
Posted by: OP at February 16, 2009 6:27 AMCan you share resources for learning more about the optimal way to store files in a web application? We currently put all files into the main directory, and this is creating some issues with copying and we think backups. One folder has over 185,000 files, all of which are fairly small. The copy rate is about 6 gig/hour on a LAN.
Posted by: Tb at July 13, 2009 4:51 PMDoes any one here know about the maximum number of files in a single folder for ext2, ext2 FS of linux.
Posted by: sreejith at August 29, 2009 7:44 AM?
My question and problem is this.. I have all my mp3 files cataloged in one directory.. which is about 30GB on a 1TB SATA drive.
Posted by: mykeeX at September 25, 2009 5:56 AMIm albe to play music just fine but if i wanted to open my directory where all my music is.. It takes like 5 mins to open..
I realize it has to read all the files before opening the directory..
So my question is this.. where is the fine line at.. how much can music or files can be store in one directory so it doesnt take you 20 years or longer to open?
what is the max limit of single file that can be access from the share path.
Posted by: Jaisin at October 6, 2009 9:42 AM