On Thu, 3 Dec 2009, Kevin Kofler wrote:
Seth Vidal wrote:
> If you're looking for perfect division, sure - but the reality is this:
>
> 19K items in a single dir and ext3 and nfs and many many other things crap
> themselves returning that list.
>
> If you make 36 subdirs (26+10) performance gets DRAMATICALLY better for
> producing the same list of files.
The problem is, a few of those starting letters still correspond to A LOT of
packages, e.g. p* matches perl-*, python-* and php-* and that's a lot of
stuff (especially Perl and Python). And adding python3-* (and perl6-*, or
are we going to use the rakudo-* namespace there?) won't make it any less.
And yet, when tested, just making those 36 subdirs made a HUGE difference.
What I've found is getting any one dir down below 3K entries makes things
faster, by a lot.
-sv