procmail
[Top] [All Lists]

Re: Some ideas to improve performance

2004-11-24 05:37:10
On Wed, Nov 24, 2004 at 11:34:16AM +0100, Ruud H.G. van Tol wrote:
Toen wij mailarch(_at_)xy1(_dot_)org kietelden, kwam er dit uit:


The file.mbox contains more than 10 000 messages!
This means that formail will pipe(), fork() and exec() 
procmail 10 000 times!!!
It's very slow!

There are easy ways to improve on that. One way is to use 
lockfiles that have the seconds-part of the Date-header in 
the filename (which would limit it to 60 procmails). In the 
same way you can limit it to 10 or 600 procmails, or whatever.

Ruud, can you explain more about that?  I don't follow you
there.  You mean the mharc thing is reading in the Date and
procmail is then interpreting xx:yy as a lockfile?  Isn't
that some kind of bogosity with the mharc or something?

Anyway, one could use formail or readmsg to extract a set
of messages -- say, 1000 at a time -- and run the main process
on those smaller files.

dman

____________________________________________________________
procmail mailing list   Procmail homepage: http://www.procmail.org/
procmail(_at_)lists(_dot_)RWTH-Aachen(_dot_)DE
http://MailMan.RWTH-Aachen.DE/mailman/listinfo/procmail