procmail
[Top] [All Lists]

Re: Some ideas to improve performance

2004-11-24 11:50:47
On Wed, Nov 24, 2004 at 11:34:16AM +0100, Ruud H.G. van Tol wrote:
Toen wij mailarch(_at_)xy1(_dot_)org kietelden, kwam er dit uit:


The file.mbox contains more than 10 000 messages!
This means that formail will pipe(), fork() and exec() 
procmail 10 000 times!!!
It's very slow!

There are easy ways to improve on that. One way is to use 
lockfiles that have the seconds-part of the Date-header in 
the filename (which would limit it to 60 procmails). In the 
same way you can limit it to 10 or 600 procmails, or whatever.

Ok but I need to parse anyway the 10 000 messages.


What I need would be that:
- support for multiple messages, currently procmail reads only one
  message from stdin, so formail is no more needed with my problem.
- support for the bison/yacc tools to precompile the procmailrc file
in a C file, and to compile the regex rules. 

That is what you think that you need. I know you don't.

The only way I see to resolve my problem is to buy a new CPU with more speed.
Because my CPU is already at 99% by executing "formail -s procmail..." for more 
than 3 hours.

So there are two solutions:
- buying new processor with more speed
- changing the source code in procmail by adding multiple messages support in 
procmailrc

The problem is the source code is for me a little difficult to understand.

I don't know what to do, but I need more performance speed!!
My CPU is already at 99% for several hours!

-- 
saf
http://Archivum.info/ - Administrator

____________________________________________________________
procmail mailing list   Procmail homepage: http://www.procmail.org/
procmail(_at_)lists(_dot_)RWTH-Aachen(_dot_)DE
http://MailMan.RWTH-Aachen.DE/mailman/listinfo/procmail