At 10:08 2006-02-02 +0100, Michelle Konzack wrote:
is there any way to filter outgoing mail...
As I know the answer is no.
"outgoing" as defined by locally-originated messages, or messages running
through the SMTP interface? If you can invoke procmail (say, via the
sendmail milter interface), yes, you can filter outbound mail. It's
generally ugly, it's inefficient, it's rife with version-specific MTA
hacks. Every turkey that wants to add a "corporate security and moronic
misaddressing" disclaimer to their mail is asking for this capability, and
it definatley exists - but the hassle of setting it up isn't a procmail
matter - it's a function of your MTA.
The rest of this message is way off topic for Procmail (and has no procmail
content).
But in some month it must be cahnged... New laws in Europe! They do
not want only the connections archived but the contents of E-Mails too.
=> <http://www.dataretentionisnosolution.com/>
Curious that the "information" bit fails to identify any actual
bill/resolution/proposal number (whatever your governments might call
proposed laws). Makes it really difficult to head to a government site to
look up the actual proposed wording of it without having to go trawl the
web. So much for open information. I generally take places offering up
information without providing cites for the source of it as suspect.
Which mean, I need to backup around 18.000 (increasing) $USERS with
around 8 MByte E-Mail per day per $USER which mean with a compressed
size of around 52 GByte per day. Need to be archived for 6 month
minimum.
Well, if you're going to start archiving, then it's going to make a lot of
sense to do a shared database - generate signatures of the message content
and store identical messages ONCE, with references to that storage from
each user who had a copy (separate the BODY from the headers and this will
be easier to do - each user has their own copy of the header, but the body
points to the.
Surely this misguided Euro law you speak of standard doesn't require the
same of incoming viruses and spam? That would be exceedingly RETARDED,
given that these are already such a blight on the internet. If the law
does require that, then expect a lot of major ISPs to buck the system and
challenge the law - the first time the government comes knocking looking
for archives, the ISPs will say it is unrealistic to keep it stored, so
they don't.
They'd have an easier time mandating that everyone BCC some government
archive on their correspondance. If the government wants the messages, let
THEM store it.
FTR, if you're already hosting 18K users and have a _compressed_ mail
transit of 52GByte per day, you're in a class of users who should be more
than able to deal with implementing and maintaining the storage
infrastructure necessary for that mail. If your figures are real, and not
blown out of proportion, your mailspool must be really ugly.
FTR, 144GB of mail traffic, assuming an even 50:50 split of in and outbound
traffic splits to 72GB each way. Further, assuming an even distribution of
data across the day (and not burts of it), that's about 900KB/second
(easily ~10Mbit, when considering protocol overhead). Granted, a lot of
mail has multiple recipients, so there's one network hit, and it multiplies
locally (send a 1MB message to 1,000 AOLers, and you're sending 1MB+headers
identifying 1,000 recipients (call it 40KB or so), not 1GB of mail).
Further, if this archiving bit is reality, expect that MTAs will probably
step in to afford a logical interface for performing the archiving (esp.
since the MTA is aware of when there is one message and can most easily
archive it efficiently). Plus, there's the outbound matter, which the MTA
will be involved in, but the LDA wouldn't.
Gotta wonder: does this "law" include archiving requirements for messages
which are *RELAYED* through a host? Imagine having a backup MX that has to
have a few terrabytes of storage...
If it really got down to it, you could probably circumvent it by getting
mail hosting set up outside of the EU. That'd be the no-brainer solution
if your mail traffic is really as high as you say.
---
Sean B. Straw / Professional Software Engineering
Procmail disclaimer: <http://www.professional.org/procmail/disclaimer.html>
Please DO NOT carbon me on list replies. I'll get my copy from the list.
____________________________________________________________
procmail mailing list Procmail homepage: http://www.procmail.org/
procmail(_at_)lists(_dot_)RWTH-Aachen(_dot_)DE
http://MailMan.RWTH-Aachen.DE/mailman/listinfo/procmail