procmail
[Top] [All Lists]

Re: copy of all mails to one user

2006-02-02 11:48:25
At 10:08 2006-02-02 +0100, Michelle Konzack wrote:
is there any way to filter outgoing mail...

      As I know the answer is no.

"outgoing" as defined by locally-originated messages, or messages running 
through the SMTP interface?  If you can invoke procmail (say, via the 
sendmail milter interface), yes, you can filter outbound mail.  It's 
generally ugly, it's inefficient, it's rife with version-specific MTA 
hacks.  Every turkey that wants to add a "corporate security and moronic 
misaddressing" disclaimer to their mail is asking for this capability, and 
it definatley exists - but the hassle of setting it up isn't a procmail 
matter - it's a function of your MTA.

The rest of this message is way off topic for Procmail (and has no procmail 
content).

But in some month it must be cahnged...  New laws in Europe!  They do
not want only the connections archived but the contents of E-Mails too.

    =>  <http://www.dataretentionisnosolution.com/>

Curious that the "information" bit fails to identify any actual 
bill/resolution/proposal number (whatever your governments might call 
proposed laws).  Makes it really difficult to head to a government site to 
look up the actual proposed wording of it without having to go trawl the 
web.  So much for open information.  I generally take places offering up 
information without providing cites for the source of it as suspect.

Which mean, I need to backup around 18.000 (increasing) $USERS with
around 8 MByte E-Mail per day per $USER which mean with a compressed
size of around 52 GByte per day.  Need to be archived for 6 month
minimum.

Well, if you're going to start archiving, then it's going to make a lot of 
sense to do a shared database - generate signatures of the message content 
and store identical messages ONCE, with references to that storage from 
each user who had a copy (separate the BODY from the headers and this will 
be easier to do - each user has their own copy of the header, but the body 
points to the.

Surely this misguided Euro law you speak of standard doesn't require the 
same of incoming viruses and spam?  That would be exceedingly RETARDED, 
given that these are already such a blight on the internet.  If the law 
does require that, then expect a lot of major ISPs to buck the system and 
challenge the law - the first time the government comes knocking looking 
for archives, the ISPs will say it is unrealistic to keep it stored, so 
they don't.

They'd have an easier time mandating that everyone BCC some government 
archive on their correspondance.  If the government wants the messages, let 
THEM store it.

FTR, if you're already hosting 18K users and have a _compressed_ mail 
transit of 52GByte per day, you're in a class of users who should be more 
than able to deal with implementing and maintaining the storage 
infrastructure necessary for that mail.  If your figures are real, and not 
blown out of proportion, your mailspool must be really ugly.

FTR, 144GB of mail traffic, assuming an even 50:50 split of in and outbound 
traffic splits to 72GB each way.  Further, assuming an even distribution of 
data across the day (and not burts of it), that's about 900KB/second 
(easily ~10Mbit, when considering protocol overhead).  Granted, a lot of 
mail has multiple recipients, so there's one network hit, and it multiplies 
locally (send a 1MB message to 1,000 AOLers, and you're sending 1MB+headers 
identifying 1,000 recipients (call it 40KB or so), not 1GB of mail).


Further, if this archiving bit is reality, expect that MTAs will probably 
step in to afford a logical interface for performing the archiving (esp. 
since the MTA is aware of when there is one message and can most easily 
archive it efficiently).  Plus, there's the outbound matter, which the MTA 
will be involved in, but the LDA wouldn't.

Gotta wonder: does this "law" include archiving requirements for messages 
which are *RELAYED* through a host?  Imagine having a backup MX that has to 
have a few terrabytes of storage...

If it really got down to it, you could probably circumvent it by getting 
mail hosting set up outside of the EU.  That'd be the no-brainer solution 
if your mail traffic is really as high as you say.

---
  Sean B. Straw / Professional Software Engineering

  Procmail disclaimer: <http://www.professional.org/procmail/disclaimer.html>
  Please DO NOT carbon me on list replies.  I'll get my copy from the list.


____________________________________________________________
procmail mailing list   Procmail homepage: http://www.procmail.org/
procmail(_at_)lists(_dot_)RWTH-Aachen(_dot_)DE
http://MailMan.RWTH-Aachen.DE/mailman/listinfo/procmail

<Prev in Thread] Current Thread [Next in Thread>