[Top] [All Lists]

Re: [ietf-smtp] Compressing SMTP streams

2016-01-29 17:22:06
On Fri, Jan 29, 2016 at 1:42 PM, John Levine <johnl(_at_)taugh(_dot_)com> wrote:

1000 recipients at ~30 bytes each with each domain likely the same...

Can you make any estimates of how common large recipient lists are?  My
impression is that since most bulk mail is customized per recipient, big
lists in stuff that isn't spam are rare.

Pretty rare, I think our average is in the 1.3 per message range.

If you're only compressing the data, what's the interaction with RFC 1870?
Do you use the compressed size or the original,

It has to be the original size.  If you're using a stream compressor
like deflate you can't tell what the compressed size will be unless
you make a prepass over the data.  And anyway, my impression is that
the motivation for using 1870 is still the internal storage, not the
transmission time.

Makes sense.

And I'd think it's an alternative to BDAT, same thing, but compressed?

Same problem, client generally doesn't know the compressed size in advance.

Hmm, so we'd be stuck with trying to find the EOD marker, or doing some
streaming decompression til we reach the right end size.

I think I prefer the full stream compression.

ietf-smtp mailing list