ietf-asrg
[Top] [All Lists]

Re: [Asrg] Blacklist metrics FYI

2003-03-20 14:15:18

Chris Lewis said:
Justin Mason wrote:

SBL's effectiveness is 8.01% for us; for Chris it's 7.63%.  Pretty
close.  But our effectiveness for OPM is much lower, at 6.3% instead
of 51%.

Two reasons for the OPM issue.  One is that OPM's coverage has had a 
huge jump over the past month or two.  Second is "I'd have to kill you" 
(which is also related to reason #1) :-)
Too bad you didn't have MONKEYS in there too.  That'd have answered the 
question of whether the "I'd have to kill you" factor predominates or not.

Yeah -- basically, there was a time when the Monkeys BL was down, so it
didn't seem quite reliable enough for distribution in SpamAssassin by 
default.

Chris notes an accuracy rate of 20% for SPEWS.  We get 53% (as
relays.osirusoft.com), but with 11% FPs.

My numbers for SPEWS and yours for relays.osirusoft.com aren't 
comparable.  relays.osirusoft.com is a combination of several things in 
addition to SPEWS.  OSIRUS relays (inputs.relays.osirusoft.com) and 
Socks (socks.relays.osirusoft.com) are very large (OSsocks larger than 
SPEWS), and together they skew the relays.osirusoft.com values far away 
from SPEWS alone. However, I'd suggest that SPEWS was the main 
contributor to the "nonspam" value (tho, "spamsites" may have 
contributed too).  It'd have been more useful if you differentiated the 
contributing lists to OSIRUS.

oops, should have posted this to break that out:

  0.682   1.4714   0.0839    0.946   0.79    0.00  X_OSIRU_OPEN_RELAY
  4.438   8.6452   1.2520    0.873   0.63    0.00  X_OSIRU_SPAMWARE_SITE
  3.277   1.4857   4.6343    0.243   0.41    0.00  X_OSIRU_DUL_FH
  0.000   0.0000   0.0000    0.500   0.12    0.00  X_OSIRU_SPAM_SRC
  1.522   1.4224   1.5983    0.471   0.10    0.00  X_OSIRU_DUL

There's those ratings.  However I think Osirusoft's "Confirmed Spam
Source" (127.0.0.4) still includes more than SPEWS anyway....

Be interesting to try SpamAssassin on our spamtrap.  Maybe one day.

with a big machine ;)

--j.
_______________________________________________
Asrg mailing list
Asrg(_at_)ietf(_dot_)org
https://www1.ietf.org/mailman/listinfo/asrg



<Prev in Thread] Current Thread [Next in Thread>