spf-discuss
[Top] [All Lists]

Re: spf-milter and memory

2004-06-24 06:51:49

The load is generally less than 1.00, both servers affected are running
2x500Mhz PIII with 512MB to 768MB memory. The load in terms of traffic is
quite significant, these two servers handle inbound mail for about 1000
domains. Yesterday the servers collectively processed just under 1 million
messages, ~50,000 messages were accepted for delivery. Very little of the
mail is legitimate (93.4% rejected yesterday) so what doesn't get rejected
by spf-milter is rejected by milter-sender. We've been running
milter-sender for a while now and aren't experiencing any memory or
crashing issues with it. On startup spf-milter is using ~25MB of memory
and starts climbing from there. Within 90 minutes it will be using ~100MB.
I suspect it's running out of memory, I'm going to see if perl core dumps
this time and analyze the core file to confirm this. We're also running
Sendmail 8.12.11 included with the base system.

Regards,
        Chris

Chris Miller
NetGate Internet
An iStrata Company

On Thu, 24 Jun 2004, Koen Martens wrote:

Hello,

What load is the server taking?

I'm also running the spf-milter on freebsd 4.10, inside a jail actually, here 
is my data:

  PID USERNAME PRI NICE  SIZE    RES STATE    TIME   WCPU    CPU COMMAND
  639 root       2   0 29432K 13572K poll    13:57  0.00%  0.00% perl
  669 root       2   0 21724K  6904K poll     1:24  0.00%  0.00% perl

It hasn't crashed yet (for 56 days now).

 Fyi, i'm using sendmail-8.12.11..

Koen


On Wed, Jun 23, 2004 at 11:42:21PM -0700, Chris Miller wrote:

Greetings,
    I've just installed spf-milter on a couple of mail servers running
FreeBSD 4.9/4.10. I'm seeing memory usage of over 100MB and having
spf-milter crash. I saw a memory usage issue mentioned in another thread,
but far less than what I'm experiencing, and it was on a linux system. I'm
running perl-threaded-5.8.4 from the "ports" collection and spf-milter
1.41. I saw there was a memory leak in Perl 5.8.2 but I can find nothing
mentioned of a memory leak in Perl 5.8.4. Any suggestions on how to track
this down or if it's a known problem? Perl -V below...

USER    PID %CPU %MEM   VSZ  RSS  TT  STAT STARTED      TIME COMMAND
smmsp 68487  7.3 22.2 125652 115320  ??  Ss   10:46PM   4:48.52 spf-milter
(perl)

Regards,
        Chris

Chris Miller
NetGate Internet
An iStrata Company

perl -V
Summary of my perl5 (revision 5 version 8 subversion 4) configuration:
  Platform:
    osname=freebsd, osvers=4.10-stable,
archname=i386-freebsd-thread-multi-64int
    uname='freebsd 4.10-stable freebsd 4.10-stable #0:
fri jun 18 11:30:50 pdt 2004 :usrobjusrsrcsys i386 '
    config_args='-sde -Dprefix=/usr/local
-Darchlib=/usr/local/lib/perl5/5.8.4/mach
-Dprivlib=/usr/local/lib/perl5/5.8.4
-Dman3dir=/usr/local/lib/perl5/5.8.4/perl/man/man3
-Dman1dir=/usr/local/man/man1 -Duse64bitint
-Dsitearch=/usr/local/lib/perl5/site_perl/5.8.4/mach
-Dsitelib=/usr/local/lib/perl5/site_perl/5.8.4 -Dscriptdir=/usr/local/bin
-Dsiteman3dir=/usr/local/lib/perl5/5.8.4/man/man3
-Dsiteman1dir=/usr/local/man/man1 -Ui_malloc -Ui_iconv -Uinstallusrbinperl
-Dcc=cc -Doptimize=-O -pipe  -Duseshrplib
-Dccflags=-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.4/BSDPAN" -Ud_dosuid
-Ui_gdbm -Dusethreads=y -Dusemymalloc=n'
    hint=recommended, useposix=true, d_sigaction=define
    usethreads=define use5005threads=undef useithreads=define
usemultiplicity=define
    useperlio=define d_sfio=undef uselargefiles=define usesocks=undef
    use64bitint=define use64bitall=undef uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='cc', ccflags ='-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.4/BSDPAN"
-DHAS_FPSETMASK -DHAS_FLOATINGPOINT_H -fno-strict-aliasing
-I/usr/local/include',
    optimize='-O -pipe ',
    cppflags='-DAPPLLIB_EXP="/usr/local/lib/perl5/5.8.4/BSDPAN"
-DHAS_FPSETMASK -DHAS_FLOATINGPOINT_H -fno-strict-aliasing
-I/usr/local/include'
    ccversion='', gccversion='2.95.4 20020320 [FreeBSD]', gccosandvers=''
    intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=12345678
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=12
    ivtype='long long', ivsize=8, nvtype='double', nvsize=8,
Off_t='off_t', lseeksize=8
    alignbytes=4, prototype=define
  Linker and Libraries:
    ld='cc', ldflags ='-pthread -Wl,-E  -L/usr/local/lib'
    libpth=/usr/lib /usr/local/lib
    libs=-lm -lcrypt -lutil -lc_r
    perllibs=-lm -lcrypt -lutil -lc_r
    libc=, so=so, useshrplib=true, libperl=libperl.so
    gnulibc_version=''
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='
-Wl,-R/usr/local/lib/perl5/5.8.4/mach/CORE'
    cccdlflags='-DPIC -fPIC', lddlflags='-shared  -L/usr/local/lib'


Characteristics of this binary (from libperl):
  Compile-time options: MULTIPLICITY USE_ITHREADS USE_64_BIT_INT
USE_LARGE_FILES PERL_IMPLICIT_CONTEXT
  Built under freebsd
  Compiled at Jun 21 2004 16:47:13
  @INC:
    /usr/local/lib/perl5/site_perl/5.8.4/mach
    /usr/local/lib/perl5/site_perl/5.8.4
    /usr/local/lib/perl5/site_perl
    /usr/local/lib/perl5/5.8.4/BSDPAN
    /usr/local/lib/perl5/5.8.4/mach
    /usr/local/lib/perl5/5.8.4

-------
Sender Policy Framework: http://spf.pobox.com/
Archives at http://archives.listbox.com/spf-discuss/current/
Send us money!  http://spf.pobox.com/donations.html
To unsubscribe, change your address, or temporarily deactivate your 
subscription,
please go to 
http://v2.listbox.com/member/?listname=spf-discuss(_at_)v2(_dot_)listbox(_dot_)com

--
K.F.J. Martens, Sonologic, http://www.sonologic.nl/
Networking, embedded systems, unix expertise, artificial intelligence.
Public PGP key: http://www.metro.cx/pubkey-gmc.asc
Wondering about the funny attachment your mail program
can't read? Visit http://www.openpgp.org/

-------
Sender Policy Framework: http://spf.pobox.com/
Archives at http://archives.listbox.com/spf-discuss/current/
Send us money!  http://spf.pobox.com/donations.html
To unsubscribe, change your address, or temporarily deactivate your 
subscription,
please go to 
http://v2.listbox.com/member/?listname=spf-discuss(_at_)v2(_dot_)listbox(_dot_)com


<Prev in Thread] Current Thread [Next in Thread>