[exim-dev] [Bug 1178] New: queue runner is using huge amount…

Top Page
Delete this message
Reply to this message
Author: Fused Team
Date:  
To: exim-dev
New-Topics: [exim-dev] [Bug 1178] queue runner is using huge amounts of memory, [exim-dev] [Bug 1178] queue runner is using huge amounts of memory, [exim-dev] [Bug 1178] queue runner is using huge amounts of memory
Subject: [exim-dev] [Bug 1178] New: queue runner is using huge amounts of memory
------- You are receiving this mail because: -------
You are on the CC list for the bug.

http://bugs.exim.org/show_bug.cgi?id=1178
           Summary: queue runner is using huge amounts of memory
           Product: Exim
           Version: 4.69
          Platform: Other
        OS/Version: Linux
            Status: NEW
          Severity: bug
          Priority: high
         Component: Queues
        AssignedTo: nigel@???
        ReportedBy: admins@???
                CC: exim-dev@???



This bug would be hard to reproduce.

We've noticed that one of our servers is constantly going into swap-then-dead
state. Something was using quite a lot of memory. Investigation revealed that
the source of problems is exim queue runner process. It runs for 2-3-4 days
(queue runner!!), slowly increasing its memory usage and then, if we're lucky,
it gets killed by oom condition. As the server runs CPanel (and their small
mods, I presume), the version number isn't much recent.

So here's what I see currently:

# ps -O etime,cputime,rss,vsize -p 6676
  PID     ELAPSED     TIME   RSS    VSZ S TTY          TIME COMMAND
 6676       49:06 00:27:25 862280 924248 R ?       00:27:25 /usr/sbin/exim -q


And this is just the start. It will grow further and further.
I have "(gdb) generate-core-file" of that process and can supply it if needed.

# exim -bV
Exim version 4.69 #1 built 15-Aug-2011 12:18:22
Copyright (c) University of Cambridge 2006
Berkeley DB: Sleepycat Software: Berkeley DB 4.3.29: (July 12, 2010)
Support for: crypteq iconv() IPv6 PAM Perl OpenSSL Content_Scanning Old_Demime
Experimental_SPF Experimental_SRS Experimental_DomainKeys Experimental_DKIM
Lookups: lsearch wildlsearch nwildlsearch iplsearch dbm dbmnz passwd
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir autoreply pipe smtp
Size of off_t: 8
Configuration file is /etc/exim.conf

# du -h --max-depth=1 /var/spool/exim/
980K    /var/spool/exim/scan
7.9M    /var/spool/exim/input
368K    /var/spool/exim/msglog
4.6M    /var/spool/exim/db
14M     /var/spool/exim/


# exim -bpc
51

# lsof -nn -p 6676
COMMAND  PID USER   FD   TYPE DEVICE     SIZE     NODE NAME
exim    6676 root  cwd    DIR    8,5     4096   851158 /var/spool/exim
exim    6676 root  rtd    DIR    8,2     4096        2 /
exim    6676 root  txt    REG    8,2  1227584 11156129 /usr/sbin/exim
exim    6676 root  mem    REG    8,2   143600 53969079 /lib64/ld-2.5.so
exim    6676 root  mem    REG    8,2  1722304 53969163 /lib64/libc-2.5.so
exim    6676 root  mem    REG    8,2    23360 53969173 /lib64/libdl-2.5.so
exim    6676 root  mem    REG    8,2   145824 53969175 /lib64/libpthread-2.5.so
exim    6676 root  mem    REG    8,2   615136 53969167 /lib64/libm-2.5.so
exim    6676 root  mem    REG    8,2    85544 53969178 /lib64/libz.so.1.2.3
exim    6676 root  mem    REG    8,2    95464 53969187 /lib64/libselinux.so.1
exim    6676 root  mem    REG    8,2   247496 53969184 /lib64/libsepol.so.1
exim    6676 root  mem    REG    8,2  1008656 53968996 /lib64/libdb-4.3.so
exim    6676 root  mem    REG    8,2   114352 53969172 /lib64/libnsl-2.5.so
exim    6676 root  mem    REG    8,2    48600 53969143 /lib64/libcrypt-2.5.so
exim    6676 root  mem    REG    8,2    92736 53969228 /lib64/libresolv-2.5.so
exim    6676 root  mem    REG    8,2    58400 53969170
/lib64/libgcc_s-4.1.2-20080825.so.1
exim    6676 root  mem    REG    8,2  1366368 53969298
/lib64/libcrypto.so.0.9.8e
exim    6676 root  mem    REG    8,2     9472 53968900
/lib64/libkeyutils-1.2.so
exim    6676 root  mem    REG    8,2   976312 11157654
/usr/lib64/libstdc++.so.6.0.8
exim    6676 root  mem    REG    8,2    10096 53969237 /lib64/libcom_err.so.2.1
exim    6676 root  mem    REG    8,2    98920 53969137 /lib64/libaudit.so.0.0.0
exim    6676 root  mem    REG    8,2   190976 11159606
/usr/lib64/libgssapi_krb5.so.2.2
exim    6676 root  mem    REG    8,2  1262384 11274688
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so
exim    6676 root  mem    REG    8,2    35984 11159365
/usr/lib64/libkrb5support.so.0.1
exim    6676 root  mem    REG    8,2   153720 11159519
/usr/lib64/libk5crypto.so.3.1
exim    6676 root  mem    REG    8,2   614088 11159522
/usr/lib64/libkrb5.so.3.3
exim    6676 root  mem    REG    8,2   315064 53969372 /lib64/libssl.so.0.9.8e
exim    6676 root  mem    REG    8,2    46800 53969190 /lib64/libpam.so.0.81.5
exim    6676 root  mem    REG    8,2    18152 53969419 /lib64/libutil-2.5.so
exim    6676 root  mem    REG    8,2    53880 53969033
/lib64/libnss_files-2.5.so
exim    6676 root    0u   CHR    1,3              1707 /dev/null
exim    6676 root    1u   CHR    1,3              1707 /dev/null
exim    6676 root    2u   CHR    1,3              1707 /dev/null
exim    6676 root    3w   REG    8,5 25547447   523874 /var/log/exim_mainlog
exim    6676 root    4uw  REG    8,5   264584   851706
/var/spool/exim/input/x/1ROIPx-0007P2-6M-D
exim    6676 root    5w  FIFO    0,6            558829 pipe
exim    6676 root    6w   REG    8,5        0   851671
/var/spool/exim/msglog/x/1ROIPx-0007P2-6M
exim    6676 root   11r  FIFO    0,6           1050994 pipe


1050994 pipes come and go, but the 1ROIPx-0007P2-6M message fds stay there.

-rw-r----- 1 mailnull mail 0 Nov 23 10:12
/var/spool/exim/msglog/x/1ROIPx-0007P2-6M
/var/spool/exim/input/x/1ROIPx-0007P2-6M-D is basically spam with
DHL-Express-Delivery-Notification-2034_25UQ.zip file embedded.

We have "demime" in exim.conf if that's relevant.

I consider this a bug. Help!

Thanks.


--
Configure bugmail: http://bugs.exim.org/userprefs.cgi?tab=email