[exim] Re: failure to transfer data from subprocess

Startseite
Nachricht löschen
Nachricht beantworten
Autor: Robert Nicholson
Datum:  
To: Andrew C Aitchison
CC: Evgeniy Berdnikov via Exim-users
Betreff: [exim] Re: failure to transfer data from subprocess
Here I’m testing with an earlier message that originally failed.

It eventually came thru after I simplified the .forward.

2023-06-02 12:36:42 cwd=/var/spool/exim 3 args: /usr/sbin/exim -Mc 1q5AZm-0002cJ-0b

2023-06-02 12:36:42 1q5AZm-0002cJ-0b <= bbarlow@??? H=mail-lf1-f42.google.com [209.85.167.42] P=esmtps X=TLS1.2:ECDHE-ECDSA-AES128-GCM-SHA256:128 CV=no S=8426 DKIM=matlensilver-com.20221208.gappssmtp.com id=CAMp+ihqxHtpWWBWrj4ifG27gqX+-YqF8BAgrGqPhAcpaiT-urg@??? T="Test #2" from <bbarlow@???> for robert@???
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (fault address: (nil))
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (null pointer indirection)
2023-06-02 12:36:42 1q5AZm-0002cJ-0b internal problem in userforward router (recipient is elastica@???): failure to transfer data from subprocess: status=0100 readerror='No such file or directory'
2023-06-02 12:36:42 1q5AZm-0002cJ-0b == elastica@??? <robert@???> R=userforward defer (-1): internal problem in userforward router (recipient is elastica@???): failure to transfer data from subprocess: status=0100 readerror='No such file or directory'
2023-06-02 13:16:23 1q5AZm-0002cJ-0b => |$home/perlscripts/filter.sh (elastica@???) <robert@???> F=<bbarlow@???> R=userforward T=address_pipe S=8481
2023-06-02 13:16:23 1q5AZm-0002cJ-0b Completed

-----

This is with the working .forward file.

exim -bf ~/.forward </tmp/6.txt
Return-path copied from sender
Sender      = elastica@???
Recipient   = elastica@???
Testing Exim filter file "/home/elastica/.forward"

Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:37 -0700 GOT from mail-lf1-f42.google.com ([209.85.167.42])\n    by lhvm02.lizardhill.com with esmtps  (TLS1.2) tls TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n    (Exim 4.96-58-g4e9ed49f8)\n    (envelope-from <bbarlow@???>)\n    id 1q5AZm-0002cJ-0b\n    for robert@???;\n    Fri, 02 Jun 2023 12:36:42 -0700\nby mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n        for <robert@???>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2 Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbarlow@???> to robert@??? about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.


This is testing with a .forward that was failing with this message.

exim -bf ~/.forward.20230602 </tmp/6.txt
Return-path copied from sender
Sender      = elastica@???
Recipient   = elastica@???
Testing Exim filter file "/home/elastica/.forward.20230602"

Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:20 -0700 GOT from mail-lf1-f42.google.com ([209.85.167.42])\n    by lhvm02.lizardhill.com with esmtps  (TLS1.2) tls TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n    (Exim 4.96-58-g4e9ed49f8)\n    (envelope-from <bbarlow@???>)\n    id 1q5AZm-0002cJ-0b\n    for robert@???;\n    Fri, 02 Jun 2023 12:36:42 -0700\nby mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n        for <robert@???>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2 Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbarlow@???> to robert@??? about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.


-----

So you can see I don’t really have a very good way to test since the above isn’t reproducing the issue as far as I can tell.

If it’s relevant here’s my attempt at -d

working .forward

exim -d -bf ~/.forward </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30436 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
                        Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
                      Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips  26 Jan 2017
                          Runtime: OpenSSL 1.0.2k-fips  26 Jan 2017
                                 : built on: reproducible build, date unspecified
Library version: spf2: Compile: 1.2.11
                       Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
                        Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
  uid=1043 gid=1045 pid=30436
  auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to     03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     03104000: 02000000 (no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     03104000: 04000000 (no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     07104000: 10000000 (no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied


Problematic .forward

exim -d -bf ~/.forward.20230602 </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30492 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
                        Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
                      Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips  26 Jan 2017
                          Runtime: OpenSSL 1.0.2k-fips  26 Jan 2017
                                 : built on: reproducible build, date unspecified
Library version: spf2: Compile: 1.2.11
                       Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
                        Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
  uid=1043 gid=1045 pid=30492
  auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to     03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     03104000: 02000000 (no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     03104000: 04000000 (no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     07104000: 10000000 (no_tlsv1_1 +cipher_server_preference)
openssl option, adding to     17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied


> On Jun 3, 2023, at 5:50 AM, Andrew C Aitchison via Exim-users <exim-users@???> wrote:
> 
> On Fri, 2 Jun 2023, Robert Nicholson via Exim-users wrote:
> 
>> I’ve shrunk the .forward now and some of the problematic emails
>> started getting delivered.
>> 
>> Still I don’t have root cause.
>> 
>> But I’m told that the backup that you see me saving things into it’s
>> immediate but rather delayed hence the messages don’t end up there
>> either.
>> 
>> The biggest contributor making this difficult to resolve is largely
>> the inability to push test data thru it without involving Admins
>> (takes time) because I don’t have the actual messages nor can I push
>> it thru end to end thru userforward etc myself as I don’t have the
>> permissions.
> 
> I am a bit confused. You say that some of the problematic messages have been delivered but you don't have actual messages.
> 
> Does `exim -bf ~/.forward < ... ` work in your circumstances ?
> 
> -- 
> Andrew C. Aitchison                      Kendal, UK
>                   andrew@???
> 
> -- 
> ## subscription configuration (requires account):
> ##   https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
> ## unsubscribe (doesn't require an account):
> ##   exim-users-unsubscribe@???
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/



--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-users-unsubscribe@???
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/