Here I’m testing with an earlier message that originally failed.
It eventually came thru after I simplified the .forward.
2023-06-02 12:36:42 cwd=/var/spool/exim 3 args: /usr/sbin/exim -Mc 1q5AZm-0002cJ-0b
2023-06-02 12:36:42 1q5AZm-0002cJ-0b <= bbarlow@??? H=mail-lf1-f42.google.com [209.85.167.42] P=esmtps X=TLS1.2:ECDHE-ECDSA-AES128-GCM-SHA256:128 CV=no S=8426 DKIM=matlensilver-com.20221208.gappssmtp.com id=CAMp+ihqxHtpWWBWrj4ifG27gqX+-YqF8BAgrGqPhAcpaiT-urg@??? T="Test #2" from <bbarlow@???> for robert@???
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (fault address: (nil))
2023-06-02 12:36:42 1q5AZm-0002cJ-0b SIGSEGV (null pointer indirection)
2023-06-02 12:36:42 1q5AZm-0002cJ-0b internal problem in userforward router (recipient is elastica@???): failure to transfer data from subprocess: status=0100 readerror='No such file or directory'
2023-06-02 12:36:42 1q5AZm-0002cJ-0b == elastica@??? <robert@???> R=userforward defer (-1): internal problem in userforward router (recipient is elastica@???): failure to transfer data from subprocess: status=0100 readerror='No such file or directory'
2023-06-02 13:16:23 1q5AZm-0002cJ-0b => |$home/perlscripts/filter.sh (elastica@???) <robert@???> F=<bbarlow@???> R=userforward T=address_pipe S=8481
2023-06-02 13:16:23 1q5AZm-0002cJ-0b Completed
-----
This is with the working .forward file.
exim -bf ~/.forward </tmp/6.txt
Return-path copied from sender
Sender = elastica@???
Recipient = elastica@???
Testing Exim filter file "/home/elastica/.forward"
Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:37 -0700 GOT from mail-lf1-f42.google.com ([209.85.167.42])\n by lhvm02.lizardhill.com with esmtps (TLS1.2) tls TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n (Exim 4.96-58-g4e9ed49f8)\n (envelope-from <bbarlow@???>)\n id 1q5AZm-0002cJ-0b\n for robert@???;\n Fri, 02 Jun 2023 12:36:42 -0700\nby mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n for <robert@???>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2 Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbarlow@???> to robert@??? about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.
This is testing with a .forward that was failing with this message.
exim -bf ~/.forward.20230602 </tmp/6.txt
Return-path copied from sender
Sender = elastica@???
Recipient = elastica@???
Testing Exim filter file "/home/elastica/.forward.20230602"
Logfile /home/elastica/filter.log
Logwrite "Sat, 03 Jun 2023 08:39:20 -0700 GOT from mail-lf1-f42.google.com ([209.85.167.42])\n by lhvm02.lizardhill.com with esmtps (TLS1.2) tls TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256\n (Exim 4.96-58-g4e9ed49f8)\n (envelope-from <bbarlow@???>)\n id 1q5AZm-0002cJ-0b\n for robert@???;\n Fri, 02 Jun 2023 12:36:42 -0700\nby mail-lf1-f42.google.com with SMTP id 2adb3069b0e04-4f004cc54f4so3402189e87.3\n for <robert@???>; Fri, 02 Jun 2023 12:36:39 -0700 (PDT) Fri, 2 Jun 2023 15:36:25 -0400 message from Brandon Barlow <bbarlow@???> to robert@??? about Test #2\n"
Pipe message to: $home/perlscripts/filter.sh
Finish
Filtering set up at least one significant delivery or other action.
No other deliveries will occur.
-----
So you can see I don’t really have a very good way to test since the above isn’t reproducing the issue as far as I can tell.
If it’s relevant here’s my attempt at -d
working .forward
exim -d -bf ~/.forward </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30436 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips 26 Jan 2017
Runtime: OpenSSL 1.0.2k-fips 26 Jan 2017
: built on: reproducible build, date unspecified
Library version: spf2: Compile: 1.2.11
Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
uid=1043 gid=1045 pid=30436
auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to 03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 02000000 (no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 04000000 (no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 07104000: 10000000 (no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied
Problematic .forward
exim -d -bf ~/.forward.20230602 </tmp/6.txt
Exim version 4.96-58-g4e9ed49f8 uid=1043 gid=1045 pid=30492 D=f7715cfd
Support for: crypteq IPv6 Perl OpenSSL TLS_resume move_frozen_messages Content_Scanning DKIM DNSSEC Event OCSP PIPECONNECT PRDR Queue_Ramp SPF SRS TCP_Fast_Open
Lookups (built-in): lsearch wildlsearch nwildlsearch iplsearch cdb dbm dbmjz dbmnz dnsdb
Authenticators: cram_md5 dovecot plaintext spa
Routers: accept dnslookup ipliteral manualroute queryprogram redirect
Transports: appendfile/maildir/mailstore/mbx autoreply lmtp pipe smtp
Malware: f-protd f-prot6d drweb aveserver fsecure kavdaemon sophie clamd mksd avast sock cmdline
Fixed never_users: 0
Configure owner: 0:0
Size of off_t: 8
Compiler: GCC [4.8.5 20150623 (Red Hat 4.8.5-44)]
Library version: Glibc: Compile: 2.17
Runtime: 2.17
Library version: BDB: Compile: Berkeley DB 5.3.21: (May 11, 2012)
Runtime: Berkeley DB 5.3.21: (May 11, 2012)
Library version: OpenSSL: Compile: OpenSSL 1.0.2k-fips 26 Jan 2017
Runtime: OpenSSL 1.0.2k-fips 26 Jan 2017
: built on: reproducible build, date unspecified
Library version: spf2: Compile: 1.2.11
Runtime: 1.2.11
Library version: PCRE2: Compile: 10.35
Runtime: 10.35 2020-05-09
Total 11 lookups
WHITELIST_D_MACROS unset
TRUSTED_CONFIG_LIST unset
changed uid/gid: -C, -D, -be or -bf forces real uid
uid=1043 gid=1045 pid=30492
auxiliary group list: 1045
seeking password data for user "mail": cache not available
getpwnam() succeeded uid=8 gid=12
seeking password data for user "majordomo": cache not available
getpwnam() succeeded uid=993 gid=2
seeking password data for user "diradmin": cache not available
getpwnam() succeeded uid=995 gid=995
seeking password data for user "root": cache not available
getpwnam() succeeded uid=0 gid=0
openssl option, adding to 03104000: 01000000 (no_sslv2 +no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 02000000 (no_sslv3 +no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 03104000: 04000000 (no_tlsv1 +no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 07104000: 10000000 (no_tlsv1_1 +cipher_server_preference)
openssl option, adding to 17104000: 00400000 (cipher_server_preference)
XDG_SESSION_ID in keep_environment? no (end of list)
HOSTNAME in keep_environment? no (end of list)
TERM in keep_environment? no (end of list)
SHELL in keep_environment? no (end of list)
HISTSIZE in keep_environment? no (end of list)
SSH_CLIENT in keep_environment? no (end of list)
PERL5LIB in keep_environment? no (end of list)
SSH_TTY in keep_environment? no (end of list)
USER in keep_environment? no (end of list)
LS_COLORS in keep_environment? no (end of list)
MAIL in keep_environment? no (end of list)
PATH in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
LANG in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HISTCONTROL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
SHLVL in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LOGNAME in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
SSH_CONNECTION in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
LESSOPEN in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
XDG_RUNTIME_DIR in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
_ in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
OLDPWD in keep_environment? no (end of list)
PWD in keep_environment? yes (matched "PWD")
HOME in keep_environment? yes (matched "HOME")
configuration file is /etc/exim.conf
log selectors = 000024ac 73205036 0000000e
exim: debugging permission denied
> On Jun 3, 2023, at 5:50 AM, Andrew C Aitchison via Exim-users <exim-users@???> wrote:
>
> On Fri, 2 Jun 2023, Robert Nicholson via Exim-users wrote:
>
>> I’ve shrunk the .forward now and some of the problematic emails
>> started getting delivered.
>>
>> Still I don’t have root cause.
>>
>> But I’m told that the backup that you see me saving things into it’s
>> immediate but rather delayed hence the messages don’t end up there
>> either.
>>
>> The biggest contributor making this difficult to resolve is largely
>> the inability to push test data thru it without involving Admins
>> (takes time) because I don’t have the actual messages nor can I push
>> it thru end to end thru userforward etc myself as I don’t have the
>> permissions.
>
> I am a bit confused. You say that some of the problematic messages have been delivered but you don't have actual messages.
>
> Does `exim -bf ~/.forward < ... ` work in your circumstances ?
>
> --
> Andrew C. Aitchison Kendal, UK
> andrew@???
>
> --
> ## subscription configuration (requires account):
> ## https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
> ## unsubscribe (doesn't require an account):
> ## exim-users-unsubscribe@???
> ## Exim details at http://www.exim.org/
> ## Please use the Wiki with this list - http://wiki.exim.org/
--
## subscription configuration (requires account):
##
https://lists.exim.org/mailman3/postorius/lists/exim-users.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-users-unsubscribe@???
## Exim details at
http://www.exim.org/
## Please use the Wiki with this list -
http://wiki.exim.org/
