Re: [exim-dev] Preliminary testing of a new Exim test suite

Top Page
Delete this message
Reply to this message
Author: Daniel Tiefnig
Date:  
To: exim-dev
Subject: Re: [exim-dev] Preliminary testing of a new Exim test suite
Philip Hazel wrote:
> I had to do a minor fix to Exim for some of these tests - I've made a
> snapshot, but it is fail safe in the sense that the relevant tests
> will be skipped if you just use 4.54. They are for the obscure
> features translate_ip_address and move_frozen_messages.


Hmm, is it in ftp://ftp.csx.cam.ac.uk/[...]/exim-snapshot.tar.gz? How do
I enable translate_ip_address? The testscript insists in "missing
support translate_ip_address".

> I expect you to have trouble with these new tests. They are
> exercising new things.


Well:

Basic/0037 differs:
Line 121 of "test-mainlog-munged" does not match line 121 of "log/0037".
----------
[...] Permission denied (euid=CALLER_UID egid=gggg)
----------
[...] Permission denied (euid=CALLER_UID egid=CALLER_GID)

Similar with Basic/0076 and Basic/0107.


Basic/0072 says:
===============
Line 12 of "test-mail-munged" does not match line 12 of "mail/0072.CALLER".
----------
From: Debian-exim@???
----------
From: exim@???

Same for Basic/0073 on Lines 12 and 28...


Basic/0090 fails with the following in stderr:
| [...] re-exec of exim
| (/home/tiefnig/exim/exim-testsuite-0.00/eximdir/exim) with -t failed:
| Permission denied


~/exim/exim-testsuite-0.00$ ls -la eximdir
drwx--x---  2 tiefnig     Debian-exim   4096 Oct 20 18:14 ./
drwxr-xr-x 21 tiefnig     tiefnig       4096 Oct 20 18:40 ../
-rwsr-xr-x  1 root        root        818266 Oct 20 18:14 exim*
-rwxr-xr-x  1 tiefnig     tiefnig      12754 Oct 20 18:14 exim_dbmbuild*
-rwxr-xr-x  1 tiefnig     tiefnig      16078 Oct 20 18:14 exim_dumpdb*
-rwsr-sr-x  1 Debian-exim Debian-exim 818266 Oct 20 18:14 exim_exim*



In Basic/0109 there is:
From line 4 of "test-mainlog-munged" and line 4 of "log/0109" the files
are different.
----------
[...] R=remote T=smtp defer (dd): Connection refused
----------
[...] R=remote T=smtp defer (111): Connection refused


plaintext-OpenSSL/3463 TLS (server: tls_remember_esmtp)
** Command 5 (starting at line 25)
** Return code 1 (expected 0)

Hmm, have to look into that.


maildir/5000 exim quota + warn threshold with maildir
Test 10
** test-mail/new/1129827276.H394052P26968.myhost.test.ex:S370 is not empty

I'm thinking: So what? And the file contains (surprise!) an e-mail.


Tell me if I should look into something more deeply, I'm specifically
not sure why tests 0090 and 3463 fail and will look into that as soon as
I get some more time.


Ah, omitted tests were:
1000-Basic-ipv6 (missing support IPv6)
2000-GnuTLS (missing support GnuTLS)
2250-dnsdb-ipv6 (missing support IPv6)
2600-SQLite (missing lookup sqlite)
3450-plaintext-GnuTLS (missing support GnuTLS)
4950-translate-ip (missing support translate_ip_address)


lg,
daniel