Re: [exim-dev] Exim test suite running thru Basic/0216

On Tue, Mar 22, 2011 at 4:31 AM, Phil Pennock <exim-dev@???> wrote:
> On 2011-01-30 at 03:58 -0500, Phil Pennock wrote:
>> At 0217, things fail in such a way as to kill a daemon assumed to be
>> running in later tests?  Or something.  I'm too tired at this point to
>> debug further.
>
> Got around to tests before the final 4.75 cut.
>
> I can now get up to: ipliteral/5301 (ie, the end!)
>
> However, in addition to the LRU issues I noted before, I saw some more
> issues which I continued past.
>
> These are the tests I haven't fixed and would like to know if the
> failures are commonly observed.

Took me a while to find my testing notes. My last successful testing
was 2010-07-19 (and at a company I no longer work for, hence taking a
while to find the notes)

0288 was testing cleanly for me at that time. I'm sorry but I can't
provide any lib versions for the server I was using to test

0358 was broken back then. My notes say "line ordering" and that I
sent an email to exim-dev on 2010-06-08 w/ no response.

0548 was likewise broken then. I don't have any notes about suspected cause.

1003, 1006, 1009 - I don't have any notes for these tests but I'm not
100% sure the IPv6 tests would have run on that machine.

2100
2101
2102
2111
2112
2114
2120
2124
2125
2127 - I had all of these flagged. my only comment was "new TLS
disconnect string".

3650 - not sure I would have hit this test

5007 - my notes say I sent an email to exim-dev about this test on
2010-06-12, that may provide additional thoughts on this failure.

Hope that helps.

--John


>
> ----------------------------8< cut here >8------------------------------
> Basic/0288 serialize_hosts
> ** Comparison of test-mainlog-munged with log/0288 failed===============
> From line 3 of "test-mainlog-munged" and line 3 of "log/0288" the files are different.
> ----------
> 1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory
> 1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close
> 1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory
> 1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close
> 1999-03-02 09:44:33 10HmaX-0005vi-00 == b@??? R=all T=smtp defer (-53): connection limit reached for all hosts
> 1999-03-02 09:44:33 10HmaX-0005vi-00 => a@??? R=all T=smtp H=127.0.0.1 [127.0.0.1]
> 1999-03-02 09:44:33 End queue run: pid=pppp
> ----------
> 1999-03-02 09:44:33 10HmaX-0005vi-00 == b@??? R=all T=smtp defer (-53): connection limit reached for all hosts
> 1999-03-02 09:44:33 10HmaX-0005vi-00 => a@??? R=all T=smtp H=127.0.0.1 [127.0.0.1]
> 1999-03-02 09:44:33 End queue run: pid=pppp
> ===============
> 1 difference found.
> "test-mainlog-munged" contains 9 lines; "log/0288" contains 5 lines.
> ----------------------------8< cut here >8------------------------------
>
> ----------------------------8< cut here >8------------------------------
> Basic/0358 retrying address errors (not first address)
> ** Comparison of test-stdout-munged with stdout/0358 failed===============
> Lines 2-9 of "test-stdout-munged" do not match lines 2-9 of "stdout/0358".
> ----------
>  R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 1
>  R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 1
> +++++++++++++++++++++++++++
>  R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 2
>  R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> ----------
>  R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 1
>  R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 1
> +++++++++++++++++++++++++++
>  R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> first failed = time last try = time2 next try = time2 + 2
>  R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
> ===============
> 1 difference found.
> "test-stdout-munged" contains 40 lines; "stdout/0358" contains 40 lines.
> ----------------------------8< cut here >8------------------------------
>
> Similar issues on 0548.
>
> ----------------------------8< cut here >8------------------------------
> Basic/0437 queue run: close lookups before delivery
> ** Command 1 ("exim", starting at line 2)
> ** Return code 1 (expected 0)
> show stdErr, show stdOut, Continue (without file comparison), or Quit?
> [Q] e
> 2011-03-22 04:06:06 failed to expand spool_directory
> "/usr/globnix/homes/exim-build/exim/test/${lookup{spool}lsearch{/usr/globnix/homes/exim-build/exim/test/aux-fixed/0437.ls}}":
> unknown lookup type "lsearch"
> ----------------------------8< cut here >8------------------------------
> [ and again for command 2 ]
>
> ----------------------------8< cut here >8------------------------------
> Basic-ipv6/1003 interface selection (v4 vs v6) in outgoing SMTP
> ** Comparison of test-mainlog-munged with log/1003 failed===============
> Lines 9-14 of "test-mainlog-munged" do not match lines 9-12 of "log/1003".
> ----------
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 ::1 [::1] Connection timed out
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 == userx@??? R=client T=send_to_server defer (dd): Connection timed out
> 1999-03-02 09:44:33 10HmbA-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
> 1999-03-02 09:44:33 10HmbA-0005vi-00 Completed
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]*
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed
> ----------
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
> 1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed
> 1999-03-02 09:44:33 10HmbA-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
> 1999-03-02 09:44:33 10HmbA-0005vi-00 Completed
> ===============
> From line 23 of "test-mainlog-munged" and line 21 of "log/1003" the files are different.
> ----------
> 1999-03-02 09:44:33 no host name found for IP address ::1
> 1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00@???
> 1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmaZ-0005vi-00@???
> 1999-03-02 09:44:33 no host name found for IP address ::1
> 1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00@???
> ----------
> 1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER@??? H=the.local.host.name (myhost.test.ex) [ip6:ip6:ip6:ip6:ip6:ip6:ip6:ip6] P=esmtp S=sss id=E10HmaZ-0005vi-00@???
> 1999-03-02 09:44:33 no host name found for IP address ::1
> 1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00@???
> 1999-03-02 09:44:33 no host name found for IP address ::1
> 1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00@???
> ===============
> 2 differences found.
> "test-mainlog-munged" contains 27 lines; "log/1003" contains 25 lines.
> ----------------------------8< cut here >8------------------------------
>
> ----------------------------8< cut here >8------------------------------
> Basic-ipv6/1006 disable_ipv6
> ** Comparison of test-stdout-munged with stdout/1006 failed===============
> Line 8 of "test-stdout-munged" does not match line 8 of "stdout/1006".
> ----------
>  host 46.test.ex [V4NET.0.0.4]
> ----------
>  host 46.test.ex [V4NET.0.0.4]
> ===============
> 1 difference found.
> "test-stdout-munged" contains 26 lines; "stdout/1006" contains 26 lines.
> ----------------------------8< cut here >8------------------------------
>
> Similar issue on: Basic-ipv6/1009 (line 4 instead of 8, but otherwise
> the same).
>
> ----------------------------8< cut here >8------------------------------
> OpenSSL/2102 TLS server: general
> ** Comparison of test-stdout-munged with stdout/2102 failed===============
> Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2102".
> ----------
> SSL info: SSLv3 read server session ticket A
> ===============
> Lines 82-83 of "test-stdout-munged" do not match lines 81-82 of "stdout/2102".
> ----------
> SSL info: SSLv3 read server session ticket A
> SSL info: SSLv3 read server session ticket A
> ----------
> SSL info: SSLv3 read finished A
> SSL info: SSLv3 read finished A
> ===============
> Line 120 of "test-stdout-munged" occurs before line 119 of "stdout/2102".
> ----------
> SSL info: SSLv3 read server session ticket A
> ===============
> 3 differences found.
> "test-stdout-munged" contains 150 lines; "stdout/2102" contains 148 lines.
> ----------------------------8< cut here >8------------------------------
> and similar for: OpenSSL/2114 OpenSSL/2124
>
> ----------------------------8< cut here >8------------------------------
> OpenSSL/2103 TLS server: unavailable cipher
> ** Comparison of test-stdout-munged with stdout/2103 failed===============
> Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2103".
> ----------
> SSL info: SSLv3 read server session ticket A
> ===============
> Line 73 of "test-stdout-munged" occurs before line 72 of "stdout/2103".
> ----------
> SSL info: SSLv3 read server session ticket A
> ===============
> 2 differences found.
> "test-stdout-munged" contains 98 lines; "stdout/2103" contains 96 lines.
> ----------------------------8< cut here >8------------------------------
> and similar for: OpenSSL/2105 OpenSSL/2106 OpenSSL/2118 OpenSSL/2119
>                 OpenSSL/2122 OpenSSL/2128 OpenSSL/2150
>                 plaintext-OpenSSL/3460 plaintext-OpenSSL/3463
>                 plaintext-OpenSSL/3464
>
> ----------------------------8< cut here >8------------------------------
> Dovecot/3650 Dovecot authentication (server only)
> ** runtest error: Couldn't open /usr/globnix/homes/exim-build/exim/test/confs/3650: No such file or directory
> ----------------------------8< cut here >8------------------------------
>
> After this one, runtest bailed out.  Unsurprising, since there's a test
> without a confs/ entry.
>
> Continued with { 4000 + }.
>
> ----------------------------8< cut here >8------------------------------
> maildir/5007 maildirsize for quota handling quota > 2G
> ** Comparison of test-mail-munged with mail/5007.userx/new/1.myhost.test.ex failed===============
> From line 5 of "test-mail-munged" and line 5 of "mail/5007.userx/new/1.myhost.test.ex" the files are different.
> ----------
> Message-Id: <E10HmaX-0005vi-00@???>
> From: CALLER_NAME <CALLER@???>
> Date: Tue, 2 Mar 1999 09:44:33 +0000
>
> Test message
> ----------
> Date: Tue, 2 Mar 1999 09:44:33 +0000
> Message-Id: <E10HmaX-0005vi-00@???>
> From: CALLER_NAME <CALLER@???>
>
> Test message
> ===============
> 1 difference found.
> "test-mail-munged" contains 9 lines; "mail/5007.userx/new/1.myhost.test.ex" contains 9 lines.
> ----------------------------8< cut here >8------------------------------
>
> -Phil
>