Re: [exim-dev] Exim test suite running thru Basic/0216

Top Page
Delete this message
Reply to this message
Author: Phil Pennock
Date:  
To: exim-dev
CC: John Jetmore
Old-Topics: [exim-dev] Exim test suite running thru Basic/0216
Subject: Re: [exim-dev] Exim test suite running thru Basic/0216
On 2011-01-30 at 03:58 -0500, Phil Pennock wrote:
> At 0217, things fail in such a way as to kill a daemon assumed to be
> running in later tests? Or something. I'm too tired at this point to
> debug further.


Got around to tests before the final 4.75 cut.

I can now get up to: ipliteral/5301 (ie, the end!)

However, in addition to the LRU issues I noted before, I saw some more
issues which I continued past.

These are the tests I haven't fixed and would like to know if the
failures are commonly observed.

----------------------------8< cut here >8------------------------------
Basic/0288 serialize_hosts
** Comparison of test-mainlog-munged with log/0288 failed===============
>From line 3 of "test-mainlog-munged" and line 3 of "log/0288" the files are different.

----------
1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory
1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close
1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory
1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close
1999-03-02 09:44:33 10HmaX-0005vi-00 == b@??? R=all T=smtp defer (-53): connection limit reached for all hosts
1999-03-02 09:44:33 10HmaX-0005vi-00 => a@??? R=all T=smtp H=127.0.0.1 [127.0.0.1]
1999-03-02 09:44:33 End queue run: pid=pppp
----------
1999-03-02 09:44:33 10HmaX-0005vi-00 == b@??? R=all T=smtp defer (-53): connection limit reached for all hosts
1999-03-02 09:44:33 10HmaX-0005vi-00 => a@??? R=all T=smtp H=127.0.0.1 [127.0.0.1]
1999-03-02 09:44:33 End queue run: pid=pppp
===============
1 difference found.
"test-mainlog-munged" contains 9 lines; "log/0288" contains 5 lines.
----------------------------8< cut here >8------------------------------

----------------------------8< cut here >8------------------------------
Basic/0358 retrying address errors (not first address)
** Comparison of test-stdout-munged with stdout/0358 failed===============
Lines 2-9 of "test-stdout-munged" do not match lines 2-9 of "stdout/0358".
----------
R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 1
R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 1
+++++++++++++++++++++++++++
R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 2
R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
----------
R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 1
R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 1
+++++++++++++++++++++++++++
R:userx@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<userx@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
first failed = time last try = time2 next try = time2 + 2
R:usery@???:<CALLER@???> -44 13121 SMTP error from remote mail server after RCPT TO:<usery@???>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error
===============
1 difference found.
"test-stdout-munged" contains 40 lines; "stdout/0358" contains 40 lines.
----------------------------8< cut here >8------------------------------

Similar issues on 0548.

----------------------------8< cut here >8------------------------------
Basic/0437 queue run: close lookups before delivery
** Command 1 ("exim", starting at line 2)
** Return code 1 (expected 0)
show stdErr, show stdOut, Continue (without file comparison), or Quit?
[Q] e
2011-03-22 04:06:06 failed to expand spool_directory
"/usr/globnix/homes/exim-build/exim/test/${lookup{spool}lsearch{/usr/globnix/homes/exim-build/exim/test/aux-fixed/0437.ls}}":
unknown lookup type "lsearch"
----------------------------8< cut here >8------------------------------
[ and again for command 2 ]

----------------------------8< cut here >8------------------------------
Basic-ipv6/1003 interface selection (v4 vs v6) in outgoing SMTP
** Comparison of test-mainlog-munged with log/1003 failed===============
Lines 9-14 of "test-mainlog-munged" do not match lines 9-12 of "log/1003".
----------
1999-03-02 09:44:33 10HmaZ-0005vi-00 ::1 [::1] Connection timed out
1999-03-02 09:44:33 10HmaZ-0005vi-00 == userx@??? R=client T=send_to_server defer (dd): Connection timed out
1999-03-02 09:44:33 10HmbA-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
1999-03-02 09:44:33 10HmbA-0005vi-00 Completed
1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]*
1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed
----------
1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed
1999-03-02 09:44:33 10HmbA-0005vi-00 => userx@??? R=client T=send_to_server H=::1 [::1]
1999-03-02 09:44:33 10HmbA-0005vi-00 Completed
===============
>From line 23 of "test-mainlog-munged" and line 21 of "log/1003" the files are different.

----------
1999-03-02 09:44:33 no host name found for IP address ::1
1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00@???
1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmaZ-0005vi-00@???
1999-03-02 09:44:33 no host name found for IP address ::1
1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00@???
----------
1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER@??? H=the.local.host.name (myhost.test.ex) [ip6:ip6:ip6:ip6:ip6:ip6:ip6:ip6] P=esmtp S=sss id=E10HmaZ-0005vi-00@???
1999-03-02 09:44:33 no host name found for IP address ::1
1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00@???
1999-03-02 09:44:33 no host name found for IP address ::1
1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER@??? H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00@???
===============
2 differences found.
"test-mainlog-munged" contains 27 lines; "log/1003" contains 25 lines.
----------------------------8< cut here >8------------------------------

----------------------------8< cut here >8------------------------------
Basic-ipv6/1006 disable_ipv6
** Comparison of test-stdout-munged with stdout/1006 failed===============
Line 8 of "test-stdout-munged" does not match line 8 of "stdout/1006".
----------
  host 46.test.ex [V4NET.0.0.4] 
----------
  host 46.test.ex [V4NET.0.0.4]                          
===============
1 difference found.
"test-stdout-munged" contains 26 lines; "stdout/1006" contains 26 lines.
----------------------------8< cut here >8------------------------------


Similar issue on: Basic-ipv6/1009 (line 4 instead of 8, but otherwise
the same).

----------------------------8< cut here >8------------------------------
OpenSSL/2102 TLS server: general
** Comparison of test-stdout-munged with stdout/2102 failed===============
Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2102".
----------
SSL info: SSLv3 read server session ticket A
===============
Lines 82-83 of "test-stdout-munged" do not match lines 81-82 of "stdout/2102".
----------
SSL info: SSLv3 read server session ticket A
SSL info: SSLv3 read server session ticket A
----------
SSL info: SSLv3 read finished A
SSL info: SSLv3 read finished A
===============
Line 120 of "test-stdout-munged" occurs before line 119 of "stdout/2102".
----------
SSL info: SSLv3 read server session ticket A
===============
3 differences found.
"test-stdout-munged" contains 150 lines; "stdout/2102" contains 148 lines.
----------------------------8< cut here >8------------------------------
and similar for: OpenSSL/2114 OpenSSL/2124

----------------------------8< cut here >8------------------------------
OpenSSL/2103 TLS server: unavailable cipher
** Comparison of test-stdout-munged with stdout/2103 failed===============
Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2103".
----------
SSL info: SSLv3 read server session ticket A
===============
Line 73 of "test-stdout-munged" occurs before line 72 of "stdout/2103".
----------
SSL info: SSLv3 read server session ticket A
===============
2 differences found.
"test-stdout-munged" contains 98 lines; "stdout/2103" contains 96 lines.
----------------------------8< cut here >8------------------------------
and similar for: OpenSSL/2105 OpenSSL/2106 OpenSSL/2118 OpenSSL/2119
                 OpenSSL/2122 OpenSSL/2128 OpenSSL/2150
         plaintext-OpenSSL/3460 plaintext-OpenSSL/3463
         plaintext-OpenSSL/3464


----------------------------8< cut here >8------------------------------
Dovecot/3650 Dovecot authentication (server only)
** runtest error: Couldn't open /usr/globnix/homes/exim-build/exim/test/confs/3650: No such file or directory
----------------------------8< cut here >8------------------------------

After this one, runtest bailed out. Unsurprising, since there's a test
without a confs/ entry.

Continued with { 4000 + }.

----------------------------8< cut here >8------------------------------
maildir/5007 maildirsize for quota handling quota > 2G
** Comparison of test-mail-munged with mail/5007.userx/new/1.myhost.test.ex failed===============
>From line 5 of "test-mail-munged" and line 5 of "mail/5007.userx/new/1.myhost.test.ex" the files are different.

----------
Message-Id: <E10HmaX-0005vi-00@???>
From: CALLER_NAME <CALLER@???>
Date: Tue, 2 Mar 1999 09:44:33 +0000

Test message
----------
Date: Tue, 2 Mar 1999 09:44:33 +0000
Message-Id: <E10HmaX-0005vi-00@???>
From: CALLER_NAME <CALLER@???>

Test message
===============
1 difference found.
"test-mail-munged" contains 9 lines; "mail/5007.userx/new/1.myhost.test.ex" contains 9 lines.
----------------------------8< cut here >8------------------------------

-Phil