[exim-dev] test suite out of order results

Top Page

Reply to this message
Author: Todd Lyons
Date:  
To: exim-dev
Subject: [exim-dev] test suite out of order results
When I run the test suite, some tests give me out of order results in
the log file. A good example is test #5. Ever seen this before? Can
anybody suggest changes I can or should make to get these log lines
appearing in the right order? This is running on a real machine, not
a vm. It's Ubuntu 11.04. App is configured to be owned by user
"exim" and builder/tester user is "exim-build":

[exim-build@tlyons ~/projects/exim/test (master)]$ id exim
uid=480(exim) gid=500(pubwww) groups=500(pubwww)
[exim-build@tlyons ~/projects/exim/test (master)]$ id exim-build
uid=1000(exim-build) gid=136(exim-build) groups=136(exim-build),500(pubwww)

Does anything above look wrong?

Here is a description I sent offline to someone else:


---------------- Forwarded Message ----------------

I'll start with a simple issue:
With current master, tests 1-4 work fine.  test 5 errors, caused by
what I assume is a simple timing issue.  The munging is working fine,
it's just that the lines end up out of order.  log/0005 basically has:
queueID_1 <= sender
queueID_1 => recipient
queueID_1 Completed
queueID_2 <= sender
queueID_2 => recipient
queueID_2 Completed
queueID_3 <= sender
Start queue run
queueID_3 => recipient
queueID_3 Completed
End queue run

Whereas mine ends up looking like:
queueID_1 <= sender
queueID_2 <= sender
queueID_3 <= sender
Start queue run
queueID_1 => recipient
queueID_1 Completed
queueID_2 => recipient
queueID_2 Completed
queueID_3 => recipient
queueID_3 Completed
End queue run

Does yours do the same?  Or does the ordering end up exactly the way
the test log appears?  I may need to look at what features I'm
enabling on this build.  It's a plain build with almost nothing extra
enabled beside the bare requirements.  I can provide my Local/Makefile
that I use to build exim if necessary.



...Todd

--
Always code as if the guy who ends up maintaining your code will be a
violent psychopath who knows where you live. -- Martin Golding