Author: Todd Lyons Date: To: exim-dev Subject: [exim-dev] test suite out of order results
When I run the test suite, some tests give me out of order results in
the log file. A good example is test #5. Ever seen this before? Can
anybody suggest changes I can or should make to get these log lines
appearing in the right order? This is running on a real machine, not
a vm. It's Ubuntu 11.04. App is configured to be owned by user
"exim" and builder/tester user is "exim-build":
[exim-build@tlyons ~/projects/exim/test (master)]$ id exim
uid=480(exim) gid=500(pubwww) groups=500(pubwww)
[exim-build@tlyons ~/projects/exim/test (master)]$ id exim-build
uid=1000(exim-build) gid=136(exim-build) groups=136(exim-build),500(pubwww)
Does anything above look wrong?
Here is a description I sent offline to someone else:
I'll start with a simple issue:
With current master, tests 1-4 work fine. test 5 errors, caused by
what I assume is a simple timing issue. The munging is working fine,
it's just that the lines end up out of order. log/0005 basically has:
queueID_1 <= sender
queueID_1 => recipient
queueID_1 Completed
queueID_2 <= sender
queueID_2 => recipient
queueID_2 Completed
queueID_3 <= sender
Start queue run
queueID_3 => recipient
queueID_3 Completed
End queue run
Whereas mine ends up looking like:
queueID_1 <= sender
queueID_2 <= sender
queueID_3 <= sender
Start queue run
queueID_1 => recipient
queueID_1 Completed
queueID_2 => recipient
queueID_2 Completed
queueID_3 => recipient
queueID_3 Completed
End queue run
Does yours do the same? Or does the ordering end up exactly the way
the test log appears? I may need to look at what features I'm
enabling on this build. It's a plain build with almost nothing extra
enabled beside the bare requirements. I can provide my Local/Makefile
that I use to build exim if necessary.
...Todd
--
Always code as if the guy who ends up maintaining your code will be a
violent psychopath who knows where you live. -- Martin Golding