Re: [exim] Deduplicate message copies

Top Page
Delete this message
Reply to this message
Author: Heiko Schlittermann
Date:  
To: exim-users
Subject: Re: [exim] Deduplicate message copies
Konstantin <myownletters@???> (Mo 12 Mai 2014 16:26:59 CEST):
> Hi
>
> I have following router used to send messages to archive server.
> Archive server can't recognise duplicated messages.
>
> Is there any option to configure exim to send only one copy of message to
> my.backup.server ?


How should exim know that's a duplicate message. Exim will send the
each message exactly once, except it doesn't see the final '2xx OK'
of the peer.

(Duplicate detection is not as easy as it looks at a first glance.

    - same message id -- doesn't have to be a dup (messages
      going via some list manager keep the original message id, but
      are no dup, the headers are changed, sometimes the body is
      changed)


    - other indicators for dups?


I'd say, the only way is comparing the complete message (header and
body). I can imagine some kind of ratelimit, based on the hash of the
message headers and body. Maybe some shortcut can be to use only the
complete message headers.

I'd try to use some ratelimit keyed on the messages body.


    Best regards from Dresden/Germany
    Viele Grüße aus Dresden
    Heiko Schlittermann
-- 
 SCHLITTERMANN.de ---------------------------- internet & unix support -
 Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} -
 gnupg encrypted messages are welcome --------------- key ID: 7CBF764A -
 gnupg fingerprint: 9288 F17D BBF9 9625 5ABC  285C 26A9 687E 7CBF 764A -
(gnupg fingerprint: 3061 CFBF 2D88 F034 E8D2  7E92 EE4E AC98 48D0 359B)-