procmail
[Top] [All Lists]

Difference in headers

2009-01-05 00:24:29

Hello.

We have had some problems with incoming email, due to changes made by our web hosting ISP; the ISP messed up their POP server, and our incoming email has been adversely affected.

We apparently fixed one of the problems, with help from the fetchmail list, but we still have a significant problem that defeats our procmail setup, due to a change to the message headers.

Below is the description of the remaining problem, extracted from the message posted to the fetchmail list, from which list, I have not yet received a reply.

Can anyone on this list, help with the problem?

Thank you in anticipation.

--
Bret Busby
Armadale
West Australia
..............

"So once you do know what the question actually is,
 you'll know what the answer means."
- Deep Thought,
  Chapter 28 of Book 1 of
  "The Hitchhiker's Guide to the Galaxy:
  A Trilogy In Four Parts",
  written by Douglas Adams,
  published by Pan Books, 1992

....................................................

---------- Forwarded message ----------

Our web hosting ISP made some changes to their hosting, and it wrecked
our downloading of email from that ISP to our mail server. The ISP had
been using a "self made certificate" or something similar, that had
expired, that ended up preventing us from downloading email, and they did a (apparently cheap and nasty) patch, that led from one error that we received, to another.


(Having fixed one problem, with the assistance of the fetchmail list, the following problem still remains)

Now, the problem that remains, in the ability to filter incoming email messages, appears to be caused by a difference in full headers.

From a mailing list message from 30 November, is the following full
header.


On Sun, 30 Nov 2008, Gavin Chester wrote:

Return-Path: <busby(_at_)busby(_dot_)net>
X-Original-To: bret(_at_)localhost
Delivered-To: bret(_at_)localhost
Received: by mailserver.busby.net (Postfix, from userid 1002)
    id 6879516811; Sun, 30 Nov 2008 21:23:50 +0900 (WST)
X-Original-To: busby(_at_)localhost
Delivered-To: busby(_at_)localhost
Received: from mailserver.busby.net (localhost [127.0.0.1])
    by mailserver.busby.net (Postfix) with ESMTP id 34B6A16811
    for <busby(_at_)localhost>; Sun, 30 Nov 2008 21:23:50 +0900 (WST)
Received: from mail.busby.net [114.31.74.40]
    by mailserver.busby.net with POP3 (fetchmail-6.3.6)
for <busby(_at_)localhost> (single-drop); Sun, 30 Nov 2008 21:23:50 +0900 (WST)
Received: (qmail 352 invoked from network); 30 Nov 2008 23:11:19 +1100
Received: from shameless.plug.org.au (203.82.208.245)
  by 40-static.distributeit.com.au with SMTP; 30 Nov 2008 23:11:19 +1100
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id D447F14DA6B;
    Sun, 30 Nov 2008 21:10:41 +0900 (WST)
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id 67F8414DA50;
    Sun, 30 Nov 2008 21:10:40 +0900 (WST)
X-Original-To: plug(_at_)plug(_dot_)org(_dot_)au
Delivered-To: plug(_at_)plug(_dot_)org(_dot_)au
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id 1030214DA59
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Sun, 30 Nov 2008 21:10:28 +0900 
(WST)
Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.176])
    by shameless.plug.org.au (Postfix) with ESMTP id DDC7314DA4D
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Sun, 30 Nov 2008 21:10:25 +0900 
(WST)
Received: by wa-out-1112.google.com with SMTP id j40so1380916wah.1
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Sun, 30 Nov 2008 04:10:38 -0800 
(PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
    h=domainkey-signature:received:received:subject:from:to:in-reply-to
    :references:content-type:date:message-id:mime-version:x-mailer
    :content-transfer-encoding;
    bh=ciqk+jv24RLxSIPwHn7rbbeylFNFAjn4JIGbq1fm5V0=;
    b=Gr0XgvcoBN4sS27OcnYwLYz4oBnPznYLJ/xfHFlYJjV/V+cZ5EwwSAZiUL0r6I1xtG
    TaOnIwxZDjgPU93qHaFy4SjaSg+Moyk98EqReARYIL7xCDfJ3Z/HmOTJ/B39I23/h/1d
    dlUMbg8T/Q823LrH+aKKcD7e4Yu5RbKUVZFMM=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
    h=subject:from:to:in-reply-to:references:content-type:date:message-id
    :mime-version:x-mailer:content-transfer-encoding;
    b=x23K7+5HdfCMI4OTCYPpDVagnm/zsXDSmcnIIUGzZXpAUg+1gFmUrCUiWWdM+GWOnz
    47+mp4nTM6hyrAOXhd3nNuvzpXEcdXgpXpE5IwhWoFldla5rE/kwHSV+MB+jCYq39OzR
    nM4/5kV7sT/KPxuTfrGft+OC0BWtWZUxRSMXg=
Received: by 10.114.203.20 with SMTP id a20mr5724045wag.167.1228047038811;
    Sun, 30 Nov 2008 04:10:38 -0800 (PST)
Received: from ?10.1.1.3? (203.161.101.36.static.amnet.net.au [203.161.101.36])
    by mx.google.com with ESMTPS id y11sm2260404pod.5.2008.11.30.04.10.36
    (version=SSLv3 cipher=RC4-MD5); Sun, 30 Nov 2008 04:10:38 -0800 (PST)
Subject: Re: [plug] [OT] Emergency secondary dns services
From: Gavin Chester <gavin(_dot_)chester(_at_)gmail(_dot_)com>
To: plug(_at_)plug(_dot_)org(_dot_)au
In-Reply-To: <1228045319(_dot_)6187(_dot_)12(_dot_)camel(_at_)rivendell>
References: <1228045319(_dot_)6187(_dot_)12(_dot_)camel(_at_)rivendell>
Content-Type: text/plain
Date: Sun, 30 Nov 2008 21:10:34 +0900
Message-Id: 
<1228047034(_dot_)22983(_dot_)67(_dot_)camel(_at_)linuxserver(_dot_)site>
Mime-Version: 1.0
X-Mailer: Evolution 2.12.0 Content-Transfer-Encoding: 7bit
X-BeenThere: plug(_at_)plug(_dot_)org(_dot_)au
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: plug(_at_)plug(_dot_)org(_dot_)au
List-Id: Perth Linux Users' Group mailing list <plug.plug.org.au>
List-Unsubscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
    <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=unsubscribe>
List-Archive: <http://www.plug.org.au/archives>
List-Post: <mailto:plug(_at_)plug(_dot_)org(_dot_)au>
List-Help: <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=help>
List-Subscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
    <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=subscribe>
Sender: plug-bounces(_at_)plug(_dot_)org(_dot_)au
Errors-To: plug-bounces(_at_)plug(_dot_)org(_dot_)au
X-DSPAM-Result: Whitelisted
X-DSPAM-Confidence: 0.5580
X-DSPAM-Probability: 0.0000
X-DSPAM-Signature: 493282d0221862124720946



From a message from the same mailing list, dated 30 May, the Full header
is

On Fri, 30 May 2008, Kai wrote:

Return-Path: <busby(_at_)busby(_dot_)net>
X-Original-To: bret(_at_)localhost
Delivered-To: bret(_at_)localhost
Received: by mailserver.busby.net (Postfix, from userid 1002)
    id D1B7A16812; Fri, 30 May 2008 12:33:07 +0800 (WST)
X-Original-To: busby(_at_)localhost
Delivered-To: busby(_at_)localhost
Received: from mailserver.busby.net (localhost [127.0.0.1])
    by mailserver.busby.net (Postfix) with ESMTP id 8F79D16812
    for <busby(_at_)localhost>; Fri, 30 May 2008 12:33:07 +0800 (WST)
Delivered-To: 1387-bret(_at_)busby(_dot_)net
Received: from mail.busby.net [203.113.228.30]
    by mailserver.busby.net with POP3 (fetchmail-6.3.6)
for <busby(_at_)localhost> (single-drop); Fri, 30 May 2008 12:33:07 +0800 (WST)
Received: (qmail 4254 invoked from network); 30 May 2008 14:14:36 +1000
Received: from shameless.plug.org.au (203.82.208.245)
  by plesk3.distributeit.com.au with SMTP; 30 May 2008 14:14:36 +1000
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id 2223665CE2;
    Fri, 30 May 2008 12:14:08 +0800 (WST)
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id E64CCB77AC;
    Fri, 30 May 2008 11:19:06 +0800 (WST)
X-Original-To: plug(_at_)plug(_dot_)org(_dot_)au
Delivered-To: plug(_at_)plug(_dot_)org(_dot_)au
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
    by shameless.plug.org.au (Postfix) with ESMTP id C7A833126C
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Fri, 30 May 2008 11:18:36 +0800 
(WST)
Received: from hosted07.westnet.com.au (hosted07.westnet.com.au [203.10.1.223])
    by shameless.plug.org.au (Postfix) with ESMTP id BF37014D6D0
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Fri, 30 May 2008 09:50:13 +0800 
(WST)
Received: from hosted07.westnet.com.au (hosted07.westnet.com.au [127.0.0.1])
    by hosted07.westnet.com.au (Postfix) with SMTP id 9535A33DFBE
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Fri, 30 May 2008 09:50:05 +0800 
(WST)
Received: from [192.168.1.102] (dsl-58-7-223-132.wa.westnet.com.au
    [58.7.223.132])
    by hosted07.westnet.com.au (Postfix) with ESMTP id A6B8133DE12
    for <plug(_at_)plug(_dot_)org(_dot_)au>; Fri, 30 May 2008 09:49:49 +0800 
(WST)
Message-ID: <483F5D42(_dot_)7010603(_at_)westnet(_dot_)com(_dot_)au>
Date: Fri, 30 May 2008 09:49:54 +0800
From: Kai <vk6ksj(_at_)westnet(_dot_)com(_dot_)au>
User-Agent: Thunderbird 2.0.0.14 (X11/20080505)
MIME-Version: 1.0
To: plug(_at_)plug(_dot_)org(_dot_)au
Subject: Re: Ubuntu X crashes - Was Re: [plug] Greetings
References: <1211552658(_dot_)8510(_dot_)19(_dot_)camel(_at_)precision(_dot_)gswd(_dot_)com> <48378BA4(_dot_)8020008(_at_)bbnet(_dot_)com(_dot_)au>
    <48382A96(_dot_)2010901(_at_)westnet(_dot_)com(_dot_)au>      
<4838CF16(_dot_)7030006(_at_)westnet(_dot_)com(_dot_)au>
    <4838E444(_dot_)5010001(_at_)wasp(_dot_)net(_dot_)au> 
<4838F5FD(_dot_)6040704(_at_)iinet(_dot_)net(_dot_)au>
    
<ab296fb70805250110t444c205cheb53186492acdeb7(_at_)mail(_dot_)gmail(_dot_)com>
In-Reply-To: 
<ab296fb70805250110t444c205cheb53186492acdeb7(_at_)mail(_dot_)gmail(_dot_)com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-PMX-Branch: TNG-Outgoing
X-BeenThere: plug(_at_)plug(_dot_)org(_dot_)au
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: plug(_at_)plug(_dot_)org(_dot_)au
List-Id: Perth Linux Users' Group mailing list <plug.plug.org.au>
List-Unsubscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
    <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=unsubscribe>
List-Archive: <http://www.plug.org.au/archives>
List-Post: <mailto:plug(_at_)plug(_dot_)org(_dot_)au>
List-Help: <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=help>
List-Subscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
    <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=subscribe>
Sender: plug-bounces(_at_)plug(_dot_)org(_dot_)au
Errors-To: plug-bounces(_at_)plug(_dot_)org(_dot_)au
X-DSPAM-Result: Whitelisted
X-DSPAM-Confidence: 0.6183
X-DSPAM-Probability: 0.0000
X-DSPAM-Signature: 483f7f25118218332320330




Now, the earliest occurring difference in the lines of the two full headers above, appears to be the line

Delivered-To: 1387-bret(_at_)busby(_dot_)net

which appears just after fetchmail has downloaded the message from the ISP that hosts our domain name (which means the ISP from which we download our incoming email; our POP server).

Now, similarly, from a message from the same mailing list, to which my wife is also subscribed, dated 25 May, is the following full header.


Return-Path: <busby(_at_)busby(_dot_)net>
X-Original-To: anne(_at_)localhost
Delivered-To: anne(_at_)localhost
Received: by mailserver.busby.net (Postfix, from userid 1002) id
3C0B316823; Sun, 25 May 2008 20:26:06 +0800 (WST)
X-Original-To: busby(_at_)localhost
Delivered-To: busby(_at_)localhost
Received: from mailserver.busby.net (localhost [127.0.0.1]) by
mailserver.busby.net (Postfix) with ESMTP id 096F316812 for
<busby(_at_)localhost>; Sun, 25 May 2008 20:26:06 +0800 (WST)
Delivered-To: 1387-anne(_at_)busby(_dot_)net
Received: from mail.busby.net [203.113.228.30] by mailserver.busby.net
with POP3 (fetchmail-6.3.6) for <busby(_at_)localhost> (single-drop); Sun, 25
May 2008 20:26:06 +0800 (WST)
Received: (qmail 2584 invoked from network); 25 May 2008 22:17:33 +1000
Received: from shameless.plug.org.au (203.82.208.245) by
plesk3.distributeit.com.au with SMTP; 25 May 2008 22:17:33 +1000
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
by shameless.plug.org.au (Postfix) with ESMTP id 2C32D31186; Sun, 25 May
2008 20:17:15 +0800 (WST)
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
by shameless.plug.org.au (Postfix) with ESMTP id 357DD9095; Sun, 25 May
2008 20:17:14 +0800 (WST)
X-Original-To: plug(_at_)plug(_dot_)org(_dot_)au
Delivered-To: plug(_at_)plug(_dot_)org(_dot_)au
Received: from shameless.plug.org.au (localhost.localdomain [127.0.0.1])
by shameless.plug.org.au (Postfix) with ESMTP id 7E2EC31198 for
<plug(_at_)plug(_dot_)org(_dot_)au>; Sun, 25 May 2008 20:16:04 +0800 (WST)
Received: from ipmail01.adl6.internode.on.net
(ipmail01.adl6.internode.on.net [203.16.214.146]) by
shameless.plug.org.au (Postfix) with ESMTP id 504F33118A for
<plug(_at_)plug(_dot_)org(_dot_)au>; Sun, 25 May 2008 20:16:04 +0800 (WST)
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: AqkAAErzOEiWZZOFdGdsb2JhbAAIki8BJ5k2
X-IronPort-AV: E=Sophos;i="4.27,537,1204464600";
d="scan'208";a="110431335"
Received: from ppp150-101-147-133.lns1.per1.internode.on.net (HELO
[192.168.254.8]) ([150.101.147.133]) by ipmail01.adl6.internode.on.net
with ESMTP; 25 May 2008 21:46:01 +0930
From: Leon Brooks <leon-plug(_at_)cyberknights(_dot_)com(_dot_)au>
Organization: Perth Linux User Group
To: plug(_at_)plug(_dot_)org(_dot_)au, billk(_at_)iinet(_dot_)net(_dot_)au
Subject: Re: [plug] Greetings
Date: Sun, 25 May 2008 20:19:00 +0800
User-Agent: KMail/1.9.7
References: 
<1211552658(_dot_)8510(_dot_)19(_dot_)camel(_at_)precision(_dot_)gswd(_dot_)com>
<48382A96(_dot_)2010901(_at_)westnet(_dot_)com(_dot_)au> 
<1211716481(_dot_)27448(_dot_)13(_dot_)camel(_at_)rattus>
In-Reply-To: <1211716481(_dot_)27448(_dot_)13(_dot_)camel(_at_)rattus>
MIME-Version: 1.0
Content-Type: text/plain; charset="iso-8859-7"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
Message-Id: 
<200805252019(_dot_)00689(_dot_)leon-plug(_at_)cyberknights(_dot_)com(_dot_)au>
X-BeenThere: plug(_at_)plug(_dot_)org(_dot_)au
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: plug(_at_)plug(_dot_)org(_dot_)au
List-Id: Perth Linux Users' Group mailing list <plug.plug.org.au>
List-Unsubscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
<mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=unsubscribe>
List-Archive: <http://www.plug.org.au/archives>
List-Post: <mailto:plug(_at_)plug(_dot_)org(_dot_)au>
List-Help: <mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=help>
List-Subscribe: <http://www.plug.org.au/mailman/listinfo/plug>,
<mailto:plug-request(_at_)plug(_dot_)org(_dot_)au?subject=subscribe>
Sender: plug-bounces(_at_)plug(_dot_)org(_dot_)au
Errors-To: plug-bounces(_at_)plug(_dot_)org(_dot_)au
X-DSPAM-Result: Whitelisted
X-DSPAM-Confidence: 0.6181
X-DSPAM-Probability: 0.0000
X-DSPAM-Signature: 483958dc182079280118230
Status: X-Evolution-Source: pop://anne(_at_)mailserver/




Now, that message, similar to the above message header dated 30 May, has an equivalent header line;

Delivered-To: 1387-anne(_at_)busby(_dot_)net

which appears to have happened after fetchmail grabbed it from the ISP's POP server.

It appears that, after that line is included, the filtering on our mail server, sends each message from a mailing list, to the respective recipient's mail folder, for the recipient to download to the recipient's computer and email application.

However, that line is no longer present in message headers, as shown above, which means that we cannot filter email messages that are distributed by mailing lists that have a to address that is different to our particular individual email addresses, thus disabling our filtering.

So, after all of that, the first question (apart from the question of how do we fix the filtering), is, what caused that line of the full headers of messages, to be no longer present?

Is it a change in fetchmail, or a change in the message handling by the ISP, or, is it a change in procmail?

This problem appears to have occurred only since the ISP made its changes regarding its certificates, but, with system updates since then, it is always possible that it could have been a change in fetchmail or procmail (I am not sure whether they have been updated or changed, since the ISP made its changes to email processing.)

Now, all incoming messages from mailing lists, unless they are from particular mailing lists that address messages directly to subscribers, are delivered to me, regardless of whether I am the subscriber, as that line that apparently determines to whom the messages are delivered, is no longer present.

Thank you in anticipation, for your assistance.

--
Bret Busby
Armadale
West Australia
..............

"So once you do know what the question actually is,
 you'll know what the answer means."
- Deep Thought,
  Chapter 28 of Book 1 of
  "The Hitchhiker's Guide to the Galaxy:
  A Trilogy In Four Parts",
  written by Douglas Adams,
  published by Pan Books, 1992

....................................................
____________________________________________________________
procmail mailing list   Procmail homepage: http://www.procmail.org/
procmail(_at_)lists(_dot_)RWTH-Aachen(_dot_)DE
http://MailMan.RWTH-Aachen.DE/mailman/listinfo/procmail

<Prev in Thread] Current Thread [Next in Thread>