vger.kernel.org mail queue issue?

vger.kernel.org mail queue issue?

[Florian Fainelli]

Hi David, Linus,

I am seeing emails being received right now from @vger.kernel.org that
seem to be from this morning according to my mailer. Has anything
changed on vger.kernel.org that could cause that? Other mailing-lists
(e.g: infradead.org) seems to be fine.

Here is an example that seems to be from 11h ago:
https://www.spinics.net/lists/netdev/msg414023.html
-- 
Florian

Re: vger.kernel.org mail queue issue?

[David Miller]

From: Florian Fainelli <f.fainelli@gmail.com>
Date: Wed, 11 Jan 2017 18:01:47 -0800

> I am seeing emails being received right now from @vger.kernel.org that
> seem to be from this morning according to my mailer. Has anything
> changed on vger.kernel.org that could cause that? Other mailing-lists
> (e.g: infradead.org) seems to be fine.
> 
> Here is an example that seems to be from 11h ago:
> https://www.spinics.net/lists/netdev/msg414023.html

Nope, in fact I've been aggressively removing bouncers lately
and trying to keep the system running efficiently.

I kind of suspect that google has ramped up their rate limiting
settings a little bit on gmail.

I'll try to keep an eye out.

Re: vger.kernel.org mail queue issue?

[afzal mohammed]

Hi,

On Wed, Jan 11, 2017 at 09:07:35PM -0500, David Miller wrote:
> From: Florian Fainelli <f.fainelli@gmail.com>

> > I am seeing emails being received right now from @vger.kernel.org that
> > seem to be from this morning according to my mailer. Has anything
> > changed on vger.kernel.org that could cause that? Other mailing-lists
> > (e.g: infradead.org) seems to be fine.

> Nope, in fact I've been aggressively removing bouncers lately
> and trying to keep the system running efficiently.
> 
> I kind of suspect that google has ramped up their rate limiting
> settings a little bit on gmail.
> 
> I'll try to keep an eye out.

Seems gmail again is receiving mails with a delay, the last received
lk mail has date as 30 Apr 2017 08:23:50 +0300, while here it is
around 01 May 2017 17:10 + 0530. And lkml archives has a lot of mails
after that.

With filters based on TO|CC (my problem) & due to cross posted mails,
to realize the issue it takes some time, seems the issue is there for
last few days.

Regards
afzal

Re: vger.kernel.org mail queue issue?

[David Miller]

From: afzal mohammed <afzal.mohd.ma@gmail.com>
Date: Mon, 1 May 2017 17:13:39 +0530

> Hi,
> 
> On Wed, Jan 11, 2017 at 09:07:35PM -0500, David Miller wrote:
>> From: Florian Fainelli <f.fainelli@gmail.com>
> 
>> > I am seeing emails being received right now from @vger.kernel.org that
>> > seem to be from this morning according to my mailer. Has anything
>> > changed on vger.kernel.org that could cause that? Other mailing-lists
>> > (e.g: infradead.org) seems to be fine.
> 
>> Nope, in fact I've been aggressively removing bouncers lately
>> and trying to keep the system running efficiently.
>> 
>> I kind of suspect that google has ramped up their rate limiting
>> settings a little bit on gmail.
>> 
>> I'll try to keep an eye out.
> 
> Seems gmail again is receiving mails with a delay, the last received
> lk mail has date as 30 Apr 2017 08:23:50 +0300, while here it is
> around 01 May 2017 17:10 + 0530. And lkml archives has a lot of mails
> after that.
> 
> With filters based on TO|CC (my problem) & due to cross posted mails,
> to realize the issue it takes some time, seems the issue is there for
> last few days.

There is really nothing I can do about this.

The problem is that GMAIL has extremely restrictive rate limiting.  It
really is insufficient for absorbing the rate at which postings are
made on the lists during the busiest times of the day.  And when the
rate it exceeded, the gmail accounts in question simply drop postings
for a certain period of time.

So I have to intentionally back off the rate at which vger.kernel.org
queues up to GMAIL accounts.

If I let it go at full speed then half of the postings would get
dropped and people would miss content.

Complain to GMAIL if you dislike this but I have tried in the past and
they have no intention of increasing their default posting rate
limits.

Re: vger.kernel.org mail queue issue?

[afzal mohammed]

Hi,

On Mon, May 01, 2017 at 10:50:57AM -0400, David Miller wrote:
> From: afzal mohammed <afzal.mohd.ma@gmail.com>
> > On Wed, Jan 11, 2017 at 09:07:35PM -0500, David Miller wrote:
> >> From: Florian Fainelli <f.fainelli@gmail.com>

> >> > I am seeing emails being received right now from @vger.kernel.org that
> >> > seem to be from this morning according to my mailer. Has anything
> >> > changed on vger.kernel.org that could cause that? Other mailing-lists
> >> > (e.g: infradead.org) seems to be fine.
> > 
> >> Nope, in fact I've been aggressively removing bouncers lately
> >> and trying to keep the system running efficiently.
> >> 
> >> I kind of suspect that google has ramped up their rate limiting
> >> settings a little bit on gmail.
> >> 
> >> I'll try to keep an eye out.
> > 
> > Seems gmail again is receiving mails with a delay, the last received
> > lk mail has date as 30 Apr 2017 08:23:50 +0300, while here it is
> > around 01 May 2017 17:10 + 0530. And lkml archives has a lot of mails
> > after that.

> There is really nothing I can do about this.
> 
> The problem is that GMAIL has extremely restrictive rate limiting.  It
> really is insufficient for absorbing the rate at which postings are
> made on the lists during the busiest times of the day.  And when the
> rate it exceeded, the gmail accounts in question simply drop postings
> for a certain period of time.
> 
> So I have to intentionally back off the rate at which vger.kernel.org
> queues up to GMAIL accounts.
> 
> If I let it go at full speed then half of the postings would get
> dropped and people would miss content.

Thanks much for handling it the way you are now, it at least helps in
getting all mails instead of missing.

The last time even before Florian reported the issue, i was seeing it,
but initially thought it was a problem related to my account, tried
unsubscribe & subscribe, contacting list owner etc, none did help,
only upon seeing Florian's mail, did realize that it was a generic
GMAIL issue.

> Complain to GMAIL if you dislike this but I have tried in the past and
> they have no intention of increasing their default posting rate
> limits.

Don't know whether you had done some changes, now able to get mails in
realtime. Next time upon seeing this kind of issue will request GMAIL,
irrespective of the outcome, i will do my part.

And thanks for taking the time to reply.

Regards
afzal