Rocksolid Light

Welcome to novaBBS (click a section below)

mail  files  register  newsreader  groups  login

Message-ID:  

LOAD "LINUX",8,1 -- Topic on #LinuxGER


computers / news.software.nntp / Re: [PATCH] OVER issue in slrn

SubjectAuthor
* Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
+* Re: Bug in SLRN trunk: not seen in 1.0.3.Ray Banana
|`* Re: Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
| +* Re: Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
| |`* Re: Bug in SLRN trunk: not seen in 1.0.3.Russ Allbery
| | +- Re: Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
| | `* Re: Bug in SLRN trunk: not seen in 1.0.3.Julien ÉLIE
| |  +- Re: Bug in SLRN trunk: not seen in 1.0.3.Retro Guy
| |  +* Re: Bug in SLRN trunk: not seen in 1.0.3.Russ Allbery
| |  |`* Re: Bug in SLRN trunk: not seen in 1.0.3.Julien ÉLIE
| |  | `- Re: Bug in SLRN trunk: not seen in 1.0.3.Russ Allbery
| |  `* Re: Bug in SLRN trunk: not seen in 1.0.3.Julien ÉLIE
| |   `* Re: Bug in SLRN trunk: not seen in 1.0.3.Ray Banana
| |    `* Re: Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
| |     `* Re: Bug in SLRN trunk: not seen in 1.0.3.Julien ÉLIE
| |      `- Re: Bug in SLRN trunk: not seen in 1.0.3.Kaz Kylheku
| `- Re: Bug in SLRN trunk: not seen in 1.0.3.Ray Banana
`* [PATCH] OVER issue in slrn [was: Bug in SLRN trunk: not seen inKaz Kylheku
 `- Re: [PATCH] OVER issue in slrnJulien ÉLIE

1
Bug in SLRN trunk: not seen in 1.0.3.

<20230911185353.581@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2113&group=news.software.nntp#2113

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 01:59:16 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 38
Message-ID: <20230911185353.581@kylheku.com>
Injection-Date: Tue, 12 Sep 2023 01:59:16 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="c4d2f9d891c0a83c444defc9ec9b8b50";
logging-data="1466778"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/a1Pu3AZybZxhlkZc2nCG1171GLMAgn2A="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:4WGxAO25UedAeJNhu6dTLwYGLL8=
 by: Kaz Kylheku - Tue, 12 Sep 2023 01:59 UTC

Hi all, I've run into the following little bug.

For reference, I'm using Eternal September as you can see.

In my ~/.jewsrc I currently have:

comp.lang.c: 1-254200

1. When I run SLRN, it reports that comp.lang.c has 1 new article.

2. When I select the newsgroup, it immediately reports "No unread
articles" (without showing that any have been killed).

3. The unread count does not go to 0; it stays at 1.

4. When I quit slrn, the count stays at 1-254200

The old 1.0.3 that comes from Ubuntu will flip the articles to 0,
and change to 1-254201.

I dit a "git bisect", which points to this commit:

commit 68319838d0073fc63206e17463441221be4735fa
Author: John E. Davis <jed@jedsoft.org>
Date: Fri Mar 17 23:57:51 2023 -0400

pre1.0.4-8: Added support for "OVER" defined by rfc3977

While bisecting, I reproduced the problem by manually resetting
the read range to 1-254200 to get it to show 1 unread. The
above is the first commit at which the problem appears: 1 stays 1,
doesn't update .jnewsrc.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOTE: If you use Google Groups, I don't see you, unless you're whitelisted.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<slrnufvq4m.15l9v.rayban@raybanana.net>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2114&group=news.software.nntp#2114

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!raybanana.eternal-september.org!.POSTED!not-for-mail
From: ray...@raybanana.net (Ray Banana)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 04:27:02 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 33
Message-ID: <slrnufvq4m.15l9v.rayban@raybanana.net>
References: <20230911185353.581@kylheku.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Tue, 12 Sep 2023 04:27:02 -0000 (UTC)
Injection-Info: raybanana.eternal-september.org; posting-host="c0c79202400bc24dd6a86f3ceb165254";
logging-data="1500709"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/x2KhxdKKZpFShSwDtcpAIfTBoIInomRo="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:lApyZGytO5Y7cevSIEoLwQiM14E=
 by: Ray Banana - Tue, 12 Sep 2023 04:27 UTC

* Kaz Kylheku wrote:
> Hi all, I've run into the following little bug.
>
> For reference, I'm using Eternal September as you can see.
>
> In my ~/.jewsrc I currently have:
>
> comp.lang.c: 1-254200
>
> 1. When I run SLRN, it reports that comp.lang.c has 1 new article.
>
> 2. When I select the newsgroup, it immediately reports "No unread
> articles" (without showing that any have been killed).
>
> 3. The unread count does not go to 0; it stays at 1.
>
> 4. When I quit slrn, the count stays at 1-254200

This is not a bug in slrn or any other newsreader that shows the same
behaviour. This phenomenon occurs when srticles are removed from the
server by a cancel message or perl-mocem (because they are spam). The
removed article is still present, hence it shows in the article list,
but not in the spool, so the article can not be downloaded and displayed.
The articles will disappear from the overview after the next run of
expireover (run from news.daily every night).

As comp.lang.c receives a massive flood drug/med spam, this behaviour can
best be observed in this group.

--
Пу́тін — хуйло́
http://www.eternal-september.org

Re: Bug in SLRN trunk: not seen in 1.0.3.

<20230911214521.831@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2116&group=news.software.nntp#2116

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 04:57:41 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 42
Message-ID: <20230911214521.831@kylheku.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net>
Injection-Date: Tue, 12 Sep 2023 04:57:41 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="c4d2f9d891c0a83c444defc9ec9b8b50";
logging-data="1506999"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+jyPLYd/F+LVZeGDVx/35nCTAZWm8oujM="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:7Jr0gBjzrlYxVPow2/J8GMqXBZ8=
 by: Kaz Kylheku - Tue, 12 Sep 2023 04:57 UTC

On 2023-09-12, Ray Banana <rayban@raybanana.net> wrote:
> * Kaz Kylheku wrote:
>> Hi all, I've run into the following little bug.
>>
>> For reference, I'm using Eternal September as you can see.
>>
>> In my ~/.jewsrc I currently have:
>>
>> comp.lang.c: 1-254200
>>
>> 1. When I run SLRN, it reports that comp.lang.c has 1 new article.
>>
>> 2. When I select the newsgroup, it immediately reports "No unread
>> articles" (without showing that any have been killed).
>>
>> 3. The unread count does not go to 0; it stays at 1.
>>
>> 4. When I quit slrn, the count stays at 1-254200
>
> This is not a bug in slrn or any other newsreader that shows the same
> behaviour. This phenomenon occurs when srticles are removed from the
> server by a cancel message or perl-mocem (because they are spam).

Okay Ray, so which is correct: slrn 1.0.3 or current?

> removed article is still present, hence it shows in the article list,

The issue is that old slrn marks the article read, bumping up the
number past it. New slrn does not advance.

(If you use the c (catch up) command on the newsgroup, then it does.)

> As comp.lang.c receives a massive flood drug/med spam, this behaviour can
> best be observed in this group.

Just not with slrn before the commit I found with git bisect.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOTE: If you use Google Groups, I don't see you, unless you're whitelisted.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<20230911222037.955@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2117&group=news.software.nntp#2117

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 05:24:42 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 32
Message-ID: <20230911222037.955@kylheku.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
Injection-Date: Tue, 12 Sep 2023 05:24:42 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="c4d2f9d891c0a83c444defc9ec9b8b50";
logging-data="1512194"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19euupwtsBPE1Pl2xQj1J9UQ0maUiSBE0c="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:WJVeADp/bVzrtLF6FXadXxlAQPU=
 by: Kaz Kylheku - Tue, 12 Sep 2023 05:24 UTC

On 2023-09-12, Kaz Kylheku <864-117-4973@kylheku.com> wrote:
> Just not with slrn before the commit I found with git bisect.

It's happening again.

comp.lang.c: 1-254212

There are 2 articles being reported, thus they must be 254213 and
254214.

New slrn leaves it like that; it will not increment to 1-254214 and
write the file.

Old slrn will catch the newsgroup up; no unread articles found,
and it will increment to 1-254214.

I can do that manually too by editing the file; then the newsgroup
is no longer listed as having unread articles.

The catch-up command works too.

This is a bad behavior; there is no use in leaving recalled,
inaccessible articles unread.

The program says "no unread articles found", which directly contradicts
the unread count staying at 2! No unread means zero.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOTE: If you use Google Groups, I don't see you, unless you're whitelisted.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<877cowj6sm.fsf@hope.eyrie.org>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2118&group=news.software.nntp#2118

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Mon, 11 Sep 2023 22:32:09 -0700
Organization: The Eyrie
Message-ID: <877cowj6sm.fsf@hope.eyrie.org>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net>
<20230911214521.831@kylheku.com> <20230911222037.955@kylheku.com>
Mime-Version: 1.0
Content-Type: text/plain
Injection-Info: hope.eyrie.org;
logging-data="15301"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13)
Cancel-Lock: sha1:FDnmi7Wj9aD0SQb3HLuXvvaPYvY=
 by: Russ Allbery - Tue, 12 Sep 2023 05:32 UTC

Kaz Kylheku <864-117-4973@kylheku.com> writes:

> New slrn leaves it like that; it will not increment to 1-254214 and
> write the file.

> Old slrn will catch the newsgroup up; no unread articles found,
> and it will increment to 1-254214.

> I can do that manually too by editing the file; then the newsgroup
> is no longer listed as having unread articles.

> The catch-up command works too.

> This is a bad behavior; there is no use in leaving recalled,
> inaccessible articles unread.

The basic problem is that from the perspective of slrn it's an
inconsistency in the overview database (and maybe the active file; I'm not
sure precisely what the database looks like since it's been a while since
I've looked at this). There are records for two more articles, but those
articles don't exist when looked up in the spool.

The thing is, slrn doesn't know which way that inconsistency will
eventually resolve. We all know that it's probably because the articles
were deleted and thus this will be resolved by deleting the overview
records as well, and this isn't done because due to the structure of the
overview database in the most common configurations deletions are
expensive and are therefore batched. But from slrn's perspective, it's
possible that the articles are going to show up later and make the
overview correct (and there are indeed some configurations where that can
possibly happen). So it's making the conservative decision to keep
retrying those articles to see if they start working, until the overview
records are removed.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<slrnug00fm.5ij.rayban@raybanana.net>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2119&group=news.software.nntp#2119

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!raybanana.eternal-september.org!.POSTED!not-for-mail
From: ray...@raybanana.net (Ray Banana)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 06:15:18 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 18
Message-ID: <slrnug00fm.5ij.rayban@raybanana.net>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
Injection-Date: Tue, 12 Sep 2023 06:15:18 -0000 (UTC)
Injection-Info: raybanana.eternal-september.org; posting-host="9f91cd377dcfe7fd555307660e08ac41";
logging-data="1523274"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19AbYUwnQ2tr32MM+T8IEe/enOnDyIRYnU="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:N3ZtDaABu6ZRNtUg/e1CfIZGkA8=
 by: Ray Banana - Tue, 12 Sep 2023 06:15 UTC

* Kaz Kylheku wrote:

>> This is not a bug in slrn or any other newsreader that shows the same
>> behaviour. This phenomenon occurs when srticles are removed from the
>> server by a cancel message or perl-mocem (because they are spam).
>
> Okay Ray, so which is correct: slrn 1.0.3 or current?

Sorry, I didn't quite get your point.
slrn 1.0.3 does indeed mark the missing article
as read and decrements the unread articles count
accordingly. slrn pre 1.0.4 still lists it as unread,
which is glitch in the prerelease.

--
Too many ingredients in the soup, no room for a spoon
http://www.eternal-september.org

Re: Bug in SLRN trunk: not seen in 1.0.3.

<20230911231331.362@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2120&group=news.software.nntp#2120

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 06:26:31 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 47
Message-ID: <20230911231331.362@kylheku.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
Injection-Date: Tue, 12 Sep 2023 06:26:31 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="c4d2f9d891c0a83c444defc9ec9b8b50";
logging-data="1527947"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+uFygiyxdlhUnuGe8I9X0s1CML2JNkm3k="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:W8odA0hipXKw9EwN3hwuoR3km00=
 by: Kaz Kylheku - Tue, 12 Sep 2023 06:26 UTC

On 2023-09-12, Russ Allbery <eagle@eyrie.org> wrote:
> Kaz Kylheku <864-117-4973@kylheku.com> writes:
>
>> New slrn leaves it like that; it will not increment to 1-254214 and
>> write the file.
>
>> Old slrn will catch the newsgroup up; no unread articles found,
>> and it will increment to 1-254214.
>
>> I can do that manually too by editing the file; then the newsgroup
>> is no longer listed as having unread articles.
>
>> The catch-up command works too.
>
>> This is a bad behavior; there is no use in leaving recalled,
>> inaccessible articles unread.
>
> The basic problem is that from the perspective of slrn it's an
> inconsistency in the overview database (and maybe the active file; I'm not
> sure precisely what the database looks like since it's been a while since
> I've looked at this). There are records for two more articles, but those
> articles don't exist when looked up in the spool.
>
> The thing is, slrn doesn't know which way that inconsistency will
> eventually resolve. We all know that it's probably because the articles
> were deleted and thus this will be resolved by deleting the overview
> records as well, and this isn't done because due to the structure of the
> overview database in the most common configurations deletions are
> expensive and are therefore batched. But from slrn's perspective, it's
> possible that the articles are going to show up later and make the
> overview correct (and there are indeed some configurations where that can
> possibly happen). So it's making the conservative decision to keep
> retrying those articles to see if they start working, until the overview
> records are removed.

Okay.

Interstingly, the only thing changed in the slrn commit where the
behavior change occurs is using the RFC 3977 "OVER" command instead of
"XOVER" when it probes available. That's it.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOng.c: 1-254212
TE: If you use Google Groups, I don't see you, unless you're whitelisted.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<udpkdo$2sh67$1@news.trigofacile.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2121&group=news.software.nntp#2121

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!nntp.comgw.net!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.176.143-2-105.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 14:09:28 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <udpkdo$2sh67$1@news.trigofacile.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Tue, 12 Sep 2023 12:09:28 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="176.143-2-105.abo.bbox.fr:176.143.2.105";
logging-data="3032263"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
Gecko/20100101 Thunderbird/102.15.0
Cancel-Lock: sha1:xw5g0wP66HQNY5pwInwZHHD+ELk= sha256:nv7Hl6RBr+BwfYwyVVnAhWKb8Bt6KxeMroDsTKFdQGM=
sha1:vvUTTtweNvBb83wsLeVKMLKTa4E= sha256:ERciJEJeIhK+sEx9CTUJryNRG4Y8G71urkxsLeSfwj0=
In-Reply-To: <877cowj6sm.fsf@hope.eyrie.org>
 by: Julien ÉLIE - Tue, 12 Sep 2023 12:09 UTC

Hi Russ,

> The basic problem is that from the perspective of slrn it's an
> inconsistency in the overview database (and maybe the active file; I'm not
> sure precisely what the database looks like since it's been a while since
> I've looked at this).

The high water mark never decreases in the active file as this
information is used by innd to assign the next unused article number.

Though overview data may be handled differently, I think the same rule
is also followed, and the expiry process does not decrease high water
marks in overview data, but only updates low water marks, article counts
and removes old articles. It is what I have in mind from recent
investigation in the 4 overview methods when looking at how they handle
empty newsgroups.
Just to be sure, I have just cancelled an article in a local testing
group, and will report tomorrow.

> The thing is, slrn doesn't know which way that inconsistency will
> eventually resolve. We all know that it's probably because the articles
> were deleted and thus this will be resolved by deleting the overview
> records as well, and this isn't done because due to the structure of the
> overview database in the most common configurations deletions are
> expensive and are therefore batched. But from slrn's perspective, it's
> possible that the articles are going to show up later and make the
> overview correct (and there are indeed some configurations where that can
> possibly happen). So it's making the conservative decision to keep
> retrying those articles to see if they start working, until the overview
> records are removed.

In order to improve the experience of news clients, wouldn't a
groupexacthigh parameter in readers.conf be useful in INN?
The idea would be that nnrpd would give a high water mark corresponding
to an existing article when responding to GROUP, LISTGROUP, LIST ACTIVE
and LIST COUNTS.

In Kaz's example where ~/.jewsrc has "comp.lang.c: 1-254212" but the
news server reports that the highest available article number is 254214,
using "groupexacthigh: 5" in readers.conf would result in the news
server reporting that the highest available article number is 254212.
It would probe the existence of articles from 254214 to (254214-5), and
report the highest existing one, or (254214-5), to the client.

In the latest INN 2.7.1 release, a groupexactcount parameter was added
to report the real article *count* instead of an estimate. When the
estimated count of articles is strictly smaller than groupexactcount,
nnrpd recounts the number of still existing articles, and report the
exact value. If groupexactcount is set to 0, nnrpd always recounts. If
set to 1, it never recounts.
Though exact article counts are not required by the NNTP protocol, they
may be useful to distinguish empty newsgroups by reporting an exact
count of 0 instead of an estimate of 1 (when it happens, the news client
may show that 1 article is present in the newsgroup, then it tries to
retrieve the article, and finally does not show anything to the user).
The default value for this parameter is 5.

I suggest a similar parameter for the high water mark, as it also sounds
useful (independently of whether there is a regression in slrn 1.0.4,
other news clients may also report that 2 new articles are available in
comp.lang.c but on entering the group and downloading its real overview
data, the number of new articles to read becomes 0).

I add the news.software.readers newsgroup in this discussion. Maybe
some people have there information about news clients reporting
available articles, and then nothing when entering the group?

--
Julien ÉLIE

« Life is short… so eat dessert first! »

Re: Bug in SLRN trunk: not seen in 1.0.3.

<369f4305b571e2c5dd663da796d82ef6@news.novabbs.org>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2122&group=news.software.nntp#2122

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!.POSTED!not-for-mail
From: retro....@rocksolidbbs.com (Retro Guy)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 14:02:41 +0000
Organization: Rocksolid Light
Message-ID: <369f4305b571e2c5dd663da796d82ef6@news.novabbs.org>
References: <20230911185353.581@kylheku.com> <slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com> <20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org> <udpkdo$2sh67$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org;
logging-data="1668811"; mail-complaints-to="usenet@i2pn2.org";
posting-account="PGd4t4cXnWwgUWG9VtTiCsm47oOWbHLcTr4rYoM0Edo";
User-Agent: Rocksolid Light 0.9.1
X-Rslight-Posting-User: 91053d4a47d51b416144568e5a1040f05e31ed1b
X-Rslight-Site: $2y$10$Z3zGEFc/qmwZ7D8lJ64EbeouKQVmTWqk3bIvCrpxxwJInVckvmdB2
X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-13) on i2pn2.org
X-Face: .&YR-G(w(DZ$$,}%k=]*5*!p'=(anr"IT`wZG'2VWdfl\r)l[42u7JH`n(JUQ*e5*A|XCDf
?&\X&uwkl38"CYX3O8m}C8E4p'%N$2#kSTVzx{Ly|DjLT\Vk7NE}NQ(VC$Yq]i:7|z[.9iv^g>*8_B
H0=hZt'[%)4kG|
 by: Retro Guy - Tue, 12 Sep 2023 14:02 UTC

Julien_ÉLIE wrote:

> Hi Russ,

>> The basic problem is that from the perspective of slrn it's an
>> inconsistency in the overview database (and maybe the active file; I'm not
>> sure precisely what the database looks like since it's been a while since
>> I've looked at this).

> The high water mark never decreases in the active file as this
> information is used by innd to assign the next unused article number.

>> The thing is, slrn doesn't know which way that inconsistency will
>> eventually resolve. We all know that it's probably because the articles
>> were deleted and thus this will be resolved by deleting the overview
>> records as well, and this isn't done because due to the structure of the
>> overview database in the most common configurations deletions are
>> expensive and are therefore batched. But from slrn's perspective, it's
>> possible that the articles are going to show up later and make the
>> overview correct (and there are indeed some configurations where that can
>> possibly happen). So it's making the conservative decision to keep
>> retrying those articles to see if they start working, until the overview
>> records are removed.

> In order to improve the experience of news clients, wouldn't a
> groupexacthigh parameter in readers.conf be useful in INN?
> The idea would be that nnrpd would give a high water mark corresponding
> to an existing article when responding to GROUP, LISTGROUP, LIST ACTIVE
> and LIST COUNTS.

This is how my simple nnrpd server handles this, and clients seem to respond
fine to it. Missing articles (deleted, cancelled, NoCeM) are not listed
and not counted. When the highest article is deleted, it is noted in a file
and not reused.

Here's a sample:

200 Rocksolid Light NNTP Server ready (no posting)
group rocksolid.test.test
211 180 2 214 rocksolid.test.test
quit
205 closing connection - goodbye!

Then, I delete the highest article (214)

200 Rocksolid Light NNTP Server ready (no posting)
group rocksolid.test.test
211 179 2 213 rocksolid.test.test
quit
205 closing connection - goodbye!

Then I post a new article

200 Rocksolid Light NNTP Server ready (no posting)
group rocksolid.test.test
211 180 2 215 rocksolid.test.test
quit
Connection closed by foreign host.

The same counting applies to any nnrpd commands requesting count
infomation. So far I have so far not seen any issues with clients.

--
Retro Guy

Re: Bug in SLRN trunk: not seen in 1.0.3.

<87v8cfgxyo.fsf@hope.eyrie.org>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2123&group=news.software.nntp#2123

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 09:25:51 -0700
Organization: The Eyrie
Message-ID: <87v8cfgxyo.fsf@hope.eyrie.org>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net>
<20230911214521.831@kylheku.com> <20230911222037.955@kylheku.com>
<877cowj6sm.fsf@hope.eyrie.org> <udpkdo$2sh67$1@news.trigofacile.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Info: hope.eyrie.org;
logging-data="17090"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13)
Cancel-Lock: sha1:5h1P6Lyge3BI7E6ih7wOgk1d4Xk=
 by: Russ Allbery - Tue, 12 Sep 2023 16:25 UTC

Julien ÉLIE <iulius@nom-de-mon-site.com.invalid> writes:

> The high water mark never decreases in the active file as this
> information is used by innd to assign the next unused article number.

The initial number of unread articles is probably based entirely on the
high water mark, but to me the question is why slrn doesn't mark those
articles as read the first time you enter the group and they don't exist.
I am assuming that this is because it sees phantom OVER entries for them,
but then the articles are missing when it goes to retrieve them. This
could indicate, say, an overchan setup where the overview was written
before the article was written, so it is arguably correct to not mark such
articles as read.

If the OVER command also doesn't return any data for those articles,
though, I think slrn really should just mark them as read and move on.
Articles that are both missing and don't have OVER entries probably have
been deleted. (Although I guess this could be wrong if somehow the high
water mark got updated before *either* the article was written or the
overview database was updated. I don't remember if that can happen.)

> Though overview data may be handled differently, I think the same rule
> is also followed, and the expiry process does not decrease high water
> marks in overview data, but only updates low water marks, article counts
> and removes old articles. It is what I have in mind from recent
> investigation in the 4 overview methods when looking at how they handle
> empty newsgroups.

I thought the overview data for the deleted article would be dropped from
the database during nightly expire, so will not appear in the OVER output,
but it's been a while since I looked at it so I could be wrong. In other
words, I think you're correct that the high water marks would not change,
since that's how INN ensures that it never reuses an article number, but
when you run OVER on the group, I believe the entries for those articles
should be missing.

> In order to improve the experience of news clients, wouldn't a
> groupexacthigh parameter in readers.conf be useful in INN? The idea
> would be that nnrpd would give a high water mark corresponding to an
> existing article when responding to GROUP, LISTGROUP, LIST ACTIVE and
> LIST COUNTS.

Yes, that would also solve the problem. It won't avoid the appearance of
three unread articles and then seeing only one unread article the next
time an article arrives that isn't deleted, but I think that's unavoidable
in the protocol.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<udq8js$2ss6l$2@news.trigofacile.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2126&group=news.software.nntp#2126

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!news.nntp4.net!news.gegeweb.eu!gegeweb.org!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 19:54:04 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <udq8js$2ss6l$2@news.trigofacile.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com> <87v8cfgxyo.fsf@hope.eyrie.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Tue, 12 Sep 2023 17:54:04 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="3043541"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
Gecko/20100101 Thunderbird/102.15.0
Cancel-Lock: sha1:TfVkZGKqidY8yw2A3ukMi4Ocqiw= sha256:Gy+ZdyRnzPBqG0Y+yxRL7qgWI/uZX+ujui9bI/xXick=
sha1:45YH9wg7A38t/a+puHqqmap+s0g= sha256:WqC7g3D6dd0ASxnGIJ1OXCth5nGyJnIs+OaYnRVXVb4=
In-Reply-To: <87v8cfgxyo.fsf@hope.eyrie.org>
 by: Julien ÉLIE - Tue, 12 Sep 2023 17:54 UTC

Hi Russ,

>> Though overview data may be handled differently, I think the same rule
>> is also followed, and the expiry process does not decrease high water
>> marks in overview data, but only updates low water marks, article counts
>> and removes old articles. It is what I have in mind from recent
>> investigation in the 4 overview methods when looking at how they handle
>> empty newsgroups.
>
> I thought the overview data for the deleted article would be dropped from
> the database during nightly expire, so will not appear in the OVER output,
> but it's been a while since I looked at it so I could be wrong. In other
> words, I think you're correct that the high water marks would not change,
> since that's how INN ensures that it never reuses an article number, but
> when you run OVER on the group, I believe the entries for those articles
> should be missing.

The entries for cancelled articles no longer are in the overview data
returned by an OVER request. When processing a cancel, the rows are
deleted in ovdb/ovsqlite database and the index entry is deleted in
tradindexed. OVER no longer shows them.
The expiration process will then properly remove the overview data in
tradindexed.

The use case when the overview data is still present but no longer the
article, is when using CNFS and the article has been overwritten. OVER
will report the article until the next expire run.

>> In order to improve the experience of news clients, wouldn't a
>> groupexacthigh parameter in readers.conf be useful in INN? The idea
>> would be that nnrpd would give a high water mark corresponding to an
>> existing article when responding to GROUP, LISTGROUP, LIST ACTIVE and
>> LIST COUNTS.
>
> Yes, that would also solve the problem. It won't avoid the appearance of
> three unread articles and then seeing only one unread article the next
> time an article arrives that isn't deleted, but I think that's unavoidable
> in the protocol.

Ah yes, indeed, there may be gaps in the available article numbers. The
problem solved here would be to show unread articles whereas there are
no new articles to read, but not the exact count of unread articles,
which is impossible to know from a mere GROUP command.
The client may send a "LISTGROUP latest high-new advertised high"
command and counts itself, but it will slow down a bit the reading
experience.

--
Julien ÉLIE

« Sum, ergo bibo ; bibo, ergo sum. »

Re: Bug in SLRN trunk: not seen in 1.0.3.

<878r9bgt6c.fsf@hope.eyrie.org>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2127&group=news.software.nntp#2127

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Tue, 12 Sep 2023 11:09:15 -0700
Organization: The Eyrie
Message-ID: <878r9bgt6c.fsf@hope.eyrie.org>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net>
<20230911214521.831@kylheku.com> <20230911222037.955@kylheku.com>
<877cowj6sm.fsf@hope.eyrie.org> <udpkdo$2sh67$1@news.trigofacile.com>
<87v8cfgxyo.fsf@hope.eyrie.org> <udq8js$2ss6l$2@news.trigofacile.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Info: hope.eyrie.org;
logging-data="17090"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13)
Cancel-Lock: sha1:6fDqtsppmyYG6lUWTCsYIp5ygvs=
 by: Russ Allbery - Tue, 12 Sep 2023 18:09 UTC

Julien ÉLIE <iulius@nom-de-mon-site.com.invalid> writes:

> The entries for cancelled articles no longer are in the overview data
> returned by an OVER request. When processing a cancel, the rows are
> deleted in ovdb/ovsqlite database and the index entry is deleted in
> tradindexed. OVER no longer shows them.

Oh! Okay, so my diagnosis of the problem was wrong because I forgot that
we did hide the overview information immediately.

So you're right, this probably is entirely about the high water mark.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<uds2fp$2ua8g$1@news.trigofacile.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2133&group=news.software.nntp#2133

  copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Wed, 13 Sep 2023 12:21:45 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <uds2fp$2ua8g$1@news.trigofacile.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Wed, 13 Sep 2023 10:21:45 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="3090704"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
Gecko/20100101 Thunderbird/102.15.0
Cancel-Lock: sha1:STl4Pf37k25AbbVOJKIpjJ+8Ow8= sha256:BEhj/Q5V9hkk7tqa5q8M4MCdjpMfJQb6tXzqi289g9w=
sha1:chYSkzDCYXnI1n9xYt2Op8X3kwA= sha256:1QsYVmUInNQL1F5PMGCkV4qaNRs5tdqo13pj6wY3T5o=
In-Reply-To: <udpkdo$2sh67$1@news.trigofacile.com>
 by: Julien ÉLIE - Wed, 13 Sep 2023 10:21 UTC

Responding to my previous article:
> The high water mark never decreases in the active file as this
> information is used by innd to assign the next unused article number.
>
> Though overview data may be handled differently, I think the same rule
> is also followed, and the expiration process does not decrease high water
> marks in overview data, but only updates low water marks, article counts
> and removes old articles.
> Just to be sure, I have just cancelled an article in a local testing
> group, and will report tomorrow.

I confirm the high water mark does not decrease in the overview data
after an expiration run. Same thing as for the active file.
The expiration process properly cleans up the related (hidden) expired
overview data, as discussed yesterday.

--
Julien ÉLIE

« Donec eris felix, multos numerabis amicos. » (Ovide)

Re: Bug in SLRN trunk: not seen in 1.0.3.

<slrnug36bf.1uq94.rayban@raybanana.net>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2135&group=news.software.nntp#2135

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!raybanana.eternal-september.org!.POSTED!not-for-mail
From: ray...@raybanana.net (Ray Banana)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Wed, 13 Sep 2023 11:13:51 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 14
Message-ID: <slrnug36bf.1uq94.rayban@raybanana.net>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com> <uds2fp$2ua8g$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Wed, 13 Sep 2023 11:13:51 -0000 (UTC)
Injection-Info: raybanana.eternal-september.org; posting-host="bfaa1b1219a957192c8e4dec5ad89db9";
logging-data="2215490"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19uabMnVYC+sVOnF13ip7RWoVOP0UoMM/c="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:n9aZrx3EDAI1GMU9F+0w7E4GgG4=
 by: Ray Banana - Wed, 13 Sep 2023 11:13 UTC

* Julien ÉLIE wrote:
> Responding to my previous article:
[...]
> I confirm the high water mark does not decrease in the overview data
> after an expiration run.

That's good to know, as anything else would break the xrefslave feature.

;-)

--
Пу́тін — хуйло́
http://www.eternal-september.org

Re: Bug in SLRN trunk: not seen in 1.0.3.

<20230913165804.736@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2136&group=news.software.nntp#2136

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Thu, 14 Sep 2023 03:17:04 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 51
Message-ID: <20230913165804.736@kylheku.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com> <uds2fp$2ua8g$1@news.trigofacile.com>
<slrnug36bf.1uq94.rayban@raybanana.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 14 Sep 2023 03:17:04 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="3cc25e62ab9734f1842fb79a3bbf3440";
logging-data="2627902"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+K7A2KrrsIvHc6CfznK+USQGJtjwPmOAo="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:89g8c8ZyJ2r0+RhPRBeNFuqXg2M=
 by: Kaz Kylheku - Thu, 14 Sep 2023 03:17 UTC

On 2023-09-13, Ray Banana <rayban@raybanana.net> wrote:
> * Julien ÉLIE wrote:
>> Responding to my previous article:
> [...]
>> I confirm the high water mark does not decrease in the overview data
>> after an expiration run.
>
> That's good to know, as anything else would break the xrefslave feature.
>
> ;-)

In any case, about the slrn behavior, it goes away if I make this change
to the code to disable the use of OVER instead of XOVER.

diff --git a/src/nntplib.c b/src/nntplib.c
index 595c6c8..596a453 100644
--- a/src/nntplib.c
+++ b/src/nntplib.c
@@ -842,12 +842,14 @@ int nntp_has_cmd (NNTP_Type *s, char *cmd)
if (!strcmp (cmd, "XOVER"))
{
if (s->can_xover != -1) return s->can_xover;
+#if 0
if (1 == _nntp_probe_server (s, "OVER")) /* rfc3977 */
{
s->can_xover = 1;
s->xover_cmd_name = "OVER";
return 1;
}
+#endif
return PROBE_XCMD(s, s->can_xover, cmd);
}

It's strange. While there are only junk articles you get the behavior
that it doesn't catch up. Currently there are 5. As soon as a 6th
article shows up that is good, then when I read it, slrn will catch
up and there will be 0 unread.

There must be a protocol level difference between what slrn is getting
from OVER vs XOVER.

I'm suspecting that in the situations in which this manifests itself,
OVER is reporting fewer articles than the watermark, which differs from XOVER.

And then slrn is refusing to catch up beyond what was reported by OVER.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOTE: If you use Google Groups, I don't see you, unless you're whitelisted.

Re: Bug in SLRN trunk: not seen in 1.0.3.

<uduej7$2vvku$1@news.trigofacile.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2137&group=news.software.nntp#2137

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Thu, 14 Sep 2023 10:00:39 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <uduej7$2vvku$1@news.trigofacile.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com> <uds2fp$2ua8g$1@news.trigofacile.com>
<slrnug36bf.1uq94.rayban@raybanana.net> <20230913165804.736@kylheku.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 14 Sep 2023 08:00:39 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="3145374"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
Gecko/20100101 Thunderbird/102.15.1
Cancel-Lock: sha1:0aYyDjqKzJsX5jD4VRac/ArAIK0= sha256:B44CzUbdZqhNWkYyVUXSi1RnBveM6fkiZJEJY/Anb/k=
sha1:CqlWcX+ZMMwhZeeQoSrjoD49WJs= sha256:4ro0PzVdY/UzK7XV7S7GkeN63xZ0kERdUk7xmNGXl+0=
In-Reply-To: <20230913165804.736@kylheku.com>
 by: Julien ÉLIE - Thu, 14 Sep 2023 08:00 UTC

Hi Kaz,

> It's strange. While there are only junk articles you get the behavior
> that it doesn't catch up. Currently there are 5. As soon as a 6th
> article shows up that is good, then when I read it, slrn will catch
> up and there will be 0 unread.
>
> There must be a protocol level difference between what slrn is getting
> from OVER vs XOVER.
>
> I'm suspecting that in the situations in which this manifests itself,
> OVER is reporting fewer articles than the watermark, which differs from XOVER.
>
> And then slrn is refusing to catch up beyond what was reported by OVER.

The same overview data is returned by OVER and XOVER.
The only protocol level difference is the response code when an empty
range is given as the argument to the command. OVER returns 423 (no
articles) whereas XOVER returns 224 (OK) without any subsequent information.

Example of newsgroup with high number = 27 but article number 27 is not
available, and you have "comp.lang.c: 1-26" in your .slrnrc file.

GROUP comp.lang.c
211 21 1 27 comp.lang.c

STAT 27
423 No such article number 27

OVER 27-
423 No articles in 27-

XOVER 27-
224 No articles in 27-
..

Maybe this slight difference triggers the behaviour slrn has when using
OVER because it does not handle the 423 response code as equivalent to
XOVER returning no articles at all?

--
Julien ÉLIE

« L'éternité, c'est long, surtout vers la fin. » (Woody Allen)

Re: Bug in SLRN trunk: not seen in 1.0.3.

<20230914093037.807@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2138&group=news.software.nntp#2138

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: Re: Bug in SLRN trunk: not seen in 1.0.3.
Date: Thu, 14 Sep 2023 16:34:33 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 20
Message-ID: <20230914093037.807@kylheku.com>
References: <20230911185353.581@kylheku.com>
<slrnufvq4m.15l9v.rayban@raybanana.net> <20230911214521.831@kylheku.com>
<20230911222037.955@kylheku.com> <877cowj6sm.fsf@hope.eyrie.org>
<udpkdo$2sh67$1@news.trigofacile.com> <uds2fp$2ua8g$1@news.trigofacile.com>
<slrnug36bf.1uq94.rayban@raybanana.net> <20230913165804.736@kylheku.com>
<uduej7$2vvku$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 14 Sep 2023 16:34:33 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="3cc25e62ab9734f1842fb79a3bbf3440";
logging-data="2840488"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX197Nwe5zRuOTLe0oPgY/Kvrh+698Mbqupg="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:ry9XG5WJ2u4+s5UcjLRNJcWIWfI=
 by: Kaz Kylheku - Thu, 14 Sep 2023 16:34 UTC

On 2023-09-14, Julien ÉLIE <iulius@nom-de-mon-site.com.invalid> wrote:
> Maybe this slight difference triggers the behaviour slrn has when using
> OVER because it does not handle the 423 response code as equivalent to
> XOVER returning no articles at all?

Thanks Julien,

I see in slrn where it treats anything other than 224 as an error
and returns -1, in a certain function.

But 423 isn't an error; it's just a positive indication that there are
no articles.

I am testing a change now.

--
TXR Programming Language: http://nongnu.org/txr
Cygnal: Cygwin Native Application Library: http://kylheku.com/cygnal
Mastodon: @Kazinator@mstdn.ca
NOTE: If you use Google Groups, I don't see you, unless you're whitelisted.

[PATCH] OVER issue in slrn [was: Bug in SLRN trunk: not seen in 1.0.3.]

<20231004210356.147@kylheku.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2245&group=news.software.nntp#2245

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: 864-117-...@kylheku.com (Kaz Kylheku)
Newsgroups: news.software.nntp
Subject: [PATCH] OVER issue in slrn [was: Bug in SLRN trunk: not seen in
1.0.3.]
Date: Thu, 5 Oct 2023 04:06:26 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 56
Message-ID: <20231004210356.147@kylheku.com>
References: <20230911185353.581@kylheku.com>
Injection-Date: Thu, 5 Oct 2023 04:06:26 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="b59c8ead4a79372c535e43b6fbdd887e";
logging-data="825869"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/GZx/Jn/Bo9fCVIT6JwSs6hi6kpYd2VPQ="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:wW9SsWuqFCbyZ6zDlhvOx/uciAQ=
 by: Kaz Kylheku - Thu, 5 Oct 2023 04:06 UTC

On 2023-09-12, Kaz Kylheku <864-117-4973@kylheku.com> wrote:
> Hi all, I've run into the following little bug.
>

I have a fix for this now.

commit 5b43b2e927f51e30fe1ec14242cdd573ee143621
Author: Kaz Kylheku <kaz@kylheku.com>
Date: Wed Oct 4 20:46:47 2023 -0700

bug: OVER issue: not advancing past articles.

We need to handle the 423 code (ERR_NOARTIG) when OVER is used
instead of XOVER. Just pretending that it is 224 (OK_XOVER)
doesn't work because the code then tries to get headers,
and the connection will abruptly close unlike in the XOVER
case.

The manifestation of the problem is like this. Sometimes
a certain newsgroup shows a positive number of articles
unread. When an attempt is made to select the newsgroup,
slrn shows "No articles unread" --- but the count does not
go to zero. It does not advance the article count.

* src/art.c (get_headers): Do not bail if slrn_open_xover
returns ERR_NOARTIG (423). Furthermore, in this case, do not
try slrn_read_xover, because the socket will close, which
causes a problem. We just skip over the loop, to the state
updates at the end of the function.

diff --git a/src/art.c b/src/art.c
index 66bc1d5..9cbcfa7 100644
--- a/src/art.c
+++ b/src/art.c
@@ -5714,10 +5714,9 @@ static int get_headers (NNTP_Artnum_Type min, NNTP_Artnum_Type max, NNTP_Artnum_
/* slrn_set_suspension (1); */
err = slrn_open_xover (min, max);
- if (err != OK_XOVER)
+ if (err != OK_XOVER && err != ERR_NOARTIG)
{
- if ((err == ERR_NOCRNT) || /* no articles in the range */
- (err == ERR_NOARTIG)) /* this one is not RFC 2980 compliant */
+ if ((err == ERR_NOCRNT))
return 0;
return -1;
@@ -5726,7 +5725,7 @@ static int get_headers (NNTP_Artnum_Type min, NNTP_Artnum_Type max, NNTP_Artnum_
num_processed = 0;
expected_num = min;
num = Total_Num_Headers + Number_Killed;
- while (slrn_read_xover(&xov) > 0)
+ while (err != ERR_NOARTIG && slrn_read_xover(&xov) > 0)
{
NNTP_Artnum_Type this_num;

Re: [PATCH] OVER issue in slrn

<ufn0hd$76bs$2@news.trigofacile.com>

  copy mid

https://www.novabbs.com/computers/article-flat.php?id=2268&group=news.software.nntp#2268

  copy link   Newsgroups: news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.176.143-2-105.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp
Subject: Re: [PATCH] OVER issue in slrn
Date: Thu, 5 Oct 2023 20:50:21 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <ufn0hd$76bs$2@news.trigofacile.com>
References: <20230911185353.581@kylheku.com> <20231004210356.147@kylheku.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 5 Oct 2023 18:50:21 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="176.143-2-105.abo.bbox.fr:176.143.2.105";
logging-data="235900"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:rKNBWHHstb4qyzMY2cvfN9ExI0c= sha256:twJD/8Gwf9FU2o1cB38w2j3CARLud489PYs+J1PzGwc=
sha1:LlHp94rWPcB1FMYMnGcUsT3q0DA= sha256:tlsZ4E+piyaQKcNZpfg/VXxWPr0MU9d3aNOIYys6aqo=
In-Reply-To: <20231004210356.147@kylheku.com>
 by: Julien ÉLIE - Thu, 5 Oct 2023 18:50 UTC

Hi Kaz,

> bug: OVER issue: not advancing past articles.
>
> We need to handle the 423 code (ERR_NOARTIG) when OVER is used
> instead of XOVER. Just pretending that it is 224 (OK_XOVER)
> doesn't work because the code then tries to get headers,
> and the connection will abruptly close unlike in the XOVER
> case.

Thanks for the fix for slrn!

(If slrn ever implements HDR, there's also a similar difference between
the results of HDR and XHDR on empty responses.)

--
Julien ÉLIE

« Le carré est un triangle qui a réussi, ou une circonférence qui a mal
tourné. » (Pierre Dac)

1
server_pubkey.txt

rocksolid light 0.9.8
clearnet tor