Rocksolid Light

Welcome to novaBBS (click a section below)

mail  files  register  newsreader  groups  login

Message-ID:  

"Morality is one thing. Ratings are everything." -- A Network 23 executive on "Max Headroom"


computers / news.software.readers / Re: Advertising metadata and other fields in overview

SubjectAuthor
* Advertising metadata and other fields in overviewJulien ÉLIE
+* Re: Advertising metadata and other fields in overviewAdam H. Kerman
|`* Re: Advertising metadata and other fields in overviewJulien ÉLIE
| +* Re: Advertising metadata and other fields in overviewAdam H. Kerman
| |`* Re: Advertising metadata and other fields in overviewEli the Bearded
| | `- Re: Advertising metadata and other fields in overviewRuss Allbery
| `- Re: Advertising metadata and other fields in overviewUrs Janßen
+* Re: Advertising metadata and other fields in overviewMichael Bäuerle
|`* Re: Advertising metadata and other fields in overviewJulien ÉLIE
| +* Re: Advertising metadata and other fields in overviewMichael Bäuerle
| |`* Re: Advertising metadata and other fields in overviewUrs Janßen
| | `- Re: Advertising metadata and other fields in overviewMichael Bäuerle
| `* Re: Advertising metadata and other fields in overviewMichael Bäuerle
|  `- Re: Advertising metadata and other fields in overviewJulien ÉLIE
+* Re: Advertising metadata and other fields in overviewMichael Bäuerle
|+- Re: Advertising metadata and other fields in overviewRuss Allbery
|`- Re: Advertising metadata and other fields in overviewJulien ÉLIE
`- Re: Advertising metadata and other fields in overviewAndreas Kempe

1
Advertising metadata and other fields in overview

<tc6fmu$2q025$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1069&group=news.software.readers#1069

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.176.143-2-105.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Advertising metadata and other fields in overview
Date: Sun, 31 Jul 2022 19:55:42 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <tc6fmu$2q025$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Sun, 31 Jul 2022 17:55:42 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="176.143-2-105.abo.bbox.fr:176.143.2.105";
logging-data="2949189"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0)
Gecko/20100101 Thunderbird/91.11.0
Cancel-Lock: sha1:FSqJkRWQ1AaGhplJ6wgsCoKeTUg= sha256:3Y80akjJ2BrsSOzBJPK4ROT9mZJWhTwL3a0zODY12DI=
sha1:DDAbEraH0di3VDRegAlqztvCbGc= sha256:Nl10E2fUAWG3mjOQ1njBFkTZMB7l6zwQX5/6kjcJW7k=
 by: Julien ÉLIE - Sun, 31 Jul 2022 17:55 UTC

Hi all,

The LIST OVERVIEW.FMT command MUST return these 7 following
case-insensitive strings:

Subject:
From:
Date:
Message-ID:
References:
:bytes
:lines

However, RFC 3977 also states in Section 8.4.2 that "for compatibility
with existing implementations, the last two lines MAY instead be:

Bytes:
Lines:

even though they refer to metadata, not headers."

Are you aware of news readers that send LIST OVERVIEW.FMT and would
break if they encountered ":bytes" or ":lines"? I'm wondering whether
it is safe nowadays to advertise the expected strings.

Also, are there useful other header fields that news readers are already
searching for in their (X)OVER requests and then would benefit from them
if present in the overview? The idea would then be to suggest to news
admins adding such fields in their overview data.
Like Newsgroups to know whether the article is crossposted? (Some news
servers already provide the Xref header field, but one cannot take for
sure that an article is crossposted with that mere field.)

--
Julien ÉLIE

« Tant qu'il y a des marmites, il y a de l'espoir ! » (Astérix)

Re: Advertising metadata and other fields in overview

<tc6iv0$f5bj$3@dont-email.me>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1070&group=news.software.readers#1070

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!eternal-september.org!reader01.eternal-september.org!.POSTED!not-for-mail
From: ahk...@chinet.com (Adam H. Kerman)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Sun, 31 Jul 2022 18:51:12 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 35
Message-ID: <tc6iv0$f5bj$3@dont-email.me>
References: <tc6fmu$2q025$1@news.trigofacile.com>
Injection-Date: Sun, 31 Jul 2022 18:51:12 -0000 (UTC)
Injection-Info: reader01.eternal-september.org; posting-host="1aa053e1bc16c9c54b0caa2147520cfd";
logging-data="497011"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18XFV1jczZyixxdl7Jk7jefKfQt1wPQB3o="
Cancel-Lock: sha1:ES57FO8BF/VeaRMKPicrN1iX/o8=
X-Newsreader: trn 4.0-test77 (Sep 1, 2010)
 by: Adam H. Kerman - Sun, 31 Jul 2022 18:51 UTC

Julien wrote:

>The LIST OVERVIEW.FMT command MUST return these 7 following
>case-insensitive strings:

> Subject:
> From:
> Date:
> Message-ID:
> References:
> :bytes
> :lines

>However, RFC 3977 also states in Section 8.4.2 that "for compatibility
>with existing implementations, the last two lines MAY instead be:

> Bytes:
> Lines:

>even though they refer to metadata, not headers."

>Are you aware of news readers that send LIST OVERVIEW.FMT and would
>break if they encountered ":bytes" or ":lines"? I'm wondering whether
>it is safe nowadays to advertise the expected strings.

>Also, are there useful other header fields that news readers are already
>searching for in their (X)OVER requests and then would benefit from them
>if present in the overview? The idea would then be to suggest to news
>admins adding such fields in their overview data.
>Like Newsgroups to know whether the article is crossposted? (Some news
>servers already provide the Xref header field, but one cannot take for
>sure that an article is crossposted with that mere field.)

Newsgroups would make my life easier, certainly. I also have kill file
entries based on Path.

Re: Advertising metadata and other fields in overview

<tc6m45$2q38p$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1071&group=news.software.readers#1071

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!eternal-september.org!reader01.eternal-september.org!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Sun, 31 Jul 2022 21:45:08 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <tc6m45$2q38p$1@news.trigofacile.com>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<tc6iv0$f5bj$3@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Sun, 31 Jul 2022 19:45:09 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="2952473"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0)
Gecko/20100101 Thunderbird/91.11.0
Cancel-Lock: sha1:fboz2P4ds2BGUw3me5gsqDFNeyY= sha256:0DDWJJBLBtWGywHOws0G0r2AuBmL8lh5KPorwbK3JD0=
sha1:POjsoXYhoW2DMkw7xI2aeA3zcXI= sha256:2ANyoCRwMML8jHfDI/YNXiQBrfcNOG41G6jkqeXLDPc=
In-Reply-To: <tc6iv0$f5bj$3@dont-email.me>
 by: Julien ÉLIE - Sun, 31 Jul 2022 19:45 UTC

Hi Adam,

>> Also, are there useful other header fields that news readers are already
>> searching for in their (X)OVER requests and then would benefit from them
>> if present in the overview? The idea would then be to suggest to news
>> admins adding such fields in their overview data.
>> Like Newsgroups to know whether the article is crossposted? (Some news
>> servers already provide the Xref header field, but one cannot take for
>> sure that an article is crossposted with that mere field.)
>
> Newsgroups would make my life easier, certainly. I also have kill file
> entries based on Path.

I see that you're using trn. The question would then be: were the
Newsgroups and Path header fields be present in (X)OVER responses, would
trn use them directly? (without sending (X)HDR or HEAD commands to
retrieve these header fields)
It is the whole point of having them in the overview database. Yet, I
don't know whether current versions of news clients would directly grab
them from there. (It may be an interesting feature to implement in news
clients if they aren't already doing that.)

--
Julien ÉLIE

« Just don't create a file called -rf. » (Larry Wall)

Re: Advertising metadata and other fields in overview

<tc6s9l$ft8g$2@dont-email.me>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1072&group=news.software.readers#1072

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!eternal-september.org!reader01.eternal-september.org!.POSTED!not-for-mail
From: ahk...@chinet.com (Adam H. Kerman)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Sun, 31 Jul 2022 21:30:29 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 33
Message-ID: <tc6s9l$ft8g$2@dont-email.me>
References: <tc6fmu$2q025$1@news.trigofacile.com> <tc6iv0$f5bj$3@dont-email.me> <tc6m45$2q38p$1@news.trigofacile.com>
Injection-Date: Sun, 31 Jul 2022 21:30:29 -0000 (UTC)
Injection-Info: reader01.eternal-september.org; posting-host="1aa053e1bc16c9c54b0caa2147520cfd";
logging-data="521488"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19Q8c/VqgaPkaKrcBClGXdwKpFvQnZoi6w="
Cancel-Lock: sha1:8IE33StIqtFPqKJSG/s2zZ4jz0M=
X-Newsreader: trn 4.0-test77 (Sep 1, 2010)
 by: Adam H. Kerman - Sun, 31 Jul 2022 21:30 UTC

Julien <iulius@nom-de-mon-site.com.invalid> wrote:
>Hi Adam,

>>>Also, are there useful other header fields that news readers are already
>>>searching for in their (X)OVER requests and then would benefit from them
>>>if present in the overview? The idea would then be to suggest to news
>>>admins adding such fields in their overview data.
>>>Like Newsgroups to know whether the article is crossposted? (Some news
>>>servers already provide the Xref header field, but one cannot take for
>>>sure that an article is crossposted with that mere field.)

>>Newsgroups would make my life easier, certainly. I also have kill file
>>entries based on Path.

>I see that you're using trn. The question would then be: were the
>Newsgroups and Path header fields be present in (X)OVER responses, would
>trn use them directly? (without sending (X)HDR or HEAD commands to
>retrieve these header fields)

Perhaps Wayne Davidson is still reading news.software.readers on
occassion. Eli the Bearded had contributed some trn patches a few years
ago; maybe he could glance at the code.

>It is the whole point of having them in the overview database. Yet, I
>don't know whether current versions of news clients would directly grab
>them from there. (It may be an interesting feature to implement in news
>clients if they aren't already doing that.)

Well, yes, since which headers are being downloaded is configurable at
the server level, it would be ideal if the newsreader could determine
which additional headers beyond the standard headers had been downloaded.

You're absolutely right. That should be a newsreader feature.

Re: Advertising metadata and other fields in overview

<tc7l9n$cl8$1@nntp.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1077&group=news.software.readers#1077

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!nntp.de!.POSTED.akk21-int.akk.kit.edu!not-for-mail
From: urs...@buil.tin.org (Urs Janßen)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 04:37:11 -0000 (UTC)
Organization: tin.org
Archive: no
Message-ID: <tc7l9n$cl8$1@nntp.de>
References: <tc6fmu$2q025$1@news.trigofacile.com> <tc6iv0$f5bj$3@dont-email.me> <tc6m45$2q38p$1@news.trigofacile.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Mon, 1 Aug 2022 04:37:11 -0000 (UTC)
Injection-Info: nntp.de; posting-host="akk21-int.akk.kit.edu:2a00:1398:5:f602:cafe:cafe:cafe:21";
logging-data="12968"; mail-complaints-to="abuse@nntp.de"
User-Agent: tin/2.6.2-20220630 ("Convalmore") (Linux/4.19.0-14-amd64 (x86_64))
Cancel-Lock: sha1:PcfUMrikRMUl0E870ym73HM5gTA=
X-No-Archive: yes
X-No-HTML: yes
 by: Urs Janßen - Mon, 1 Aug 2022 04:37 UTC

Julien ÉLIE <iulius@nom-de-mon-site.com.invalid> wrote:
> It is the whole point of having them in the overview database. Yet, I
> don't know whether current versions of news clients would directly grab
> them from there. (It may be an interesting feature to implement in news
> clients if they aren't already doing that.)

JFTR, tin should (for Path)

Re: Advertising metadata and other fields in overview

<AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1078&group=news.software.readers#1078

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!aioe.org!news.servidellagleba.it!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: michael....@stz-e.de (Michael Bäuerle)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 11:49:43 +0200 (CEST)
Lines: 22
Message-ID: <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de>
References: <tc6fmu$2q025$1@news.trigofacile.com>
Reply-To: Michael Bäuerle <michael.baeuerle@gmx.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=fixed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net RphfFVhh+C40EVL+L1d+mg6N60h3UVyOultvu35h6Baj/u/8Un
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:O8GwR+5MDo05b6mEp3XnXXCdwhc= sha256:vG3/oHt6Fqy3FOLGxCOfjeB26j/nxRBtHsTEkqn2m34= sha1:lqovTpKe5v8ZmuQeT4x5BPy9rTA=
Injection-Date: Mon, 1 Aug 2022 09:49:43 -0000
User-Agent: flnews/1.2.0pre0 (for NetBSD)
 by: Michael Bäuerle - Mon, 1 Aug 2022 09:49 UTC

Julien ÉLIE wrote:
>
> [...]
> Also, are there useful other header fields that news readers are already
> searching for in their (X)OVER requests and then would benefit from them
> if present in the overview? The idea would then be to suggest to news
> admins adding such fields in their overview data.
> Like Newsgroups to know whether the article is crossposted? (Some news
> servers already provide the Xref header field, but one cannot take for
> sure that an article is crossposted with that mere field.)

Newsgroups would be nice to have for scoring.

Currently the OVER command must be disabled for this to work in flnews.
Quoted from man page:
|
| o nntp_no_over (Integer) Disable usage of overview (OVER command) for
| NNTP protocol
|
| Setting this to a nonzero value disables usage of overview and makes
| the whole newsgroup list usable for scoring rules.
| [...]

Re: Advertising metadata and other fields in overview

<AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1079&group=news.software.readers#1079

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!news.in-chemnitz.de!news2.arglkargh.de!news.karotte.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: michael....@stz-e.de (Michael Bäuerle)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 12:55:15 +0200 (CEST)
Lines: 21
Message-ID: <AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
References: <tc6fmu$2q025$1@news.trigofacile.com>
Reply-To: Michael Bäuerle <michael.baeuerle@gmx.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=fixed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net ApUqWaBiHAxZ1F8uIum1sgMBxQjCRTtDm6npUwqcqbak2cexwn
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:aBrPzrGy4/6cjeyLGc587/BuauI= sha256:D9pc5gsubCG813NZTH4MpYre69vhEf/p25f1dKQr1RU= sha1:dTLTzz176Fhx39dWaypIdSRM/PM=
Injection-Date: Mon, 1 Aug 2022 10:55:15 -0000
User-Agent: flnews/1.2.0pre0 (for NetBSD)
 by: Michael Bäuerle - Mon, 1 Aug 2022 10:55 UTC

Julien ÉLIE wrote:
>
> [...]
> The LIST OVERVIEW.FMT command MUST return these 7 following
> case-insensitive strings:
>
> Subject:
> From:
> Date:
> Message-ID:
> References:
> :bytes
> :lines

RFC 3977 says in Section 8.4.2:
|
| This command MAY generate different results if it is used more than
| once in a session.

A newsreader needs to know when to refresh the information in this case.
Or is it intended to be repeated before every OVER command?

Re: Advertising metadata and other fields in overview

<87v8rbc3ab.fsf@hope.eyrie.org>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1081&group=news.software.readers#1081

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 01 Aug 2022 09:54:52 -0700
Organization: The Eyrie
Message-ID: <87v8rbc3ab.fsf@hope.eyrie.org>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Info: hope.eyrie.org;
logging-data="30447"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
Cancel-Lock: sha1:fU1g6EVOGmhDRRyO6mwrwFNvRi0=
 by: Russ Allbery - Mon, 1 Aug 2022 16:54 UTC

Michael Bäuerle <michael.baeuerle@stz-e.de> writes:
> Julien ÉLIE wrote:

>> [...]
>> The LIST OVERVIEW.FMT command MUST return these 7 following
>> case-insensitive strings:
>>
>> Subject:
>> From:
>> Date:
>> Message-ID:
>> References:
>> :bytes
>> :lines

> RFC 3977 says in Section 8.4.2:

> | This command MAY generate different results if it is used more than
> | once in a session.

> A newsreader needs to know when to refresh the information in this case.
> Or is it intended to be repeated before every OVER command?

That is just a cover-your-ass provision for the news server that allows
the admin to reconfigure overview storage dynamically without having to
take special precautions to prevent the list from changing. I wouldn't
expect a newsreader to refresh its understanding of the valid fields
except when it reconnects.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: Advertising metadata and other fields in overview

<tc978v$2shvj$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1082&group=news.software.readers#1082

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.176.143-2-105.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 20:50:07 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <tc978v$2shvj$1@news.trigofacile.com>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Mon, 1 Aug 2022 18:50:07 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="176.143-2-105.abo.bbox.fr:176.143.2.105";
logging-data="3033075"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0)
Gecko/20100101 Thunderbird/91.11.0
Cancel-Lock: sha1:JSQhgry0Za6C7LAOawi4XOiwhc4= sha256:nwKCU0WZWuPbrrUt1fOURqaP7XhPeSvgjNMsbzzTbSA=
sha1:RJpEhRtEk0x2MUMPaPME5g1OGkk= sha256:OugvUpW9VRQs/ag7XwWjbvA1n5kiyt2HUVV4Fbule28=
In-Reply-To: <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de>
 by: Julien ÉLIE - Mon, 1 Aug 2022 18:50 UTC

Hi Michael,

>> Also, are there useful other header fields that news readers are already
>> searching for in their (X)OVER requests and then would benefit from them
>> if present in the overview? The idea would then be to suggest to news
>> admins adding such fields in their overview data.
>> Like Newsgroups to know whether the article is crossposted? (Some news
>> servers already provide the Xref header field, but one cannot take for
>> sure that an article is crossposted with that mere field.)
>
> Newsgroups would be nice to have for scoring.

Sure.

> Currently the OVER command must be disabled for this to work in flnews.
> Quoted from man page:
> |
> | o nntp_no_over (Integer) Disable usage of overview (OVER command) for
> | NNTP protocol
> |
> | Setting this to a nonzero value disables usage of overview and makes
> | the whole newsgroup list usable for scoring rules.
> | [...]

Why not automatically disable OVER if there exists a scoring rule using
the Newsgroups header field? (and keep using OVER otherwise)

In case you wish to test a possible use of the Newsgroups field if
present in overview data, I've added it in my news server
(news.trigofacile.com):

LIST OVERVIEW.FMT
215 Order of fields in overview database
Subject:
From:
Date:
Message-ID:
References:
:bytes
:lines
Xref:full
Newsgroups:full
Path:full
..

GROUP news.software.nntp
211 10940 1 15264 news.software.nntp

OVER 15262
224 Overview information for 15262 follows
15262 Re: Advertising metadata and other fields in overview Michael
=?ISO-8859-1?Q?B=E4uerle?= <michael.baeuerle@stz-e.de> Mon, 1 Aug 2022
12:55:15 +0200 (CEST) <AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
<tc6fmu$2q025$1@news.trigofacile.com> 1585 21 Xref:
news.trigofacile.com news.software.nntp:15262 Newsgroups:
news.software.nntp,news.software.readers Path:
news.trigofacile.com!weretis.net!feeder8.news.weretis.net!lilly.ping.de!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
..

I've also added Path, as Urs has a special handling of it in tin.
And switched to the "preferred" naming of ":bytes" and ":lines" (feel
free to test that everything is still OK with these names).

--
Julien ÉLIE

« Just don't create a file called -rf. » (Larry Wall)

Re: Advertising metadata and other fields in overview

<tc987d$2sij6$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1083&group=news.software.readers#1083

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 21:06:20 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <tc987d$2sij6$1@news.trigofacile.com>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Mon, 1 Aug 2022 19:06:21 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="3033702"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0)
Gecko/20100101 Thunderbird/91.11.0
Cancel-Lock: sha1:f8w62lm+YzsMq+SYGHkMVbTUbjs= sha256:A28npMs7jvuF5nYS9mUdMfSfsi6EbMckK7NjQ0LvjWE=
sha1:omNM31sR0BrxSUyu12oWNhlNl6I= sha256:JmxfFvPcsu+sZ7/ERsYN5BvxRM2eo3BUp29TU0VRo7E=
In-Reply-To: <AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
 by: Julien ÉLIE - Mon, 1 Aug 2022 19:06 UTC

Hi all,

> RFC 3977 says in Section 8.4.2:
> |
> | This command MAY generate different results if it is used more than
> | once in a session.

Speaking of "session", I'm intrigued by:

12.6. Caching of Capability Lists

In most situations, the capabilities list in a given server state
will not change from session to session; for example, a given
extension will be installed permanently on a server. Some clients
may therefore wish to remember which extensions a server supports to
avoid the delay of an additional command and response, particularly
if they open multiple connections in the same session.

There is a notion of "multiple connections in the same session". Yet,
it seems that it is the only place in RFC 3977 where multiple
connections are mentioned. I would have thought a connection and a
session were synonyms but I'm maybe wrong.
Does a session have the meaning of a period of time during which a
client has at least 1 connection opened? (The term is not really
defined, and if it has that meaning, a few uses of it are ambiguous
compared to a connection.)

--
Julien ÉLIE

« Petite annonce : Artificier cherche femme canon. »

Re: Advertising metadata and other fields in overview

<eli$2208011534@qaz.wtf>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1084&group=news.software.readers#1084

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!usenet.blueworldhosting.com!feed1.usenet.blueworldhosting.com!panix!.POSTED.panix5.panix.com!qz!not-for-mail
From: *...@eli.users.panix.com (Eli the Bearded)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 1 Aug 2022 21:00:26 -0000 (UTC)
Organization: Some absurd concept
Message-ID: <eli$2208011534@qaz.wtf>
References: <tc6fmu$2q025$1@news.trigofacile.com> <tc6iv0$f5bj$3@dont-email.me> <tc6m45$2q38p$1@news.trigofacile.com> <tc6s9l$ft8g$2@dont-email.me>
Injection-Date: Mon, 1 Aug 2022 21:00:26 -0000 (UTC)
Injection-Info: reader2.panix.com; posting-host="panix5.panix.com:166.84.1.5";
logging-data="4071"; mail-complaints-to="abuse@panix.com"
User-Agent: Vectrex rn 2.1 (beta)
X-Liz: It's actually happened, the entire Internet is a massive game of Redcode
X-Motto: "Erosion of rights never seems to reverse itself." -- kenny@panix
X-US-Congress: Moronic Fucks.
X-Attribution: EtB
XFrom: is a real address
Encrypted: double rot-13
 by: Eli the Bearded - Mon, 1 Aug 2022 21:00 UTC

In news.software.readers, Adam H. Kerman <ahk@chinet.com> wrote:
>> I see that you're using trn. The question would then be: were the
>> Newsgroups and Path header fields be present in (X)OVER responses, would
>> trn use them directly? (without sending (X)HDR or HEAD commands to
>> retrieve these header fields)
> Perhaps Wayne Davidson is still reading news.software.readers on
> occassion. Eli the Bearded had contributed some trn patches a few years
> ago; maybe he could glance at the code.

As far as I know, Wayne Davidson no longer has an interest in trn or
netnewd. I do have an interest, and I keep trn source handy.

I'm not quite sure if the overview code in rt-ov.h properly deals with
extra content in overview. My experience suggests yes, but it could
have been masked by fast XHDR action. To use overview files for
searching (including KILL commands), you need to use the Hheadername
flag, like so:

/trn/Hsubject:+

The article search code in artsrch.c for ARTSCOPE_ONEHDR calls
fetchlines() in head.c to get the line, that uses fetchcache() from
cache.c to check cached headers (eg found in overview) and falls back to
XHDR if needed.

Scoring calls fetchcache() as well, but I didn't review that code.

> Well, yes, since which headers are being downloaded is configurable at
> the server level, it would be ideal if the newsreader could determine
> which additional headers beyond the standard headers had been
> downloaded.

Well trn (in rt-ov.c), for one, is clearly checking the overview.fmt
file for what overview has.

Elijah
------
the provided support/Score.pl script does not check overview.fmt

Re: Advertising metadata and other fields in overview

<87ilnbbnml.fsf@hope.eyrie.org>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1085&group=news.software.readers#1085

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Mon, 01 Aug 2022 15:33:06 -0700
Organization: The Eyrie
Message-ID: <87ilnbbnml.fsf@hope.eyrie.org>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<tc6iv0$f5bj$3@dont-email.me> <tc6m45$2q38p$1@news.trigofacile.com>
<tc6s9l$ft8g$2@dont-email.me> <eli$2208011534@qaz.wtf>
Mime-Version: 1.0
Content-Type: text/plain
Injection-Info: hope.eyrie.org;
logging-data="5128"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
Cancel-Lock: sha1:R9ELZLbfC88Z3lVSpPTgR7ZIrjY=
 by: Russ Allbery - Mon, 1 Aug 2022 22:33 UTC

Eli the Bearded <*@eli.users.panix.com> writes:

> I'm not quite sure if the overview code in rt-ov.h properly deals with
> extra content in overview. My experience suggests yes, but it could have
> been masked by fast XHDR action.

INN will automatically use overview to satisfy XHDR, XPAT, and PAT
commands if possible, FYI, although with those commands it will fall back
to opening each article individually if the header requested is not in
overview, which obviously can be quite slow.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: Advertising metadata and other fields in overview

<AABi6kT4KKEAAAKQ.A3.flnews@WStation5.stz-e.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1086&group=news.software.readers#1086

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!aioe.org!news.uzoreto.com!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: michael....@stz-e.de (Michael Bäuerle)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Wed, 3 Aug 2022 11:50:48 +0200 (CEST)
Lines: 70
Message-ID: <AABi6kT4KKEAAAKQ.A3.flnews@WStation5.stz-e.de>
References: <tc6fmu$2q025$1@news.trigofacile.com> <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de> <tc978v$2shvj$1@news.trigofacile.com>
Reply-To: Michael Bäuerle <michael.baeuerle@gmx.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=fixed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net W/DD14W3EMESoro4R/Ov/QpO4yWS9eBG7acNdqtRsojNsOBe5k
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:Yimlx/uQjL/RR7WdrYuDvy7s5FU= sha256:6UdLZBeAy8geZg0sQ9susciad08lKeLrsOmUGLyE+eA= sha1:tBn25IN9+xA8zaYNCSdS7rtuB78=
Injection-Date: Wed, 3 Aug 2022 09:50:48 -0000
User-Agent: flnews/1.2.0pre0 (for NetBSD)
 by: Michael Bäuerle - Wed, 3 Aug 2022 09:50 UTC

Julien ÉLIE wrote:
> Michael Bäuerle wrote:
> >
> > [...]
> > Currently the OVER command must be disabled for this to work in flnews.
> > Quoted from man page:
> > |
> > | o nntp_no_over (Integer) Disable usage of overview (OVER command) for
> > | NNTP protocol
> > |
> > | Setting this to a nonzero value disables usage of overview and makes
> > | the whole newsgroup list usable for scoring rules.
> > | [...]
>
> Why not automatically disable OVER if there exists a scoring rule using
> the Newsgroups header field? (and keep using OVER otherwise)

Currently scoring rules are silently skipped, if they cannot be applied.
This can happen in other cases too, e.g. if a rule contains text that
cannot be converted to the charset of the locale (flnews uses Unicode
internally, but explicitly supports operating systems without Unicode
locales).

But yes, this is likely not what a user would expect.

> In case you wish to test a possible use of the Newsgroups field if
> present in overview data, I've added it in my news server
> (news.trigofacile.com):
>
> LIST OVERVIEW.FMT
> 215 Order of fields in overview database
> Subject:
> From:
> Date:
> Message-ID:
> References:
> :bytes
> :lines
> Xref:full
> Newsgroups:full
> Path:full
> .
>
> GROUP news.software.nntp
> 211 10940 1 15264 news.software.nntp
>
> OVER 15262
> 224 Overview information for 15262 follows
> 15262 Re: Advertising metadata and other fields in overview Michael
> =?ISO-8859-1?Q?B=E4uerle?= <michael.baeuerle@stz-e.de> Mon, 1 Aug 2022
> 12:55:15 +0200 (CEST) <AABi57ETSaEAAAJK.A3.flnews@WStation5.stz-e.de>
> <tc6fmu$2q025$1@news.trigofacile.com> 1585 21 Xref: news.trigofacile.com
> news.software.nntp:15262 Newsgroups:
> news.software.nntp,news.software.readers Path:
> news.trigofacile.com!weretis.net!feeder8.news.weretis.net!lilly.ping.de!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
> .

Thank you. I will try to implement support for LIST OVERVIEW.FMT and
Newsgroups field from overview.

This should be sufficient to feed the corresponding scoring rules
without the automatic OVER disabling logic discussed above.

> I've also added Path, as Urs has a special handling of it in tin.
> And switched to the "preferred" naming of ":bytes" and ":lines" (feel
> free to test that everything is still OK with these names).

My plan is to simply skip the first 7 fields of the response.
Different order or meaning is not allowed by RFC 3977. And this
information was already used before (implicitly).

Re: Advertising metadata and other fields in overview

<tcdm0p$ri3$1@nntp.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1087&group=news.software.readers#1087

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.cgarbs.de!nntp.de!.POSTED.akk21-int.akk.kit.edu!not-for-mail
From: urs...@buil.tin.org (Urs Janßen)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Wed, 3 Aug 2022 11:26:17 -0000 (UTC)
Organization: tin.org
Archive: no
Message-ID: <tcdm0p$ri3$1@nntp.de>
References: <tc6fmu$2q025$1@news.trigofacile.com> <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de> <tc978v$2shvj$1@news.trigofacile.com> <AABi6kT4KKEAAAKQ.A3.flnews@WStation5.stz-e.de>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Wed, 3 Aug 2022 11:26:17 -0000 (UTC)
Injection-Info: nntp.de; posting-host="akk21-int.akk.kit.edu:2a00:1398:5:f602:cafe:cafe:cafe:21";
logging-data="28227"; mail-complaints-to="abuse@nntp.de"
User-Agent: tin/2.6.2-20220630 ("Convalmore") (Linux/4.19.0-14-amd64 (x86_64))
Cancel-Lock: sha1:+I4o4wbx5gh2ogA6LBXrZVIrbdo=
X-No-Archive: yes
X-No-HTML: yes
 by: Urs Janßen - Wed, 3 Aug 2022 11:26 UTC

Michael Bäuerle <michael.baeuerle@stz-e.de> wrote:
>> I've also added Path, as Urs has a special handling of it in tin.

JFTR: works like expected in tin; no extra HDR, XHDR or XPAT cmds. issued
when Path data is available in NOV and used for scoring.

> My plan is to simply skip the first 7 fields of the response.
> Different order or meaning is not allowed by RFC 3977. And this

newsoverview(5) from Geoff Collyer (some time in 1992) did specify an order
(but did't mention LIST OVERVIEW.FMT as that was invented AFAIK ~1 year
later).

RFC 2980 (from 10.2000) didn't specify an order.

RFC 3977 (from 10.2006) does specify an order.

IIRC I've seen non RFC 3977 compliant setups in the wild (reversed order,
missing mandatory fields, duplicate fields, ...).

Re: Advertising metadata and other fields in overview

<AABi6mWyB6oAAAKQ.A3.flnews@WStation5.stz-e.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1088&group=news.software.readers#1088

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: michael....@stz-e.de (Michael Bäuerle)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Wed, 3 Aug 2022 14:10:26 +0200 (CEST)
Lines: 26
Message-ID: <AABi6mWyB6oAAAKQ.A3.flnews@WStation5.stz-e.de>
References: <tc6fmu$2q025$1@news.trigofacile.com> <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de> <tc978v$2shvj$1@news.trigofacile.com> <AABi6kT4KKEAAAKQ.A3.flnews@WStation5.stz-e.de> <tcdm0p$ri3$1@nntp.de>
Reply-To: Michael Bäuerle <michael.baeuerle@gmx.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=fixed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net 805qAGCqw9oS+WXhwPLMzAtcoz7rqyIDVGENSjoTgEjaRF3A3E
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:n1qP9eTgePJhY5T7I5Th9KUVfXI= sha256:JOg1GJNPuaPQClINd2+DEtzUlAdOM7+0I1h8hJCwKno= sha1:4f0FX2nvfQfOGJpAlrXDJrKc8nI=
Injection-Date: Wed, 3 Aug 2022 12:10:26 -0000
User-Agent: flnews/1.2.0pre0 (for NetBSD)
 by: Michael Bäuerle - Wed, 3 Aug 2022 12:10 UTC

Urs Janßen wrote:
> Michael Bäuerle <michael.baeuerle@stz-e.de> wrote:
> >
> > [...]
> > My plan is to simply skip the first 7 fields of the response.
> > Different order or meaning is not allowed by RFC 3977. And this
>
> newsoverview(5) from Geoff Collyer (some time in 1992) did specify an order
> (but did't mention LIST OVERVIEW.FMT as that was invented AFAIK ~1 year
> later).
>
> RFC 2980 (from 10.2000) didn't specify an order.

flnews has never supported RFC 2980 (XOVER command).
> RFC 3977 (from 10.2006) does specify an order.
>
> IIRC I've seen non RFC 3977 compliant setups in the wild (reversed order,
> missing mandatory fields, duplicate fields, ...).

Hopefully such setups have not advertised OVER via CAPABILITIES
command.

Currently flnews uses overview only with OVER command, and only if the
server advertises OVER capability. If the overview is broken, it can be
disabled with the "nntp_no_over" option.

Re: Advertising metadata and other fields in overview

<AABi6uDp+hIAAAwk.A3.flnews@Server4.micha.freeshell.org>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1089&group=news.software.readers#1089

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!lilly.ping.de!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: michael....@gmx.net (Michael Bäuerle)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Wed, 3 Aug 2022 20:56:09 -0000
Lines: 76
Message-ID: <AABi6uDp+hIAAAwk.A3.flnews@Server4.micha.freeshell.org>
References: <tc6fmu$2q025$1@news.trigofacile.com> <AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de> <tc978v$2shvj$1@news.trigofacile.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=fixed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net 4qagpdmqiO5xstavspytjwa225kbHDbBt9ghaPg3DvxkShEUMS
X-Orig-Path: not-for-mail
Cancel-Lock: sha256:iubwlL9X9KD9rhcIc5blr+BqsglONLrb0FZRRVl7tJ4= sha1:H6wtlCOU0e4iNGr1XMQ7TDf6g9A=
Injection-Date: Wed, 3 Aug 2022 20:56:09 -0000
User-Agent: flnews/1.1.0 (for HP-UX)
 by: Michael Bäuerle - Wed, 3 Aug 2022 20:56 UTC

Julien ÉLIE wrote:
>
> [...]
> In case you wish to test a possible use of the Newsgroups field if
> present in overview data, I've added it in my news server
> (news.trigofacile.com):
>
> LIST OVERVIEW.FMT
> 215 Order of fields in overview database
> Subject:
> From:
> Date:
> Message-ID:
> References:
> :bytes
> :lines
> Xref:full
> Newsgroups:full
> Path:full
> .
> [...]

I have implemented support for LIST OVERVIEW.FMT in the snapshot flnews
1.2.0pre1. According to the comment from Russ, the command is executed
only once per session.

Protocol log:
------------------------------------------------------------------------
[Using NNTP protocol driver]
[=> Connect to news.trigofacile.com:nntps]
[Established encrypted connection using TLSv1.3 protocol with cipher suite TLS_AES_256_GCM_SHA384]
[<= Expect X509 certificate]
Certificate:
[...]
[Server certificate verification successful]
[<=] 200 news.trigofacile.com InterNetNews NNRP server INN 2.8.0 (20220801 prerelease) ready (no posting)
[=>] CAPABILITIES
[<=] 101 Capability list:
[<= Expect multiline data block]
VERSION 2
IMPLEMENTATION INN 2.8.0 (20220801 prerelease)
AUTHINFO USER SASL
COMPRESS DEFLATE
HDR
LIST ACTIVE ACTIVE.TIMES COUNTS DISTRIB.PATS DISTRIBUTIONS HEADERS MODERATORS MOTD NEWSGROUPS OVERVIEW.FMT SUBSCRIPTIONS
OVER
READER
SASL GS2-IAKERB GS2-KRB5 SCRAM-SHA-1 SCRAM-SHA-256 GSS-SPNEGO GSSAPI DIGEST-MD5 OTP NTLM CRAM-MD5 LOGIN PLAIN
XPAT
[Switch to NNTP V2 (RFC 3977) mode]

[Client authentication]
[Compression]

[=>] LIST OVERVIEW.FMT
[<=] 215 Order of fields in overview database
[<= Expect multiline data block]
Subject:
From:
Date:
Message-ID:
References:
:bytes
:lines
Xref:full
Newsgroups:full
Path:full
[Newsgroups header field available from overview]
[...]
------------------------------------------------------------------------

Urs noted that some server implementations are broken.
The mandatory fields are now checked for presence and order.

The Newsgroups header field, if present, is copied from the overview.
Scoring rules of type "group" are applied to all groups in this case.

Re: Advertising metadata and other fields in overview

<tcfr3h$315sh$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1090&group=news.software.readers#1090

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.176.143-2-105.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Thu, 4 Aug 2022 09:05:21 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <tcfr3h$315sh$1@news.trigofacile.com>
References: <tc6fmu$2q025$1@news.trigofacile.com>
<AABi56G3E9YAAAJK.A3.flnews@WStation5.stz-e.de>
<tc978v$2shvj$1@news.trigofacile.com>
<AABi6uDp+hIAAAwk.A3.flnews@Server4.micha.freeshell.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 4 Aug 2022 07:05:21 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="176.143-2-105.abo.bbox.fr:176.143.2.105";
logging-data="3184529"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0)
Gecko/20100101 Thunderbird/91.11.0
Cancel-Lock: sha1:kcdsfqXsnF5teSWy6iebgIC5VYQ= sha256:x4a7RGu/sahQ4aOD16pGlJZJHYZMLnbqjWDKKh31ahk=
sha1:YbYad1SoUnRihHf1oQUI1f88ZsY= sha256:ZYbVVLGcj21k9NRZlpRmO6H6iC4QK7Sgz2mpNl9NZPs=
In-Reply-To: <AABi6uDp+hIAAAwk.A3.flnews@Server4.micha.freeshell.org>
 by: Julien ÉLIE - Thu, 4 Aug 2022 07:05 UTC

Hi Michael,

> I have implemented support for LIST OVERVIEW.FMT in the snapshot flnews
> 1.2.0pre1.

Good news!

> [Compression]

I hope more news clients and servers get to implement the COMPRESS
command...

> [Newsgroups header field available from overview]
> > Urs noted that some server implementations are broken.
> The mandatory fields are now checked for presence and order.
>
> The Newsgroups header field, if present, is copied from the overview.
> Scoring rules of type "group" are applied to all groups in this case.

Sounds great! Thanks for it.

--
Julien ÉLIE

« Il y a un proverbe serbe qui dit ceci : « Notre passé est sinistre,
notre présent est invivable, heureusement que nous n'avons pas
d'avenir ! » (Philippe Geluck)

Re: Advertising metadata and other fields in overview

<td36mn$l3c$1@nyheter.lysator.liu.se>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1110&group=news.software.readers#1110

 copy link   Newsgroups: news.software.nntp news.software.readers
Path: i2pn2.org!i2pn.org!eternal-september.org!reader01.eternal-september.org!nyheter.lysator.liu.se!.POSTED!not-for-mail
From: kem...@lysator.liu.se (Andreas Kempe)
Newsgroups: news.software.nntp,news.software.readers
Subject: Re: Advertising metadata and other fields in overview
Date: Thu, 11 Aug 2022 15:19:51 -0000 (UTC)
Organization: Lysator ACS
Message-ID: <td36mn$l3c$1@nyheter.lysator.liu.se>
References: <tc6fmu$2q025$1@news.trigofacile.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 11 Aug 2022 15:19:51 -0000 (UTC)
Injection-Info: nyheter.lysator.liu.se; posting-account="kempe";
logging-data="21612"; mail-complaints-to="newsmaster@lysator.liu.se"
User-Agent: slrn/1.0.3 (FreeBSD)
 by: Andreas Kempe - Thu, 11 Aug 2022 15:19 UTC

Den 2022-07-31 skrev Julien ÉLIE <iulius@nom-de-mon-site.com.invalid>:
> Hi all,
>

Hello Julien,

> The LIST OVERVIEW.FMT command MUST return these 7 following
> case-insensitive strings:
>
> Subject:
> From:
> Date:
> Message-ID:
> References:
> :bytes
> :lines
>
> However, RFC 3977 also states in Section 8.4.2 that "for compatibility
> with existing implementations, the last two lines MAY instead be:
>
> Bytes:
> Lines:
>
> even though they refer to metadata, not headers."
>
>
>
> Are you aware of news readers that send LIST OVERVIEW.FMT and would
> break if they encountered ":bytes" or ":lines"? I'm wondering whether
> it is safe nowadays to advertise the expected strings.
>

As far as I can tell by looking at the source of slrn, which I use, it
expects Bytes and Lines to be present for overview support to be
enabled, but it would not break if :bytes and :lines are present in
addition to the two aforementioned fields.

Someone, please correct me if I'm wrong.

>
> Also, are there useful other header fields that news readers are already
> searching for in their (X)OVER requests and then would benefit from them
> if present in the overview? The idea would then be to suggest to news
> admins adding such fields in their overview data.
> Like Newsgroups to know whether the article is crossposted? (Some news
> servers already provide the Xref header field, but one cannot take for
> sure that an article is crossposted with that mere field.)
>

Personally, I would find it great to have easier filtering on Path,
although I don't think slrn supports it in the overview at the moment.
For some groups, Google's spam is horrendous and it would be nice to
be able to filter it.

1
server_pubkey.txt

rocksolid light 0.9.7
clearnet tor