Rocksolid Light

Welcome to novaBBS (click a section below)

mail  files  register  newsreader  groups  login

Message-ID:  

"Gort, klaatu nikto barada." -- The Day the Earth Stood Still


computers / news.software.readers / Re: betterbird: reading crossposts once?

SubjectAuthor
* betterbird: reading crossposts once?candycanearter07
+* Re: betterbird: reading crossposts once?Adam H. Kerman
|`* Re: betterbird: reading crossposts once?candycanearter07
| `* Re: betterbird: reading crossposts once?Adam H. Kerman
|  `- Re: betterbird: reading crossposts once?candycanearter07
+* Re: betterbird: reading crossposts once?The Doctor
|`- Re: betterbird: reading crossposts once?candycanearter07
`* Re: betterbird: reading crossposts once?VanguardLH
 +* Re: betterbird: reading crossposts once?Russ Allbery
 |`* Re: betterbird: reading crossposts once?VanguardLH
 | +* Re: betterbird: reading crossposts once?Ray Banana
 | |`* Re: betterbird: reading crossposts once?VanguardLH
 | | `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |  `* Re: betterbird: reading crossposts once?candycanearter07
 | |   `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |    `* Re: betterbird: reading crossposts once?Julien ÉLIE
 | |     +* Re: betterbird: reading crossposts once?VanguardLH
 | |     |`* Re: betterbird: reading crossposts once?Russ Allbery
 | |     | `- Re: betterbird: reading crossposts once?Olivier Miakinen
 | |     +- Re: betterbird: reading crossposts once?Olivier Miakinen
 | |     `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      +- Re: betterbird: reading crossposts once?Olivier Miakinen
 | |      +* Re: betterbird: reading crossposts once?Ray Banana
 | |      |+* Re: betterbird: reading crossposts once?VanguardLH
 | |      ||`* Re: betterbird: reading crossposts once?J.B. Nicholson
 | |      || +- Re: betterbird: reading crossposts once?VanguardLH
 | |      || `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      ||  `- Re: betterbird: reading crossposts once?issdr
 | |      |+* Re: betterbird: reading crossposts once?candycanearter07
 | |      ||`- Re: betterbird: reading crossposts once?VanguardLH
 | |      |`* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | +* Re: betterbird: reading crossposts once?candycanearter07
 | |      | |`* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | | `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | |  `* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | |   `- Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | +* Re: betterbird: reading crossposts once?VanguardLH
 | |      | |+* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | ||`* Re: betterbird: reading crossposts once?VanguardLH
 | |      | || `- Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | |+* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | ||+* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | |||`* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | ||| `* Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | |||  `* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | |||   `- Re: betterbird: reading crossposts once?Frank Slootweg
 | |      | ||`* Re: betterbird: reading crossposts once?candycanearter07
 | |      | || `* Re: betterbird: reading crossposts once?Jakob Bohm
 | |      | ||  `- Re: betterbird: reading crossposts once?candycanearter07
 | |      | |`* Re: betterbird: reading crossposts once?J.B. Nicholson
 | |      | | +* Re: betterbird: reading crossposts once?VanguardLH
 | |      | | |`- Re: betterbird: reading crossposts once?J.B. Nicholson
 | |      | | `- Re: betterbird: reading crossposts once?Matija Nalis
 | |      | `* Re: betterbird: reading crossposts once?Russ Allbery
 | |      |  `- Re: betterbird: reading crossposts once?Frank Slootweg
 | |      `- Re: betterbird: reading crossposts once?Julien ÉLIE
 | `* Re: betterbird: reading crossposts once?Russ Allbery
 |  `- Re: betterbird: reading crossposts once?VanguardLH
 `* Re: betterbird: reading crossposts once?candycanearter07
  `- Re: betterbird: reading crossposts once?VanguardLH

Pages:123
Re: betterbird: reading crossposts once?

<ugj890$20f1$1@cabale.usenet-fr.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1543&group=news.software.readers#1543

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!news.nntp4.net!news.gegeweb.eu!gegeweb.org!usenet-fr.net!.POSTED!not-for-mail
From: om+n...@miakinen.net (Olivier Miakinen)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 13:54:08 +0200
Organization: There's no cabale
Lines: 14
Message-ID: <ugj890$20f1$1@cabale.usenet-fr.net>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net>
NNTP-Posting-Host: 200.89.28.93.rev.sfr.net
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-15
Content-Transfer-Encoding: 8bit
X-Trace: cabale.usenet-fr.net 1697457249 66017 93.28.89.200 (16 Oct 2023 11:54:09 GMT)
X-Complaints-To: abuse@usenet-fr.net
NNTP-Posting-Date: Mon, 16 Oct 2023 11:54:09 +0000 (UTC)
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
Firefox/52.0 SeaMonkey/2.49.4
In-Reply-To: <ugjdnb.ido.1@ID-201911.user.individual.net>
 by: Olivier Miakinen - Mon, 16 Oct 2023 11:54 UTC

Le 16/10/2023 13:27, Frank Slootweg a écrit :
>
> But to be sure:
>
> In the above mentioned context, are you reading both groups from the
> same server? (Or better yet, perhaps you have configured only one server
> in Thunderbird?)

From my experience in dozens of years (from Netscape 4 to SeaMonkey), yes,
it was always about several groups read from a unique server.

--
Olivier Miakinen

Re: betterbird: reading crossposts once?

<8mpm1esqft.fsf@raybanana.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1544&group=news.software.readers#1544

 copy link   Newsgroups: news.software.readers news.software.nntp
Followup: news.software.readers
Path: i2pn2.org!rocksolid2!i2pn.org!paganini.bofh.team!eternal-september.org!news.eternal-september.org!raybanana.eternal-september.org!.POSTED!not-for-mail
From: ray...@raybanana.net (Ray Banana)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Followup-To: news.software.readers
Date: Mon, 16 Oct 2023 14:27:18 +0200
Organization: A noiseless patient spider
Lines: 20
Message-ID: <8mpm1esqft.fsf@raybanana.net>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net>
<ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net>
<ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Info: raybanana.eternal-september.org; posting-host="3919b7d5b9d9c38ce65377f8884f1139";
logging-data="1488179"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/mbfIPcS+9fZVErKhCugMqiIzr9n1/usM="
User-Agent: Plonkenlights
Cancel-Lock: sha1:6LVfLaFLnMVGrbhfCJg//VZmr/Y=
sha1:iryfRR4UYK7T661KwNlN9K5Jm8w=
X-Attribution: Ray Banana
 by: Ray Banana - Mon, 16 Oct 2023 12:27 UTC

Thus spake Frank Slootweg <this@ddress.is.invalid>

> The reason for my question is obvious: Thunderbird should use article
> numbers to mark articles are read in both groups, but (as you are of
> course all too aware of), article numbers are server specific, so
> marking crossposted articles are read across multiple servers is
> (nearly) impossible.

Obviously, I was referring to a setup where all groups are read from the
same server.
It would have never occurred to me that somebody would expect this to
work across multiple servers ;-)

I don't know any newsreader that is able to do that.

--
Пу́тін — хуйло́
http://www.eternal-september.org

Re: betterbird: reading crossposts once?

<1qerpoc749pj3.dlg@v.nguard.lh>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1545&group=news.software.readers#1545

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: V...@nguard.LH (VanguardLH)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 07:56:45 -0500
Organization: Usenet Elder
Lines: 32
Sender: V@nguard.LH
Message-ID: <1qerpoc749pj3.dlg@v.nguard.lh>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Trace: individual.net 2XTISERswvcQKEx1hLLz7AmlHzdUv4Nwo4KOjWan17/VGkHm04
Keywords: VanguardLH,VLH
Cancel-Lock: sha1:joyPTR0pPuP+ESd9giiYYCVwjBU= sha256:4ZPhP+UU4tC9Se/eZ9D/C3zlojIfYXwrD7AVU4LQkR8=
User-Agent: 40tude_Dialog/2.0.15.41
 by: VanguardLH - Mon, 16 Oct 2023 12:56 UTC

Ray Banana <rayban@raybanana.net> wrote:

> Thus spake Frank Slootweg <this@ddress.is.invalid>
>
>
>> The reason for my question is obvious: Thunderbird should use article
>> numbers to mark articles are read in both groups, but (as you are of
>> course all too aware of), article numbers are server specific, so
>> marking crossposted articles are read across multiple servers is
>> (nearly) impossible.
>
> Obviously, I was referring to a setup where all groups are read from the
> same server.
> It would have never occurred to me that somebody would expect this to
> work across multiple servers ;-)
>
> I don't know any newsreader that is able to do that.

If implemented across servers, the MID would have to get used since
that's the same for a message no matter were peered. Article numbers
would be unusable for tracking read-state across servers.

Since Thunderbird switch to SQLite long ago, and record structures would
be modified to add a field for MID, doesn't seem that much an onus to
code for the same MID across the SQLite databases for all folders.
However, that probably would incur a delay between when the Read button
was pressed until the message changed formatting (bold to unbolded).

By using MID, seem plausible the read-state could be reflected for the
same message across newsgroups polled from different servers. Not an
elegant solution, but a possible one. Yet interest seems to have faded
with the Tbird dev folks.

Re: betterbird: reading crossposts once?

<ugjbvd$1dqe9$1@dont-email.me>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1546&group=news.software.readers#1546

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: no...@thanks.net (candycanearter07)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 07:57:17 -0500
Organization: A noiseless patient Spider
Lines: 11
Message-ID: <ugjbvd$1dqe9$1@dont-email.me>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Mon, 16 Oct 2023 12:57:17 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="690180fe64dd413193aebcd80b55fde4";
logging-data="1501641"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/1QlJv5vjjWCGFsxT5pBfyP2OJngWl+o1t9BxFvUhgXA=="
User-Agent: Betterbird (Linux)
Cancel-Lock: sha1:LFkNdpVLKJXzU2EgQ0P9oz+0A0I=
Content-Language: en-US
In-Reply-To: <8mpm1esqft.fsf@raybanana.net>
 by: candycanearter07 - Mon, 16 Oct 2023 12:57 UTC

On 10/16/23 07:27, Ray Banana wrote:
> Obviously, I was referring to a setup where all groups are read from the
> same server.
> It would have never occurred to me that somebody would expect this to
> work across multiple servers ;-)

Why would you? The point of USENET is shared posts across all servers,
right?
--
user <candycane> is generated from /dev/urandom

Re: betterbird: reading crossposts once?

<1pc34ow7hbs97.dlg@v.nguard.lh>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1547&group=news.software.readers#1547

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!paganini.bofh.team!2.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: V...@nguard.LH (VanguardLH)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 08:16:13 -0500
Organization: Usenet Elder
Lines: 14
Sender: V@nguard.LH
Message-ID: <1pc34ow7hbs97.dlg@v.nguard.lh>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjbvd$1dqe9$1@dont-email.me>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Trace: individual.net iQzZUOtvcHMHuqvPYvAbRg1wZksf83/8fYX/e7LMKhHm2lZBcT
Keywords: VanguardLH,VLH
Cancel-Lock: sha1:BPBadQKB6UYS/atfb5FWXFYSRw4= sha256:3uMoonFi30EwihuhCt8q/I8PKBs8G5EF68hDso4p/c8=
User-Agent: 40tude_Dialog/2.0.15.41
 by: VanguardLH - Mon, 16 Oct 2023 13:16 UTC

candycanearter07 <no@thanks.net> wrote:

> Ray Banana wrote:
>
>> Obviously, I was referring to a setup where all groups are read from
>> the same server. It would have never occurred to me that somebody
>> would expect this to work across multiple servers ;-)
>
> Why would you? The point of USENET is shared posts across all servers,
> right?

You're thinking about peering whether articles are cross-posted, or not.
Each server generates its own article numbers. They peer posts. They
don't sync their Overview and Articles databases.

Re: betterbird: reading crossposts once?

<ugjt35.nqo.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1548&group=news.software.readers#1548

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.trigofacile.com!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 16 Oct 2023 15:49:33 GMT
Organization: NOYB
Lines: 26
Message-ID: <ugjt35.nqo.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
X-Trace: individual.net XjQKD6wyvu8Ht/NK1wXWcQBL2roBp9txYrxTnY5xhhwnhZCmh4
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:jwyHLouZO+HiLIAzNqMYdQ2z+mQ= sha256:eu2BE5aGQ0Sp0yq63ACZ3alXmIEoYaJdmc8tU8yQNsg=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Mon, 16 Oct 2023 15:49 UTC

Ray Banana <rayban@raybanana.net> wrote:
> Thus spake Frank Slootweg <this@ddress.is.invalid>
>
>
>
> > The reason for my question is obvious: Thunderbird should use article
> > numbers to mark articles are read in both groups, but (as you are of
> > course all too aware of), article numbers are server specific, so
> > marking crossposted articles are read across multiple servers is
> > (nearly) impossible.
>
> Obviously, I was referring to a setup where all groups are read from the
> same server.
> It would have never occurred to me that somebody would expect this to
> work across multiple servers ;-)

Well, one of the respondents in this thread talked about a multiple
server scenario, so I wanted to be sure that Julien (and you and others)
were talking single server.

> I don't know any newsreader that is able to do that.

Neither do I, but it's just SMOP (Small Matter Of Programming). All
you have to do is to remember all the hundred of thousands / millions of
message-ids of the postings you've ever 'read'. How hard can *that* be!?
:-)

Re: betterbird: reading crossposts once?

<ugjmsc$1fjvk$2@dont-email.me>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1549&group=news.software.readers#1549

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: no...@thanks.net (candycanearter07)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 11:03:24 -0500
Organization: A noiseless patient Spider
Lines: 12
Message-ID: <ugjmsc$1fjvk$2@dont-email.me>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
<ugjt35.nqo.1@ID-201911.user.individual.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Mon, 16 Oct 2023 16:03:24 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="51a6b86aa07ca618e2b8e15dcedea538";
logging-data="1560564"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+y5rYqsWXDl6+3DUmduHniTdYaqho5YDNj+dV6m3rEdw=="
User-Agent: Betterbird (Linux)
Cancel-Lock: sha1:+VTcOyT2lg9tyT6ViDUTJvwWpww=
In-Reply-To: <ugjt35.nqo.1@ID-201911.user.individual.net>
Content-Language: en-US
 by: candycanearter07 - Mon, 16 Oct 2023 16:03 UTC

On 10/16/23 10:49, Frank Slootweg wrote:
> Neither do I, but it's just SMOP (Small Matter Of Programming). All
> you have to do is to remember all the hundred of thousands / millions of
> message-ids of the postings you've ever 'read'. How hard can *that* be!?
> :-)

You could just scan for matching ids when you read an article. Or, maybe
you could limit it to the messages read in the last x days, to cut down
on processing time.
--
user <candycane> is generated from /dev/urandom

Re: betterbird: reading crossposts once?

<PYicnd_php9R_7D4nZ2dnZeNn_Vi4p2d@giganews.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1550&group=news.software.readers#1550

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!usenet.blueworldhosting.com!diablo1.usenet.blueworldhosting.com!feeder.usenetexpress.com!tr3.iad1.usenetexpress.com!69.80.99.27.MISMATCH!Xl.tags.giganews.com!local-2.nntp.ord.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date: Mon, 16 Oct 2023 16:20:28 +0000
Subject: Re: betterbird: reading crossposts once?
Newsgroups: news.software.readers,news.software.nntp
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <ugjmsc$1fjvk$2@dont-email.me>
From: jb-use...@wisemo.com.invalid (Jakob Bohm)
Organization: WiseMo A/S
Date: Mon, 16 Oct 2023 18:21:12 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:6.2) Goanna/20230604 Epyrus/2.0.2
MIME-Version: 1.0
In-Reply-To: <ugjmsc$1fjvk$2@dont-email.me>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Message-ID: <PYicnd_php9R_7D4nZ2dnZeNn_Vi4p2d@giganews.com>
Lines: 29
X-Usenet-Provider: http://www.giganews.com
X-Trace: sv3-YPkY2Axxb5L4AegiK17z1cEX3G34raRy46t2NEW7r0B06n2WKLh4i1mjvFftOvcHCRHQSbblEXptBll!ZZfEA/3L8zxQdIhvPpl3KM236zIBShvVR3v3+fM6fWCxFIkYj1uk0WIAxGC3/829v1WqzlQLXFc=
X-Complaints-To: abuse@giganews.com
X-DMCA-Notifications: http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40
 by: Jakob Bohm - Mon, 16 Oct 2023 16:21 UTC

On 2023-10-16 18:03, candycanearter07 wrote:
> On 10/16/23 10:49, Frank Slootweg wrote:
>>    Neither do I, but it's just SMOP (Small Matter Of Programming). All
>> you have to do is to remember all the hundred of thousands / millions of
>> message-ids of the postings you've ever 'read'. How hard can *that* be!?
>> :-)
>
> You could just scan for matching ids when you read an article. Or, maybe
> you could limit it to the messages read in the last x days, to cut down
> on processing time.

A more practical optimization is to only retain a database of MIDs of
messages that are marked "read" in actively kept message storage. Thus
when a read message is "aged out" of storage, its "read" status is aged
out too. To avoid old messages transiting in and out of view, keep a
count of how many copies are marked read for each MID and count that
down as messages age out. Once in a while, rebuild database from the
stored messages and their "read" status, then do a second pass to mark
duplicates of read messages as read. Bonus: Also index the body
contents hash to catch identical multi-posting.

Enjoy

Jakob
--
Jakob Bohm, CIO, Partner, WiseMo A/S. https://www.wisemo.com
Transformervej 29, 2860 Søborg, Denmark. Direct +45 31 13 16 10
This public discussion message is non-binding and may contain errors.
WiseMo - Remote Service Management for PCs, Phones and Embedded

Re: betterbird: reading crossposts once?

<ugk2rn.pb0.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1551&group=news.software.readers#1551

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 16 Oct 2023 17:27:56 GMT
Organization: NOYB
Lines: 42
Message-ID: <ugk2rn.pb0.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <ugjmsc$1fjvk$2@dont-email.me> <PYicnd_php9R_7D4nZ2dnZeNn_Vi4p2d@giganews.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Trace: individual.net U96u907VUHrdH3pnxSYIkw5cj5CM2CT66k7Zb9G0USsSAfIMHf
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:Iurn/N2Hp4Tt/s6TVhAfPiuvOAY= sha256:BVwqrQ+ZNEF9Nxnwn3bRczuwd3uEKQ0b9SGiLQCj0rA=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Mon, 16 Oct 2023 17:27 UTC

Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
> On 2023-10-16 18:03, candycanearter07 wrote:
> > On 10/16/23 10:49, Frank Slootweg wrote:
> >>    Neither do I, but it's just SMOP (Small Matter Of Programming). All
> >> you have to do is to remember all the hundred of thousands / millions of
> >> message-ids of the postings you've ever 'read'. How hard can *that* be!?
> >> :-)
> >
> > You could just scan for matching ids when you read an article. Or, maybe
> > you could limit it to the messages read in the last x days, to cut down
> > on processing time.
>
> A more practical optimization is to only retain a database of MIDs of
> messages that are marked "read" in actively kept message storage. Thus
> when a read message is "aged out" of storage, its "read" status is aged
> out too. To avoid old messages transiting in and out of view, keep a
> count of how many copies are marked read for each MID and count that
> down as messages age out. Once in a while, rebuild database from the
> stored messages and their "read" status, then do a second pass to mark
> duplicates of read messages as read. Bonus: Also index the body
> contents hash to catch identical multi-posting.

I said "hundred of thousands / millions of message-ids" for a reason.

I have well over a million articles in my "message storage". Keeping
that a amount of messages-ids is already not practical, but *scanning*
(for read/not_read status) them for each an every new (and old) article
is impossible.

But even if you don't keep (that) many articles in your message store,
when you add a new newsserver which has a long retention time, you *do*
have to scan all those articles, just in case there's one which you have
already marked as read.

That's why newsservers and newsreaders use article numbers instead of
message-ids. It makes things much more simple (actually possible instead
of impossible). But yes, it works only for a specific server, not
accross servers and when adding a new group or/and new server you should
only fetch the latest N articles (which is very simple using article
numbers).

Bottom line: Using article numbers is done for a very good reason.

Re: betterbird: reading crossposts once?

<ugk0sb$cebb$1@news.trigofacile.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1552&group=news.software.readers#1552

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!news.trigofacile.com!.POSTED.san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr!not-for-mail
From: iul...@nom-de-mon-site.com.invalid (Julien ÉLIE)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 20:54:03 +0200
Organization: Groupes francophones par TrigoFACILE
Message-ID: <ugk0sb$cebb$1@news.trigofacile.com>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Mon, 16 Oct 2023 18:54:03 -0000 (UTC)
Injection-Info: news.trigofacile.com; posting-account="julien"; posting-host="san13-h02-176-143-2-105.dsl.sta.abo.bbox.fr:176.143.2.105";
logging-data="407915"; mail-complaints-to="abuse@trigofacile.com"
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:DvWHxFZOQ4P2qLRp1IyLhI/iL8I= sha256:6OJ+/fBrJ2aOfxOXFypxogQ/yor1Pk/4p4T55WILvIw=
sha1:U8VepnAC5eZW1HkeZWAyrd6vJDE= sha256:2nmP+gvSwBfZ+14GYXBecs9S0SKttjLUW6MXg5LxoLA=
In-Reply-To: <ugjdnb.ido.1@ID-201911.user.individual.net>
 by: Julien ÉLIE - Mon, 16 Oct 2023 18:54 UTC

Hi Frank,

>> As a user of Thunderbird, and reading both news.software.readers and
>> news.software.nntp, I confirm that when I read (and mark as so) an
>> article in this thread either in news.software.readers or
>> news.software.nntp first, it still shows up unread in the other newsgroup.
>> I'm using the latest version of Thunderbird (115.3.2), and this bug was
>> present in previous versions too.
>
> In the above mentioned context, are you reading both groups from the
> same server?

Yes.

> (Or better yet, perhaps you have configured only one server in Thunderbird?)

I have configured several servers, but the test case was on the same
server (and newsrc file).

--
Julien ÉLIE

« La vie n'est qu'un tissu de coups de poignard qu'il faut savoir boire
goutte à goutte. »

Re: betterbird: reading crossposts once?

<DR2cna8-c45fBbD4nZ2dnZeNn_Vi4p2d@giganews.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1553&group=news.software.readers#1553

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder6.news.weretis.net!border-2.nntp.ord.giganews.com!nntp.giganews.com!Xl.tags.giganews.com!local-1.nntp.ord.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date: Mon, 16 Oct 2023 20:10:42 +0000
Subject: Re: betterbird: reading crossposts once?
Newsgroups: news.software.readers,news.software.nntp
References: <uftnus$2voq4$1@dont-email.me> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
<ugjt35.nqo.1@ID-201911.user.individual.net> <ugjmsc$1fjvk$2@dont-email.me>
<PYicnd_php9R_7D4nZ2dnZeNn_Vi4p2d@giganews.com>
<ugk2rn.pb0.1@ID-201911.user.individual.net>
From: jb-use...@wisemo.com.invalid (Jakob Bohm)
Organization: WiseMo A/S
Date: Mon, 16 Oct 2023 22:11:26 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:6.2) Goanna/20230604
Epyrus/2.0.2
MIME-Version: 1.0
In-Reply-To: <ugk2rn.pb0.1@ID-201911.user.individual.net>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Message-ID: <DR2cna8-c45fBbD4nZ2dnZeNn_Vi4p2d@giganews.com>
Lines: 69
X-Usenet-Provider: http://www.giganews.com
X-Trace: sv3-oQh212Qzl+eg+s+CZvUmXj9CKMhH/KxzByCB7mUt9Y4mKMkdgUP8z/fwOEuVanuWKiF8x+RRWIwOAtZ!Axd4NLyYElZeqyBGawZtZCmvPP7oSgM690+URfc3GD8/RMCK6tdNQwSmyiB8Rrk7oeyhMUTVrBY=
X-Complaints-To: abuse@giganews.com
X-DMCA-Notifications: http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40
 by: Jakob Bohm - Mon, 16 Oct 2023 20:11 UTC

On 2023-10-16 19:27, Frank Slootweg wrote:
> Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
>> On 2023-10-16 18:03, candycanearter07 wrote:
>>> On 10/16/23 10:49, Frank Slootweg wrote:
>>>>    Neither do I, but it's just SMOP (Small Matter Of Programming). All
>>>> you have to do is to remember all the hundred of thousands / millions of
>>>> message-ids of the postings you've ever 'read'. How hard can *that* be!?
>>>> :-)
>>>
>>> You could just scan for matching ids when you read an article. Or, maybe
>>> you could limit it to the messages read in the last x days, to cut down
>>> on processing time.
>>
>> A more practical optimization is to only retain a database of MIDs of
>> messages that are marked "read" in actively kept message storage. Thus
>> when a read message is "aged out" of storage, its "read" status is aged
>> out too. To avoid old messages transiting in and out of view, keep a
>> count of how many copies are marked read for each MID and count that
>> down as messages age out. Once in a while, rebuild database from the
>> stored messages and their "read" status, then do a second pass to mark
>> duplicates of read messages as read. Bonus: Also index the body
>> contents hash to catch identical multi-posting.
>
> I said "hundred of thousands / millions of message-ids" for a reason.
>
> I have well over a million articles in my "message storage". Keeping
> that a amount of messages-ids is already not practical, but *scanning*
> (for read/not_read status) them for each an every new (and old) article
> is impossible.
>
> But even if you don't keep (that) many articles in your message store,
> when you add a new newsserver which has a long retention time, you *do*
> have to scan all those articles, just in case there's one which you have
> already marked as read.
>
> That's why newsservers and newsreaders use article numbers instead of
> message-ids. It makes things much more simple (actually possible instead
> of impossible). But yes, it works only for a specific server, not
> accross servers and when adding a new group or/and new server you should
> only fetch the latest N articles (which is very simple using article
> numbers).
>
> Bottom line: Using article numbers is done for a very good reason.
>

You don't understand what I wrote. Idea would be to use some kind of
available (search optimized) database engine to store the values,
updated incrementally as messages enter and leave the storage or are
marked read. Scanning all messages would be a "once in a while"
database repair in case the database gets out of sync with the message
storage and be done using O(n*log(n)) code.

Database lookups would happen during the initial import of messages (to
see if a newly arrived message was marked read by an earlier user access
to a duplicate) and when displaying a message or its header on screen
(to see if it a duplicate was marked read since its arrival).

Thus common operations change from complexity O(n*n) to O(delta*log(n))
given typically assumed lookup costs in indexed databases.

Enjoy

Jakob
--
Jakob Bohm, CIO, Partner, WiseMo A/S. https://www.wisemo.com
Transformervej 29, 2860 Søborg, Denmark. Direct +45 31 13 16 10
This public discussion message is non-binding and may contain errors.
WiseMo - Remote Service Management for PCs, Phones and Embedded

Re: betterbird: reading crossposts once?

<slrnuirha7.2kgi.jbn@forestfield.org>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1554&group=news.software.readers#1554

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!reader5.news.weretis.net!news.solani.org!.POSTED!not-for-mail
From: jbn...@forestfield.org (J.B. Nicholson)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 23:20:39 -0000 (UTC)
Message-ID: <slrnuirha7.2kgi.jbn@forestfield.org>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
<1qerpoc749pj3.dlg@v.nguard.lh>
Injection-Date: Mon, 16 Oct 2023 23:20:39 -0000 (UTC)
Injection-Info: solani.org;
logging-data="367971"; mail-complaints-to="abuse@news.solani.org"
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:9XzihqX9Z1uVHzGO6q6B5ZEuSvQ=
X-User-ID: eJwNysEBwCAIA8CVQJNAx1EK+4/Q3vu45aqAKHA4dW/itZzmegQzVCOoWn/ycDVPWUJ2Ijb8AxWVED4=
 by: J.B. Nicholson - Mon, 16 Oct 2023 23:20 UTC

VanguardLH <V@nguard.LH> wrote:
> Since Thunderbird switch to SQLite long ago, and record structures
> would be modified to add a field for MID, doesn't seem that much an
> onus to code for the same MID across the SQLite databases for all
> folders. However, that probably would incur a delay between when
> the Read button was pressed until the message changed formatting
> (bold to unbolded).

Why not do that job in a background task/thread?

> By using MID, seem plausible the read-state could be reflected for
> the same message across newsgroups polled from different servers.
> Not an elegant solution, but a possible one. Yet interest seems to
> have faded with the Tbird dev folks.

Why would that be inelegant? It seems to me that using the only
approach one could use to implement a nice feature ought to qualify as
elegant. I'd appreciate marking the same articles as read (and
updating all dependencies including unread article counts, newsrcs,
and saved searches) across one's news servers so I don't have to waste
time re-marking stuff read multiple times.

Re: betterbird: reading crossposts once?

<eakbt2ptwt44$.dlg@v.nguard.lh>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1555&group=news.software.readers#1555

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: V...@nguard.LH (VanguardLH)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 22:10:28 -0500
Organization: Usenet Elder
Lines: 54
Sender: V@nguard.LH
Message-ID: <eakbt2ptwt44$.dlg@v.nguard.lh>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <1qerpoc749pj3.dlg@v.nguard.lh> <slrnuirha7.2kgi.jbn@forestfield.org>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Trace: individual.net G8602T2oZGPs4DkDhCbg+A5U8beiuWcZgYVxBcqjJ0tKkCmvth
Keywords: VanguardLH,VLH
Cancel-Lock: sha1:S9si24pyb4Xsmj+CbS8Ni96ROSI= sha256:5WNryVcucNmIr07wBYtfxWf32lPSN+oGL9JXttmrDYI=
User-Agent: 40tude_Dialog/2.0.15.41
 by: VanguardLH - Tue, 17 Oct 2023 03:10 UTC

"J.B. Nicholson" <jbn@forestfield.org> wrote:

> VanguardLH <V@nguard.LH> wrote:
>
>> Since Thunderbird switch to SQLite long ago, and record structures
>> would be modified to add a field for MID, doesn't seem that much an
>> onus to code for the same MID across the SQLite databases for all
>> folders. However, that probably would incur a delay between when
>> the Read button was pressed until the message changed formatting
>> (bold to unbolded).
>
> Why not do that job in a background task/thread?

"Mark as read" doesn't happen until the user views a message. No way to
know beforehand which articles a user will view.

>> By using MID, seem plausible the read-state could be reflected for
>> the same message across newsgroups polled from different servers.
>> Not an elegant solution, but a possible one. Yet interest seems to
>> have faded with the Tbird dev folks.
>
> Why would that be inelegant? It seems to me that using the only
> approach one could use to implement a nice feature ought to qualify as
> elegant.

The performance impact when "mark as read" to then issue a query on all
other folder databases (newsgroups) would cause a momentary hang in the
program along with flickering of the folders due to changing the New or
Pending count shown in the tree pane.

There isn't one local message store in Thunderbird. It keeps an SQLite
database for each folder (newsgroup). The moment you read an article,
or otherwise marked it as read, that read-state would have to sync
across as many SQLite databases as there are folders in the tree (to
however many newsgroups to which you subscribed).

Another method would be to not sync the SQLite databases when a user
read an article or marked it as read. Instead update the SQLite
database for a folder when the user clicked on a folder. However, that
means all the other SQLite database must be queried to see if the same
article in the other folders were marked as read.

Or, when an article is read that has the Xref header with more than one
article number, update a global SQLite database to track the
cross-posted articles. Rather than a text .rc file, an SQLite database
gets used to record all the cross-postings since SQL searches are faster
than parsing a text file. When a folder is selected (opened), each
article retrieved would be checked if it were cross-posted. However,
that only identifies cross-posted articles, not if they have been read,
so you'd still have to do multiple folder SQLite queries to bring the
read state into a message for the selected folder.

Xref just identifies which article numbers are cross-posted, not their
read state.

Re: betterbird: reading crossposts once?

<1jc7gql3n1783.dlg@v.nguard.lh>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1556&group=news.software.readers#1556

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: V...@nguard.LH (VanguardLH)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Mon, 16 Oct 2023 22:34:41 -0500
Organization: Usenet Elder
Lines: 64
Sender: V@nguard.LH
Message-ID: <1jc7gql3n1783.dlg@v.nguard.lh>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Trace: individual.net By1qB57F1NEBqk5Eoywn3giF4tHt/rqv+rgdjcs4ohfhS9IE3J
Keywords: VanguardLH,VLH
Cancel-Lock: sha1:EjkylhuUgJZFgeN7WdmV/tRS6Hs= sha256:SvL4agZu52HlICrUVUoYWuqeyOucXRyeWsAuCCGpY1Q=
User-Agent: 40tude_Dialog/2.0.15.41
 by: VanguardLH - Tue, 17 Oct 2023 03:34 UTC

Frank Slootweg <this@ddress.is.invalid> wrote:

> All you have to do is to remember all the hundred of thousands /
> millions of message-ids of the postings you've ever 'read'. How hard
> can *that* be!?

Thunderbird uses SQLite for the messages databases, one for each folder
(newsgroup). While SQLite is fast for small database sizes, it doesn't
scale well. The bigger the database, the slow queries get, and the
slowdown is not linear. SQLite recommends once you pass into the
terabyte range to find a different solution.

https://www.dbtalks.com/tutorials/learn-sqlite/what-are-the-limitations-of-sqlite
A SQLite database can have maximum 2147483646 pages. Hence the maximum
number of tables in a schema cannot reach more than 2147483646. The
maximum number of rows in a table is 264. The maximum number of columns
is 32767 in a table.

Notice only 264 rows per table. You end up managing thousands of tables
to retain millions of records. Been way too long since I did any work
with SQL, but I thought queries were per table. You'd need a macro that
walked through all the tables to do a query across them all. Maybe for
the table spec you could use a wildcard, like *, to have the query
process across all tables.

Many clients also have an option to either flag or delete articles over
a threshold in age. I have my client purge posts older than 60 days.
Older than that, and the discussion becomes stale. For the expiration,
each table in a database, and for each database (folder/newsgroup),
you'd have to issue a purge and compact.

Overall an SQLite database can hold 140 TB. Is that really big enough?
Consider these are message databases, so it's the entire message that
gets stored, and that includes very long messages that have gads of
quoted content because lots of posters never trim. It would require
even more space to store binaries. There are 20K+ newsgroups, and tons
of messages in each. To be reasonable, some cutoff in expiration would
be needed, but that could result in undoing the read-state tracking, so
the same article in different newsgroups across servers could get out of
sync.

Plus you're talking about caching locally the entire Usenet that a
provider has. It would only be for the newsgroups to which you
subscribe, but some users subscribe to a lot a newsgroups. I was up to
52 at one time, and am now down to 26. Depending on how many newsgroups
to which you subscribe, you could end up having a storage media
requirement equivalent to the Usenet providers. How much free disk
space do you have?

There are some users that run proxy servers for personal use, like using
Hamster to leech from a Usenet provider. That lets them have everything
the Usenet provider has. A lot of work. Very few users operate their
own server.

Hard enough to implement read-state tracking on one server. Massively
more difficult to do across multiple servers. And we're talking about
NNTP clients that could be running on underpowered computers.

I've notice my NNTP client will slow down when its message store gets
large. Right now it's about 700 MB, but it will grow. That's one
reason to have a purge of 60-day old messages to keep quick the
responsiveness of my client. That also means threads that have articles
older than 60 days and articles younger than 60 days end up getting
truncated, so I see a partial thread remaining.

Re: betterbird: reading crossposts once?

<ugm5ik.dug.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1557&group=news.software.readers#1557

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 17 Oct 2023 12:26:36 GMT
Organization: NOYB
Lines: 77
Message-ID: <ugm5ik.dug.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <ugjmsc$1fjvk$2@dont-email.me> <PYicnd_php9R_7D4nZ2dnZeNn_Vi4p2d@giganews.com> <ugk2rn.pb0.1@ID-201911.user.individual.net> <DR2cna8-c45fBbD4nZ2dnZeNn_Vi4p2d@giganews.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Trace: individual.net SF7IEBslaMxbczRaGwUUCAs99ULvi1QOLjiY05rjzbvO7rflfK
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:NaeQHRfEJOhd9CQ76Lo1+2izx+Q= sha256:oePzSURs3GZ4fEKsLUL9c/GNLI/mBq2rbmvLfGlwOLA=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Tue, 17 Oct 2023 12:26 UTC

Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
> On 2023-10-16 19:27, Frank Slootweg wrote:
> > Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
> >> On 2023-10-16 18:03, candycanearter07 wrote:
> >>> On 10/16/23 10:49, Frank Slootweg wrote:
> >>>>    Neither do I, but it's just SMOP (Small Matter Of Programming). All
> >>>> you have to do is to remember all the hundred of thousands / millions of
> >>>> message-ids of the postings you've ever 'read'. How hard can *that* be!?
> >>>> :-)
> >>>
> >>> You could just scan for matching ids when you read an article. Or, maybe
> >>> you could limit it to the messages read in the last x days, to cut down
> >>> on processing time.
> >>
> >> A more practical optimization is to only retain a database of MIDs of
> >> messages that are marked "read" in actively kept message storage. Thus
> >> when a read message is "aged out" of storage, its "read" status is aged
> >> out too. To avoid old messages transiting in and out of view, keep a
> >> count of how many copies are marked read for each MID and count that
> >> down as messages age out. Once in a while, rebuild database from the
> >> stored messages and their "read" status, then do a second pass to mark
> >> duplicates of read messages as read. Bonus: Also index the body
> >> contents hash to catch identical multi-posting.
> >
> > I said "hundred of thousands / millions of message-ids" for a reason.
> >
> > I have well over a million articles in my "message storage". Keeping
> > that a amount of messages-ids is already not practical, but *scanning*
> > (for read/not_read status) them for each an every new (and old) article
> > is impossible.
> >
> > But even if you don't keep (that) many articles in your message store,
> > when you add a new newsserver which has a long retention time, you *do*
> > have to scan all those articles, just in case there's one which you have
> > already marked as read.
> >
> > That's why newsservers and newsreaders use article numbers instead of
> > message-ids. It makes things much more simple (actually possible instead
> > of impossible). But yes, it works only for a specific server, not
> > accross servers and when adding a new group or/and new server you should
> > only fetch the latest N articles (which is very simple using article
> > numbers).
> >
> > Bottom line: Using article numbers is done for a very good reason.
> >
>
> You don't understand what I wrote. Idea would be to use some kind of
> available (search optimized) database engine to store the values,
> updated incrementally as messages enter and leave the storage or are
> marked read. Scanning all messages would be a "once in a while"
> database repair in case the database gets out of sync with the message
> storage and be done using O(n*log(n)) code.
>
> Database lookups would happen during the initial import of messages (to
> see if a newly arrived message was marked read by an earlier user access
> to a duplicate) and when displaying a message or its header on screen
> (to see if it a duplicate was marked read since its arrival).
>
> Thus common operations change from complexity O(n*n) to O(delta*log(n))
> given typically assumed lookup costs in indexed databases.

I understood perfectly what you wrote, but you proposed solution does
not cover the scenarios I described, especially - but not only - the
scenario of adding a new newsserver which has a long retention time.

So I'm afraid "You don't understand what I wrote."

Yes, you can work around that with hacks like not loading old
articles, but that will require use of article numbers instead of
message-ids, so you might as well use article numbers from the start.

Anyway, *if* this issue is a real problem - i.e. not just a minor
inconvience in some corner cases - for some people, they can try to
switch to a newsreader which does aggregrate articles from several
servers (i.e. something which Thunderbird (and Betterbird?) does not do)
or add a 'proxy' which does the aggregration (like Hamster, which I
use).

Re: betterbird: reading crossposts once?

<ugm98p.mks.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1558&group=news.software.readers#1558

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 17 Oct 2023 13:29:38 GMT
Organization: NOYB
Lines: 35
Message-ID: <ugm98p.mks.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh>
X-Trace: individual.net b0Hg/7UaIpgOCeixBBiyBA1+d6jcheiquScvf0e8ZUi+aJ/OFs
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:5TnCt9jrWqRtDA2P0VB82i67jwo= sha256:kGclPXz0gUFSPTtGTKrEoNxONwXRhQszfm91fNIkHYc=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Tue, 17 Oct 2023 13:29 UTC

VanguardLH <V@nguard.lh> wrote:
> Frank Slootweg <this@ddress.is.invalid> wrote:
>
> > All you have to do is to remember all the hundred of thousands /
> > millions of message-ids of the postings you've ever 'read'. How hard
> > can *that* be!?

Sigh!

You post-edited my post by snipping the start and end of my paragraph
and reformatting the rest. By doing that, you've turned my blatantly
obvious joke into something serious. Why?

[...]

> There are some users that run proxy servers for personal use, like using
> Hamster to leech from a Usenet provider. [...]

Actually, Hamster is a solution to this 'problem'.

> Hard enough to implement read-state tracking on one server. Massively
> more difficult to do across multiple servers. And we're talking about
> NNTP clients that could be running on underpowered computers.

Read-state tracking for (not on) one server is trivial. Every
newsreader does it (via article-number range tracking in .newsrc type
files). That Thunderbird et al mess it up, doesn't change that.

Read-state tracking for multiple servers can be done by aggregrating
articles from several servers. I've seen people imply that some
newsreaders can do that, but I have no details (Any takers?). And, as I
said above, Hamster can do this as well. Perhaps Leafnode can do the
same on Linux (the OP uses Linux).

[...]

Re: betterbird: reading crossposts once?

<ugmga1.7es.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1559&group=news.software.readers#1559

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: 17 Oct 2023 15:29:48 GMT
Organization: NOYB
Lines: 13
Message-ID: <ugmga1.7es.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <1qerpoc749pj3.dlg@v.nguard.lh> <slrnuirha7.2kgi.jbn@forestfield.org>
X-Trace: individual.net MV/86Wp5gYk8wqagT0We5Q9Nz17S9QkSOv5Qs+H4oPKzAXq96n
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:MnozJjUTe329C9LLf1HK5X2Oeck= sha256:uO2SIwdYoStjoucQVq29egvrT32pMtq1U3XkXGwH+DM=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Tue, 17 Oct 2023 15:29 UTC

J.B. Nicholson <jbn@forestfield.org> wrote:
[...]

> I'd appreciate marking the same articles as read (and
> updating all dependencies including unread article counts, newsrcs,
> and saved searches) across one's news servers so I don't have to waste
> time re-marking stuff read multiple times.

As I mentioned in another response, Hamster can aggregrate articles
from several news servers and solves this problem. I see that you're
using slrn on Linux, so you can not (easily) use Hamster (which is a
Windows program). But you might want to look if Leafnode can do the same
on Linux.

Re: betterbird: reading crossposts once?

<87r0lt44x0.fsf@ID-313311.news.uni-berlin.de>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1560&group=news.software.readers#1560

 copy link   Newsgroups: news.software.readers
Path: i2pn2.org!i2pn.org!usenet.goja.nl.eu.org!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: p_u_n_k_...@yahoo.it (issdr)
Newsgroups: news.software.readers
Subject: Re: betterbird: reading crossposts once?
Date: Tue, 17 Oct 2023 17:58:19 +0200
Lines: 9
Message-ID: <87r0lt44x0.fsf@ID-313311.news.uni-berlin.de>
References: <uftnus$2voq4$1@dont-email.me> <87y1g5yxux.fsf@hope.eyrie.org>
<w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net>
<ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net>
<ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net>
<8mpm1esqft.fsf@raybanana.net> <1qerpoc749pj3.dlg@v.nguard.lh>
<slrnuirha7.2kgi.jbn@forestfield.org>
<ugmga1.7es.1@ID-201911.user.individual.net>
Mime-Version: 1.0
Content-Type: text/plain
X-Trace: individual.net +uijBpSKTmlU/JgQjgrxywQap7GiV+mkZvzpQEFMuia012NgQ/
X-Orig-Path: ID-313311.news.uni-berlin.de!not-for-mail
Cancel-Lock: sha1:OHFCFSTwnnQHdej10nl9HDODjQA= sha256:QiVwbd2bKaq6rSAFz/XJcHHc3SFV9WJfrYuOnard8NA=
User-Agent: Gnus/5.13 Emacs/30.0.50 (gnu/linux)
X-Face: Zw,R[}.rn5!7_4>.U1j!zNkszle\GP]4G+xPe`%F=i$PMP)8W/c57#P6B_TFI@1-LR6?a9
T@A$^Vh,|cG:_4p59{<cR\^_^r9<1Iq/8?4,7|-PhJpEyE/v42omF=F]M<p?9+;~(nPqwCCm*IaHu
N4S.pGVU=E!6R=0!PVz1`vb&zc`.X<jw
 by: issdr - Tue, 17 Oct 2023 15:58 UTC

Frank Slootweg wrote:

> As I mentioned in another response, Hamster can aggregrate articles
> from several news servers and solves this problem. I see that you're
> using slrn on Linux, so you can not (easily) use Hamster (which is a
> Windows program). But you might want to look if Leafnode can do the same
> on Linux.

better leafnode2. yes, it does.

Re: betterbird: reading crossposts once?

<tcb5m082w0r7$.dlg@v.nguard.lh>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1562&group=news.software.readers#1562

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: V...@nguard.LH (VanguardLH)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Tue, 17 Oct 2023 15:26:05 -0500
Organization: Usenet Elder
Lines: 12
Sender: V@nguard.LH
Message-ID: <tcb5m082w0r7$.dlg@v.nguard.lh>
References: <uftnus$2voq4$1@dont-email.me> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh> <ugm98p.mks.1@ID-201911.user.individual.net>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Trace: individual.net MASmNKHOYv6V86m4yUrMtwvUX8RZr6+FOxOvVAlGQKwfNY/fac
Keywords: VanguardLH,VLH
Cancel-Lock: sha1:9RYn3s9rJ4dbefwwZ8SZ4BtrL4U= sha256:+u0wBi2EPZgOKlk10PEhFuUGCyc5c1svq8x6qu8kh0U=
User-Agent: 40tude_Dialog/2.0.15.41
 by: VanguardLH - Tue, 17 Oct 2023 20:26 UTC

Frank Slootweg <this@ddress.is.invalid> wrote:

> Read-state tracking for multiple servers can be done by aggregrating
> articles from several servers. I've seen people imply that some
> newsreaders can do that, but I have no details (Any takers?). And, as I
> said above, Hamster can do this as well. Perhaps Leafnode can do the
> same on Linux (the OP uses Linux).

At that point as a cross-server aggregator, using something like Hamster
might suffice. It would collect articles across multiple servers, but
does Hamster then assign its own article numbers (so it could add the
Xref header with its article numbers)?

Re: betterbird: reading crossposts once?

<ugof5h.om8.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1563&group=news.software.readers#1563

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!news.niel.me!news.gegeweb.eu!gegeweb.org!news.trigofacile.com!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 18 Oct 2023 09:22:37 GMT
Organization: NOYB
Lines: 22
Message-ID: <ugof5h.om8.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh> <ugm98p.mks.1@ID-201911.user.individual.net> <tcb5m082w0r7$.dlg@v.nguard.lh>
X-Trace: individual.net YJcaXPlzX8PcZ4y+6HIeagcw2JykExoR/BJwIu9kYJuLuEPa8D
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:UrOftcIhdc2Zkss+nhyupIWK8vA= sha256:dYwjzQI25zUz9avGa9Ql3hg0a1K4387k8R4fgfT15xc=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Wed, 18 Oct 2023 09:22 UTC

VanguardLH <V@nguard.lh> wrote:
> Frank Slootweg <this@ddress.is.invalid> wrote:
>
> > Read-state tracking for multiple servers can be done by aggregrating
> > articles from several servers. I've seen people imply that some
> > newsreaders can do that, but I have no details (Any takers?). And, as I
> > said above, Hamster can do this as well. Perhaps Leafnode can do the
> > same on Linux (the OP uses Linux).
>
> At that point as a cross-server aggregator, using something like Hamster
> might suffice. It would collect articles across multiple servers, but
> does Hamster then assign its own article numbers (so it could add the
> Xref header with its article numbers)?

Yes, for the user/newsreader side, Hamster works like a news server,
so it indeed assigns its own local article numbers and reports them in a
Xref header (the old Xref header is retained, but renamed to
'X-Old-Xref:').

For the 'real' news server - i.e. News.Individual.Net in my case -,
Hamster works like a newsreader, i.e. it uses NNTP command like
LISTGROUP, XOVER, ARTICLE, etc.. So Hamster is a kind of proxy server.

Re: betterbird: reading crossposts once?

<XA2dnYXpbLiVhq34nZ2dnZeNn_Vi4p2d@giganews.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1564&group=news.software.readers#1564

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder6.news.weretis.net!border-2.nntp.ord.giganews.com!nntp.giganews.com!Xl.tags.giganews.com!local-1.nntp.ord.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date: Wed, 18 Oct 2023 17:51:04 +0000
Subject: Re: betterbird: reading crossposts once?
Newsgroups: news.software.readers,news.software.nntp
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
<ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh>
From: jb-use...@wisemo.com.invalid (Jakob Bohm)
Organization: WiseMo A/S
Date: Wed, 18 Oct 2023 19:51:52 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:6.2) Goanna/20230604
Epyrus/2.0.2
MIME-Version: 1.0
In-Reply-To: <1jc7gql3n1783.dlg@v.nguard.lh>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Message-ID: <XA2dnYXpbLiVhq34nZ2dnZeNn_Vi4p2d@giganews.com>
Lines: 47
X-Usenet-Provider: http://www.giganews.com
X-Trace: sv3-WwoUtrbm9OEJvVFOoQsOUdwEkZj3Q35vIQ8BOpnC7+0UkIB8eWpymlPeToALmp+mBpm6+4xFLL0nlxY!7veuZY81kRB6UCYA0QVKTCGNDJEicKo1L+LpW36LpfOs+tE6y+gR9BBhbm00vr9ABbuIKZ47XiA=
X-Complaints-To: abuse@giganews.com
X-DMCA-Notifications: http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40
 by: Jakob Bohm - Wed, 18 Oct 2023 17:51 UTC

On 2023-10-17 05:34, VanguardLH wrote:
> Frank Slootweg <this@ddress.is.invalid> wrote:
>
>> All you have to do is to remember all the hundred of thousands /
>> millions of message-ids of the postings you've ever 'read'. How hard
>> can *that* be!?
>
> Thunderbird uses SQLite for the messages databases, one for each folder
> (newsgroup). While SQLite is fast for small database sizes, it doesn't
> scale well. The bigger the database, the slow queries get, and the
> slowdown is not linear. SQLite recommends once you pass into the
> terabyte range to find a different solution.
>
> https://www.dbtalks.com/tutorials/learn-sqlite/what-are-the-limitations-of-sqlite
> A SQLite database can have maximum 2147483646 pages. Hence the maximum
> number of tables in a schema cannot reach more than 2147483646. The
> maximum number of rows in a table is 264. The maximum number of columns
> is 32767 in a table.
>

According to the official docs at https://www.sqlite.org/limits.html
this limit is 2 to the 64th power not twohundredandsixtyfour.

With that and a database table containing only 2 columns: MID and count
of read flags already set, the database would contain only one small row
per read message with only the numeric field changing after adding a
row. Replacing MIDs by fixed-size hashes of MIDs would allow fixed
length records, thus further easing the DB engine burden. Anyways disk
space for known messages would hit physical limits before the database
fills up.

The goal with this proposal is to handle 2 real world situations:

1. Cross-posts to multiple newsgroups from one server.

2. Having multiple newsserver accounts in one xxBird configuration, such
as news.dotsrc.org (the old SunSite) and eternal-september.org .

Enjoy

Jakob
--
Jakob Bohm, CIO, Partner, WiseMo A/S. https://www.wisemo.com
Transformervej 29, 2860 Søborg, Denmark. Direct +45 31 13 16 10
This public discussion message is non-binding and may contain errors.
WiseMo - Remote Service Management for PCs, Phones and Embedded

Re: betterbird: reading crossposts once?

<ugpfis.m38.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1565&group=news.software.readers#1565

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!nntp.comgw.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 18 Oct 2023 18:35:48 GMT
Organization: NOYB
Lines: 43
Message-ID: <ugpfis.m38.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh> <XA2dnYXpbLiVhq34nZ2dnZeNn_Vi4p2d@giganews.com>
X-Trace: individual.net zU8fZre2jrclJ8AVwdVrGwOjcrbnH/Ziq2iI2CsqhApJGwWuxH
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:ikW0w2rRBS6Yc0ov9KHk0oCKmjI= sha256:Oc09xLWUIk8Bd74ktx76m3trgb2y1ttw63npn51RRrY=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Wed, 18 Oct 2023 18:35 UTC

Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
[...]

> According to the official docs at https://www.sqlite.org/limits.html
> this limit is 2 to the 64th power not twohundredandsixtyfour.
>
> With that and a database table containing only 2 columns: MID and count
> of read flags already set, the database would contain only one small row
> per read message with only the numeric field changing after adding a
> row. Replacing MIDs by fixed-size hashes of MIDs would allow fixed
> length records, thus further easing the DB engine burden. Anyways disk
> space for known messages would hit physical limits before the database
> fills up.
>
> The goal with this proposal is to handle 2 real world situations:

As I've mentioned before, but you've ignored, your proposal handles
only *part* of the 'problems', only for relatively new not-seen
articles, not for - probably older - other not-yet-seen articles.

Having repeated that, let me comment on the "2 real world situations":

> 1. Cross-posts to multiple newsgroups from one server.

This is already handled by article-number ranges in .newsrc type
files.

That Thunderbird et al inherit a design-flaw from their predecessors
(as far back as Netscape Communicator or even further), does not change
this. Fix Thunderbird et al or live with the flaw.

> 2. Having multiple newsserver accounts in one xxBird configuration, such
> as news.dotsrc.org (the old SunSite) and eternal-september.org .

That's only relevant if one's primary NSP is shaky and you need
another NSP in case as the primary one is down, misses articles, etc.,
etc.. (Best) Solution: Get a proper NSP.

But if you can't get a proper NSP, there's - as I mentioned several
times - Hamster (for Windows) and Leafnode2 (for Linux and Unix-like
OSs). That solves *both* the "2 real world situations".

Bottom line: 'Problems' solved. Next problem.

Re: betterbird: reading crossposts once?

<877cnjyc89.fsf@hope.eyrie.org>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1567&group=news.software.readers#1567

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!paganini.bofh.team!news.killfile.org!news.eyrie.org!.POSTED!not-for-mail
From: eag...@eyrie.org (Russ Allbery)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Wed, 18 Oct 2023 12:14:30 -0700
Organization: The Eyrie
Message-ID: <877cnjyc89.fsf@hope.eyrie.org>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net>
<ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net>
<ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net>
<8mpm1esqft.fsf@raybanana.net>
<ugjt35.nqo.1@ID-201911.user.individual.net>
Mime-Version: 1.0
Content-Type: text/plain
Injection-Info: hope.eyrie.org;
logging-data="9017"; mail-complaints-to="news@eyrie.org"
User-Agent: Gnus/5.13 (Gnus v5.13)
Cancel-Lock: sha1:UnjIiotRbwF9lJbZe2A360o7NHg=
 by: Russ Allbery - Wed, 18 Oct 2023 19:14 UTC

Frank Slootweg <this@ddress.is.invalid> writes:

> Neither do I, but it's just SMOP (Small Matter Of Programming). All you
> have to do is to remember all the hundred of thousands / millions of
> message-ids of the postings you've ever 'read'. How hard can *that* be!?
> :-)

Well, we know exactly how hard this is, because you're describing a news
server's history database. News servers also have to remember every
message they've seen, and they have to do that by message ID. News
servers limit this to articles within a certain date range and reject all
articles older than that date range, but servers that never expire
essentially keep that data forever.

There are a bunch of techniques for maintaining that database. It mostly
uses dedicated data structures optimized for this specific problem, not a
SQLite database, although I'd be interested to see someone try with modern
SQLite or another SQL database and see if it can be optimized enough,
since those tools have a lot more general optimizations and way more
active developers.

This is certainly *doable*, since it's done all the time, and a modern
server is often smaller (in disk, memory, and CPU) than a typical laptop,
let alone desktop. On my news server, it currently takes up about 660MiB
of disk space, which is smaller than a lot of video games. :) But that's
literally every message the server has on disk, and I can assure you that
I have not read the VAST majority of them, so most history databases for a
personal newsreader would be substantially smaller.

--
Russ Allbery (eagle@eyrie.org) <https://www.eyrie.org/~eagle/>

Please post questions rather than mailing me directly.
<https://www.eyrie.org/~eagle/faqs/questions.html> explains why.

Re: betterbird: reading crossposts once?

<ugqoc6$3t15h$1@dont-email.me>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1569&group=news.software.readers#1569

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!news.niel.me!news.gegeweb.eu!gegeweb.org!eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: no...@thanks.net (candycanearter07)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: Thu, 19 Oct 2023 03:11:49 -0500
Organization: A noiseless patient Spider
Lines: 9
Message-ID: <ugqoc6$3t15h$1@dont-email.me>
References: <uftnus$2voq4$1@dont-email.me> <1qnm7s6fh6uot$.dlg@v.nguard.lh>
<87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh>
<slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh>
<uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me>
<ughha2.nhc.1@ID-201911.user.individual.net>
<ughfd8$aigv$1@news.trigofacile.com>
<ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net>
<ugjt35.nqo.1@ID-201911.user.individual.net> <1jc7gql3n1783.dlg@v.nguard.lh>
<XA2dnYXpbLiVhq34nZ2dnZeNn_Vi4p2d@giganews.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 19 Oct 2023 08:11:50 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="954b90874bdb63a9d88ce6a62cbb6c62";
logging-data="4097201"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+gqnTyOo6mXtM1+ttP1E3haTQGSjBxvJvYwptK9A+6ig=="
User-Agent: Betterbird (Linux)
Cancel-Lock: sha1:hZ4dlJO1eNRsaGKePihinxtAWo0=
Content-Language: en-US
In-Reply-To: <XA2dnYXpbLiVhq34nZ2dnZeNn_Vi4p2d@giganews.com>
 by: candycanearter07 - Thu, 19 Oct 2023 08:11 UTC

On 10/18/23 12:51, Jakob Bohm wrote:
> 2. Having multiple newsserver accounts in one xxBird configuration, such
> as news.dotsrc.org (the old SunSite) and eternal-september.org .

XXbird? Does that mean there are more clients based on Thunderbird?
--
user <candycane> is generated from /dev/urandom

Re: betterbird: reading crossposts once?

<ugrh4v.m6g.1@ID-201911.user.individual.net>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=1570&group=news.software.readers#1570

 copy link   Newsgroups: news.software.readers news.software.nntp
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: thi...@ddress.is.invalid (Frank Slootweg)
Newsgroups: news.software.readers,news.software.nntp
Subject: Re: betterbird: reading crossposts once?
Date: 19 Oct 2023 13:14:49 GMT
Organization: NOYB
Lines: 50
Message-ID: <ugrh4v.m6g.1@ID-201911.user.individual.net>
References: <uftnus$2voq4$1@dont-email.me> <87y1g5yxux.fsf@hope.eyrie.org> <w29h803rmpn4.dlg@v.nguard.lh> <slrnuilnm3.3uvei.rayban@raybanana.net> <ofkn3js6yvvh$.dlg@v.nguard.lh> <uggt8q.rdg.1@ID-201911.user.individual.net> <ugh6ae$cvr5$3@dont-email.me> <ughha2.nhc.1@ID-201911.user.individual.net> <ughfd8$aigv$1@news.trigofacile.com> <ugjdnb.ido.1@ID-201911.user.individual.net> <8mpm1esqft.fsf@raybanana.net> <ugjt35.nqo.1@ID-201911.user.individual.net> <877cnjyc89.fsf@hope.eyrie.org>
X-Trace: individual.net F7xe7q+VSFJ6eH9r1SyuvAzgtzWZVI16DTtL0nP+JxYEY3sqnx
X-Orig-Path: not-for-mail
Cancel-Lock: sha1:zvdy8ck+qqhnJzpWSDOxgbZ08Go= sha256:RiyJPaBxjaD5eciV1yAiBUOfd6uysPAZt7FHgL3elc8=
User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (CYGWIN_NT-10.0-WOW/2.8.0(0.309/5/3) (i686)) Hamster/2.0.2.2
 by: Frank Slootweg - Thu, 19 Oct 2023 13:14 UTC

Russ Allbery <eagle@eyrie.org> wrote:
> Frank Slootweg <this@ddress.is.invalid> writes:
>
> > Neither do I, but it's just SMOP (Small Matter Of Programming). All you
> > have to do is to remember all the hundred of thousands / millions of
> > message-ids of the postings you've ever 'read'. How hard can *that* be!?
> > :-)
>
> Well, we know exactly how hard this is, because you're describing a news
> server's history database. News servers also have to remember every
> message they've seen, and they have to do that by message ID. News
> servers limit this to articles within a certain date range and reject all
> articles older than that date range, but servers that never expire
> essentially keep that data forever.
>
> There are a bunch of techniques for maintaining that database. It mostly
> uses dedicated data structures optimized for this specific problem, not a
> SQLite database, although I'd be interested to see someone try with modern
> SQLite or another SQL database and see if it can be optimized enough,
> since those tools have a lot more general optimizations and way more
> active developers.
>
> This is certainly *doable*, since it's done all the time, and a modern
> server is often smaller (in disk, memory, and CPU) than a typical laptop,
> let alone desktop. On my news server, it currently takes up about 660MiB
> of disk space, which is smaller than a lot of video games. :) But that's
> literally every message the server has on disk, and I can assure you that
> I have not read the VAST majority of them, so most history databases for a
> personal newsreader would be substantially smaller.

Hi Russ,

Just to be sure/clear: I was both joking (hence "SMOP", "How hard can
*that* be!?" and the smiley) and serious in my responses to those who
apparently took my comments seriously.

And indeed, it's not that hard to do, because it's exactly what a
newsserver's history database does. That's why I later talked about
Hamster (which I use) and Leafnode(2).

My response was somewhat in jest, because it was a response to Ray's
likeminded post:

RB> It would have never occurred to me that somebody would expect this to
RB> work across multiple servers ;-)

So neither Ray, nor I took the original 'problem' seriously. But
humour and Usenet often don't go well together.

Hope this clarifies things.

Pages:123
server_pubkey.txt

rocksolid light 0.9.7
clearnet tor