Rocksolid Light

Welcome to novaBBS

register   nodelist   faq  

Your account also provides newsreader access to all groups at news.i2pn2.org port 119 or 563 (TLS)


rocksolid / Rocksolid Nodes Announce / Re: rslight-0.6.6

SubjectAuthor
* rslight-0.6.6Retro Guy
`* Re: rslight-0.6.6anon
 `* Re: rslight-0.6.6Retro Guy
  `* Re: rslight-0.6.6Retro Guy
   `* Re: rslight-0.6.6Retro Guy
    `* Re: rslight-0.6.6Retro Guy
     `* Re: rslight-0.6.6Anonymous
      `* Re: rslight-0.6.6Retro Guy
       `* Re: rslight-0.6.6Retro Guy
        `* Re: rslight-0.6.6Retro Guy
         `* Re: rslight-0.6.6Retro Guy
          +- Re: rslight-0.6.6Guest
          `* Re: rslight-0.6.6Retro Guy
           +- Re: rslight-0.6.6Guest
           `* Re: rslight-0.6.6Retro Guy
            `- Re: rslight-0.6.6rslightuser

Pages:12
Subject: Re: rslight-0.6.6
From: retro....@rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
Organization: novaBBS
Date: Thu, 24 Sep 2020 07:45 UTC
Date: Thu, 24 Sep 2020 07:45:39 +0000
Subject: Re: rslight-0.6.6
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs
From: retro....@rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
X-Rslight-Site: $2y$10$Om/RYGxM/44Of16/I2Nivu8X56g9Soh0FrBcjoxnGFxpTMVWH1EWe
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
References: <b1deb8da4b6f8413b937ba4300ab840a$1@www.novabbs.com> <afaf98ae07e01c65d1dfb5a182f7c546@def4> <b3a3e8fb4fc40a54d73aab91fadf3d3a$1@www.novabbs.com> <44da0a756b6016bbf4f54753a06ab00f$1@www.novabbs.com> <3171fa327eb6a5e70e0a393900c16b7f$1@www.novabbs.com> <395a19de714f601018c8d2a7c0206f04$1@www.novabbs.com> <FChmQiC2nEjHYFZJGp8fHFMxvnqYwTsBf@blah> <fa10328b63da53ad7d0718510e9a769d$1@news.novabbs.org> <09636e225b8d10a8e535cc056de96743$1@www.novabbs.com> <7fc48825ec3b4fe5b92a61efa0ee7f25$1@news.novabbs.org>
Organization: novaBBS
Message-ID: <1ab08dc6119352329ba5d841e10b7017$1@www.novabbs.com>
View all headers
Finally found a good way to tremendously speed up creating the threads page while displaying last poster for each thread.

I was not happy with how slow it was after adding that feature but now it is, from an end user point of view, just about instantaneous. Previous to this, it was taking one to two seconds for groups with maybe 35,000 posts. That doesn't seem long, but it's a delay noticable by a user, and it was really wasting processing time. Now, it's working very well.

I knew how I wanted to fix it, but it took me a while to get it done. I read the group overview from the end (newest) and go backward to find the article info. This makes sense as most users are looking at newer threads instead of older ones. Since the threads are sorted by date, newest to oldest, I was wasting time starting at the top (bottom) again for each thread. Now I have it working properly to just start where it left off, and never read the same line in the file again for a group.

I still would like to create a php function to read the file line by line from the end, which I can write just haven't yet, but right now I'm still using 'tac' ('tail -r' on freeBSD) and it's working fine.

Retro Guy

--
Posted on: novaBBS
www.novabbs.com



Subject: Re: rslight-0.6.6
From: gue...@retrobbs.rocksolidbbs.com (Guest)
Newsgroups: rocksolid.nodes.announce
Organization: Dancing elephants
Date: Thu, 24 Sep 2020 19:28 UTC
Path: i2pn2.org!i2pn.org!rocksolid2!def5!.POSTED.bogusentry!not-for-mail
From: gue...@retrobbs.rocksolidbbs.com (Guest)
Newsgroups: rocksolid.nodes.announce
Subject: Re: rslight-0.6.6
Date: Thu, 24 Sep 2020 15:28:56 -0400
Organization: Dancing elephants
Lines: 7
Message-ID: <rkis05$ill$1@def5.org>
References: <1ab08dc6119352329ba5d841e10b7017$1@www.novabbs.com>
Reply-To: Guest <guest@retrobbs.rocksolidbbs.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 24 Sep 2020 19:28:05 -0000 (UTC)
Injection-Info: def5.org; posting-host="bogusentry:192.168.1.189";
logging-data="19125"; mail-complaints-to="usenet@def5.org"
User-Agent: FUDforum 3.0.7
X-FUDforum: 6666cd76f96956469e7be39d750cc7d9 <439456>
View all headers
Glad you got it done, although I don't understand the problem really, I 'm afraid.
Would it not be much faster to read the whole thing into mem and then treat it as an array ?

And why is this post not on def2 ? Is this a crosspost ? I still have fix this, atm def2 rejects all messages going to several groups.

cheers

trw

--
Posted on def3


Subject: Re: rslight-0.6.6
From: retro_...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
Organization: RetroBBS
Date: Fri, 25 Sep 2020 02:49 UTC
Path: i2pn2.org!rocksolid2!.POSTED.localhost!not-for-mail
From: retro_...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
Subject: Re: rslight-0.6.6
Date: Thu, 24 Sep 2020 19:49:58 -0700
Organization: RetroBBS
Message-ID: <20200924194958.40d3d7c7@desktop14.dt>
References: <1ab08dc6119352329ba5d841e10b7017$1@www.novabbs.com>
<rkis05$ill$1@def5.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Injection-Info: novabbs.org; posting-account="retrobbs1"; posting-host="localhost:127.0.0.1";
logging-data="2064"; mail-complaints-to="usenet@novabbs.org"
X-Newsreader: Claws Mail 3.11.1 (GTK+ 2.24.25; x86_64-pc-linux-gnu)
View all headers
On Thu, 24 Sep 2020 15:28:56 -0400
Guest <guest@retrobbs.rocksolidbbs.com> wrote:

Glad you got it done, although I don't understand the problem really,
I 'm afraid. Would it not be much faster to read the whole thing into
mem and then treat it as an array ?

Yes, it is much faster to read into an array, but that takes memory.
When testing on a large group with a lot of posts, it uses up php's
limit of memory so I just read the file directly.

And why is this post not on def2 ? Is this a crosspost ? I still have
fix this, atm def2 rejects all messages going to several groups.

I just checked and the message you replied to is only in one group:
Newsgroups: rocksolid.nodes.announce

rocksolid.nodes.announce on def2 looks stalled since 04/17/20 There are
a number of posts since then that I don't see there. Maybe it has
stopped polling this group for some reason? I'll check other groups in
a bit, maybe it's just one group.

Are you still pulling posts using code from rslight? If so, maybe we
can modify the function to drop groups from the Newsgroups: header, and
only leave one group before it ever gets to vichan? Would that maybe be
a way to solve it?

Retro Guy



Subject: Re: rslight-0.6.6
From: gue...@retrobbs.rocksolidbbs.com (Guest)
Newsgroups: rocksolid.nodes.announce
Organization: Dancing elephants
Date: Fri, 25 Sep 2020 08:29 UTC
Path: i2pn2.org!rocksolid2!def5!.POSTED.bogusentry!not-for-mail
From: gue...@retrobbs.rocksolidbbs.com (Guest)
Newsgroups: rocksolid.nodes.announce
Subject: Re: rslight-0.6.6
Date: Fri, 25 Sep 2020 04:29:48 -0400
Organization: Dancing elephants
Lines: 12
Message-ID: <rkk9oa$b42$1@def5.org>
References: <20200924194958.40d3d7c7@desktop14.dt>
Reply-To: Guest <guest@retrobbs.rocksolidbbs.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 25 Sep 2020 08:28:58 -0000 (UTC)
Injection-Info: def5.org; posting-host="bogusentry:192.168.1.189";
logging-data="11394"; mail-complaints-to="usenet@def5.org"
User-Agent: FUDforum 3.0.7
X-FUDforum: 6666cd76f96956469e7be39d750cc7d9 <440204>
View all headers
rocksolid.nodes.announce on def2 looks stalled since 04/17/20 There are
a number of posts since then that I don't see there. Maybe it has
stopped polling this group for some reason?

Maybe a db-fuckup of some kind. I need to check on my end.

Are you still pulling posts using code from rslight? If so, maybe we

I pull from a lot of servers, all rslight plus the news servers. I appreciate your proposal, but I'd rather solve this on the vichan site (using pretty much the method you described). Otherwise you would have to deploy this hack everywhere or I'd have to limit def2 to a specific sever.

cheers

trw

--
Posted on def3


Subject: Re: rslight-0.6.6
From: retro_...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
Organization: RetroBBS
Date: Fri, 25 Sep 2020 08:39 UTC
Path: i2pn2.org!i2pn.org!rocksolid2!.POSTED.localhost!not-for-mail
From: retro_...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes.announce
Subject: Re: rslight-0.6.6
Date: Fri, 25 Sep 2020 01:39:42 -0700
Organization: RetroBBS
Message-ID: <20200925013942.75d79cce@desktop14.dt>
References: <20200924194958.40d3d7c7@desktop14.dt>
<rkk9oa$b42$1@def5.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Injection-Info: novabbs.org; posting-account="retrobbs1"; posting-host="localhost:127.0.0.1";
logging-data="14338"; mail-complaints-to="usenet@novabbs.org"
X-Newsreader: Claws Mail 3.11.1 (GTK+ 2.24.25; x86_64-pc-linux-gnu)
View all headers
On Fri, 25 Sep 2020 04:29:48 -0400
Guest <guest@retrobbs.rocksolidbbs.com> wrote:

Are you still pulling posts using code from rslight? If so, maybe we

I pull from a lot of servers, all rslight plus the news servers. I
appreciate your proposal, but I'd rather solve this on the vichan
site (using pretty much the method you described). Otherwise you
would have to deploy this hack everywhere or I'd have to limit def2
to a specific sever.

What I meant was are you still using code from the rslight codebase in
vichan to pull posts :)



Subject: Re: rslight-0.6.6
From: rslightu...@rslight.i2p (rslightuser)
Newsgroups: rocksolid.nodes.announce
Organization: Rocksolid Light
Date: Fri, 25 Sep 2020 11:01 UTC
Path: i2pn2.org!rocksolid2!.POSTED.localhost!not-for-mail
From: rslightu...@rslight.i2p (rslightuser)
Newsgroups: rocksolid.nodes.announce
Subject: Re: rslight-0.6.6
Date: Fri, 25 Sep 2020 11:01:18 +0000
Organization: Rocksolid Light
Message-ID: <9ebecb1668743b52b412edc2b80cbb4a$1@dkzerogt6z6ybhcj.onion>
References: <20200924194958.40d3d7c7@desktop14.dt> <rkk9oa$b42$1@def5.org> <20200925013942.75d79cce@desktop14.dt>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: novabbs.org; posting-account="retrobbs1"; posting-host="localhost:127.0.0.1";
logging-data="12824"; mail-complaints-to="usenet@novabbs.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.org
X-Spam-Level: **
X-Rslight-Site: $2y$10$XyiCQfMtH1j0tp9JBs/qJ.mMej19TKWdiwWRnl9vg9bwDNEm6b2dW
View all headers
What I meant was are you still using code from the rslight codebase in vichan to pull posts :)

ah, ok. no, there is an independent code running now.
--
Posted on: Rocksolid Light
dkzerogt6z6ybhcj.onion


Pages:12
rocksolid light 0.6.6
clearnet i2p tor