Rocksolid Light

Welcome to Rocksolid Light

register   nodelist   faq  


rocksolid / rocksolid.nodes / Re: rslight as nntp server

SubjectAuthor
* rslight with leafnodeRetro Guy
`* Re: rslight with leafnodeanon
 `* Re: rslight with leafnodeRetro Guy
  +* Re: rslight with leafnodeRetro Guy
  |`* Re: rslight with leafnodeRetro Guy
  | `* Re: rslight with leafnodeanon
  |  `* Re: rslight with leafnodeRetro Guy
  |   +- Re: rslight with leafnodeRetro Guy
  |   `* Re: rslight with leafnodeMei
  |    `* Re: rslight with leafnodeRetro Guy
  |     `* Re: rslight with leafnodeMei
  |      `- Re: rslight with leafnodeRetro Guy
  +- Re: rslight with leafnodeRetro Guy
  `* Re: rslight with leafnodeRetro Guy
   `* rslight as nntp serverAnonUser
    `* Re: rslight as nntp serveranon
     `* Re: rslight as nntp serverRetro Guy
      `* Re: rslight as nntp serverRetro Guy
       `* Re: rslight as nntp serverRetro Guy
        `* Re: rslight as nntp serverRetro Guy
         `* Re: rslight as nntp serverRetro Guy
          `* Re: rslight as nntp serverRetro Guy
           `* Re: rslight as nntp serverRetro Guy
            `* Re: rslight as nntp serverRetro Guy
             +* Re: rslight as nntp serveranon
             |`- Re: rslight as nntp serverRetro Guy
             `* Re: rslight as nntp serverRetro Guy
              `* Re: rslight as nntp serverRetro Guy
               `* Re: rslight as nntp serverRetro Guy
                `* Re: rslight as nntp serverRetro Guy
                 `* Re: rslight as nntp serverRetro Guy
                  `- Re: rslight as nntp serverRetro Guy

Subject: Re: rslight as nntp server
From: Retro Guy@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: Rocksolid Light
Date: Sat, 29 Feb 2020 09:35 UTC
Cool, found a but already! It's an issue with xover. I was lazy and was using the data from the upstream server and storing it. Seems that if there is a delay or timeout connecting via i2p, the cache gets messed up. I guess I'll have to create it myself, which I was trying to avoid. Since I already create an overview with spoolnews anyway, it won't be a real issue. Bugs like to show up as soon as you walk away, lol.

I'll work on that in a few days, the weekends are my busiest work hours of the week, so not much will be worked on for a few days.

Retro Guy
--
Posted on Rocksolid Light
news.novabbs.com


Subject: Re: rslight as nntp server
From: Retro Guy@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: Rocksolid Light
Date: Sun, 1 Mar 2020 08:49 UTC
Currently supported commands in rslight nntp server:

AUTHINFO
MODE
GROUP
XOVER
HEAD
ARTICLE
HELP
QUIT

Mode is just there because clients may send it by default, but this nntp server only serves a reader anyway. You can send 'MODE flux capacitor' and it's still just in 'MODE reader'.

I've changed the way xover handles things, hopefully more stable now via i2p. If not, I should be able to get it working smoothly.

Once I'm comfortable this is all working reasonably well, I'll handle POST. It will work by spooling the article, and sending it to a remote server on next sync. If rslight sites are chained, I'll work out a path to outside so that articles actually get sent, just as a BBS does.

Retro Guy

--
Posted on Rocksolid Light
news.novabbs.com


Subject: Re: rslight as nntp server
From: Retro Guy@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: Rocksolid Light
Date: Mon, 2 Mar 2020 10:46 UTC
Yay, descriptions work now that XGTITLE is implemented.

Also have NEWGROUPS working and fixed a bug with LIST NEWSGROUPS.

Currently testing with rslight, knode and pan as clients. It's really only meant to serve rslight, but if I can standardize enough, that's all the better.

Right now you can read all the groups served by your local rslight install with a newsreader, which is a nice plus. If you bind to an external address, you can allow remote connections by newsreader (or rslight) also.

Still lots of work and testing to do, but working nicely so far.

Retro Guy

--
Posted on Rocksolid Light
news.novabbs.com


Subject: Re: rslight as nntp server
From: Retro Guy@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: Rocksolid Light
Date: Tue, 3 Mar 2020 08:58 UTC
Working on this has helped me find quite a few bugs not necessarily related to the nntp server. This was a nice chance to find problems I wasn't aware of and address them.

This also has given me the chance to tie spoolnews in much better, and now I've removed duplication of files in rslight, which of course reduces disk space usage, and speeds it up.

Just tested the server with Thunderbird as a client and it works just fine. Other than if I try to post (I don't), I'm not currently receiving errors from knode, pan and it looks like thunderbird now also. I do watch the knode and pan logs and all seems fine.

The server also now handles keeping descriptions up to date (according to it's remote server) and rslight displays what is provided by the server, so no need to add the descriptions in groups.txt unless you want to.

It's moving along more quickly than I anticipated, but I'm still going to keep running and testing it for a while before finishing the POST function.

Retro Guy

--
Posted on Rocksolid Light
news.novabbs.com


Subject: Re: rslight as nntp server
From: anon@anon.com (anon)
Newsgroups: rocksolid.nodes
Organization: def5
Date: Tue, 3 Mar 2020 20:22 UTC

kudos to your skills, patience and effort. Once this has reached a level where installing a node is reduced to extracting an archive and fiddling with a few config files, this could boost the number of nodes.
really nice outlook. on my end, i just have no time at all at the moment to do anything more than posting, there is too much meatspace stuff going on. did not even fix yet the broken layout on def3, let alone to get def2 running again....

cheers

trw

Posted on def4


Subject: Re: rslight as nntp server
From: Retro Guy@example.com (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: New rslight site
Date: Thu, 5 Mar 2020 07:20 UTC
anon wrote:


kudos to your skills, patience and effort. Once this has reached a level where installing a node is reduced to extracting an archive and fiddling with a few config files, this could boost the number of nodes.

Thank you! This is my goal also. Once I'm comfortable with the new features, I plan to really clean up and organize the config file to make it very simple.
really nice outlook. on my end, i just have no time at all at the moment to do anything more than posting, there is too much meatspace stuff going on. did not even fix yet the broken layout on def3, let alone to get def2 running again....

Understandable. rl really gets in the way of things, it's like we have to earn money and eat and stuff :)

Retro Guy
--
Posted on: Rocksolid Light test site
192.168.0.220


Subject: Re: rslight as nntp server
From: Retro Guy@example.com (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: New rslight site
Date: Thu, 5 Mar 2020 07:25 UTC
Posting seems to be working fine now, with rslight, knode or pan as a newsreader.

It works similar to leafnode, using two separate programs or scripts to operate:

spoolnews.php collects articles from a remote server and creates a local news spool, creates overview information, and group/description information. This file also sends articles posted locally each time it is run (from cron is the idea).

nntp.php is the nntp server. It handles all negotiation and communication with clients, and reads articles, overview etc from the files created by spoolnews. When you post an article locally, it is created locally for spoolnews to send on its next run.

If you set in your config file to use the local nntp server, spoolnews.php will start it on it's next run if it's not already running, so no need to start it separately. I don't want the end user to do a million little things, if they can be handled by just running one cron job.

nntp.php runs as a daemon, and spawns clients as necessary, that will die after use, so multiple server connections are accepted.

I'm sure there are plenty of bugs, but right now it is functioning as designed, I just need to keep using it to see what breaks. This message is being sent using it (as were a lot of test messages I made using a secondary test group).

Retro Guy

--
Posted on: Rocksolid Light test site
192.168.0.220


Subject: Re: rslight as nntp server
From: Retro Guy@example.com (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: New rslight site
Date: Thu, 5 Mar 2020 22:25 UTC
It looks like chaining rslight sites is working.

This post is from a rslight site that is only connected to another rslight site. It's only access to inn is through the other site.

I plan to create an option in settings to set any rslight site as a "Hub", which would mean no external nntp server is necessary at all, you would be able to connect two or more rslight sites and have a complete network.

This would also allow one rslight site to operate as an independent forum, with no connections to other sites at all.

Lot's more testing to do, but it's working.

Retro Guy

--
Posted on: Rocksolid Light chained test site
192.168.0.220


Subject: Re: rslight as nntp server
From: Retro Guy@example.com (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: New rslight site
Date: Fri, 6 Mar 2020 08:40 UTC
Retro Guy wrote:

It looks like chaining rslight sites is working.

This post is from a rslight site that is only connected to another rslight site. It's only access to inn is through the other site.

This seems to be working fine. This post (if you ever see it, lol), will travel through two other rslight sites before reaching an inn server.

I plan to create an option in settings to set any rslight site as a "Hub", which would mean no external nntp server is necessary at all, you would be able to connect two or more rslight sites and have a complete network.

I believe I have working now independent article numbers. Previously, the article numbers matched the server you connect to, so if you change servers you would need to delete your spool and reload the articles from the new server.

On my test site, the 'newspool' link is where the article numbers are independent of the server. I've loaded articles in that area by loading some, changing servers, loading more, etc. for a total of three upstream servers. It seems to be working fine, but of course testing will hopefully show what might need to be improved.

This way, your upstream server can go away, and you just connect to another one (or an rslight site as your upstream server). All seems to be working so far.

The idea is to make federation as simple as possible, and reliable.

Oh, one thing I did to test against fudforum is to load some newer articles first, then pull old articles (2.5 years) from my Synchronet server. Unlike fudforum, the articles stay sorted by posted date, not just newest received on top. I need to see what effect this has on some newsreaders, but knode seems fine with it.

Time to eat!

Retro Guy


--
Posted on: Rocksolid Light test site
192.168.0.220


Subject: Re: rslight as nntp server
From: Retro Guy@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Organization: Rocksolid Light
Date: Fri, 13 Mar 2020 10:00 UTC
Ok, auth works now. I previously had it just authorizing all users so I could work on the code. Now it's properly verifying. It's designed to allow reading to all, but auth is required to post.

Tested with rslight and three different newsreaders and all seems ok.

I'll be cleaning up the config files next (making them simple to follow), and bringing a few rarely used files up to date (like the display page for decrypted messages and a couple of others).

Retro Guy

--
Posted on: Rocksolid Light
news.novabbs.com


Pages:1234
rocksolid light 0.6.5e
clearnet i2p tor