Hello!

There has been over year from last time I posted some maps. So I think
some update is nice.
This time I used 90 days worth of posts from all groups from my server,
so 12. august to 10. november.

First, generic view, based on paths in my server:
http://usenet.ee/maps/2021/graph-n-20211010.png

Done with neato from Graphviz. This time cleanup was surprisingly easy,
I found only few patterns, that needed aggregation. Those were IP or
some hash based, probably client identifiers.

Little bit different view, same data:
http://usenet.ee/maps/2021/graph-t-20211010.png

That was done with twopi from Graphviz.

If you want PDF version, replace png in url with pdf.

Lastly, those graphs are pretty messy and hard to read. I tried
different filters, but for that amount data Graphviz don't seem good
solution.
For making more readable picture I looked TOP25 from Anthologeek TOP1000
and made map purely for those sites and their relations:

http://usenet.ee/maps/2021/graph-top25-n-20211010.png

--
Best regards
U.ee

Le 13/11/2021 à 16:22, U.ee a écrit :
> Hello!
>
>
> There has been over year from last time I posted some maps. So I think
> some update is nice.
> This time I used 90 days worth of posts from all groups from my server,
> so 12. august to 10. november.

thanks, that's a web :-))

jdd
--
http://dodin.org
http://valeriedodin.com

On 11/13/21 9:22 AM, U.ee wrote:
[...]

> Done with neato from Graphviz. This time cleanup was surprisingly easy,
>  I found only few patterns, that needed aggregation. Those were IP or
> some hash based, probably client identifiers.

[...] GraphViz is handy.

> Lastly, those graphs are pretty messy and hard to read. I tried
> different filters, but for that amount data Graphviz don't seem good

[...]

CmapTools has a great auto-layout generator. You can set it to use
curvy splines instead of straight lines. I don't know if it can import
..dot files from graphviz.

DotToXML can be used to convert .dot files to GraphML for yEd graph editor.

Maybe one of these would be less onerous for generating prettier output.

--
──┏━━━━┓──┏━━┓───┏━━┓── ┌────────────────────────┐ ┌────────┐
──┗━━┓─┃──┗┓─┃───┗┓─┃── │ Spooky Mart [chan] 711 │ │ always │
─────┃─┃──┏┛─┗┓──┏┛─┗┓─ │ https://bitmessage.org │ │ open │
─────┗━┛──┗━━━┛──┗━━━┛─ └────────────────────────┘ └────────┘

On 15.11.21 08:41, 711 Spooky Mart wrote:
> On 11/13/21 9:22 AM, U.ee wrote:
> [...]
>
>> Done with neato from Graphviz. This time cleanup was surprisingly easy,
>>  I found only few patterns, that needed aggregation. Those were IP or
>> some hash based, probably client identifiers.
>
> [...] GraphViz is handy.
>
>> Lastly, those graphs are pretty messy and hard to read. I tried
>> different filters, but for that amount data Graphviz don't seem good
>
> [...]
>
> CmapTools has a great auto-layout generator. You can set it to use
> curvy splines instead of straight lines. I don't know if it can import
> .dot files from graphviz.
>
> DotToXML can be used to convert .dot files to GraphML for yEd graph editor.
>
> Maybe one of these would be less onerous for generating prettier output.
>

I think that amount nodes and connecting lines are better presented in
3D. Little bit more space can help in 2D, but there is still lots of
crossing lines.
Thanks for those suggestions!

--
U.ee

On 13.11.21 20:43, jdd wrote:
> Le 13/11/2021 à 16:22, U.ee a écrit :
>> Hello!
>>
>>
>> There has been over year from last time I posted some maps. So I think
>> some update is nice.
>> This time I used 90 days worth of posts from all groups from my server,
>> so 12. august to 10. november.
>
> thanks, that's a web :-))

Thanks for checking! Interestingly, my dataset has 516 nodes. I did not
compare that list directly to top1000, but additionally to those nodes
I aggregated out (like fidonet) seems like current top1000 contains old
nonfunctional servers, like goblin.stu.neva.ru. Maybe someone opened
some old temporarily down peering and got lot of old news.

--
U.ee

Hi,

Am 16.11.2021 um 17:38 schrieb U.ee:
> On 15.11.21 08:41, 711 Spooky Mart wrote:
>> On 11/13/21 9:22 AM, U.ee wrote:
>> [...]
>>
>>> Done with neato from Graphviz. This time cleanup was surprisingly easy,
>>>   I found only few patterns, that needed aggregation. Those were IP or
>>> some hash based, probably client identifiers.
>>
>> [...] GraphViz is handy.
>>
>>> Lastly, those graphs are pretty messy and hard to read. I tried
>>> different filters, but for that amount data Graphviz don't seem good
>>
>> [...]
>>
>> CmapTools has a great auto-layout generator. You can set it to use
>> curvy splines instead of straight lines. I don't know if it can import
>> .dot files from graphviz.
>>
>> DotToXML can be used to convert .dot files to GraphML for yEd graph
>> editor.
>>
>> Maybe one of these would be less onerous for generating prettier output.
>>
>
> I think that amount nodes and connecting lines are better presented in
> 3D. Little bit more space can help in 2D, but there is still lots of
> crossing lines.
> Thanks for those suggestions!

Maybe something interactive with javascript could be the solution. I
imagine you would click a node and all the connections from that node
would be highlighted.

Possible there are javascript frameworks that already do that ... I dont
have the time at the moment to look into that.

Cheers,
Martin

Hi,

> There has been over year from last time I posted some maps. So I think
> some update is nice.
> This time I used 90 days worth of posts from all groups from my server,
> so 12. august to 10. november.
>
> First, generic view, based on paths in my server:
> http://usenet.ee/maps/2021/graph-n-20211010.png

Very interesting. Many thanks for sharing it!

Shouldn't subdomains appear as only one? For instance, there are
(dhaller|sb|moses|binnsroad|disneywizard|backpage|snipe|...).eternal-september.org
all going to reader02.eternal-september.org.

Entries ending with ".POSTED" may be dropped too.

--
Julien ÉLIE

« Dès que le silence se fait, les gens le meublent. » (Raymond Devos)

Hello!

On 19.11.21 20:29, Julien ÉLIE wrote:
> Shouldn't subdomains appear as only one?  For instance, there are
> (dhaller|sb|moses|binnsroad|disneywizard|backpage|snipe|...).eternal-september.org
> all going to reader02.eternal-september.org.

Aggregation was done case-by-case, some hosts like mentioned
eternal-september.org wasn't trouble enough for aggregating. It is
probably nicer though to put them together.

>
> Entries ending with ".POSTED" may be dropped too.
>

Yes, those were hassle. I cleaned up some of them, but several are still
there.
Interestingly, those sometimes are somewhat unique:
news.mozilla.org.POSTED adjacent to nntp.mozilla.org,
news.earthlink.com.POSTED to nntp.earthlink.com, so they probably are
from different hosts.

Thanks for Your suggestions!

--
Best regards
U.ee

Hi,

U.ee a tapoté le 23/11/2021 19:35:

> news.mozilla.org.POSTED adjacent to nntp.mozilla.org,
> news.earthlink.com.POSTED to nntp.earthlink.com, so they probably are
> from different hosts.

The .POSTED different of "!.POSTED" in the PATH is a client information
with is permitted by configuration in the latest versions of INN*.

*maybe since INN 2.6.0?

--
Stéphane
Sorry for my bad English...