Rocksolid Light

Welcome to novaBBS (click a section below)

mail  files  register  newsreader  groups  login

Message-ID:  

"Pull the wool over your own eyes!" -- J. R. "Bob" Dobbs


computers / rocksolid.nodes / Re: hey, what do know ? vichan supports nntp

SubjectAuthor
* hey, what do know ? vichan supports nntpanon
+* hey, what do know ? vichan supports nntpanon
|`* hey, what do know ? vichan supports nntpRetro Guy
| `* hey, what do know ? vichan supports nntpanon
|  `* hey, what do know ? vichan supports nntpRetro Guy
|   `* hey, what do know ? vichan supports nntpanon
|    `* hey, what do know ? vichan supports nntpanon
|     `* hey, what do know ? vichan supports nntpRetro Guy
|      `* hey, what do know ? vichan supports nntpanon
|       `* hey, what do know ? vichan supports nntpanon
|        +* hey, what do know ? vichan supports nntpanon
|        |`* hey, what do know ? vichan supports nntpanonymous
|        | +* hey, what do know ? vichan supports nntpRetro Guy
|        | |`* hey, what do know ? vichan supports nntpanon
|        | | `* hey, what do know ? vichan supports nntpRetro Guy
|        | |  `* hey, what do know ? vichan supports nntpanonymous
|        | |   `* hey, what do know ? vichan supports nntpRetro Guy
|        | |    `* hey, what do know ? vichan supports nntpanonymous
|        | |     `* hey, what do know ? vichan supports nntpanon
|        | |      +* hey, what do you know: vichan supports nntpanon
|        | |      |+- hey, what do you know: vichan supports nntpRetro Guy
|        | |      |`* hey, what do you know: vichan supports nntpanon
|        | |      | `- hey, what do you know: vichan supports nntpRetro Guy
|        | |      `- hey, what do know ? vichan supports nntpRetro Guy
|        | `* hey, what do know ? vichan supports nntpRetro Guy
|        |  `* hey, what do know ? vichan supports nntpanonymous
|        |   `* hey, what do know ? vichan supports nntpanonymous
|        |    `* hey, what do know ? vichan supports nntpanonymous
|        |     +* hey, what do know ? vichan supports nntpanonymous
|        |     |`* hey, what do know ? vichan supports nntpanonymous
|        |     | `* hey, what do know ? vichan supports nntpanonymous
|        |     |  `* hey, what do know ? vichan supports nntpanonymous
|        |     |   `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |    `* hey, what do know ? vichan supports nntpanonymous
|        |     |     `* hey, what do know ? vichan supports nntpanonymous
|        |     |      `* hey, what do know ? vichan supports nntpanonymous
|        |     |       `* hey, what do know ? vichan supports nntpanonymous
|        |     |        `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |         `* hey, what do know ? vichan supports nntpanonymous
|        |     |          `* hey, what do know ? vichan supports nntpanonymous
|        |     |           `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |            `* hey, what do know ? vichan supports nntpanonymous
|        |     |             `* hey, what do know ? vichan supports nntpanonymous
|        |     |              `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |               `* hey, what do know ? vichan supports nntpanon
|        |     |                `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |                 `* hey, what do know ? vichan supports nntpanonymous
|        |     |                  `* hey, what do know ? vichan supports nntpanonymous
|        |     |                   `* hey, what do know ? vichan supports nntpanonymous
|        |     |                    `* hey, what do know ? vichan supports nntpanonymous
|        |     |                     `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |                      `* hey, what do know ? vichan supports nntpanonymous
|        |     |                       +* hey, what do know ? vichan supports nntpanonymous
|        |     |                       |+- hey, what do know ? vichan supports nntpanonymous
|        |     |                       |`- hey, what do know ? vichan supports nntpRetro Guy
|        |     |                       `* hey, what do know ? vichan supports nntpRetro Guy
|        |     |                        `- hey, what do know ? vichan supports nntpanonymous
|        |     `- hey, what do know ? vichan supports nntpRetro Guy
|        `- hey, what do know ? vichan supports nntpRetro Guy
+- hey, what do know ? vichan supports nntpanon
+* hey, what do know ? vichan supports nntpanon
|`* hey, what do know ? vichan supports nntpanonymous
| +- hey, what do you know....anon
| `* hey, what do know ? vichan supports nntpanonymous
|  `* hey, what do know ? vichan supports nntpRetro Guy
|   `- hey, what do know ? vichan supports nntpanon
+* basics are workingAnonymous
|`- basics are workingRetro Guy
+* guess i will open for business soonAnonymous
|+* guess i will open for business soonMei
||`- guess i will open for business soonRetro Guy
|`- guess i will open for business soonRetro Guy
+- opsec check is goodAnonymous
+- > goo to go.Anonymous
+* yes that should workAnonymous
|`- yes that should workRetro Guy
+* cron or not ?Anonymous
|`- cron or not ?Retro Guy
+- themes on def2.i2pAnonymous
`* ok, ok, i switched the default themeAnonymous
 `* ok, ok, i switched the default themeMei
  `- ok, ok, i switched the default themeanon

Pages:1234
Re: hey, what do know ? vichan supports nntp

<96872abfea21a7f3d415a30e15921a3b@def4>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=291&group=rocksolid.nodes#291

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!rocksolid2!def5!POSTED.localhost!not-for-mail
From: ano...@anon.com (anon)
Newsgroups: rocksolid.nodes
Message-ID: <96872abfea21a7f3d415a30e15921a3b@def4>
Subject: Re: hey, what do know ? vichan supports nntp
Date: Sun, 24 May 2020 16:22:42+0000
Organization: def5
In-Reply-To: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
 by: anon - Sun, 24 May 2020 16:22 UTC

to dig out the thread starting message, this code should do it, right ? (from article-flat.php):

if($message) {
// load thread-data and get IDs of the actual subthread
$thread=thread_load($group);
$subthread=thread_getsubthreadids($message->header->id,$thread);
if($thread_articles == false) {
sort($subthread);
}

trw

Posted on def4

Re: hey, what do know ? vichan supports nntp

<1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=292&group=rocksolid.nodes#292

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: anonym...@anon.com (anonymous)
Newsgroups: rocksolid.nodes
Subject: Re: hey, what do know ? vichan supports nntp
Date: Sun, 24 May 2020 21:23 UTC
Organization: def2
Message-ID: <1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <96872abfea21a7f3d415a30e15921a3b@def4>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="10701"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Rslight-Site: $2y$10$V02o9AfgAbNYaKuY4ltWWurGO9EdrvTq0go1Uyyjktz8v7vtFTWD6
 by: anonymous - Sun, 24 May 2020 21:23 UTC

I did my own code to do the threading like vichan expects it, wasn't so hard after all (one recursive function, basically).
I just redo the message import, still get mistakes, but a lot less. seems more and more usable. If only I knew what vichan is expecting exactly as a date (this is the last (obvious) thing to solve).

cheers

trw
--
Posted on def2
z5bqfv5v75kxy7pj.onion

Re: hey, what do you know....

<6b0ef1d5b22aa3329e5020265a6a3f2b@def4>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=293&group=rocksolid.nodes#293

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!rocksolid2!def5!POSTED.localhost!not-for-mail
From: ano...@anon.com (anon)
Newsgroups: rocksolid.nodes
Message-ID: <6b0ef1d5b22aa3329e5020265a6a3f2b@def4>
Subject: Re: hey, what do you know....
Date: Sun, 24 May 2020 23:38:30+0000
Organization: def5
In-Reply-To: <1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion>
References: <1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
 by: anon - Sun, 24 May 2020 23:38 UTC

>If only I knew what vichan is expecting exactly as a date (this is the last (obvious) thing to solve).

Turns out that it expected what I had been trying at the very start: a unix timestamp. ...it just doesn't respect it !
So for some reason the date of the import is always displayed as the messages time, no matter what the original time is... which is no problem if updates happen in timely manner, but for rebuilding an existing message base it is not so good (at least one context of the messages is gone).
guess the image boards have always been fixated on short term, low latency interaction...

Posted on def4

Re: hey, what do know ? vichan supports nntp

<5647b0460b715d292fd9a74f64a0be13$1@z5bqfv5v75kxy7pj.onion>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=294&group=rocksolid.nodes#294

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: anonym...@anon.com (anonymous)
Newsgroups: rocksolid.nodes
Subject: Re: hey, what do know ? vichan supports nntp
Date: Mon, 25 May 2020 21:49 UTC
Organization: def2
Message-ID: <5647b0460b715d292fd9a74f64a0be13$1@z5bqfv5v75kxy7pj.onion>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <96872abfea21a7f3d415a30e15921a3b@def4> <1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="27972"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Rslight-Site: $2y$10$Afzq/Yq0do2nvWdI0I6l0.aNTtt6uTikwPWylFElmx6JOCu2kGubS
 by: anonymous - Mon, 25 May 2020 21:49 UTC

had to rewrite the re-indexing code due to some bugs, this is the data exchange format I use now:

---snip

"<04a2efaf39f90b7fd445b3d34b04e849$1@retrobbs.rocksolidbbs.com>": {
"parents": [
"<5fa5f7ef9a71f09f4a486c3d579083bf@def4.com>",
"<fb56c3093f6c0f918ca58cd34ad42065@def4.com>",
"<prlg96$jgf$1@def3.retrobbs.com>"
],
"op": false,
"ref": "<prlg96$jgf$1@def3.retrobbs.com>",
"ref_org": "<5fa5f7ef9a71f09f4a486c3d579083bf@def4.com>",
"solved": true
},
"<d11adec78757e4dad3e4b7d2f46880f5$1@dkzerogt6z6ybhcj.onion>": {
"parents": [],
"op": true
},
"<b5d27591156eeb51329e572177153951$1@www.novabbs.com>": {
"parents": [],
"op": true
},
"<7c83a8ef135c1022d441adde9029441b$1@www.novabbs.com>": {
"parents": [
"<b5d27591156eeb51329e572177153951$1@www.novabbs.com>"
],
"op": false,
"ref": "<b5d27591156eeb51329e572177153951$1@www.novabbs.com>",
"ref_org": "<b5d27591156eeb51329e572177153951$1@www.novabbs.com>",
"solved": true
},

---snap

with this implemented properly, most of the threads should work on vichan as well. than i just have to reindex all messages.
but first the rslight upgrade.

cheers

trw
--
Posted on def2
z5bqfv5v75kxy7pj.onion

Re: hey, what do know ? vichan supports nntp

<23446718aac5c9bb5100df609426140f$1@www.novabbs.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=295&group=rocksolid.nodes#295

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Retro ...@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: hey, what do know ? vichan supports nntp
Date: Tue, 26 May 2020 09:07 UTC
Organization: Rocksolid Light
Message-ID: <23446718aac5c9bb5100df609426140f$1@www.novabbs.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <96872abfea21a7f3d415a30e15921a3b@def4> <1f58d56998423c513ee9c6e5e98df25f$1@z5bqfv5v75kxy7pj.onion> <5647b0460b715d292fd9a74f64a0be13$1@z5bqfv5v75kxy7pj.onion>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="4591"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$dWDFsiqoV6ItI2LRGxPlOeV3chnlxLhYJFh/QQ61utotCgW5fGVQO
 by: Retro Guy - Tue, 26 May 2020 09:07 UTC

anonymous wrote:

> had to rewrite the re-indexing code due to some bugs, this is the data exchange format I use now:

> ---snip

> with this implemented properly, most of the threads should work on vichan as well. than i just have to reindex all messages.
> but first the rslight upgrade.

This is awesome! You're really making some great mods to vichan!

Once you have some code you want applied to spoolnews let me know. I'd like to either get most of it into a function (or two), or a script itself (vichan.php?)

I'll just put a toggle in config like I do with synchronet ($synchronet=true/false).

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

Re: hey, what do know ? vichan supports nntp

<6effa0f2ee99f0f0c4d5ce67b9849296@def4>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=296&group=rocksolid.nodes#296

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!rocksolid2!def5!POSTED.localhost!not-for-mail
From: ano...@anon.com (anon)
Newsgroups: rocksolid.nodes
Message-ID: <6effa0f2ee99f0f0c4d5ce67b9849296@def4>
Subject: Re: hey, what do know ? vichan supports nntp
Date: Tue, 26 May 2020 10:50:56+0000
Organization: def5
In-Reply-To: <23446718aac5c9bb5100df609426140f$1@www.novabbs.com>
References: <23446718aac5c9bb5100df609426140f$1@www.novabbs.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
 by: anon - Tue, 26 May 2020 10:50 UTC

>This is awesome! You're really making some great mods to vichan!

Thanks for the kind words, it is really fun to work on that.

Just in case some vichan or nntpchan dev should ever read this thread: I'm still standing on the proverbial "shoulders of giants". Anyway, thanks for this nice piece of software.

cheers

trw

Posted on def4

basics are working

<n.232.195omy@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=297&group=rocksolid.nodes#297

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: basics are working
Date: Tue, 26 May 2020 08:34:01 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.232.195omy@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary=d299d1fb9af5b5d0014ff7992bc19505ae56652d
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="20677"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Tue, 26 May 2020 15:34 UTC
Attachments: "bg_jyc_new.png"; name="attachment" (image/png)

with some 11 exceptions my routine could glue all the threads together again.
this is still far from being elegant, mind you....

this code handles all the exporting from rslight to vichan.
-it checks the articles in the spool,
-builds an index file and a watermark file (if necessary),
-then resolves all the broken threads (fixed 10 iterations, have to make that dynamic later),
-then exports everything to vichan.

on the vichan side there is a modified post.php to get the messages.

so far the three parts (rslight, vichan and the script) are fully decoupled and individually called from cron.

in the long run code could be merged of course.

import script:

<?php

include "config.inc.php";
include "$file_newsportal";
include 'message.inc.php';

$groups = array(
'rocksolid.nodes',
'rocksolid.nodes.help',
'rocksolid.nodes.announce',
'rocksolid.shared.encryption',
'rocksolid.shared.entertainment',
'rocksolid.shared.freenet',
'rocksolid.shared.general',
'rocksolid.shared.hacking',
'rocksolid.shared.helpdesk',
'rocksolid.shared.i2p',
'rocksolid.shared.linux',
'rocksolid.shared.news',
'rocksolid.shared.offtopic',
'rocksolid.programming',
'rocksolid.shared.rocksolid',
'rocksolid.shared.security',
'rocksolid.social',
'rocksolid.shared.test',
'rocksolid.shared.tor',
);

if(!file_exists('xt.json')){
echo("no index found, building it \n\r");
$threads = build_threads($groups);
} else {
$threads = json_decode(file_get_contents('xt.json'), true);
$watermarks = json_decode(file_get_contents('xw.json'), true);
$threads = update_threads($groups, $threads, $watermarks);
} $thread_keys = array_keys($threads);
for ($i = 0; $i < 10; $i++){
$threads = stage($thread_keys, $threads);
}

$jsonFile = fopen('xt.json', 'w');
fwrite($jsonFile, json_encode($threads, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonFile);

update_sync($threads);

exit;

function build_threads($groups){
$threads = array();
$watermarks = array();
foreach($groups as $group){
$watermarks[$group] = array();
echo("building index for group " . $group . "\n\r");
for ($i = 0; $i < 1000; $i++){
$message = message_read($i, 0, $group);
if($message){
echo("processing message # " . $i . " from group " . $group . "\r");
$rawData = json_decode(json_encode((array) $message, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES), true);
$ID = $rawData['header']['id'];
$Ref = $rawData['header']['references']['0'];
$firstRef = explode("<", $Ref);
$Ref = ("<" . $firstRef[1]);
$threads[$ID] = array();
$threads[$ID]['parents'] = array();
$threads[$ID]['synced'] = false;
$threads[$ID]['number'] = $i;
$threads[$ID]['group'] = $group;
$threads[$ID]['message'] = array();
$threads[$ID]['message'] = $rawData;
if($Ref == "<"){
$threads[$ID]['op'] = true;
$threads[$ID]['solved'] = true;
} else {
$threads[$ID]['op'] = false;
$threads[$ID]['ref'] = $Ref;
$threads[$ID]['ref_org'] = $rawData['header']['references']['0'];
$threads[$ID]['solved'] = false;
}
array_push($watermarks[$group],$i);
}
}
}
$jsonFile = fopen('xt.json', 'w');
fwrite($jsonFile, json_encode($threads, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonFile);
$jsonWatermarks = fopen('xw.json', 'w');
fwrite($jsonWatermarks, json_encode((array) $watermarks, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonWatermarks);
return $threads;
} function update_threads($groups, $threads, $watermarks){
$update = false;
foreach($groups as $group){
echo("updating index for group " . $group . "\n\r");
for ($i = 0; $i < 1000; $i++){
if(!in_array($i,$watermarks[$group])){
$message = message_read($i, 0, $group);
if($message){
echo("processing message # " . $i . " from group " . $group . "\r");
$update = true;
$rawData = json_decode(json_encode((array) $message, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES), true);
$ID = $rawData['header']['id'];
$Ref = $rawData['header']['references']['0'];
$firstRef = explode("<", $Ref);
$Ref = ("<" . $firstRef[1]);
$threads[$ID] = array();
$threads[$ID]['parents'] = array();
$threads[$ID]['synced'] = false;
$threads[$ID]['number'] = $i;
$threads[$ID]['group'] = $group;
$threads[$ID]['message'] = array();
$threads[$ID]['message'] = $rawData;
if($Ref == "<"){
$threads[$ID]['op'] = true;
$threads[$ID]['solved'] = true;
} else {
$threads[$ID]['op'] = false;
$threads[$ID]['ref'] = $Ref;
$threads[$ID]['ref_org'] = $rawData['header']['references']['0'];
$threads[$ID]['solved'] = false;
}
array_push($watermarks[$group],$i);
}
}
}
}
if($update){
echo("saving updated threading\n\r");
$jsonFile = fopen('xt.json', 'w');
fwrite($jsonFile, json_encode($threads, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonFile);
echo("saving updated watermarks\n\r");
$jsonWatermarks = fopen('xw.json', 'w');
fwrite($jsonWatermarks, json_encode((array) $watermarks, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonWatermarks);
} else {
echo("no new files found\n\r");
}
return $threads;
}

function stage($thread_keys, $threads){
foreach($thread_keys as $thread_key){
if( ($threads[$thread_key]['solved'] !== true) && (threads[$thread_key]['op'] !== true) ){
echo("checking message" . $thread_key . "\r");
if ($threads[$thread_key]['parents']){
$to_check = end($threads[$thread_key]['parents']);
if(!array_key_exists($to_check, $threads)){
$threads[$thread_key]['op'] = true;
$threads[$thread_key]['ref'] = array();
$threads[$thread_key]['missing_ref'] = $to_check;
$threads[$thread_key]['solved'] = true;
} else {
if($threads[$to_check]['op'] == true){
$threads[$thread_key]['ref'] = $to_check;
$threads[$thread_key]['solved'] = true;
} else {
array_push($threads[$thread_key]['parents'], $threads[$to_check]['ref']);
array_filter($threads[$thread_key]['parents'], static function($var){return $var !== null;} );
}
}
} elseif ($threads[$thread_key]['ref']){
array_push($threads[$thread_key]['parents'], $threads[$thread_key]['ref']);
}
}
}
return $threads;
}

function update_sync($threads){
$update = false;
$thread_keys = array_keys($threads);
foreach($thread_keys as $thread_key){
if( ($threads[$thread_key]['synced'] == false) && ($threads[$thread_key]['solved'] == true) ){
echo("processing message # " . $threads[$thread_key]['number'] . " from group " . $threads[$thread_key]['group'] . "\n\r");
$rawData = $threads[$thread_key]['message'];
if($threads[$thread_key]['ref']){
$rawData['header']['references']['0'] = $threads[$thread_key]['ref'];
} else {
unset($rawData['header']['references']);
}
$paddedI = str_pad($threads[$thread_key]['number'], 5, '0', STR_PAD_LEFT);
$jsonFile = fopen('/var/www/html/vi/vichan-master/debug/' . $paddedI . '_' . $threads[$thread_key]['group'] . '.json', 'w');
fwrite($jsonFile, json_encode((array) $rawData, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonFile);
chown($jsonFile, 'www-data');
chgrp($jsonFile, 'www-data');
$update = true;
$threads[$thread_key]['synced'] = true;
echo($thread['synced'] . "\n\r");
}
}
if($update){
echo("saving updated syncing\n\r");
$jsonFile = fopen('xt.json', 'w');
fwrite($jsonFile, json_encode($threads, JSON_PRETTY_PRINT | JSON_UNESCAPED_SLASHES));
fclose($jsonFile);
} else {
echo("no new files found for syncing\n\r");
}
}
Click here to read the complete articleAttachments:  

guess i will open for business soon

<n.233.40xx8o@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=298&group=rocksolid.nodes#298

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: guess i will open for business soon
Date: Tue, 26 May 2020 09:24:55 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.233.40xx8o@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="26956"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Tue, 26 May 2020 16:24 UTC

....and switch def2.i2p to vichan

just a little security research before, guess shouldn't take too long.

cheers

trw

opsec check is good

<n.234.1ks519@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=299&group=rocksolid.nodes#299

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: opsec check is good
Date: Tue, 26 May 2020 12:44:12 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.234.1ks519@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="21161"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Tue, 26 May 2020 19:44 UTC

no bugs listed at bugtraq, none in my favorite hacker forum, none in google, no known hacks that I would heard about.
seems like we're goo to go.

cheers

trw

> goo to go.

<n.235.3s4rn9@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=300&group=rocksolid.nodes#300

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: > goo to go.
Date: Tue, 26 May 2020 12:47:12 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.235.3s4rn9@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="21641"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Tue, 26 May 2020 19:47 UTC

yeah, we are googoogoogoo...
good to go. spelling is difficult.

Re: basics are working

<af0db666e6c7dab4838ec58b91d4418e$1@www.novabbs.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=301&group=rocksolid.nodes#301

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Retro ...@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: basics are working
Date: Tue, 26 May 2020 19:45 UTC
Organization: Rocksolid Light
Message-ID: <af0db666e6c7dab4838ec58b91d4418e$1@www.novabbs.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.232.195omy@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="21772"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$g7YtmFskVIFxmMkGAojHlOKYpZO46BfnmFNJpEirjYB5v/DP.aOZW
 by: Retro Guy - Tue, 26 May 2020 19:45 UTC

Anonymous wrote:

> with some 11 exceptions my routine could glue all the threads together again.
> this is still far from being elegant, mind you....

> this code handles all the exporting from rslight to vichan.
> -it checks the articles in the spool,
> -builds an index file and a watermark file (if necessary),
> -then resolves all the broken threads (fixed 10 iterations, have to make that dynamic later),
> -then exports everything to vichan.

> on the vichan side there is a modified post.php to get the messages.

> so far the three parts (rslight, vichan and the script) are fully decoupled and individually called from cron.

That looks like a great way to handle it. So when complete, if I just add a $enable_vichan in config, then reference that in cron.php, I can just use that to decide whether to run the code at all. Is that correct?

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

yes that should work

<n.237.1zueiu@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=302&group=rocksolid.nodes#302

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: yes that should work
Date: Wed, 27 May 2020 00:58:20 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.237.1zueiu@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="7931"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Wed, 27 May 2020 07:58 UTC

>I can just use that to decide whether to run the code at all. Is that correct?

should work as far my export script is concerned.
on the vichan side of things i think the import script (the modified post.php) has to run from crontab directly, when i called post.php from another php script, I was getting errors (which could be fixed, i guess, but i could not find how, it was missing includes, most likely because the path was not right).

cheers

trw

Re: yes that should work

<1c6e36fd6d47d1387dfac1f87369534e$1@www.novabbs.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=303&group=rocksolid.nodes#303

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Retro ...@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: yes that should work
Date: Wed, 27 May 2020 09:10 UTC
Organization: Rocksolid Light
Message-ID: <1c6e36fd6d47d1387dfac1f87369534e$1@www.novabbs.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.237.1zueiu@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="17160"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$ljiXzlIoeiYgyYafSULqXe51sRIaCw/Ru/kwSuIG2/dm74J3S.dh6
 by: Retro Guy - Wed, 27 May 2020 09:10 UTC

Anonymous wrote:

>>I can just use that to decide whether to run the code at all. Is that correct?

> should work as far my export script is concerned.
> on the vichan side of things i think the import script (the modified post.php) has to run from crontab directly, when i called post.php from another php script, I was getting errors (which could be fixed, i guess, but i could not find how, it was missing includes, most likely because the path was not right).

That sounds likely. Running from cron.php is no problem, so no real reason to change it.

--
Posted on: Rocksolid Light
www.novabbs.com

cron or not ?

<n.239.3xbw1r@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=304&group=rocksolid.nodes#304

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: cron or not ?
Date: Wed, 27 May 2020 05:03:12 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.239.3xbw1r@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="6378"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Wed, 27 May 2020 12:03 UTC

>That sounds likely. Running from cron.php is no problem, so no real reason to change it.

There would be one reason, which is that running from cron, you can only run the script blindly, regardless if there messages to import or not. And in case of many messages, you can only import one per minute (limitation of cron).
Both is fine for now, but actually you can also use a browser to call the script locally, and this could be done from another script. I just have to figure out how to make curl disregard the proxy options of the system and send the request directly, than I can implement that directly in my import script.
Could use wget as well, but prefer not to use any exec if I don't have to.

cheers

trw

Re: guess i will open for business soon

<9215a36f37b5d9c947c3414131d9abe3$1@rslight.i2p>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=305&group=rocksolid.nodes#305

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Mei...@rslight.i2p (Mei)
Newsgroups: rocksolid.nodes
Subject: Re: guess i will open for business soon
Date: Thu, 28 May 2020 07:56 UTC
Organization: Rocksolid Light
Message-ID: <9215a36f37b5d9c947c3414131d9abe3$1@rslight.i2p>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.233.40xx8o@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="15623"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$cZdsjA53cTvRkEEAv4sl..7TwIuG1zsVRtgAgWlWYzDxTtj5MYvYW
 by: Mei - Thu, 28 May 2020 07:56 UTC

As my sight begins to return I curse you for making it so bright. We're on the DARK web, you can't have light themes here!

What do you mean "that's not what that means?" It is now!
--
Posted on: Rocksolid Light
rslight.i2p

Re: guess i will open for business soon

<64435c6faf4aaf33cdbca4fa76f1d12d$1@www.novabbs.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=306&group=rocksolid.nodes#306

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Retro ...@rslight.i2p (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: guess i will open for business soon
Date: Thu, 28 May 2020 08:52 UTC
Organization: Rocksolid Light
Message-ID: <64435c6faf4aaf33cdbca4fa76f1d12d$1@www.novabbs.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.233.40xx8o@anon.com> <9215a36f37b5d9c947c3414131d9abe3$1@rslight.i2p>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="23264"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$9MV3O63fLBtY0ZQpWfFV9O1rJ6j2ZCwtIeYhcpqwsBczWAXuaEqC2
 by: Retro Guy - Thu, 28 May 2020 08:52 UTC

Mei wrote:

> As my sight begins to return I curse you for making it so bright. We're on the DARK web, you can't have light themes here!

LOL! I was reading your post here (on rslight), so I decided to take a quick peek again at def2 to see how bright it is. Right after I clicked the tab and it came up, a small insect in my office started bashing into the screen! Yes, this really happened :)

> What do you mean "that's not what that means?" It is now!

We shall add this new meaning to the Rocksolid Bible.

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

Re: cron or not ?

<1751ee69ea223e23c884817408d3c23d$1@rslight.i2p>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=307&group=rocksolid.nodes#307

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: retro...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: cron or not ?
Date: Thu, 28 May 2020 02:23:15 -0700
Organization: Rocksolid
Lines: 11
Message-ID: <1751ee69ea223e23c884817408d3c23d$1@rslight.i2p>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.239.3xbw1r@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7Bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="27556"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: KNode/4.14.1
 by: Retro Guy - Thu, 28 May 2020 09:23 UTC

Anonymous wrote:

>>That sounds likely. Running from cron.php is no problem, so no real reason
>>to change it.
>
> There would be one reason, which is that running from cron, you can only
> run the script blindly, regardless if there messages to import or not. And
> in case of many messages, you can only import one per minute (limitation

How are you determining if there is a message to import? Can you loop until
no new messages?

Re: guess i will open for business soon

<57f76e5a8cf8df58041d2a77f07985f7$1@rslight.i2p>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=308&group=rocksolid.nodes#308

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: retro...@retrobbs.rocksolidbbs.com (Retro Guy)
Newsgroups: rocksolid.nodes
Subject: Re: guess i will open for business soon
Date: Thu, 28 May 2020 02:24:05 -0700
Organization: Rocksolid
Lines: 8
Message-ID: <57f76e5a8cf8df58041d2a77f07985f7$1@rslight.i2p>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.233.40xx8o@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7Bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="27863"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: KNode/4.14.1
 by: Retro Guy - Thu, 28 May 2020 09:24 UTC

Anonymous wrote:

> ...and switch def2.i2p to vichan
>
> just a little security research before, guess shouldn't take too long.
>
It looks great and seems to be working pretty well!

themes on def2.i2p

<n.244.1u5n3x@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=309&group=rocksolid.nodes#309

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: themes on def2.i2p
Date: Thu, 28 May 2020 02:50:13 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.244.1u5n3x@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="30397"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Thu, 28 May 2020 09:50 UTC

>As my sight begins to return I curse you for making it so bright. We're on the DARK web, you can't have light themes here!

If you have js turned on, you can change to a dark style at the bottom of the page (like darkgreen or so).

I just wanted to try something else for once.

ok, ok, i switched the default theme

<n.246.2u4gp5@anon.com>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=311&group=rocksolid.nodes#311

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: pos...@anon.com (Anonymous)
Newsgroups: rocksolid.nodes
Subject: ok, ok, i switched the default theme
Date: Thu, 28 May 2020 04:36:55 -0700
Organization: i2pn2 (i2pn.org)
Message-ID: <n.246.2u4gp5@anon.com>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4>
Content-Type: text/plain; charset=UTF-8
Injection-Info: i2pn2.org; posting-account="def2";
logging-data="12610"; mail-complaints-to="usenet@i2pn2.org"
 by: Anonymous - Thu, 28 May 2020 11:36 UTC

hope it is dark enough for you now, and may all the insects fly free and unbound :-)

Re: ok, ok, i switched the default theme

<84463b33d241bdfd69c481307bbfab7c$1@rslight.i2p>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=312&group=rocksolid.nodes#312

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!.POSTED!not-for-mail
From: Mei...@rslight.i2p (Mei)
Newsgroups: rocksolid.nodes
Subject: Re: ok, ok, i switched the default theme
Date: Fri, 29 May 2020 05:51 UTC
Organization: Rocksolid Light
Message-ID: <84463b33d241bdfd69c481307bbfab7c$1@rslight.i2p>
References: <7b6448e9ac3e8f40f5ff6b8fa9b433b6@def4> <n.246.2u4gp5@anon.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org; posting-account="retrobbs1";
logging-data="13719"; mail-complaints-to="usenet@i2pn2.org"
User-Agent: Rocksolid Light (news.novabbs.com/getrslight)
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on novabbs.com
X-Rslight-Site: $2y$10$hLZf4HROlBQWUo8Gf5V6rOH2WldJboSeFgWlqmAtmJMqNnglK8cgS
 by: Mei - Fri, 29 May 2020 05:51 UTC

Anonymous wrote:

> hope it is dark enough for you now, and may all the insects fly free and unbound :-)

Looks great, thanks. The bugs can finally crawl back into def2 and rslight where they belong :-P
--
Posted on: Rocksolid Light
rslight.i2p

Re: ok, ok, i switched the default theme

<b448e6fa5a88c2f6cbbd932e0a4ac0de@def4>

 copy mid

https://www.novabbs.com/computers/article-flat.php?id=313&group=rocksolid.nodes#313

 copy link   Newsgroups: rocksolid.nodes
Path: i2pn2.org!rocksolid2!def5!POSTED.localhost!not-for-mail
From: ano...@anon.com (anon)
Newsgroups: rocksolid.nodes
Message-ID: <b448e6fa5a88c2f6cbbd932e0a4ac0de@def4>
Subject: Re: ok, ok, i switched the default theme
Date: Fri, 29 May 2020 14:25:03+0000
Organization: def5
In-Reply-To: <84463b33d241bdfd69c481307bbfab7c$1@rslight.i2p>
References: <84463b33d241bdfd69c481307bbfab7c$1@rslight.i2p>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
 by: anon - Fri, 29 May 2020 14:25 UTC

>The bugs can finally crawl back into def2 and rslight where they belong :-P

a project with no bugs has not tried hard enough :-)

Posted on def4

Pages:1234
server_pubkey.txt

rocksolid light 0.9.7
clearnet tor