Rocksolid Light

Welcome to novaBBS (click a section below)

mail  files  register  newsreader  groups  login

Message-ID:  

"Ignorance is the soil in which belief in miracles grows." -- Robert G. Ingersoll


devel / comp.infosystems.gopher / Gopher mirroring tool

SubjectAuthor
* Gopher mirroring toolandres
+* Re: Gopher mirroring toolDennis Boone
|`* Re: Gopher mirroring tooldcb
| `- Re: Gopher mirroring tool -- Python 3 scriptdcb
+- Re: Gopher mirroring toolSzczezuja.space
`- Re: Gopher mirroring toolBen Collver

1
Gopher mirroring tool

<slrntdag9n.di9.andres@openbsd.home.local>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=120&group=comp.infosystems.gopher#120

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!eternal-september.org!reader01.eternal-september.org!.POSTED!not-for-mail
From: and...@disroot.org (andres)
Newsgroups: comp.infosystems.gopher
Subject: Gopher mirroring tool
Date: Mon, 18 Jul 2022 11:17:20 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 8
Message-ID: <slrntdag9n.di9.andres@openbsd.home.local>
Injection-Date: Mon, 18 Jul 2022 11:17:20 -0000 (UTC)
Injection-Info: reader01.eternal-september.org; posting-host="826735917af6b2fce435c3cd121fc66d";
logging-data="335364"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/iIffvhpBpw9iRh2OSkmm0"
User-Agent: slrn/1.0.3 (OpenBSD)
Cancel-Lock: sha1:T9TVMxnwYCaa6tM1QbZv2/Hzyes=
 by: andres - Mon, 18 Jul 2022 11:17 UTC

Hello all. Does anyone know some Gopher mirroring tool a
la "wget --mirror" does on HTTP(S)? I already tried
pavuk, but it misses some relative links.
I tried to mirror the whole archive from
gopher://mozz.us/1/funnybone, but it didn't
neither download the issues nor the yearly
items linked as Gopher directories.

Re: Gopher mirroring tool

<Mv2dna1cedkUFUj_nZ2dnUU7-THNnZ2d@giganews.com>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=121&group=comp.infosystems.gopher#121

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!weretis.net!feeder6.news.weretis.net!1.us.feeder.erje.net!feeder.erje.net!border1.nntp.dca1.giganews.com!nntp.giganews.com!buffer1.nntp.dca1.giganews.com!news.giganews.com.POSTED!not-for-mail
NNTP-Posting-Date: Mon, 18 Jul 2022 11:21:29 -0500
Sender: Dennis Boone <drb@yagi.h-net.org>
From: drb...@ihatespam.msu.edu (Dennis Boone)
Subject: Re: Gopher mirroring tool
Newsgroups: comp.infosystems.gopher
References: <slrntdag9n.di9.andres@openbsd.home.local>
User-Agent: tin/2.4.5-20201224 ("Glen Albyn") (FreeBSD/13.0-RELEASE-p6 (amd64))
Message-ID: <Mv2dna1cedkUFUj_nZ2dnUU7-THNnZ2d@giganews.com>
Date: Mon, 18 Jul 2022 11:21:29 -0500
Lines: 14
X-Usenet-Provider: http://www.giganews.com
X-Trace: sv3-2hN1gEit727AJsUz/Jz6ODpGOtL8fqL7uuhF6ZX7dpBvgALpcoQFsq33u+rPaUZtCBjMkL4BKAAF6r6!yQXi40ymBvNHlW1h5s4DWW8XzHAEjbrMrVjUcu1uM+d2dF5vpmSE/Dpwq5SGo//M+hpgW0M=
X-Complaints-To: abuse@giganews.com
X-DMCA-Notifications: http://www.giganews.com/info/dmca.html
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40
X-Original-Bytes: 1646
 by: Dennis Boone - Mon, 18 Jul 2022 16:21 UTC

> Hello all. Does anyone know some Gopher mirroring tool a
> la "wget --mirror" does on HTTP(S)? I already tried
> pavuk, but it misses some relative links.
> I tried to mirror the whole archive from
> gopher://mozz.us/1/funnybone, but it didn't
> neither download the issues nor the yearly
> items linked as Gopher directories.

The gopher protocol is simple enough you could probably build one
without too much effort. The perl modules LWP::Protocol::gopher and/or
URI::gopher might do a fair amount of the work. Python doesn't seem to
have much in the way of useful libraries to help.

De

Re: Gopher mirroring tool

<tbju7g$98c$1@gioia.aioe.org>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=123&group=comp.infosystems.gopher#123

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!aioe.org!WusWrVbDloS/7tPMWr8uDQ.user.46.165.242.91.POSTED!not-for-mail
From: dotcomb...@somnolescent.net (dcb)
Newsgroups: comp.infosystems.gopher
Subject: Re: Gopher mirroring tool
Date: Sun, 24 Jul 2022 12:06:54 -0500
Organization: Aioe.org NNTP Server
Lines: 27
Message-ID: <tbju7g$98c$1@gioia.aioe.org>
References: <slrntdag9n.di9.andres@openbsd.home.local> <Mv2dna1cedkUFUj_nZ2dnUU7-THNnZ2d@giganews.com>
Injection-Info: gioia.aioe.org; logging-data="9484"; posting-host="WusWrVbDloS/7tPMWr8uDQ.user.gioia.aioe.org"; mail-complaints-to="abuse@aioe.org";
X-Newsreader: Microsoft Outlook Express 6.00.2900.5512
X-Notice: Filtered by postfilter v. 0.9.2
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5512
X-MSMail-Priority: Normal
X-RFC2646: Format=Flowed; Original
X-Priority: 3
 by: dcb - Sun, 24 Jul 2022 17:06 UTC

> > Hello all. Does anyone know some Gopher mirroring tool a
> > la "wget --mirror" does on HTTP(S)? I already tried
> > pavuk, but it misses some relative links.
> > I tried to mirror the whole archive from
> > gopher://mozz.us/1/funnybone, but it didn't
> > neither download the issues nor the yearly
> > items linked as Gopher directories.
>
> The gopher protocol is simple enough you could probably build one
> without too much effort. The perl modules LWP::Protocol::gopher and/or
> URI::gopher might do a fair amount of the work. Python doesn't seem to
> have much in the way of useful libraries to help.
>
> De

I wrote a Python library called Pituophis
(https://github.com/dotcomboom/Pituophis) some time ago that would help
here.
Recursively parsing each 1-type menu, fetching all the 0-type items and
saving them shouldn't be too bad. I can write a small script for it if you'd
like.

Also this is my first newspost, sorry if I made a mistake..

dcb

Re: Gopher mirroring tool -- Python 3 script

<tbk7e0$6fo$1@gioia.aioe.org>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=124&group=comp.infosystems.gopher#124

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!aioe.org!WusWrVbDloS/7tPMWr8uDQ.user.46.165.242.91.POSTED!not-for-mail
From: dotcomb...@somnolescent.net (dcb)
Newsgroups: comp.infosystems.gopher
Subject: Re: Gopher mirroring tool -- Python 3 script
Date: Sun, 24 Jul 2022 14:43:57 -0500
Organization: Aioe.org NNTP Server
Lines: 14
Message-ID: <tbk7e0$6fo$1@gioia.aioe.org>
References: <slrntdag9n.di9.andres@openbsd.home.local> <Mv2dna1cedkUFUj_nZ2dnUU7-THNnZ2d@giganews.com> <tbju7g$98c$1@gioia.aioe.org>
Injection-Info: gioia.aioe.org; logging-data="6648"; posting-host="WusWrVbDloS/7tPMWr8uDQ.user.gioia.aioe.org"; mail-complaints-to="abuse@aioe.org";
X-Newsreader: Microsoft Outlook Express 6.00.2900.5512
X-Priority: 3
X-MSMail-Priority: Normal
X-RFC2646: Format=Flowed; Response
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5512
X-Notice: Filtered by postfilter v. 0.9.2
 by: dcb - Sun, 24 Jul 2022 19:43 UTC

dcb wrote:
> Recursively parsing each 1-type menu, fetching all the 0-type items and
> saving them shouldn't be too bad. I can write a small script for it if
> you'd like.

I wrote a script:
https://gist.github.com/dotcomboom/1c216ea08da60d0f1c0810a33963b216

Should be able to put the starting menu url in the list and it'll download
it recursively.

dcb

Re: Gopher mirroring tool

<slrnu30poq.30ijr.szczezuja@vps648005.ovh.net>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=154&group=comp.infosystems.gopher#154

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!eternal-september.org!feeder.eternal-september.org!.POSTED!not-for-mail
From: szczez...@sdf.org (Szczezuja.space)
Newsgroups: comp.infosystems.gopher
Subject: Re: Gopher mirroring tool
Date: Fri, 7 Apr 2023 18:55:22 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 17
Message-ID: <slrnu30poq.30ijr.szczezuja@vps648005.ovh.net>
References: <slrntdag9n.di9.andres@openbsd.home.local>
Injection-Date: Fri, 7 Apr 2023 18:55:22 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="a0c847816a06898e86d909006ddedcd6";
logging-data="975669"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+1fOlHAV4QeqH6+cMQsb3yGAVynbB5Ve4="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:WQoQqR7XSrJNfqCoTdXG0OVMPrQ=
 by: Szczezuja.space - Fri, 7 Apr 2023 18:55 UTC

On 2022-07-18, andres <andres@disroot.org> wrote:
> Hello all. Does anyone know some Gopher mirroring tool a
> la "wget --mirror" does on HTTP(S)? I already tried
> pavuk, but it misses some relative links.
> I tried to mirror the whole archive from
> gopher://mozz.us/1/funnybone, but it didn't
> neither download the issues nor the yearly
> items linked as Gopher directories.

I'm testing https://sr.ht/~lioploum/offpunk/ and its cache folder for
the similar usecase. I'd like to create personal "Internet Archive" for
several Gopherholes and publish it.

--
.-=-. Szczezuja; on the small-net:
( S\ \ gemini://szczezuja.space/ - gemlog & tinylog
`--' / gopher://sdf.org:70/0/users/szczezuja/ - phlog

Re: Gopher mirroring tool

<slrnu32upu.1uv.bencollver@svadhyaya.localdomain>

  copy mid

https://www.novabbs.com/devel/article-flat.php?id=155&group=comp.infosystems.gopher#155

  copy link   Newsgroups: comp.infosystems.gopher
Path: i2pn2.org!i2pn.org!eternal-september.org!feeder.eternal-september.org!.POSTED!not-for-mail
From: bencoll...@tilde.pink (Ben Collver)
Newsgroups: comp.infosystems.gopher
Subject: Re: Gopher mirroring tool
Date: Sat, 8 Apr 2023 14:38:57 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 9
Message-ID: <slrnu32upu.1uv.bencollver@svadhyaya.localdomain>
References: <slrntdag9n.di9.andres@openbsd.home.local>
Injection-Date: Sat, 8 Apr 2023 14:38:57 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="aa24fb139f99901f4ae8f678b014282a";
logging-data="1373320"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19V7E+VGVVp83CTkHXrkK7HJ6DFlVJakec="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:W/mCOl2RxhOTVbJOCHmBOnrlmBA=
 by: Ben Collver - Sat, 8 Apr 2023 14:38 UTC

On 2022-07-18, andres <andres@disroot.org> wrote:
> Hello all. Does anyone know some Gopher mirroring tool a
> la "wget --mirror" does on HTTP(S)?

I wrote a gopher mirroring tool in Tcl.

I have only used it on Linux.

https://wiki.tcl-lang.org/page/gopher%2Dget


devel / comp.infosystems.gopher / Gopher mirroring tool

1
server_pubkey.txt

rocksolid light 0.9.81
clearnet tor