Path: i2pn2.org!i2pn.org!news.swapon.de!fu-berlin.de!uni-berlin.de!not-for-mail
From: pbr...@anode.ca (Paul Bryan)
Newsgroups: comp.lang.python
Subject: Re: Python script seems to stop running when handling very large
dataset
Date: Fri, 29 Oct 2021 16:33:41 -0700
Lines: 21
Message-ID: <mailman.144.1635550427.23718.python-list@python.org>
References: <CA+i5JwbHvfje0dDEQ9HRUe2PDhDxNUXg41r_veuU-V-EW4f=4A@mail.gmail.com>
<84c1a27050b3f0cb3a46cb9137dc71dfe7e09bb9.camel@anode.ca>
Mime-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Trace: news.uni-berlin.de oPbBWmcuneEiRYpctDADiABiUzCYNfKq+Zg196tvdSRg==
Return-Path: <pbryan@anode.ca>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
Authentication-Results: mail.python.org; dkim=pass
reason="2048-bit key; unprotected key"
header.d=anode.ca header.i=@anode.ca header.b=FxO+dM4M;
dkim-adsp=pass; dkim-atps=neutral
X-Spam-Status: OK 0.001
X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; '(e.g.': 0.05; 'provided,':
0.05; 'usage': 0.05; 'intermediate': 0.07; 'subject:when': 0.07;
'subject:script': 0.09; 'subject:Python': 0.12; 'memory': 0.15;
'dataset': 0.16; 'dataset.': 0.16; 'free?': 0.16;
'received:10.202': 0.16; 'received:10.202.2': 0.16;
'received:10.202.2.163': 0.16; 'received:internal': 0.16;
'received:messagingengine.com': 0.16; 'subject:running': 0.16;
'subject:stop': 0.16; 'system?': 0.16; 'using?': 0.16; 'wrote:':
0.16; 'python': 0.16; 'libraries': 0.19; 'to:addr:python-list':
0.20; 'fri,': 0.22; 'version': 0.23; 'anyone': 0.25; 'seems':
0.26; 'space': 0.26; 'subject:large': 0.26; 'this?': 0.29; 'header
:User-Agent:1': 0.30; 'but': 0.32; 'there': 0.33; 'script': 0.33;
'header:In-Reply-To:1': 0.34; 'running': 0.34; 'handling': 0.35;
'received:66': 0.35; 'files': 0.36; 'using': 0.37; 'during': 0.69;
'shed': 0.69; 'subject:very': 0.69; 'little': 0.73; 'monitor':
0.81; 'shi': 0.84; 'subject: \n ': 0.84; 'subject:handling': 0.84
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=anode.ca; h=
message-id:subject:from:to:date:in-reply-to:references
:content-type:mime-version; s=fm2; bh=dpstLjckWpvWAp5X0I329psmNu
Vs32iTyFKNQnyNuSA=; b=FxO+dM4MvcaCJQzozx8FM3OoFWRfi1kgrwPAOs0q/Q
11KHG/BI9TFFSNvg58mcrfaYi7QpxtI5A3LFBjqOGUFt7LeczMq6Nb62IFV35Ven
VjQOTeY1fu2IJ5HBDpJkudyzAkutaVM6Z73Pj3puqy59wEZKj7N8Y4kGbEiPNLrH
HgonAgNMVvZpovJOYtshPaBEWApXU1aJy3magylk3ijUU0pPdKZk9++7MGXtmVDg
ZThpqMjIy+IXfOVgrnUOlihb9uE2qgiiCP7MRxPliOcIJV+jULnJTi8karAyBcJj
Ci9cDQ8G2mUcEWWJ/D+iGsibzFcXslNAjC4CbOGQzzoQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
messagingengine.com; h=content-type:date:from:in-reply-to
:message-id:mime-version:references:subject:to:x-me-proxy
:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=dpstLj
ckWpvWAp5X0I329psmNuVs32iTyFKNQnyNuSA=; b=nMxRsimTNxyzdbdw0rzAfB
q3skd5E844kKDVYUVdjB3ySkMTJXxRtmYH6hDymFtpJSNuLDCg35tVphGjwUu74V
zPaWeGUD4kvl5mlcB0p+aOvS0u9gAiYBns9TZKJnR+vtsV+Ay+LIukazx4qzYjcY
qt80LjkaFuCnSa8EJxDyxATQjJIf7X3sMg6YVqvW5HhKd/SZzYRuy7a75kjtD892
5CQDM92unxb7KTK82DlM5hMfzltDzWMAnUtQXb3+WtvgDvmAqg1lAw4fC/nRR8xQ
OMDlUaDVDjU9HIBNP9q1mjsb9mzKOaxWYYtZ3umZRtHSFwesDZWRJ6z6C9nVLjUw
==
X-ME-Sender: <xms:14R8YbqIdQBnbo_2551CbwxRfjFkHPBRUImIS_qMn33ENUu_Zow4lA>
<xme:14R8YVpvUGoizBKlSOvRiQ9c3XzChG7HPoLnbbIVGp4fgTdTiW5zUjcpBBeGcyVS8
oekiFP_zdX8uRHqe2Q>
X-ME-Received: <xmr:14R8YYOdojIrBR6kW1_cJ26X29uAV4YkW_wtMH6VhpouFBim9VMHzA2Iw4BpAEE6d3Z-pV7-rFkwbW8P5PJHr_v9_TMdgeny-jpbmQ>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddrvdegiedgudeiucetufdoteggodetrfdotf
fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne
cujfgurhepkffuhffvffgjfhgtfgggsegrtderredtreejnecuhfhrohhmpefrrghulhcu
uehrhigrnhcuoehpsghrhigrnhesrghnohguvgdrtggrqeenucggtffrrghtthgvrhhnpe
dvtdetieekhfetlefgvdffieegteekkeevfeegiefgteeijeeulefhfeehkeeigeenucev
lhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehpsghrhigrnh
esrghnohguvgdrtggr
X-ME-Proxy: <xmx:14R8Ye4uaLzahiN4cXzEIubW3Gmbr3dhmNGNwo7QNJPuHEZjdT_82Q>
<xmx:14R8Ya6TMbbbgxJ_E3TKLT99Djs7e2QU9yONyA3rjOHK0mcf07qd5g>
<xmx:14R8YWjRGKdc_gecQdcdaEK4kXtOZsMWYNgdWnD7lmcVo_bHFj-wMw>
<xmx:14R8YfjHBtA2raWTOMEaBSWkPSkxiSrn-0xA2VqZj_I4yaZa2mls9Q>
In-Reply-To: <CA+i5JwbHvfje0dDEQ9HRUe2PDhDxNUXg41r_veuU-V-EW4f=4A@mail.gmail.com>
User-Agent: Evolution 3.40.4
X-Content-Filtered-By: Mailman/MimeDel 2.1.35
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.35
Precedence: list
List-Id: General discussion list for the Python programming language
<python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>,
<mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <https://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>,
<mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <84c1a27050b3f0cb3a46cb9137dc71dfe7e09bb9.camel@anode.ca>
X-Mailman-Original-References: <CA+i5JwbHvfje0dDEQ9HRUe2PDhDxNUXg41r_veuU-V-EW4f=4A@mail.gmail.com>