From |uc@r @end|ng |rom |edor@project@org  Fri Apr 12 11:32:24 2019
From: |uc@r @end|ng |rom |edor@project@org (=?UTF-8?Q?I=C3=B1aki_Ucar?=)
Date: Fri, 12 Apr 2019 11:32:24 +0200
Subject: [Rd] SUGGESTION: Settings to disable forked processing in R,
 e.g. parallel::mclapply()
In-Reply-To: <CAFDcVCSPzMYE9A9V==Gs2yYTuH+YDqWhT_q=WU4AU5JL0WzX=A@mail.gmail.com>
References: <CAFDcVCSPzMYE9A9V==Gs2yYTuH+YDqWhT_q=WU4AU5JL0WzX=A@mail.gmail.com>
Message-ID: <CALEXWq3RapiDCTOFUerzxfiawYBu3LFxpCQpYRwmL3MQBh-S4g@mail.gmail.com>

On Thu, 11 Apr 2019 at 22:07, Henrik Bengtsson
<henrik.bengtsson at gmail.com> wrote:
>
> ISSUE:
> Using *forks* for parallel processing in R is not always safe.
> [...]
> Comments?

Using fork() is never safe. The reference provided by Kevin [1] is
pretty compelling (I kindly encourage anyone who ever forked a process
to read it). Therefore, I'd go beyond Henrik's suggestion, and I'd
advocate for deprecating fork clusters and eventually removing them
from parallel.

[1] https://www.microsoft.com/en-us/research/uploads/prod/2019/04/fork-hotos19.pdf

-- 
I?aki ?car



[Rd] SUGGESTION: Settings to disable forked processing in R, e.g. parallel::mclapply()
=?UTF-8?Q?I=C3=B1aki_Ucar?=