From armstrong.whit at gmail.com  Tue Dec  2 00:33:26 2008
From: armstrong.whit at gmail.com (Whit Armstrong)
Date: Mon, 1 Dec 2008 18:33:26 -0500
Subject: [Rd] parallel build for package? (equivalent of make -j8)
In-Reply-To: <4933C423.807@statistik.tu-dortmund.de>
References: <8ec76080811300725v1021f0b2l987da0db33c2f961@mail.gmail.com>
	<4932CD8A.6000402@biostat.ku.dk>
	<4933B025.7000701@statistik.tu-dortmund.de>
	<alpine.LFD.2.00.0812011022320.29048@gannet.stats.ox.ac.uk>
	<4933C423.807@statistik.tu-dortmund.de>
Message-ID: <8ec76080812011533w772853dcudd234a88304a50e8@mail.gmail.com>

yes, this was just a parallel build within one package.

Thanks very much for your help.

-Whit


On Mon, Dec 1, 2008 at 6:01 AM, Uwe Ligges
<ligges at statistik.tu-dortmund.de> wrote:
>
>
> Prof Brian Ripley wrote:
>>
>> On Mon, 1 Dec 2008, Uwe Ligges wrote:
>>
>>>
>>>
>>> Peter Dalgaard wrote:
>>>>
>>>> Whit Armstrong wrote:
>>>>>
>>>>> I have a package that takes about 20 minutes to compile which tends to
>>>>> prolong the compile/test/compile cycle.
>>>>>
>>>>> Does anyone know how to get R CMD check or R CMD INSTALL to use
>>>>> parallel make?
>>>>>
>>>>> I looked at R CMD INSTALL --help, but I don't see anything obvious
>>>>> arguments to do this.
>>>>
>>>> Platform?
>>>>
>>>> Does
>>>>
>>>> MAKE="make -j8" R CMD INSTALL ...
>>>>
>>>> not work?
>>>
>>> I cannot believe this works safely, at least when installing into the
>>> same library, because of R's lock mechanism that locks a library if *one*
>>> installation is running ...
>>
>> It does say 'package' (singular).
>
> Good point, I thought we were talking about parallelizing many packages'
> installations. One should read the original question more carefully rather
> than starting from a response.....
> My apologies for the nonsense - and you all know fortune("talking nonsense")
> anyway:
>
> Uwe Ligges: I just told nonsense, stepclass() does not make sense with
> randomForest(), obviously ... (wonder why nobody shouted?).
> Douglas Bates: Oh, we're just so used to you talking nonsense that we don't
> bother to point it out any more :-)
>   -- Uwe Ligges and Douglas Bates
>      R-help (July 2005)
>
>
> Best,
> Uwe
>
>
>
>> It you know what you are doing you
>>
>> can switch off the locking (and you also need to worry about installing
>> dependencies in the right order, at least for source installs).
>
>>
>>
>> I don't see the issue though: if you run R CMD INSTALL on a package
>> directory (rather than a tarball), 'make' will only re-make the compiled
>> code whose sources have changed.  Or is 'compile' being used loosely for
>> 'install' (and even so it is rare for the bits that are always done, e.g.
>> dumping R code, to take long).
>>
>>>
>>> Best,
>>> Uwe
>>>
>>>
>>>> (Beware: Here there be Tygers. Parallel makes have their surprises....)
>>>>
>>>
>>> ______________________________________________
>>> R-devel at r-project.org mailing list
>>> https://stat.ethz.ch/mailman/listinfo/r-devel
>>>
>>
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
>



[Rd] parallel build for package? (equivalent of make -j8)
Whit Armstrong