From ripley at stats.ox.ac.uk  Sat Feb 12 18:12:47 2011
From: ripley at stats.ox.ac.uk (Prof Brian Ripley)
Date: Sat, 12 Feb 2011 17:12:47 +0000 (GMT)
Subject: [Rd] R limits documented?
In-Reply-To: <4D569A79.6030202@statistik.tu-dortmund.de>
References: <AANLkTinoie27eMBdq7=QBBcrhBLorhFoiBX6sW+6vBzm@mail.gmail.com>
	<7C9BDD66-4BF5-4A49-A3E1-B96274457DA4@comcast.net>
	<433F8810-FE8D-4AD0-A012-45C056A505FA@r-project.org>
	<6EAEBC2E-42FD-4D2B-BDAE-94CEC63E9FE9@r-project.org>
	<E85328A3-DCDD-4BF5-B1E8-749B68FB5F3A@comcast.net>
	<4D569A79.6030202@statistik.tu-dortmund.de>
Message-ID: <alpine.LFD.2.02.1102121701040.32157@gannet.stats.ox.ac.uk>

On Sat, 12 Feb 2011, Uwe Ligges wrote:

> I think it is easiest to point people to the manual "R Internals" for 
> questions on the size of integers, pointers etc.

But ?"Memory-limits" is a good start.

The messages below (which were not from a current version of R with 
that call!) come from

> as.integer(50000 * 50000)
[1] NA
Warning message:
NAs introduced by coercion

and times = NA is of course invalid.

>
> Best,
> Uwe Ligges
>
>
>
> On 12.02.2011 03:24, David Winsemius wrote:
>> 
>> On Feb 11, 2011, at 8:46 PM, Simon Urbanek wrote:
>> 
>>> 
>>> On Feb 11, 2011, at 8:45 PM, Simon Urbanek wrote:
>>> 
>>>> 
>>>> On Feb 11, 2011, at 7:55 PM, David Winsemius wrote:
>>>> 
>>>>> 
>>>>> On Feb 11, 2011, at 7:09 PM, Dominick Samperi wrote:
>>>>> 
>>>>>> Is there documentation on R limits?
>>>>>> That is, max matrix size, etc.?
>>>>>> 
>>>>>> Diagnostics when limits are exceeded are not always
>>>>>> meaningful. For example:
>>>>>>> x <- rep(0,50000*50000)
>>>>>> Error in rep(0, 50000 * 50000) : invalid 'times' argument
>>>>>> In addition: Warning message:
>>>>>> In as.vector(data) : NAs introduced by coercion
>>>>> 
>>>>>> x <- rep(0,40000*50000)
>>>>>> gc()
>>>>> used (Mb) gc trigger (Mb) max used (Mb)
>>>>> Ncells 4673306 249.6 6945861 371.0 5315868 283.9
>>>>> Vcells 2165579376 16522.1 4374103452 33371.8 4165580443 31780.9
>>>>>> object.size(x)
>>>>> 16000000040 bytes
>>>>> 
>>>>> So that is about 2/3 of my installed memory. This seems to be a
>>>>> limitation due to the maximum positive integer being ~ 2*10^9
>>>>>> 2*10^9 < 50000*50000
>>>>> [1] TRUE
>>>>>> 2*10^9 < 40000*50000
>>>>> [1] FALSE
>>>>> 
>>>> 
>>>> The actual limit is for obvious reasons 2^31-1
>>>> 
>>>>> as.integer(2^31-1)
>>>> [1] 2147483647
>>>>> as.integer(2^31)
>>>> [1] NA
>>>> Warning message:
>>>> NAs introduced by coercion
>>>> 
>>>> (ok, for those that this is not obvious: the integer type ("int" in
>>>> C) is 32-bit wide and it is a signed type so the range is -2^31-1 ..
>>>> 2^31-1 -- the minus one on each side is the representation of NA and
>>>> 0 respectively).
>>>> 
>>> 
>>> correction: the range should have read -(2^31-1) .. 2^31
>> 
>> I was using the number given in the help page documentation for
>> "integer". (Part of the question was whether it was "documented".) I did
>> understand that it was d/t the 4 byte range.
>> 
>> Regarding the second part of the OP's question.... this is from the
>> "character" help page:
>> "as.character truncates components of language objects to 500 characters
>> (was about 70 before 1.3.1)."
>> 
>> And there was a posting from Prof Ripley regarding some other
>> limitations that had been recently modified:
>> https://stat.ethz.ch/pipermail/r-devel/2010-November/058989.html
>> 
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
>

-- 
Brian D. Ripley,                  ripley at stats.ox.ac.uk
Professor of Applied Statistics,  http://www.stats.ox.ac.uk/~ripley/
University of Oxford,             Tel:  +44 1865 272861 (self)
1 South Parks Road,                     +44 1865 272866 (PA)
Oxford OX1 3TG, UK                Fax:  +44 1865 272595



[Rd] R limits documented?
Prof Brian Ripley