From rossini at blindglobe.net  Tue Mar  2 18:20:01 2004
From: rossini at blindglobe.net (A.J. Rossini)
Date: Tue Mar  2 18:18:32 2004
Subject: [Rd] Some timings for 64 bit Opteron (ATLAS, GOTO, std)
In-Reply-To: <x2llmjwa4r.fsf@biostat.ku.dk> (Peter Dalgaard's message of "02
	Mar 2004 16:18:12 +0100")
References: <3A822319EB35174CA3714066D590DCD504AF78D7@usrymx25.merck.com>
	<x2llmjwa4r.fsf@biostat.ku.dk>
Message-ID: <85n06zf9oe.fsf@servant.blindglobe.net>


And my understanding is completely imperfect, but note that
organization (and selection) of memory modules on the motherboard can
be critical for speed with the opterons; well known issue on the
beowulf lists.

best,
-tony

Peter Dalgaard <p.dalgaard@biostat.ku.dk> writes:

> "Liaw, Andy" <andy_liaw@merck.com> writes:
>
>> Hi Martin,
>> 
>> When I attended the LinuxWorld Expo in NYC back in January, I chatted with
>> some folks at the AMD booth, as well as guys from Penguin Computing (where
>> we bought our Opteron box).  I was told that the Operton has this somewhat
>> strange setup that the memory is controlled by one CPU.  The net effect of
>> this being that when both CPUs are running, one might only be running at
>> around 90% instead of 99%.  The `NUMA' kernel is supposed to fix this
>> problem.  I wonder if this is related to the performance of the threaded
>> GOTO lib that you saw.  Has anyone tried the NUMA kernel?
>> 
>> Best,
>> Andy
>
> My understanding is slightly different (I could be wrong though, I'm
> hardly a hardware engineer): Each CPU controls one block of memory,
> and only some motherboard have memory slots for both CPUs. If CPU2
> wants to talk to CPU1's memory it has to ask CPU1 for it, with the
> obvious potential for a performance hit.
>
> I'll see if I can get around to redoing my Opteron builds and trying
> Martin's benchmarks in the next couple of days.
>
>         -p
>
> -- 
>    O__  ---- Peter Dalgaard             Blegdamsvej 3  
>   c/ /'_ --- Dept. of Biostatistics     2200 Cph. N   
>  (*) \(*) -- University of Copenhagen   Denmark      Ph: (+45) 35327918
> ~~~~~~~~~~ - (p.dalgaard@biostat.ku.dk)             FAX: (+45) 35327907
>
> ______________________________________________
> R-devel@stat.math.ethz.ch mailing list
> https://www.stat.math.ethz.ch/mailman/listinfo/r-devel
>

-- 
rossini@u.washington.edu            http://www.analytics.washington.edu/ 
Biomedical and Health Informatics   University of Washington
Biostatistics, SCHARP/HVTN          Fred Hutchinson Cancer Research Center
UW (Tu/Th/F): 206-616-7630 FAX=206-543-3461 | Voicemail is unreliable
FHCRC  (M/W): 206-667-7025 FAX=206-667-4812 | use Email

CONFIDENTIALITY NOTICE: This e-mail message and any attachme...{{dropped}}


[Rd] Some timings for 64 bit Opteron (ATLAS, GOTO, std)
A.J. Rossini