From selivanov.dmitriy at gmail.com  Sun Aug 13 13:15:10 2017
From: selivanov.dmitriy at gmail.com (Dmitriy Selivanov)
Date: Sun, 13 Aug 2017 15:15:10 +0400
Subject: [Rd] Help to create bugzilla account
In-Reply-To: <22927.29924.782435.781870@bud.eddelbuettel.com>
References: <CAJdZCv3oUhwiqJUTwKy0ZvwkcB=qdA5WcBdfMsdAcJED9f356w@mail.gmail.com>
 <22925.47256.496267.20679@stat.math.ethz.ch>
 <CALEXWq1qcUU=cR-YT2fujXfB4HNd-7zJFdKhyuJ9icWRkV9-HQ@mail.gmail.com>
 <BB27F8C5-00DD-42D2-AD1E-5BB8E9E2AE81@r-project.org>
 <CAJdZCv0NAMf9qYodsondd5BHF1JSsP2G=wU63UXuTwfQahRmjA@mail.gmail.com>
 <alpine.DEB.2.20.1708121453120.4008@luke-Latitude>
 <22927.29924.782435.781870@bud.eddelbuettel.com>
Message-ID: <CAJdZCv1-8xBGKvxi9a702eiYPNo5rT1eB43n=aB7Az6vfSHuKA@mail.gmail.com>

Very interesting information about switching glibc malloc to jemalloc.

So I see action plan as following:

   1. set up some benchmark (need to think about design)
   2. Run it on ubuntu machine with default glibc malloc
   3. Run it with malloc_trim passed with reg.finalizer()
   4. Run it with jemalloc
   5. Review results and if they will look better than with glibc malloc -
   possibly consider switch R builds to use jemalloc on Debian, Ubuntu

Can't promise about timeline, but I will definitely try to investigate.

2017-08-13 1:36 GMT+04:00 Dirk Eddelbuettel <edd at debian.org>:

>
> On 12 August 2017 at 15:10, luke-tierney at uiowa.edu wrote:
> | As the Python posts poitns out, it is possible to use alternate malloc
> | implementations, either rebuilding R to use them or using LD_PRELOAD.
> | On Ubuntu for example, you can have R use jemalloc with
> |
> | sudo apt-get install libjemalloc1
> | env LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.1 R
> |
> | This does not seem to hold onto memory to the same degree, but I don't
> | know about any other aspect of its performance.
>
> Interesting.
>
> I don't really know anything about malloc versus jemalloc internals but I
> can
> affirm that redis -- an in-memory database written in single-threaded C for
> high performance -- in its Debian builds has been using jemalloc for years,
> presumably by choice of the maintainer. (We are very happy users of [a
> gently
> patched] redis at work; lots of writes; very good uptime.)
>
> Having the ability to switch to jemalloc, we could design a test bench and
> compare what the impact is.
>
> Similarly, if someone cared, I could (presumably) alter the default R build
> for Debian and Ubunto to also switch to jemalloc.
>
> Anybody feel like doing some empirics?
>
> Dirk
>
> --
> http://dirk.eddelbuettel.com | @eddelbuettel | edd at debian.org
>



-- 
Regards
Dmitriy Selivanov

	[[alternative HTML version deleted]]



[Rd] Help to create bugzilla account
Dmitriy Selivanov