From sachko.honda at mountainpacificgroup.com  Tue Dec 31 02:06:50 2013
From: sachko.honda at mountainpacificgroup.com (Sachko Honda)
Date: Mon, 30 Dec 2013 19:06:50 -0600
Subject: [Rd] SQLite database file gets corrupted and XP goes blue
Message-ID: <42143135B5270A45996065C2EFFC2B590BB98C58@MBX39.exg5.exghost.com>

Dear fellows,

I'm getting blue screen on XP while populating SQLite database, using
RStudio and RQLite package.

The blue screen says "INVALID PROCESS ATTACH ATTEMPT" before goes into
memory check and reboot.
The database (file) is corrupted and not readable after this happens.

I'm iterating over CSV files, each contans a time-series of as many as
500x5000: rows being dates, columns being dependent variables.  For each
CSV creates a 500x5000 matrix (preallocated), and it is "remove"-ed
immediately after its use, among other relatively large objects.

Without this explicit resource deallocation, the blue screen stuff
occurred at much earlier during the process.

Still, XP's Process Monitor shows steady increase in memory usage. 

My XP has 3GB RAM.  It seems that the screen goes blue when the usage
goes near 1GB.

The database file, when it is corrupted, has only 150MB.  SQLite's max
db size is 2TB, XP32's max file size is 4GB.  So, I'm well under the limits.

In the past, when an R process goes out of memory, it rather graceful
returned, like "Out of memory".

I have closed any other applications that accesses the database such as
SQLite Browser.

Any insight appreciated.
Sachko



[Rd] SQLite database file gets corrupted and XP goes blue
Sachko Honda