System.Data.SQLite
View Ticket
Not logged in
Ticket UUID: b76b1d18d93009303fbb49386a7e963511b138aa
Title: Out of memory error - loading 10gb database into memory
Status: Closed Type: Incident
Severity: Important Priority: Medium
Subsystem: Integration_Via_PInvoke Resolution: Not_A_Bug
Last Modified: 2013-01-28 08:13:00
Version Found In: Latest
User Comments:
anonymous added on 2013-01-25 08:19:33:
Hi,

I am trying to load a 10GB sqlite db into memeory, but get out of memory exception consistently around the 2gb mark. The server has around 30GB free RAM and I am using system.data.sqlite. Code is very simple , see below. Please advise.

SQLiteCommand cmdw = _sqlConn.CreateCommand();
                    cmdw.CommandTimeout = 3600000;
                    cmdw.CommandText = "attach database 'file::memory:?cache=shared' as DataAsset";
                    cmdw.ExecuteNonQuery();


                    cmdw.CommandText = "CREATE TABLE DataAsset.Universe AS SELECT * FROM Main.Universe;";
                    cmdw.ExecuteNonQuery();

                    cmdw.Dispose();

mistachkin added on 2013-01-28 08:13:00:
I'm guessing that the 32-bit address space limit is being hit around the 2GB
mark.  This is not a bug, it is design limitation of Windows.