What to do with 1.5 million records...
Hi Stefan;
The raw file size is 500,000kb.
I will try to re-import and add indicies.
How do I split one table into several (either in Access or SQL) after import?
I would like to stay totally in Access 2007, more comfortable...
thanks for the quick reply
-Pete
"Stefan Hoffmann" wrote:
hi Pete,
On 14.04.2010 16:11, ChicagoPete wrote:
So my company just bought another company and they send me a flat text file
with 1.5 million records of customer name/orders/transactions etc - all in
one huge txt file. Just for fun... I imported this into Access 2007 and you
can view the single table, can't do anything with it, a simple parameter
search on one customer name locks up the server, Access not responding, white
screen blah, blah blah...
Create indices for the columns in your search condition.
I tired to split the table during import with the wizard to create the 6 or
so tables I would like to have - but it kept bombing out.
How big in GB is the database if you do a simple import into one table?
Maybe your hitting the 2GB size limit.
Do I set this up on a SQL backend? If so, do I create the SQL db first then
import the text file into SQL OR do I import the text file into Access and
use the db splitter to create the SQL side? Is there a way in SQL to split
into seperate tables?
While Access can handle huge amounts of data like this, I would use a
SQL Server back-end and use the BULK INSERT command to load the data at
once.
Then you may split the table into a correct relational schema or also
simply add the necessary indices...
mfG
-- stefan --
.
|