Imported 1.5 Million hands.. REALLY slow..

[genemish]

well, in my case any LARGE imports will cause slow housekeeping

[kraada]

I haven't been able to find any other documentation that would indicate what might help to speed this up, but I'll keep looking and if I find anything I'll certainly let you know.

[genemish]

yea, i think i'll live as long as consequential housekeeping is ok (and it is) -- i am fine.

[gpete888]

I am manually importing 1mil hands right now. The import itself took like 8hours, and now im on clustering for another 10h30min so far. I read through the entire thread but is there any new developments on how to make this run faster?

I have created a new database for observed hand import and had 500k imported a few weeks ago. Im importing 1mil to the same database now.

I have a AMD x2 4400+ CPU. It took nearly all night to import and housekeep the 500k. I wonder how long this will take if I already have 500k in the database and need to housekeep 1mil.

[kraada]

How much hard drive space do you have free?

[gpete888]

Like 60gb free at this moment.. so after 11h of clustering. Made some of the most basic checks while looking through the thread. I defragged like 5 times in the past 2 weeks. I deleted more crap off of my 2nd HD in case I needed some more.

Just like with the OP, during clustering the 1GB files are continually created. So far theres like 15GB made.

EDIT: Is there a way to go talk via skype or some kind of other program? it will make things a lot easier if there is some osrt of checklist that I must go through in order to see whats wrong

[kraada]

Is this also with PostgreSQL 8.4?

[gpete888]

actually its version 8.3. I bought PT3 a few weeks ago and installed the postgreSQL version which was available.

[kraada]

That's even more puzzling then.

[gpete888]

To be more specific, I bought it on November 11th. Is it puzzling that it told me to install version 8.3 with the new version 8.4 out or that its so slow with version 8.3?

So maybe it wasnt a few weeks afterall. It was even less time.

I guess I cant do anything now while the housekeeping is going on but would it be possible to get in touch through skype and run through the possible problems?