Clustering taking too long

[kraada]

You don't need to run the cache update that often, though - once every 50 thousand hands should be plenty.

[MrBarbegris]

You don't need to run the cache update that often, though - once every 50 thousand hands should be plenty.

Ah, well that's different then. Perhaps the cache update shouldn't be checked by default after a manual import.

[WhiteRider]

Once you uncheck it it will remain unchecked for future imports.

[Vigilanty]

It's happening again....
I went to add the second million yesterday (That was added fine, no errors) and the housekeeping was going to run through the night, Clustering has been going on for 8 hours!! I went to check if the data folder in postgreSQL/8.3/data was changing... it's not. In fact the date modified on the folder is from the other day... which in my mind means that it hasn't changed even once since clustering began. help!

[kraada]

If you kill PT3 manually (press ctrl+alt+del, click Task Manager, go to the Processes Tab and End Process on PT3), then stop and restart your postgres server (Start --> Programs --> PostgreSQL --> Stop Service, followed by Start Service) that should stop the cluster.

[snoopyyo]

I have the same problem. i imported about 1 milion hands and now it takes forever to do the housekeeping. Clustering for 8 hours now.
about 40 gig free disk space. also using the postgresSQL 8.3 version.
What can we do best? my folder of the 8.3 gets bigger. but the amount of files stays the same.
A few days ago, i imported 300 000 hands and the whole housekeeping lasted about 2 hours. But i am getting crazy now
any thing we can do to speed it up a little bit, or other advice?
Maybe a faster version in the next update?
any help will be appreciated!

is it adviced to do this: "If you kill PT3 manually (press ctrl+alt+del, click Task Manager, go to the Processes Tab and End Process on PT3), then stop and restart your postgres server (Start --> Programs --> PostgreSQL --> Stop Service, followed by Start Service) that should stop the cluster." ???

[snoopyyo]

12hours now and still clustering.
my 8.3 folder is still growing , the amount of files in it also grew now. (13.8gig)
How big shall it be when finished? (aprox. 1.2Million hands)

[WhiteRider]

A lot of the space should be recovered again once the cluster is finished. IIRC a rough estimate is about 1GB/100k hands.
Bigger DBs take longer (not just a linear increase) but once it has been done the first time it shouldn't take as long subsequently.
You can improve database performance by defragmenting your hard disk too (with the postgres service stopped) - Database Management & Maintenance Guide.
You may find this useful too: Performance Tuning PostgreSQL.

[snoopyyo]

it is running for 19 hours now.
But i noticed that my 8.3 folder is smaller now than last time i checked (again 12.8GIG)
I might try the tuning thing and maybe putting the postgress on an other HD.
But i guess i can't do that while my housekeeping is still clustering ?

[WhiteRider]

No, as long as the files are still updating I would let it finish now.