Imported 1.5 Million hands.. REALLY slow..

[genemish]

impressive #s.. i am importing the hands now..

so far i am impressed by the speed.. half way done (750k out of 1.5mm) .. so far it took 1h8m ... last time it took 5 hours to import these hands... not to mention housekeeping took 20hours..


updates to follow..

[WhiteRider]

Nice - thanks for the updates.

[genemish]

Nice - thanks for the updates.

i just hope the housekeeping process is "fixed".. i did a clean uninstall of everything and reinstalled directly to the new drive (E:\).. so i am really hoping to see the postgres.exe during housekeeping.. (55 mins away)

[woopwoop]

Nice - thanks for the updates.

i just hope the housekeeping process is "fixed".. i did a clean uninstall of everything and reinstalled directly to the new drive (E:\).. so i am really hoping to see the postgres.exe during housekeeping.. (55 mins away)

To be honest, i don't see any postgres.exe activity while running housekeeping (just started it again).
postgres.exe stays around 1-2% with some rare spikes to 7-20% but those only happen like once every minute or so.
Also noteworthy is the fact that i have 14 postgres.exe processes running for some strange reason and only one of them shows cpu activity as noted above. The rest of them stay at 0%
The process having the cpu activity is the one using the most ram. Coicidence? No idea

While typing this the cpu activity just went up to 20-26% for a while during clustering and then it dropped off to 7-10%

Anyway, just some raw info. I have no idea if it's usefull at all.



edit:

impressive #s.. i am importing the hands now..

so far i am impressed by the speed.. half way done (750k out of 1.5mm) .. so far it took 1h8m ... last time it took 5 hours to import these hands... not to mention housekeeping took 20hours..


updates to follow..

To speed that up you might want to split the database per month (although i have +-1.5M hands per monthly database)

[genemish]

housekeeping started... dont see Postgres.exe in task manager...

wtf?

[woopwoop]

housekeeping started... dont see Postgres.exe in task manager...

wtf?

really strange...
perhaps something with permissions or god knows what.

You could always try process explorer as recommended by lifehacker.com => http://technet.microsoft.com/en-us/sysi ... 96653.aspx
or process hacker as recommended by downloadsquad.com => http://processhacker.sourceforge.net/

both are free.

[genemish]

would you or anyone like to use Teamviewer to connect and see the if there's an issue with permissions?

[genemish]

ok, process explorer does show postgres.exe... here are the pics..

Task Manager
http://img40.imageshack.us/img40/5430/taskmgr.jpg
Process Explorer

http://img14.imageshack.us/img14/9074/processexplorer.jpg

your thoughts??

p.s. what does ORANGE color mean?

[genemish]

Me = Dumba$$

I checked the box on the buttom of the task manager "show processes for all users" and now it's on the list...

is that correct that it's using another account (postgres)? and how do i change permissions on it to make it an admin account? I dont see it on the list under User Accounts.. (running Windows 7 Ultimate)

[genemish]

housekeeping at 4h45m...