Clustering taking too long

[doyle dave]

More housekeeping questions. A little backround information. Also see previous posts. Yesterday I uninstalled 8.3 for 8.4. I didn't back up my database so I reimported my HH (2 mil). Clustering ran for 6 hours before I cancelled. Reason I cancelled was log files were showing errors from password authentication failed to recieved fast shut down request and database shut down. Also in Program Files/ data/ base I repeatedly check the properties and was not seeing and changes (growing in size). I have now upgraded to beta 30.3 hoping this would solve the problem. I have been housekeeping (clustering) for 2hrs now and I still am not seeing any changes when I check the properties of the Program Files/Data/base sub files. I have 1 file in pg_log with the time I restarted HKing which says database system is starting up, database system is ready to accept connections, autovacuum launcher started, and then 2 lines of received SIGHUP, reloading configuration files and that was 3hrs ago with no changes since then. My questions are this.

1. While clustering shouldn't I see some change in the ProgramFiles/Data/Base sub file via checking the properties.
2. Since I'm not seeing any changes is something wrong?

On a diiferent note I never heard back on a report ticket I sent in concerning my last Housekeeping and clustering problem.
Another thing I noticed is my trail period has restarted and went back up to 60 days. This happened on Saturday I think..
Thanks so much for all the help..Dave

[kraada]

(1) The files that are written are actually new files it doesn't change the size on files that existed before the cluster starts.

(2) Clustering 2M hand databases can easily take longer than 6 hours. It shouldn't take more than 12, but I could easily see it taking 8 or 10 hours depending on your setup.

[doyle dave]

Kraada I do realize clustering 2mil HH takes awhile. My 1st go at housekeeping went for 77hrs before I cancelled. I guess I'm trying to find out if my pg_log errors from my 1st round of HK with postgreSQL 8.4 were normal? The errors I talk about in my post More Houskeeping qustions.

Aslo concerning your answer to question 1. should I see files being written (more files being added or what)? I don't really understand sorry for my limited computer knowledge, I am trying. Dave..........

[kraada]

77 hours is far more than should be required unless you have nearly no free space on the drive.

What I mean is that in the folder the database is stored, you see a lot of subfolders with numbers. Each number contains files. Those files are the database. You can look up which folder is which database but it's a bit complicated. What matters is that you have some folder that contains your PT3 database. The numbered files in the folder are the different tables and relations in the database. When clustering each one of those numbered files is rewritten with a new version with the data ordered for most effective searching. But it's written as a new number; so if 1037.1 and 1037.2 were your holdem hand player statistics table, they might be rewritten as 7355.1 and 7355.2. But those files (7355.1 and 7355.2) wouldn't have existed previously, so that folder would be getting larger as those files are written, but then the folder would shrink back once that table is done because 1037.1 and 1037.2 would be removed.

I hope that helps clear things up.

[doyle dave]

Thank you Kraada that clears things up a bunch. I really appreciate you taking the time to help me understand this whole process better.
I do have plenty of space on my drive due to the fact my computer is brand new. About 270gb. I did find some files in the subfolders containing my database. Some folders have numbers with decmal points and one file is growing in size. I hope that all is running as it should. Should I be concerned with the fact that my trail days left counter reset to 60 days? I don't remember how many days were left from my original trail but I bet around 30 or so. I would hate to get cut off and all. I don't know if I can play without PT3 anymore.
Thanks again Dave

[kraada]

Don't worry about the trial counter - if you want to get rid of it permanently, of course, you can just purchase PT3

If you see one of those files growing, cluster really is working; just let it keep going and it will eventually finish even if it seems to take forever.

[doyle dave]

Housekeeping (clustering) has been running for 22hrs. I have seen the files with decimals (17996.1) start at 0KB and fill up to just over 1 million KB. Last night I saw the files changing in size every 45 minutes. Also a new file was created at 9:09 pm MST. Now 10hrs later that same file is still at 0KB and nothing else seems to happening. The only report in pg_log is "MSTWARNING: pgstat wait timeout" I'm just trying to find out if this seem right or not. Thanks again..Dave..........

[kraada]

So there aren't any files left changing sizes?

[doyle dave]

Kraada I have been checking the folder for files changing sizes (getting larger) for an hour now and have not seen a file change. The file 17996.3 has been at 0KB since 9:00 last night. I have checked almost every other file in the folder and have not seen any movement up or down. Thier are a few files with decimals but they haven't grown in size since yesterday when I realized thats what I'm to look for. Thank you for your help I can see you are very busy.....Dave...

[doyle dave]

Kraada. I just saw my file 17996.3 has changed from 0KB to 672,976. So I'm guessing all is well again I hope. I will keep an eye on the folder today and let you know if anything else pops up. Thanks again you have been a big help...Dave...