Rebuilding cache fail

[Drignatio]

I have tried a few times to both update and rebuild my cache so I can actually begin using PT3 but it never seems to work. The progress bar just stays open and goes on and on and on. I do have quite a few hands in my database... datamined hands that total around 12 million hands just from the last month and a half.

How can I get my cache to update? I looked at my task manager and my CPU usage is super low like only 4% and postgresql processes (about 7 of them or whatever) are running but not using up any CPU.

What is the issue? I'm running PostgreSQL 8.3

[kraada]

How long did you let it run? A database of that size could easily take up to 24 hours to completely update the cache depending on how much it needs to update and the specifications of your computer.

[Drignatio]

well last week I let it run throughout the night... tried a few other times but not as long. Doing it as we speak and it's been running for 6 hours and 31 minutes so far.... at what time period should I give up if it hasn't completed yet? 48 hours?

[Drignatio]

Update: It has been running for over 14 hours and the progress bar is about 1-2% filled up.... which means I have to wait another 1,386 hours for it to be complete? That's 57 days, almost two full months! >:O

What should I do?

[WhiteRider]

It should be faster than that. What are your computer's specs? How much free disk space do you have on the drive which PostgreSQL is installed on? Do you have a lot of other applications running, or anything which is doing a lot of hard disk access?
Have you added a lot of custom stats? Are there any "unusual" custom stats?

[Drignatio]

I don't believe my computer is the issue... I basically bought the best gaming desktop I could find, then clicked the best upgrade wherever possible for each component and the computer alone (not including monitors) cost me $6k. It is only one year old. Also, when I launch task manager (I'm using windows 7 64bit) I see that on average there is only about 6-10% CPU usage... then says Physical Memory 53%. So it doesn't even look like my computer is working very hard at all on rebuilding the cache.

My specs are as follows:
-Processor: Intel(R) Core(TM) i7 CPU 965 @ 3.2Ghz 3.20 GHz
-Installed Memory (RAM) 6.00GB of the new DDR3 kind
-System type: 64-bit Windows 7
-Graphics cards: Dual Nvidia GeForce GTX 280

I have 3 hard drives in total for my computer... one of which is an expensive faster version that's only 40 gigs, designed to just run my operating system (I think it's a solid state or something like that I forgot). Then 2 others for storage which are set up in a rada ray (writes to both in case one goes bad I'm not screwed). On the operating system hard drive i have 6.5GB free of 37 and that's what PT3 is installed on... but PosgreSQL and the databases are on the storage hard drive which has 585GB free of 1.36TB. It should be fine to have PT3 installed to my operating system hard drive and draw the data from my storage hard drive, right?

Not too many other applications running... just running HEM, Tablescan Turbo, Google Chrome, Pandora, Table Ninja, while PT3 is rebuilding Cache. I could do like 20 things at once on my computer and not have it slow down all that much.

Update on the Cache rebuild: It looks like the bar is moving at least and it appears to be around 3-4% complete after now 18 hours 41 minutes. So updated ETA of completion is now 456 hours, down from the previous estimate. But it's still a problem, because once it's done 19 days will have passed and I'll have to re-import 3 weeks of datamined HH's and have the exact same problem over again since it seems you have to do this cache thing often.

I have added almost 80% of the cash game custom stats in the repository and have build like 5-10 more on my own... so I guess I have quite a few custom stats if you count the ones I imported into my database from the repository. If I had known that each of those stats add significant time to the cache I would have been a lot more selective, but they all seemed useful at the time.

What do you think the problem is? Do you want to do a screen share to check over stuff or something? I was really looking forward to getting to use my stats after I worked so hard building some... but now I can't. I also didn't get my HUD perfect before starting the cache rebuild... I'm going to have to alter it I'm sure and then I'll have to do this all again? :'(

[kraada]

Altering your HUD won't require a cache rebuild - the only times you need to update the cache are if you have the cache at less than 100% or if you add new custom stats - but adding new custom stats only needs an update which adds in the data from that stat, it won't require a full cache rebuild.

That said, on that system, this still seems far too long. Could you take a copy of your StatisticsDefinitionsCustomized.pt3 and zip it up and attach it to a support ticket? I'm wondering if perhaps there's some problem with one of your stats causing this lengthy delay - we have checks in place to prevent this sort of thing for the most part, but I think it's prudent to take a look and make certain your stats are otherwise normal.

[Drignatio]

Ticket and zipped file attached as requested.

Ok well I hope that's the issue because if it isn't how will we ever fix it? Thanks for helping me with this, I really don't want to wait another 20 days to start using PT3 I really want to use it ASAP since the custom stats are 10xs better than what I have now.

Please let me know ASAP if you find anything or need more info from me, etc.

Thanks!

[kraada]

We'll take a look and get back to you once we know more.

[Drignatio]

ok sounds good. I will be waiting for your reply.