Purge Speed

[bdadavies]

Purging 80K hands from a 2M hand DB = roughly 100hrs on a very fast computer.

Purging the same 80K hands from the my HEM DB = under 4 mins.

PT3 is clearly not doing it at the speed HEM can achieve!

[kraada]

Purging speed is definitely something we are going to work on, but thank you for doing this comparison; I'll make sure the developers see it.

[bdadavies]

No probs.

TBH I wouldnt have thought the difference would have been on that scale.

I have a ton of custom stats on PT3 which I dont on HEM but I cant see why that makes a difference when purging by date and stakes.

[kraada]

There's still a lot of data that needs to be removed from the database - I've been told in the past that most of the slowdown is from figuring out which rows need to be removed and which don't, so hopefully this is something we can improve considerably with some effort.

[APerfect10]

A few things:

1. It should not take 100 hours. PT3 purge is a slow process but not THAT slow. Can we get your log file? Something is wrong and I suspect that it may be a database corruption issue.
2. When you purge your hands in HEM, those purged hands still remain in your "stats" calculation although the hands are no longer viewable. In PT3, we remove the hands and update your stats. (What's the point of purging if the purged hands stats are still used?)

Best regards,

Derek

[bdadavies]

Definitely, I had a power cut about an hour ago and had to restart.

Where is the log file and where do you want me to send it?

[kraada]

Send it via the support system, and let us know your ticket number here once it's posted so that we can expedite matters for you.

[bdadavies]

OK So if I'm going to create a log file.

Ill need to stop the current purge and run PT3 in logging mode.

How long should I let it run for?

[APerfect10]

Definitely, I had a power cut about an hour ago and had to restart.

Where is the log file and where do you want me to send it?

A power outage during such an operating can corrupt the database which could then lead to the slow purge times that you are experiencing...

OK So if I'm going to create a log file.

Ill need to stop the current purge and run PT3 in logging mode.

How long should I let it run for?

Let it run for 3-4 hours.

[bdadavies]

The power outage happened about half way through the purge (had been running 60-70hrs by then)

I restarted it and it had just under 40hrs to go (which was roughly where it was before the power outage)

I then restarted it again to enable logging and the time has dropped to 11 hrs.

It had definitely been running for at least 60hrs before any power issues, but if there is corruption in my DB, Ill happily delete it and start over.