Handling extreamly large database, any advice?

[keggler]

However, one of the postgres experts said a while ago that the best way to do it is to leave postgres on your c: drive and just tell it to create databases on the other drive - I think that is in the thread linked at the end of the database FAQ I linked above.

Dave,

I think the only problem here is that within PT, the database management "new" command doesn't allow you to specify a drive id - it defaults to wherever postgres has been installed; so you'd have to construct the new database dataset on the other drive via the postgres command line first, then connect to it in PT...


susan

[Kalledrengen]

Thanks for describing it so clearly. I'm really clueless about all this so the explanation and links are much appriciated.

I just did what the guide said I've installed the postgreSQL on the D:\ drive now. I did however reinstall PT3 aswell because when I didn't reinstall I wasen't prompted with a postgress box when I started up PT3 and I didn't know how to proceed. However after reinstalling PT3 aswell everything worked out as it should.

I did lose around 5k hands of my own in the process that I've no clue where they are. I made a copy of the "processed" folder before reinstalling PT3 and have just now imported the files, but turns out I'm missing around 5k hands.

Any idea how that could happen? It kinda sucks because unfortunately it is HH's of me winning! So now my ptbb/100 is less than before!! But oh well, not the end of the world ^^

[keggler]

are you sure you're missing the hands? could it be the tournament summaries which are missing? this could explain the ROI variance...


susan

[Kalledrengen]

Well I'm not sure if they are hidden somewhere but at least they aren't showing in PT3 as they used to just before the reinstall. It is purely 6-max I'm talking about so no tournament summaries.

I'm clueless as to how they could disappear since I copy/pasted the processed HH folder before (not that I needed to because I clicked no when the uninstall asked me if I wanted to remove that the HH's aswell).

[keggler]

they're not by any chance still sitting in the poker clients hand history folder? and maybe were not just moved to the processed folder by PT?


susan

[WhiteRider]

I think the only problem here is that within PT, the database management "new" command doesn't allow you to specify a drive id - it defaults to wherever postgres has been installed; so you'd have to construct the new database dataset on the other drive via the postgres command line first, then connect to it in PT...

Yes, that's why I said I thought it was easier to just install on another drive - that's what I did..

I did lose around 5k hands of my own in the process that I've no clue where they are. I made a copy of the "processed" folder before reinstalling PT3 and have just now imported the files, but turns out I'm missing around 5k hands.

Just to clarify - you did actually import these hands into PT3, not just copy the processed folder, didn't you?
While the import was running, did you see any errors? Did it say it had imported the hands?
After you installed, did you click 'Refresh'?
Check the auto-import tab, top right - does it say it's importing into the current active database?

[Kalledrengen]

I did import the hands from the processed folder I had saved, manually imported.
I don't remember any errors but I'm not sure there wasen't any, didn't really pay close attention.
After I had installed PT3 I did not click refresh, I checked to see that there was indeed empty and no persons in the database and then I went on to manually import the files in the processed folder. After I had imported them I did click refresh and then I noticed the hands missing.
Regarding the auto-import, top right thing. I can't see anything where it says it is importing into the currect active database, but I guess you can only see that when the auto import is running?

[WhiteRider]

Regarding the auto-import, top right thing. I can't see anything where it says it is importing into the currect active database, but I guess you can only see that when the auto import is running?

If you can see the other hands you imported, then it won't be that, but on the auto import tab, to the right there is a Preferences tab, and on that the Databases section has 'Import played Hands' and a drop down list to select from your databases. You need to make sure that the one you are importing into is the same one that you are viewing - i.e. the active one.

You haven't got any filters set, have you?
Were all the missing hands from a particular site and/or level?

[Kalledrengen]

Ah I get it now, yes it is set to "current active database".

I haven't gotten any filters now no. I have 3 lvls in my database.

$1 NL - (Ipoker) ~ 1.700 hands
$1 NL (6-max) - (PokerStars) ~ 21.000 hands (can't completely remember if I'm missing any hands here, if I am it's at most 1500 hands tops, but I don't think anything is missing)
$0.50 NL (6-max) - (PokerStars) ~ 822 hands (previously had ~4500 hands)

The hands are all from July where I started playing aprox 2000 $0.50 NL hands before mixing in some $1 NL and after I got ~4500 hands of $0.50 NL I changed completely to $1 NL.

I am pretty sure the "move to processed" option has been on for the entire time I've played 6-max (from the beginning in July) and my poker stars HH folder is also empty. I've never deleted anything in the processed folder or moved it before I copied it before reinstalling PT3.

[WhiteRider]

Have you tried re-importing that folder, or a few hand history files from the dates that you're missing?
Do you get duplicates reported, or what?