Hand importing speed. Anyway to avoid speed dropping?

[CHINA888]

PT3 is manually importing hands at a speed of 1000h/s at start (hands are from hhdealer). However this speed drops very fast and after 3 min the speed is already at 400h/s and keeps dropping more and more.

A way to avoid this is to stop import and starting it again with the files (or folders) not imported yet, then it turns back again at 1000h/s.
However with 1000 folders is not practical to do this by hand each 2 min(time needed to import one folder).
It is also too slow if I put all those 1000 folders into 1 folder, then importing the 1 folder, the speed will drop to 100h/s after 1hour.

I was wondering if there is anyway to avoid this speed dropping or any alternative method to automaticall start importing a folder after finishing the one before.

Thanks in advance.

[kraada]

There's no alternative for PT3 other than setting up batches that work best on your system. We're testing improvements to this area in PT4 at the moment though and I am curious: what site are the hands you're importing from?

[CHINA888]

There's no alternative for PT3 other than setting up batches that work best on your system. We're testing improvements to this area in PT4 at the moment though and I am curious: what site are the hands you're importing from?

888poker

[kraada]

How many hands do you happen to have (roughly), and would you be willing to share them with our development team for testing purposes?

[CHINA888]

How many hands do you happen to have (roughly), and would you be willing to share them with our development team for testing purposes?

I have a database of 40 million hands, although many of them are played by myself over the years (2 millions or so) and I'm not willing to share the hands played by myself, sorry.

However if there is any way to filtering out these hands and exporting it, let me know and I will send you the files

[kraada]

Are these cash game or tournament hands, and are they Holdem or Omaha? I can give you a way to export only observed hands.

[CHINA888]

Are these cash game or tournament hands, and are they Holdem or Omaha? I can give you a way to export only observed hands.

All of them are cash games NL Holdem 6max

[kraada]

Ok, open up PGAdmin III and connect to your database (right click -> Connect). Choose your PT3 database in question and click the little SQL icon in the menu bar. It will pop up a new window. In this new window, paste the following into the top section:

SELECT hhh.history from holdem_hand_histories hhh where hhh.id_hand not in (SELECT hhps.id_hand from holdem_hand_player_statistics hhps, player p where hhps.id_player = p.id_player and p.player_name = 'Your Screenname');

Then click the play icon at the top that has the little disk by it. In the window that appears, put any filename in the bottom; the defaults will be fine (we'll make the data fit). Zip up the resulting file and let me know how big it is and I'll let you know the best way to get it to us.

[CHINA888]

Ok give me two or three days, Its the time I expect to finish the import and the housekeeping process