Full Tilt: Rush Poker HHs not being imported

[serenity]

This is weird. AFAIK, Full Tilt hasn't updated their software, and I haven't updated Poker Tracker (PT3 Mac beta 30.1).
Two days ago, rush poker hands imported just fine. Although the sessions tab got messed up, I could import them, see my hands, actions, etc. as normal.
Yesterday and today, PT finds the table .txt file, but doesn't import anything - it just deletes the hands from the file!
I tried to disable auto-import for a while, and manually import the file afterwards...

2010/01/24 09:27:47.499: [B0103000][ImportManual::ImportManualFeeder::Entry] Beginning thread.
2010/01/24 09:27:47.509: [B0103000][ImportManual] Message: Import beginning
2010/01/24 09:27:47.602: [B0103000][HandHistoryDatabaseImport::DatabaseVariables] Getting connections
2010/01/24 09:27:47.686: [B0210000][HandHistoryDatabaseImport::DatabaseVariables::Entry] Beginning thread.
2010/01/24 09:27:47.693: [B0103000][ImportManual] Message: Import file: /Users/serenity/Desktop/testhh.txt
2010/01/24 09:27:47.694: [B0103000][ImportManual] Message: Unrecognized file format.
2010/01/24 09:27:47.695: [B0103000][ImportManual] Message: Import complete. 0 hands in 1 file were imported. (0 errors, 0 duplicates)
2010/01/24 09:27:47.947: [B0210000][DatabaseVariables::Entry] 0 queries remain.
2010/01/24 09:27:48.136: [B0103000][ImportManualWorker] Feeder exiting.

The files do look a bit different, but I haven't checked thoroughly.

Here's a regular hand that imported fine:

Full Tilt Poker Game #17861959025: Table Follow (6 max) - $0.01/$0.02 - No Limit Hold'em - 3:43:08 ET - 2010/01/24
Seat 2: RAYMO SLOW ($3.03)
Seat 3: littleandfiesty ($0), is sitting out
Seat 4: Leowyn ($1.97)
Seat 6: nightthing66 ($1.29)
nightthing66 posts the small blind of $0.01
RAYMO SLOW posts the big blind of $0.02
The button is in seat #4
*** HOLE CARDS ***
Dealt to Leowyn [3d Jc]
Leowyn folds
nightthing66 raises to $0.06
RAYMO SLOW calls $0.04
*** FLOP *** [2d Ts 9h]
nightthing66 bets $0.12
RAYMO SLOW raises to $2.97, and is all in
nightthing66 calls $1.11, and is all in
RAYMO SLOW shows [Tc Qh]
nightthing66 shows [5d 5c]
Uncalled bet of $1.74 returned to RAYMO SLOW
*** TURN *** [2d Ts 9h] [4c]
*** RIVER *** [2d Ts 9h 4c] [6c]
RAYMO SLOW shows a pair of Tens
nightthing66 shows a pair of Fives
RAYMO SLOW wins the pot ($2.41) with a pair of Tens
nightthing66 is sitting out
*** SUMMARY ***
Total pot $2.58 | Rake $0.17
Board: [2d Ts 9h 4c 6c]
Seat 2: RAYMO SLOW (big blind) showed [Tc Qh] and won ($2.41) with a pair of Tens
Seat 3: littleandfiesty is sitting out
Seat 4: Leowyn (button) didn't bet (folded)
Seat 6: nightthing66 (small blind) showed [5d 5c] and lost with a pair of Fives

There appears to be a char limit to posts, so...

[serenity]

What the heck, I can't post the second hand! I thought it was a char limit, but apparently not. It stops at "[quote]F" (F for Full Tilt Poker Game #...).

Anyway, the rush format appears to have a "***SHOW DOWN ***" section that the regulars don't, and also says "[player] now shows ..." rather than simply "[player] shows ...".

[serenity]

Another try:

Full Tilt Poker Game #17861712204: Table Speeding Bullet (6 max) - $0.05/$0.10 - No Limit Hold'em - 3:23:04 ET - 2010/01/24
Seat 1: bail now ($5.34)
Seat 2: Leowyn ($9.70)
Seat 3: Pazzerifero ($10.70)
Seat 4: IHateToBeOnTilt ($10)
Seat 5: SD15 ($10)
Seat 6: Kozdrin ($10.75)
bail now posts the small blind of $0.05
Leowyn posts the big blind of $0.10
The button is in seat #6
*** HOLE CARDS ***
Dealt to Leowyn [9h Jc]
Pazzerifero folds
IHateToBeOnTilt folds
SD15 has 8 seconds left to act
SD15 folds
Kozdrin calls $0.10
bail now calls $0.05
Leowyn checks
*** FLOP *** [5h 2h Td]
bail now has 15 seconds left to act
bail now checks
Leowyn checks
Kozdrin bets $0.10
bail now has 15 seconds left to act
bail now raises to $0.60
Leowyn folds
Kozdrin calls $0.50
*** TURN *** [5h 2h Td] [6s]
bail now bets $0.50
Kozdrin calls $0.50
*** RIVER *** [5h 2h Td 6s] [Tc]
bail now has 15 seconds left to act
bail now bets $2.50
Kozdrin calls $2.50
*** SHOW DOWN ***
bail now shows [3h Th] three of a kind, Tens
Kozdrin mucks
bail now wins the pot ($7) with three of a kind, Tens
*** SUMMARY ***
Total pot $7.50 | Rake $0.50
Board: [5h 2h Td 6s Tc]
Seat 1: bail now (small blind) showed [3h Th] and won ($7) with three of a kind, Tens
Seat 2: Leowyn (big blind) folded on the Flop
Seat 3: Pazzerifero didn't bet (folded)
Seat 4: IHateToBeOnTilt didn't bet (folded)
Seat 5: SD15 didn't bet (folded)
Seat 6: Kozdrin (button) mucked [7d 6c] - two pair, Tens and Sixes

Very, very strange. The rush hands behave oddly in TextEdit.app, too - alt+arrows that usually select a word only select a character, and when I select words and copy/paste, I get one character per line!
I copied the above from the terminal. Both files appears to be Unicode (UTF-8?), so I have no clue what black magic this is.

[WhiteRider]

Please report your problem, attach the PokerTracker.log file along with an example hand history file.
Thanks.

[serenity]

I could play a short session to get a better log, I guess, but... Since it appears FT has changed the format, would that really help?

Also, should I play with auto-import on (which deletes all hand history), or off, and show the log for a manual import?
The latter isn't exactly helpful.

2010/01/24 09:27:47.499: [B0103000][ImportManual::ImportManualFeeder::Entry] Beginning thread.
2010/01/24 09:27:47.509: [B0103000][ImportManual] Message: Import beginning
2010/01/24 09:27:47.602: [B0103000][HandHistoryDatabaseImport::DatabaseVariables] Getting connections
2010/01/24 09:27:47.686: [B0210000][HandHistoryDatabaseImport::DatabaseVariables::Entry] Beginning thread.
2010/01/24 09:27:47.693: [B0103000][ImportManual] Message: Import file: /Users/serenity/Desktop/rush-hh.txt
2010/01/24 09:27:47.694: [B0103000][ImportManual] Message: Unrecognized file format.
2010/01/24 09:27:47.695: [B0103000][ImportManual] Message: Import complete. 0 hands in 1 file were imported. (0 errors, 0 duplicates)
2010/01/24 09:27:47.947: [B0210000][DatabaseVariables::Entry] 0 queries remain.
2010/01/24 09:27:48.136: [B0103000][ImportManualWorker] Feeder exiting.

[serenity]

I ran them through hexdump and noticed that the rush hands missedt he Unicode BOM. I added the FF FE bytes to the beginning of the rush HH, and it imported perfectly.

[serenity]

Tried it twice more.

#1: No auto import; checked the file with hexdump first, the BOM was there, and it imported manually without problems.
#2: Auto import, which didn't import any hands. Disabled auto import mid-session; the resulting file had the hands played after auto-import was disabled, but no BOM. Manual import failed until I added the BOM manually with a hex editor, after which it worked as expected.

So, there seems to be two bugs here:
#1: Auto-import deletes all rush hands at import for some reason.
#2: When you stop auto-import mid-session, it leaves the HH in a state PT can't import manually later.

Edit: Clarifications.

[tarix]

So, there seems to be two bugs here:
#1: Auto-import deletes all rush hands at import for some reason.

This is not a bug. This is to prevent duplicates when you start/stop auto-import. If we move the file then FTP will try to write to a file that doesn't exist and you will lose hands. (It's also not limited to rush hands but you notice it more because rush hands are delayed until completion so they are more likely to be written right around the time you want to stop the auto-import.)

#2: When you stop auto-import mid-session, it leaves the HH in a state PT can't import manually later.

This is a bug which oddly was fixed in the past.

[WhiteRider]

PT3 does not delete the hand history files, it moves them to the 'Processed' folder.
If you could attach your logs and example hand history files to a support ticket it will allow us to get them to the development team and fix any problem there may be.
Thanks.

[serenity]

So, there seems to be two bugs here:
#1: Auto-import deletes all rush hands at import for some reason.

This is not a bug. This is to prevent duplicates when you start/stop auto-import. If we move the file then FTP will try to write to a file that doesn't exist and you will lose hands. (It's also not limited to rush hands but you notice it more because rush hands are delayed until completion so they are more likely to be written right around the time you want to stop the auto-import.)

It wouldn't be a bug if the hands were also added to the database. They are not; they are simply deleted from the FTP HH and ignored.

The support ticket # is 80360.