avdump 0.31 -- large files

Bug reports for an official AniDB Client go here

Moderators: AniDB, AniDB API

Locked
progress
Posts: 2
Joined: Wed Mar 21, 2007 1:34 pm

avdump 0.31 -- large files

Post by progress » Wed Mar 21, 2007 1:46 pm

I'm getting some slight avdump borkage on a file which is > 2GB:

Code: Select all

L:\Video\b-a>avdump -a "(B-A)Inuyasha_Movie_2_-_The_Castle_Beyond_the_Looking_Glass_(C53A8227).mkv"
L:\Video\b-a\(B-A)Inuyasha_Movie_2_-_The_Castle_Beyond_the_Looking_Glass_(C53A8227).mkv
H  96.62%  @   6.39 MB/s  /   6.78 MB/sASSERT!
H  96.71%  @   5.13 MB/s  /   6.78 MB/sASSERT!
H  96.81%  @   7.52 MB/s  /   6.78 MB/sASSERT!
H  96.90%  @   5.81 MB/s  /   6.78 MB/sASSERT!
H  96.99%  @   7.55 MB/s  /   6.78 MB/sASSERT!
H  97.09%  @   5.81 MB/s  /   6.78 MB/sASSERT!
H  97.18%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  97.27%  @   5.57 MB/s  /   6.78 MB/sASSERT!
H  97.37%  @   8.51 MB/s  /   6.78 MB/sASSERT!
H  97.46%  @   5.81 MB/s  /   6.78 MB/sASSERT!
H  97.56%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  97.65%  @   6.10 MB/s  /   6.78 MB/sASSERT!
H  97.74%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  97.84%  @   5.83 MB/s  /   6.78 MB/sASSERT!
H  97.93%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  98.03%  @   5.56 MB/s  /   6.78 MB/sASSERT!
H  98.12%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  98.21%  @   5.57 MB/s  /   6.78 MB/sASSERT!
H  98.31%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  98.40%  @   5.81 MB/s  /   6.78 MB/sASSERT!
H  98.50%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  98.59%  @   5.81 MB/s  /   6.78 MB/sASSERT!
H  98.68%  @   8.55 MB/s  /   6.78 MB/sASSERT!
H  98.78%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  98.87%  @   9.85 MB/s  /   6.78 MB/sASSERT!
H  98.96%  @   5.56 MB/s  /   6.78 MB/sASSERT!
H  99.06%  @   8.55 MB/s  /   6.78 MB/sASSERT!
H  99.15%  @   8.00 MB/s  /   6.78 MB/sASSERT!
H  99.25%  @   9.85 MB/s  /   6.79 MB/sASSERT!
H  99.34%  @   6.39 MB/s  /   6.79 MB/sASSERT!
H  99.43%  @   8.00 MB/s  /   6.79 MB/sASSERT!
H  99.53%  @   6.76 MB/s  /   6.79 MB/sASSERT!
H  99.62%  @   7.52 MB/s  /   6.79 MB/sASSERT!
H  99.72%  @   7.12 MB/s  /   6.79 MB/sASSERT!
H  99.81%  @   6.73 MB/s  /   6.79 MB/sASSERT!
H  99.90%  @   7.52 MB/s  /   6.79 MB/sASSERT!
ASSERT!
 Hash:
  crc : c53a8227
  ed2k: 671767b3fa343421c9b8a5a529f43b96
  md5 : 1f655d3a6453373b2f27e0e0fa1d81c1
  sha1: 75ad20e8ce8c833007d0c615cf49e6cc00803739
  aich: w
  tth : sd7qyaysdt2jchjg45khqppucg7bjkld6l3cjma
 Duration: 01:38:55 (5934.73)
 Track #1: default video
  lang: und (1)
  codc: V_MS/VFW/FOURCC/XVID (DivX503b1393p XviD0039) -> XviD (17)
  reso: 720x472 (839x472) -> Unknown (aka not common) anamorphic
  fram: 23.976 fps
  rate: 2437 kbps (2436.56)
  dura: 01:38:55 (5934.69)
  size: 1.68 GB (1807529438)
 Track #2: default audio (5.1 Channel)
  lang: jpn -> Japanese (2)
  codc: A_AAC/MPEG4/LC/SBR -> AAC (9)
  chan: 6 -> 5.1 Surround
  samp: 24000 Hz
  rate: 213 kbps (212.69)
  dura: 01:38:54 (5934.39)
  size: 150.46 MB (157772913)
 Track #3: audio (5.1 Channel)
  lang: eng -> English (4)
  codc: A_AAC/MPEG4/LC/SBR -> AAC (9)
  chan: 6 -> 5.1 Surround
  samp: 24000 Hz
  rate: 214 kbps (213.69)
  dura: 01:38:54 (5934.39)
  size: 151.18 MB (158518697)
 Track #4: audio (Stereo)
  lang: jpn -> Japanese (2)
  codc: A_AAC/MPEG4/LC/SBR -> AAC (9)
  chan: 2 -> Stereo
  samp: 24000 Hz
  rate: 71 kbps (71.08)
  dura: 01:38:54 (5934.39)
  size: 50.29 MB (52728194)
 Track #5: audio (Stereo)
  lang: eng -> English (4)
  codc: A_AAC/MPEG4/LC/SBR -> AAC (9)
  chan: 2 -> Stereo
  samp: 24000 Hz
  rate: 73 kbps (73.13)
  dura: 01:38:54 (5934.39)
  size: 51.73 MB (54247392)
 Track #6: default subtitles
  lang: eng -> English (4)
  type: S_TEXT/UTF8 -> SRT (3)
  size: 33.22 KB (34019)
 Sizes: (check sanity)
  disk: 2.08 GB (2233518940)
  trac: 2.08 GB (2230830653) [based on track size]
  bitr: 2.08 GB (2230817469) [based on bitrate]
  tdif: 2.56 MB (2688287) 0.12%
  bdif: 2.58 MB (2701470) 0.12%
OK 0.31 - 250206
The ASSERTs start showing up once the hashing goes beyond the 2GB limit. The CRC and MD5 are correct (I'm guessing the SHA1 too). Not sure about AICH, which is just 'w'?

And a second question, can I just add this file to anidb? I seem to remember ed2k is limited to 2GB (the hash in the output is correct though, when properly concatting the chunk wise MD4s into a string and MD4ing the string as usual). I think a saw a file once on anidb that was >2GB, but it had a 2GB filesize and a comment with the real filesize...

Also, thirdly (just notice this now), the audio sample rate is 24000 Hz according to the dump, but 48000 Hz according to mplayer?

epoximator
AniDB Staff
Posts: 379
Joined: Sun Nov 07, 2004 11:05 am

Post by epoximator » Wed Mar 21, 2007 5:02 pm

right, i didn't bother with it since anidb doesn't support big files anyway. this should of course be fixed @ both ends. files like that will never be verified (as it stands now).

i dunno about the sample rate. since anidb doesn't use it i never really checked that either (and no one has complained about it before)

progress
Posts: 2
Joined: Wed Mar 21, 2007 1:34 pm

Post by progress » Wed Mar 21, 2007 5:27 pm

As far as ed2k large file support is concerned, it seems:

emule 0.30a+ supports >2GB (but not >4GB)
emule 0.47a+ supports upto 256GB (not sure how though, since the 4GB limit is a protocol limitation).

Should I add the file to anidb with wrong filesize in the meantime, or just wait for this to get fixed in anidb? There's a bunch of such files for Appleseed 2004, the a4e and PSNR ones with filesize 2.000.000.000.

Amour
Posts: 640
Joined: Fri Oct 08, 2004 5:19 pm
Location: France

Post by Amour » Wed Mar 21, 2007 5:58 pm

On AniDB side, the problem was reported here: http://tracker.anidb.info/view.php?id=407

epoximator
AniDB Staff
Posts: 379
Joined: Sun Nov 07, 2004 11:05 am

Post by epoximator » Wed Mar 21, 2007 8:57 pm

no point in waiting. i don't think it'll happen soon

Locked