Import tools for AniDB?

kenoki · Post by **kenoki** » Fri Jan 20, 2006 9:20 pm

I am starting the process of adding my anime collection inventory into AniDB. I've managed to maintain a pretty decent XML of all the files and DVD information.

Trouble is, I didn't store (not had often) ed2k hash values. No biggie, I'll just generate them (long process in itself!).

However, I would like to use the storage field but the web UI's ed2kdump will only do a storage value per batch. Are there any tools (hopefully non-MS, I'm on Linux) that can take the ed2k links and a specified 'storage' value for each file?

I'm faced with over 11,000 files spread across 500 DVDs (meaning 500+ ed2kdump imports!). Any pointers or suggestions to making the import less manual would be great!

Regards,
Kenoki

Post by **epoximator** » Fri Jan 20, 2006 9:52 pm

take a look at the udp api

MYLISTADD size={int4 size}&ed2k={str ed2khash}&storage={str storage}

there are several open source clients (in development) you can make use of.

Website · Post by **Rar** » Fri Jan 20, 2006 10:41 pm

You can automate it pretty easily, but as you're on linux, you'll have to do a little scripting yourself, but as you're on linux, that shoudn't be a daunting task for you. I think there's some udp code to get you started in just about any language you'll want, if you check the wiki pages epoxi suggested and maybe msg 'em to ask.

Rar

kenoki · Post by **kenoki** » Sun Jan 29, 2006 8:35 am

Thanks for the pointers!

I've have literally glued a few pieces of code together and I am now updating my list via the UDP API.

Since I'll be adding thousands of files over the next several weeks. I set it to send a request every 31 seconds (because of the 'we'll ban you if you request too quickly!'..

About 11hrs per 1000 files with this rate. If I could get a better definition of 'long term' usage then I could tune better, since I'm only doing about 500 or so each batch before I have to get around to making more ed2k hashes :b.

Again, thanks for the tip.

Regards,
Kenoki

Website · Post by **Rar** » Wed Feb 01, 2006 1:48 pm

I'm not the man in charge of this, but as epoxi and exp are being quiet... for a single-run tool that's for personal use, you may as well go up to whatever the server lets you (a request every second or so?), using udp is far lighter than trying to do the equivalent task via web interface. And the server is pretty shiny. Any public clients probably need to be a bit more careful, though.

Rar

Post by **fahrenheit** » Wed Feb 01, 2006 8:14 pm

hmm, by what he says, he's doing things by the book, 30 secs of interval.