I'd like to see colors for the states "Unknown" (red?), "Already in list" (yellow?) and "Added" (green?)... maybe also a sorted output (by state), but I don't know if that's neccessary...
Need sorting -> No, but it might help to quickly identify double or unknown files. Nonetheless, *full* sorting might be a drawback since it would break the order of the links. I think a simple sorting (by state only) sould be enough, so that state1 is output directly while the lists state2 and state3 are being filled until all links have been parsed.