The big loop

• With the comments and unnecessary code removed, the loop at last fits on one page

• Here's what it does:

  • If the file size is small, it does an in-memory comparison of all the files

  • Otherwise, it groups them by their first block

    • Files with identical first block in the same group

    • Files in the same group are md5 checksummed

    • Checksums are compared to produce a finer grouping

    • No checksumming is done if the group is small to begin with

Next

Copyright © 2006 M. J. Dominus