So if I had a cp -v operation fail, is the last file name it printed out the last successful file copy, or is it the failed partially copied file? If you had to ensure all files are copied correctly without overwriting anything, would deleting the last filename that was printed from the destination folder delete the partially copied file that the operation failed on?

all 12 comments

sorted by: hot top controversial new old
[–] 28 points 2 years ago* (4 children)

Just use rsync -va (possibly with --chown if you want user/group to be different at the destination and with --delete if you want removed files to be deleted) to continue the copy operation, it automatically takes care of figuring out which files still need to be copied and which are already there.

  • source
  • hideshow 8 child comments
  • [–] 31 points 2 years ago* (last edited 2 years ago) (2 children)

    Just use rsync -va

    NO STOP!

    The default quick check algorithm of rsync is not safe for this. It only checks filesize and modification time to determine if files are equal. After a b0rked copy, these are not to be trusted.

    You should add the -c flag so that files are properly checksummed, unfortunately if you have slow storage on either end, this often negates the speed advantage of rsync.

    For example, consider this example:

    mkdir source
    mkdir destination
    echo "hello" > source/file.txt
    echo "world" > destination/file.txt
    touch -r source/file.txt destination/file.txt
    rsync -avh source/ destination/
    cat source/file.txt
    cat destination/file.txt
    

    Contrary to what you might expect, the rsync command copies nothing and the output at the end will show:

    hello
    world
    

    If you change the rsync command in the example above to rsync -c -avh source/ destination/, it will work as expected.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 2 years ago

    True if the initial state is unknown but if you do your initial copy and all the later syncs with rsync it is not really necessary since rsync puts the partial files in a temporary location (there are same parameters to control the details of that too).

  • source
  • parent
  • [–] 9 points 2 years ago

    Run an md5sum command on the last file in each location and compare. That will tell you if one of them is different and answer your question.

  • source
  • [–] 6 points 2 years ago (1 child)
  • [–] 1 point 2 years ago

    Another way to check is to

    strace cp testfile testfile2
    

    and the sequence in which the message is printed and operations performed can be studied.

    It's perhaps a lot to read, but linux tracing tools are worth learning!

  • source
  • parent