hi, i am trying to get a working script that searches a filesystem from a start point (set using the -s option) and find all duplicate files with a certain criteria. The output has to use the -f option to display the output. I have tried this script but cant get it working so far. Any help greatly appreciated.
Thanks

OUTF=rem-duplicates.sh;
echo "#! /bin/sh" > $OUTF;
find "$@" -type f -print0 |
  xargs -0 -n1 md5sum |
    sort --key=1,32 | uniq -w 32 -d --all-repeated=separate |
    sed -r \'s/^[0-9a-f]*( )*//;s/([^a-zA-Z0-9./_-])/\\\\\\1/g;s/(.+)/#rm \\1/\' >> $OUTF;
chmod a+x $OUTF; ls -l $OUTF

Try this script instead:

# findd.sh from http://www.linuxboards.org
# Finds all duplicate files using md5chksum and prints them out on the screen
# Change /root/danno/ to a directory where you wish to search recursively
# If satisfied with initial output then remove the # comment tag from
# before the rm command and run again to delete the duplicates
#!/bin/sh

fr=0
cksum $(find /root/danno/ -type f -print)|sort -k 1,1n |
while read c1 c2 n3
do
   # save check sums and file names
   if [[ $fr -eq 0 ]]
   then
      fr=1
      prevchksum=$c1
      prevfile=$n3
      continue
   fi
   # if current checksum equals saved checksum,
   # the file is a duplicate
   if [[ $prevchksum -eq $c1 ]]
   then
      echo "file $prevfile has duplicate $n3"; #rm $n3
   else
      prevchksum=$c1
      prevfile=$n3
   fi
done
# end script

Let me know if that works for you.