|
 As for annoyance, consider that you have 50 duplicates and you want to decide for each file, what you get are 50 pop-ups, one after other, for each file. And for this reason Duplicate Cleaner is my No.1 program. Duplicate Cleaner has a very streamlined user interface divided into tabs. The scanning job sequentially progresses to the next tab. It also scans for files matching their CRC checksums. Scanning is very fast in comparison to Clone Spy. Scan results are shown as a list in the results tab, where you can select any file by looking at its name, size, date, location, or use ‘Selection Assistant’.
The Selection Assistant selects files of older date, smaller/greater size, having a specific string in file name or file path. It offers image preview of common image formats, and has a music search mode which can involve bit rate and size. It can also create hard links of the deleted duplicate files to the single file which you opt to keep. Hard linked files behave like any standard files, but are cross linked to one single file. Read further details about Hard Links before using this option.
 CloneSpy is the one of the oldest programs in its class. It's certainly not the fastest, but it's definitely the smartest. You can specifically select what is to be scanned and this can include multiple drives, multiple folders, or just individual folders. It has the ability to detect duplicates by CRC, by file name, by CRC and file name, and by file name and size. It will also detect zero length files. The program does not need to be installed but can be run from the executable so it's a good candidate for your USB Flash drive toolkit. It also throws up duplicates in a way that at least makes you think about what you are deleting. Click-happy users may find this latter feature an annoyance; to me it's a safety feature.
 Easy Duplicate Finder is another option. It is a little more generic than Duplicate Finder with a simple user interface. Does not have image previews, dedicated music search, Selection assistant, Hard Link creator like Duplicate Finder. For its standard job i.e. finding duplicates, it is really easy to use, search process is speedy, system files can be excluded. It's also more recently developed than both the above. Please read the help file and use with care. In particular do NOT include your Windows folder in your scan unless you are a (very) knowledgeable user. Latest version does require registration.
 Fast Duplicate File Finder is yet another option. It is fast and easy to use. It also features two specialty searches: Graphics and music. However, these functions are now limited in the free version.
|
Subscribe to our 
Go straight to the Quick Selection Guide
1.4.4 
Unrestricted Freeware 
Windows 98/ME/2000/XP/Vista
Delicious
Digg
StumbleUpon
Hello,
I read that some duplicate files are necessary in Windows XP and it is not recommended to remove.
Are any of these programs smart enough to know which folders these duplicates are located in and to exclude them from any searches?
Otherwise we would have to be super careful if just doing a duplicate search of all of C: for example right?
Cheers,
Paul.
Most of these programs warn you about what areas NOT to search. In most you must override a setting to search in the wrong places. They try to keep you safe.
How about Auslogics Duplicate File Finder?
http://www.auslogics.com/en/software/duplicate-file-finder/
Easy Duplicate Finder versions prior to 3.0 were free. 3.0 is now a pay product.
Yes it now requires registration but I tested it against my older version and it seems much faster and has some new features as well. Two thumbs up for http://www.EasyDuplicateFinder.com!
anti twin is a nice one i think.....
homepage url : http://www.rosenthal-software.com/en/antitwin/
Nice find, thank you.
Will review shortly.
Fast Duplicate Finder (now v2.0.0.1)is now feature limited, and barely functional as a free program. Suggest it be removed from the list.
"The FREE version of Fast Duplicate File Finder is not trial, but with the following limitations:
Searching for similar files will show you only the first 10 groups (feature not limited in 100% duplicate search mode)
You can not use the Filter functionality
You can not delete or move the selected duplicate files when searching for similar files (feature not limited in 100% duplicate search mode)
You can not use Open with Associated Program and Locate in Explorer popup menu items when searching for similar files. (feature not limited in 100% duplicate search mode)"
Just discovered that the latest version of Duplicate Cleaner (v1.4.3) supports M4A files. Awesome.
I have successfully used Duplicate Cleaner but it has a major problem - the list of music file extensions it considers when searching for Music files is limited to only 4 types. The list does not include M4A files, i.e. ipod/itunes default, but cannot be edited to add others.
I am very interested in doing a good job cleaning up my hard drive and keeping plenty of space available. Just found this site via Clone finders on Google. How do you keep away from deletion of SYS / Windows elements without a known list or hard copy of the "DO NOT TOUCH" list..?
I have just finished reading all 50 of these messages and comments. Very interesting and informative. It appears that clones and dup's are "both-files-shown" in a list of files when the scan is completed. Soooo would a date be the determining factor (date,time) for which file you would actually delete. If you delete both files or 10 of the same, have you ALSO deleted the original file,,,, meanig that what this program does is just show clone/dup's only.
What is the best Outlook Email Duplicate Remover ??
I just reported that Duplicate Cleaner would not download. Let me correct that: It will not download using the Opera browser, I had to use Internet Explorer. Whats up with THAT?
It is 26 Nov 09, and I clicked the link that takes me to Digital Volcano. Every time I click on the download link, the page blinks, but nothing happens. Digital Volcano must be broken? Digital Volcano has a web site, but no way to download Duplicate Cleaner.
The site is very much alive. Here is the download link :
http://www.digitalvolcano.co.uk/content/duplicate-cleaner/downloaddcmenu
Anupam
Try these tools:
Find Duplicate Files
Find and remove duplicate files, duplicate images and duplicate mp3 files performing file(content) analysis.
Thanks for the find! Will add to the list in a few days, having fun playing with them at this time.
Duplicate Cleaner 1.4 has just been released - it now uses MD5 hashing rather than CRC32 so it's more accurate. It has a host of other tweaks as well.
http://www.digitalvolcano.co.uk/content/duplicate-cleaner
As long as it is open source I keep supporting, Great work. Our knowledge belong to the world.
Farmasi (commercial link removed by site moderator)
You can try this FREE tool that was recently featured on PCMagazine and ZDNet:
http://www.mindgems.com/products/Fast-Duplicate-File-Finder/Fast-Duplica... - Fast Duplicate File Finder
Fast Duplicate File Finder will help you find fast all duplicate files in a folder and its sub folders.
The applications will compare the content of your files so it will find duplicates even if they are using different file names.
It uses fast binary comparison algorithm and has internal preview supporting a lot of image, video, music and text file formats.
Hi Dave, This is Zeeshan (munkasir) previous category editor.
Need to correct one thing about Clone Spy which was left unchecked by me. By default it throughs results one by one as it finds them but it can be configured to submit aggregate report at the end of the scan.
Now Clonespy has also incorporated creation of Hard links.
I haven't checked it but I suggest it for important jobs due to its strong platform. Moreover, its updated quite frequently.
Thanks to the guy at Digital Volcano for he had started updating its software after a long time. Current version is 1.3.1. I myself use both Clonespy and Duplicate Cleaner.Though I find Duplicate Cleaner easy to work with due to its design and not to forget, its selection assistant is yet to be competed in freeware.
Thanks
Zeeshan,
Thanks for the update. Sorry for the slow reply. I am very happy with both Clonespy and Duplicate Cleaner and haven't found anything better.
Dave
Your first choice includes "smaller/greater size" which I do not think is really a clone, is it? I thought a true clone is an exact copy of every detail (for example a sheep and its clone identical inlcuding having the identical DNA markers) which I thought required a byte-by-byte comparison.
I am looking for software that will identify true, exact content duplicates, regardless of name or date, primarily for use with photographs. Will any of these do that or do I need to look for another option? If these cannot identify only actual clones, what software would you recommend? An additional advantage with a byte-by-byte comparison option might be that with RAW files or those created with specialized software, the analysis software does not need to translate the file, just be able to read it.
Duplicate Cleaner 1.3 will find exact content duplicates.
Simply specify the folders you wish to search, add that path
and then in the File Search check boxes, check only Same Content (CRC)
I tried Easy Cleaner (ToniArts), Duplicate Finder v3.5.3, Duplicate File Finder (Brook Younce), Duplicate File Finder (Funduc), Duplicate Finder (Ashisoft), and they all have the same problem, when the file count gets high, they all crash. I tried many other explorer tools (Fileboss) but they were too cumbersome for my duplicate search requirements.
Duplicate Finder v3.5.3 was fast, but crashed, ran out of memory.
Duplicate File Finder (Brook Younce) has no output to file or printer.
Duplicate File Finder (Funduc), good, fast, great output, but choked after 75k files.
Duplicate Finder (Ashisoft), slow, good search selection, limited files
Only Folder Match (Salty Brine Software) could handle 100k plus files, quite fast, but limited output to text file or csv.
I really pushed these looking for a candidate, I was searching large server drives, and this was my result:
SEARCH SUMMARY:
Number Of Duplicates Found: 91437
Number Of Duplicate Groups: 22133
Total Size: 53.74GB
DoubleKiller is the most usefull of these apps for the typical (non-tech) user.
Me too, but have problem to have it work on vista. Also need manually set link file on desktop.
Heatsoft Clone Cleaner Lite for the best, duplicate file finder for the easiest to use.
I also use Easy duplicate file finder to search clones.
Also the Duplicate mp3 finder is best for finding duplicate music and Dup detector for finding picture clones.
I think you are right!
Has you considered Dupemerge?
http://schinagl.priv.at/nt/dupemerge/dupemerge.html
It will only find duplicates inside the same NTFS partition -- but, on the other hand, it will convert them into NTFS hardlinks. The end result is that you free space on the disk without having to choose which filename/folder to keep.
Some more:
Duplicate File Finder 1.1.0.3 - http://www.softpedia.com/get/System/File-Management/Duplicate-File-Finde...
DupKiller 0.8.2 - http://www.softpedia.com/get/System/File-Management/DupKiller.shtml
WinDeDup 2.4 - http://www.softpedia.com/get/System/File-Management/WinDeDup.shtml
Duplicate File Finder 3.3 - http://www.softpedia.com/get/File-managers/Duplicate-File-Finder-Brooks....
LookDisk 2.97 - http://www.softpedia.com/get/System/File-Management/LookDisk.shtml
I have not yet found a duplicate finder that will correctly identify large duplicate files. I suspect most of these tools use 32 bit integers for the file size.
Doublekiller doesn't find them.
Duplicate Cleaner hangs on my system (maybe it was needlessly computing CRC, I don't know, but it didn't respond to cancel)
Easy Duplicate Finder - seemed to hang, but did respond to cancel.
BTW - the file I was comparing was over 2^31 bytes.
That's strange, most dup detectors in this article use CRC to detect dup's. Can't see how they are failing on you, I used to use Clonespy and later - because of OS compatibility - Jv16 or EDC. They work for me, renamed files with same CRC are flagged. Is your scan finishing ? I've seen some programs having problems while calculating CRC for very large files (like yours). Try copy with Windows only, rename the file (if you want) and then scan the folder.
Forgot to add how I was able to check if they were duplicates.
Used TeraCopy, renamed one file to be the same as the other. Selected one file, and then did Copy To the other files folder - did Skip (because the file already existed), and then pushed the Test button, which computes CRC for both Source and Target files.
Easy Duplicate File Finder is really good. It supports Unicode filenames.
Yep, for duplicate files and music, duplicate cleaner is my fave.
The selection assistant is particularly handy.
I second Duplicate Cleaner. It rocks :)
Not exactly the same thing, but on a related note is VisiPics
http://www.visipics.info/index.php?title=Main_Page
VisiPics (as it's name would suggest) finds duplicate pictures on your computer, even when they are not exactly the same. You can make it detect pictures with more difference by setting it to a loose filter or make it only look for photos that are almost exactly identical by setting the filter to strict. It is great, especially if you constantly save pictures to your hard drive and don't have that great of a memory on if you have or have not saved a picture before.
Thanks a Lot Dude.
I never expected that I will find Duplicate Photo Finder with such less effort.
Sorting things in Google is difficult sometimes.
This site has been very useful for all my needs.
I agree. This is a very good utility.
Yeah, doublekiller is my no1 of this kind. No need to install. Speed is fast and above all it wont crash with great amount of files.
Only one weak point - not unicode. Otherwise it's an excellent product.
Niefer ;)
If one wishes to compare what changes have been made
between two revisions of the same file, folder or archived
folder (including subfolders) [eg. you have an older backup
of a folder and you would like to compare this with the newer
folder], then csDiff is the tool you need.
- Bharat Kurve
Hi Bharat
csDiff is indeed a very good and a kind of unique program. I thought of using it as dup detector but it seems far fetched, as there are many good software available for the job. But it certainly does not under mines the importance of the software itself as it is really quite unique for its specific task and I for myself can definitely use something like this.
Thanks for sharing.
Zeehsan
recently I needed to eliminate hundreds of duplicate mp3s {a friend panicked when on a system message and merged iTunes music...eh}
I tested several duplicite finders and found these critical features to make a difference.
-level of combinations by which to compare files [date, size, name, checksum]
-level of options to specify exclude/include directories
-visual presentation of the results after a scan...
...-speed and ability to work with the results-list of duplicates after a scan (sorting, mask-selecting...)
-an option to save/remember the results-list
and then just little things: I remember someone complained a program failed to see a difference between VOB files and reported them as duplicates...
http://www.easyduplicatefinder.com/
is my own fave, and it supports vista
doublekiller is another contender worthy of mention.
http://www.bigbangenterprises.de/en/doublekiller/
Post new comment