Duplicate finder?

Posted 08/01/2010 - 08:24 Link
Bobbinalorry wrote:
My problem is that some time ago a freind set me up with an external 500 Gig hard drive to back-up my computer; What I was too daft to grasp, being new to computers, was that every time I backed up everything was stored again, whether it was altered or not!
Happily, backup software is available which will only write new and modified files to your backup mirror.
bretti_kivi
Posted 08/01/2010 - 08:31 Link
@lonegroover: perl is available for windows - cygwin makes lots of stuff possible. Just installed it yesterday on my work Win7 machine and it runs very well, thanks...

TBH, I'd really, really think about getting a big disk and then copying all of the files into a directory or three. Then, working with dates and times (creation), you should be able to sort them.

Which operating system? How detailed instructions do you need?

Bret
my pics: link
my kit: K3, K5, K-01, DA 18-55, D-FA50 macro, Siggy 30/1.4, 100-300/f4, 70-200/2.8, Samsung 12-24/f4, Tamron 17-50, and lots of other bits.
Oggy
Posted 08/01/2010 - 09:04 Link
I guess it would be something similar to face recognition software which I believe only looks at about seven parameters. It is not immediately obvious what you'd look at with a photo if you are going to find similar ones or ones with small edits/PP. Finding identical images would not be so hard.

Oh well - I guess I'm going to have to find another excuse to get a Cray.
NDR116
Posted 08/01/2010 - 10:02 Link
Assuming just the file name had changed another option might be searching on or sorting by EXIF. If the data is exactly the same a visual comparison can be carried out. Not that I know how to do the searching or sorting. Is half an idea worse than no idea at all.
Posted 08/01/2010 - 19:25 Link
bretti_kivi wrote:
@lonegroover: perl is available for windows - cygwin makes lots of stuff possible. Just installed it yesterday on my work Win7 machine and it runs very well, thanks...
findimagedupes used the ImageMagick toolkit, which is also available for Windows - but it might need a bit of hacking to work.[/quote]
Edited by lonegroover: 08/01/2010 - 19:26
Posted 10/01/2010 - 16:55 Link
Bobbinalorry wrote:


Hi to all you good people; Does anyone out there in snappyland know of any software that finds / compares duplcate images?
digital asset mgt tool photools imatch may help you with this, quoting the help file, you can query the database to :

"
-Find duplicate images in your image collections, even if the images have been resized, rotated, cropped or resized
-Find image with similar colors or similar shapes based on original images you select
-Find images with absolute or relative size or dimensions
-Find images with similar file names or images that match a specific file name pattern
-Find images based on an absolute or relative date and timestamp
-Find images from a sketch you draw
-Find images that contain specific colors or color combinations
-Find image with specific properties or properties similar to some original images
-Find image based on the GPS coordinates within the images
-Find images based on complex combinations of criteria, like "Find all images named like bea* that have been added within the last 3 months" or
"Find images that are mostly red and smaller than 640 x 480, but only if they are newer that 6 weeks"
You get the point…

"

I have not needed to do this myself so no practical experience but no doubt it can do it, within reasonable limits, it is pretty much a does what it says on the tin type of package

worth a look imho: http://www.photools.com/
Edited by bladerunneruk: 10/01/2010 - 16:56
woodworm
Posted 10/01/2010 - 19:37 Link
I think Picasa has a 'find duplicates' filter on it. I haven't used it for a little while but that does sound familier.

You're braver than me if you use some automated solution to delete images of duplicates though - make sure you have a backup just in case ...
kellygas
Posted 13/03/2013 - 16:39 Link
i can recommend "Duplicate Files Deleter" to find and resolve your duplicate issue.. it uses md5 on searching the duplicates which is quite effective, I've been using it for awhile. hope it helps.
JohnX
Posted 08/03/2014 - 22:57 Link
Thanks Sarah, and welcome to the Forum!

I take it you're using the paid for 'Pro' version? Is it worth it, as in 'would you buy it again'?
Edited by JohnX: 08/03/2014 - 22:58
johnriley
Posted 09/03/2014 - 00:29 Link
Tineye is free and works very well. In Firefox you only need to right click an image and Tineye is in the menu once you've downloaded the program.
Best regards, John
Smeggypants
Posted 09/03/2014 - 00:41 Link
johnriley wrote:
Tineye is free and works very well. In Firefox you only need to right click an image and Tineye is in the menu once you've downloaded the program.
That's only for the Web though isn't it?
[i]Bodies: 1x K-5IIs, 2x K-5, Sony TX-5, Nokia 808
Lenses: Pentax DA 10-17mm ED(IF) Fish Eye, Pentax DA 14mm f/2.8, Sigma 17-70mm f/2.8, Pentax-A 28mm f/2.8, Sigma 30mm F1.4 EX DC, Pentax-A 50mm f/1.2, Pentax-A 50mm f/1.4, Pentax-FA 50mm f/1.4, Pentax-A 50mm f/1.7, Pentax DA* 50-135mm f/2.8, Sigma 135-400mm APO DG, and more ..
Flash: AF-540FGZ, Vivitar 283
johnriley
Posted 09/03/2014 - 00:51 Link
Yes it is only for the web, and very illuminating it can be as well.
Best regards, John
Smeggypants
Posted 09/03/2014 - 01:40 Link
johnriley wrote:
Yes it is only for the web, and very illuminating it can be as well.
I just tried it. Google photo search is much better. Brings up more results.

Tineye didn't find any of my stolen images ( which I already know the location of )
[i]Bodies: 1x K-5IIs, 2x K-5, Sony TX-5, Nokia 808
Lenses: Pentax DA 10-17mm ED(IF) Fish Eye, Pentax DA 14mm f/2.8, Sigma 17-70mm f/2.8, Pentax-A 28mm f/2.8, Sigma 30mm F1.4 EX DC, Pentax-A 50mm f/1.2, Pentax-A 50mm f/1.4, Pentax-FA 50mm f/1.4, Pentax-A 50mm f/1.7, Pentax DA* 50-135mm f/2.8, Sigma 135-400mm APO DG, and more ..
Flash: AF-540FGZ, Vivitar 283
akradiabra
Posted 15/03/2014 - 22:53 Link
I've had a need in the past and came across this freeware app. Seem to remember it doing a sterling job.

http://www.visipics.info/index.php?title=Main_Page

Add Comment

To leave a comment - Log in to Pentax User or create a new account.



Proudly supporting Pentax User

Samsung Logo Asahi Pentax Logo