Visit MPB Visit MPB Visit MPB

Duplicate finder?

Bobbinalorry
Posted 06/01/2010 - 13:47 Link
A VERY GOOD NEW YEAR TO ONE AND ALL,

Hi to all you good people; Does anyone out there in snappyland know of any software that finds / compares duplcate images?
Best Regards, Larry.

All the gear & no idea.
gartmore
Posted 06/01/2010 - 16:32 Link
Do you mean on your computer or the internet?
Ken
“We must avoid however, snapping away, shooting quickly and without thought, overloading ourselves with unnecessary images that clutter our memory and diminish the clarity of the whole.” - Henri Cartier-Bresson -
Bobbinalorry
Posted 06/01/2010 - 16:51 Link
Hello Ken,
I mean on my computer; I seem to have accumalated quite a lot of duplicates,some with differing names/numbers. I would like to find a way of assimilating matching images so that I can check to be sure to delete by picture matc rather than by name or number.

Any idea's::
Best Regards, Larry.

All the gear & no idea.
JohnX
Posted 06/01/2010 - 17:21 Link
I use Easy Duplicate Finder link, but it really only works when the file name hasn't been changed. Up side, it's free

They do have another product - Duplicate Photo Finder - which I have't tried, but I think you have to pay for it, AND it doesn't support RAW files
Edited by JohnX: 06/01/2010 - 17:26
Posted 06/01/2010 - 17:25 Link
Years ago I used a Perl script called findimagedupes which worked spectacularly well. When my collection of images grew to more than a gigabyte or so, I combined it with a program of my own which found and deleted exact file duplicates on a first run.

That was on a Linux computer, however. But in the Linux world there are a few free image management programs which have duplicate image finding built in, I'm sure the Windows world must have at least one.
johnriley
Posted 06/01/2010 - 19:14 Link
Why not just use the Windows Search facility?
Best regards, John
thoughton
Posted 06/01/2010 - 19:25 Link
Because then you need to know which images have a duplicate. The point of dupe finder software is that it will just produce a list of all the duplicate files, including the ones you never knew about. This type of software is fairly common for general computer use (general documents, but especially music) to try and prevent wasted disk space.
Tim
AF - Pentax K5, Sigma 10-20/4-5.6, Tamron 17-50/2.8, Sigma 30/1.4, Sigma 70-200/2.8, Tamron 70-300/4-5.6
MF - Vivitar CF 28/2.8, Tamron AD2 90/2.5, MTO 1000/11
Stuff - Metz 58 AF1, Cactus v4, Nikon SB24, Raynox 150, Sigma 1.4x TC, Sigma 2x TC, Kenko 2x macro TC, Redsnapper 283 tripod, iMac 27”, Macbook Pro 17”, iPad, iPhone 3G
FlickrFluidrPPGStreetPortfolio site
Feel free to edit any of my posted photos! If I post a photo for critique, I want brutal honesty. If you don't like it, please say so and tell me why!
Oggy
Posted 06/01/2010 - 20:17 Link
Bob - you mention different file names - do you mean something that will actually look at the picture and find similar ones? I've got an idea there is something that does but you might need one of these to run it. A couple of suggestions though. When I produce multiple versions of a picture I name them with a suffix eg IMGP1234, IMGP1234a. If you do this, then arranging icons by name will find them. If you show the pictures as thumbnails and arrange by file size this will also highlight some duplications. Neither method is perfect though.
Bobbinalorry
Posted 07/01/2010 - 10:57 Link
johnriley wrote:
Why not just use the Windows Search facility?

Hi John,
I did'nt know this facility could be used for this particular application;
Please would you explain to me how this would be done?

Thank's, Regards,
Larry.
Best Regards, Larry.

All the gear & no idea.
johnriley
Posted 07/01/2010 - 11:06 Link
What I had in mind was maybe where someone makes other versions of an image. Just go Start>Search and select image files and search using part of the file name so that it picks up all the variants.

So, for example, "Jenny at Sea" and "Jenny at Sea Web Version" would both be found looking up "Jenny at"

Sometimes we buy software when something useable is already built into Windows for free. It all depends what we are trying to find in this case.

I do sometimes use this search facility, but not often as I usually know where something is to be found.
Best regards, John
Bobbinalorry
Posted 07/01/2010 - 12:23 Link
johnriley wrote:
What I had in mind was maybe where someone makes other versions of an image. Just go Start>Search and select image files and search using part of the file name so that it picks up all the variants.

So, for example, "Jenny at Sea" and "Jenny at Sea Web Version" would both be found looking up "Jenny at"

Sometimes we buy software when something useable is already built into Windows for free. It all depends what we are trying to find in this case.

I do sometimes use this search facility, but not often as I usually know where something is to be found.

Hi again John,

My problem is that some time ago a freind set me up with an external 500 Gig hard drive to back-up my computer; What I was too daft to grasp,being new to computers, was that every time I backed up everything was stored again, whether it was altered or not!
In many cases I had worked on or altered / re-named images or items and suddenly my 500 Gig was full! But in very many cases items / images were duplicated 2, 3, 4 or even 5 times and copied into differing files! And often with different number or name tags.
Best Regards, Larry.

All the gear & no idea.
JohnX
Posted 07/01/2010 - 12:33 Link
Bobbinalorry wrote:

My problem is that some time ago a freind set me up with an external 500 Gig hard drive to back-up my computer; What I was too daft to grasp,being new to computers, was that every time I backed up everything was stored again, whether it was altered or not!

Bob, see my earlier post in this thread. Used Easy Duplicate Finder to resolve identical problem. Works simultaneously across multiple drives.
Bobbinalorry
Posted 07/01/2010 - 13:48 Link
JohnX wrote:
Bobbinalorry wrote:

My problem is that some time ago a freind set me up with an external 500 Gig hard drive to back-up my computer; What I was too daft to grasp,being new to computers, was that every time I backed up everything was stored again, whether it was altered or not!

Bob, see my earlier post in this thread. Used Easy Duplicate Finder to resolve identical problem. Works simultaneously across multiple drives.

Thanks JohnX,
I'll give it a go.
Best Regards, Larry.

All the gear & no idea.
Father Ted
Posted 07/01/2010 - 15:09 Link
I have this problem too, but didn't want to admit it

I made copies of SD cards to clear them before re-use. then backed the copies up, then had back ups of the back ups. I probably have a few gig of copies!!

But then, I never was very tidy, either in "real life" or with files on my PC
Getting there! Thanks to you guys

Pentax K10d, *istDL, Kit lens ( 18-55mm ), 50mm f1.7 lens, Tamron 70-300mm lens, Prinzflex 70-162 manual lens, Various old flashes.
Posted 08/01/2010 - 08:22 Link
Oggy wrote:
Bob - you mention different file names - do you mean something that will actually look at the picture and find similar ones? I've got an idea there is something that does but you might need one of these to run it.

The software I referred to above - 'findimagedupes' - does that, ie it actually examines the image, so that it will report images which are visually similar despite not being represented in identical files. Ran quite happily on a 1999 Pentium II with 96MB of memory, I'm happy to report - supercomputer not required. It did take several hours to run on that machine over a collection of a couple of gig of images, however.

BTW an admin might want to delete kangyu's post, above.

Add Comment

To leave a comment - Log in to Pentax User or create a new account.