Page 1 of 1

Video Duplicate Finder

Posted: Sun Sep 27, 2020 10:28 am
by webfork
Very useful looking program to find dupe videos and images, claims portability and is open source. Very exciting stuff.

https://github.com/0x90d/videoduplicatefinder
https://www.softpedia.com/get/PORTABLE- ... nder.shtml

Features:
Cross-platform
Fast scanning speed
Ultra fast rescan
Finds duplicate videos / images based on similarity
Windows GUI, Linux GUI and multi-OS Console
FFmpeg and FFprobe is required.

Image

Status: Untested.

Re: Video Duplicate Finder

Posted: Sat Oct 31, 2020 9:10 pm
by webfork
Update:

Got a chance to finally test this ...

Status: Portable, writes to scannedfiles.db and settings.xml.  Not stealth, writes a log file to appdata\Local\Microsoft\CLR_v4.0\UsageLogs\VideoDuplicateFinderWindows.exe.log

Re: Video Duplicate Finder

Posted: Wed Mar 31, 2021 9:15 pm
by Andrew Lee
Added to database:

https://www.portablefreeware.com/index.php?id=3054

I came across this independently while looking for a util that will find video duplicates based on content. This is the only open-source one as far as I can tell, and super fast. I unleashed it on my 500GB collection of video files, and it took only about 5 minutes on a 5th-gen i5 to process all the files, much to my surprise. More importantly, it works, delivering a few dups that I didn't know I have.

The entire video needs to more or less match, irrespective of resolution and codec. I was hoping it might be able to spot a shorter clip within a longer video, but after some testing, I can confirm it doesn't do that. It would be real cool if it could though!

Re: Video Duplicate Finder

Posted: Tue Apr 06, 2021 9:25 am
by bitcoin
Andrew Lee wrote:
Wed Mar 31, 2021 9:15 pm
The entire video needs to more or less match, irrespective of resolution and codec. I was hoping it might be able to spot a shorter clip within a longer video, but after some testing, I can confirm it doesn't do that. It would be real cool if it could though!
hopefully they can add that ability in future editions

edit:

i tried this program and it doesn't seem to detect the same video at different resolutions too well fwiw

Re: Video Duplicate Finder

Posted: Wed Apr 07, 2021 4:09 am
by Andrew Lee
bitcoin wrote:
Tue Apr 06, 2021 9:25 am
i tried this program and it doesn't seem to detect the same video at different resolutions too well fwiw
What res vids did you have? I had a couple of movies at 720p vs 1080p, and they were flagged as dups (the 720p were actually down-converted from 1080p using Handbrake, and I forgot to delete them).

Re: Video Duplicate Finder

Posted: Wed Apr 07, 2021 8:39 am
by bitcoin
Andrew Lee wrote:
Wed Apr 07, 2021 4:09 am

What res vids did you have? I had a couple of movies at 720p vs 1080p, and they were flagged as dups (the 720p were actually down-converted from 1080p using Handbrake, and I forgot to delete them).
that's what i was using 720 vs 1080 - same video length and otherwise identical

i'll do some more testing though

Re: Video Duplicate Finder

Posted: Sun Apr 11, 2021 6:40 am
by BillyECarroll
So far the program works well, I am trying to find duplicates in which the src is 1080 and then reprocessed down to SD. Also, videos that are a few seconds different.