wkdhkr/dedupper
import various files, detect duplicates with sqlite, reject image file by deep learning.
This tool helps organize large collections of image and video files by automatically detecting and removing duplicates. You input a folder with files, and it intelligently identifies copies, even if they're slightly different, and then imports the unique files into a structured library. This is ideal for photographers, digital artists, or anyone managing extensive personal media archives.
No commits in the last 6 months.
Use this if you have a chaotic collection of image and video files and want to clean it up by identifying and removing duplicates, while also organizing new imports by date.
Not ideal if you need to deduplicate other file types besides images and videos, or if you are not using Windows 10.
Stars
8
Forks
1
Language
JavaScript
License
MIT
Category
Last pushed
Mar 04, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/wkdhkr/dedupper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Cloud-CV/EvalAI
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
fireindark707/Python-Schema-Matching
A python tool using XGboost and sentence-transformers to perform schema matching task on tables.
graphbookai/graphbook
Visual AI development framework for training and inference of ML models, scaling pipelines, and...
visual-layer/fastdup
fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and...
github/CodeSearchNet
Datasets, tools, and benchmarks for representation learning of code.