mohammadhashemii/Web-Crawler-Detection
Web Crawler Detection using Unsupervised Algorithms
This tool helps website administrators and security professionals identify automated web crawlers and bots by analyzing server logs. It takes raw server log data as input, automatically extracts key session behavior, and then classifies each web request as either a legitimate user or a bot. This allows you to better understand your website traffic and protect against malicious or unwanted automated activity.
No commits in the last 6 months.
Use this if you need to detect unusual or bot-like activity on your website by analyzing your web server logs.
Not ideal if you need real-time, preventative bot blocking at the network edge, rather than post-analysis of logs.
Stars
23
Forks
4
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Sep 05, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/mohammadhashemii/Web-Crawler-Detection"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
yzhao062/pyod
A Python Library for Outlier and Anomaly Detection, Integrating Classical and Deep Learning Techniques
unit8co/darts
A python library for user-friendly forecasting and anomaly detection on time series.
elki-project/elki
ELKI Data Mining Toolkit
raphaelvallat/antropy
AntroPy: entropy and complexity of (EEG) time-series in Python
Minqi824/ADBench
Official Implement of "ADBench: Anomaly Detection Benchmark", NeurIPS 2022.