Cyber-Gwen/Website-Subpage-Scraper

This Python script scrapes internal links on a webpage. It prompts for a URL, sends a GET request to retrieve HTML, uses BeautifulSoup to parse and filter links. Then it prompts the user for output mode (terminal or file) to either print or write the links. Installs required modules (requests and beautifulsoup4) if not found.

22
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 4 / 25
Maturity 8 / 25
Community 10 / 25

How are scores calculated?

Stars

6

Forks

1

Language

Python

License

—

Category

scraper

Last pushed

Feb 22, 2023

Commits (30d)

0

GitHub
Scraper · 8276 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/perception/Cyber-Gwen/Website-Subpage-Scraper"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Featured in

Giving AI Agents Eyes: Browser Automation in 2026

Higher-rated alternatives

scrapy/scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

87

Altimis/Scweet

A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...

83

lexiforest/curl_cffi

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...

79

plabayo/rama

modular service framework to move and transform network packets

78

scrapinghub/spidermon

Scrapy Extension for monitoring spiders execution.

78

Explore Perception Tools

All categories Trending Perception directory Insights