voliveirajr/seleniumcrawler
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
This tool helps you quickly gather ferry ticket pricing and availability from directferries.com. You input your desired departure route (Dublin-Liverpool or Liverpool-Dublin) and it outputs a JSON file containing all relevant ticket information for tomorrow's departure and a 3-day return. It's ideal for travel planners, researchers, or anyone needing to collect specific ferry fare data.
128 stars. No commits in the last 6 months.
Use this if you need to programmatically collect ferry ticket data for specific routes and dates from directferries.com for analysis or comparison.
Not ideal if you need real-time booking, data from many different ferry operators, or a user-friendly interface for casual browsing.
Stars
128
Forks
44
Language
Python
License
GPL-3.0
Category
Last pushed
Feb 28, 2019
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/voliveirajr/seleniumcrawler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.