neinAlkem/scrapping-web-airflow
This project involves building an automated product scraping pipeline using Selenium and Apache Airflow to collect Amazon product data such as titles, prices, ratings, and availability. Selenium is used to handle dynamic web content and simulate user interactions, while Airflow manages scheduling, orchestration, and monitoring of scraping workflows
Stars
—
Forks
—
Language
Python
License
—
Category
Last pushed
Dec 21, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/neinAlkem/scrapping-web-airflow"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.
Kaliiiiiiiiii-Vinyzu/patchright-python
Undetected Python version of the Playwright testing and automation library.