farzanmosayyebi/TechNews
A Django-based project featuring a web crawler that automates daily scraping of the Zoomit.ir website using Scrapy and Selenium. Implemented task scheduling with Celery and Celery Beat, and containerized the application with Docker, including Dockerfile and Docker Compose for easy deployment.
No commits in the last 6 months.
Stars
2
Forks
1
Language
Python
License
MIT
Category
Last pushed
Aug 22, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/farzanmosayyebi/TechNews"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.
Kaliiiiiiiiii-Vinyzu/patchright-python
Undetected Python version of the Playwright testing and automation library.