RaheesAhmed/web-scraper
This project contains a function to scrape Google search results for a given keyword and then visit each result to scrape additional details such as the article title, meta keywords, and article content. The code is designed to be used in a Next.js API route.
No commits in the last 6 months.
Stars
4
Forks
1
Language
TypeScript
License
—
Category
Last pushed
Mar 17, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/RaheesAhmed/web-scraper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.