get-set-fetch/scraper

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

55
/ 100
Established

113 stars and 62 monthly downloads. No commits in the last 6 months. Available on npm.

Stale 6m
Maintenance 0 / 25
Adoption 13 / 25
Maturity 25 / 25
Community 17 / 25

How are scores calculated?

Stars

113

Forks

18

Language

TypeScript

License

MIT

Category

browser-automation

Last pushed

Mar 13, 2023

Monthly downloads

62

Commits (30d)

0

Dependencies

11

GitHub npm
Browser Automation · 2245 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/perception/get-set-fetch/scraper"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Featured in

Giving AI Agents Eyes: Browser Automation in 2026

Related tools

seleniumbase/SeleniumBase

APIs for browser automation, testing, and bypassing bot-detection.

95

intoli/user-agents

A JavaScript library for generating random user agents with data that's updated daily.

88

apify/crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...

88

Kaliiiiiiiiii-Vinyzu/patchright

Undetected version of the Playwright testing and automation library.

86

Kaliiiiiiiiii-Vinyzu/patchright-python

Undetected Python version of the Playwright testing and automation library.

83

Explore Perception Tools

All categories Trending Perception directory Insights