The Perception Directory
Quality-scored directory of 10,527 perception tools, updated daily. Every tool scored on maintenance, adoption, maturity, and community signals.
Perception tools give AI agents eyes and hands on the web — browser automation, web scraping, data extraction, and anti-detection infrastructure.
53
70–100
319
50–69
2,217
30–49
7,938
10–29
Top tools by quality score
| # | Tool | Score |
|---|---|---|
| 1 |
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python. |
|
| 2 |
browser-use/browser-use
🌐 Make websites accessible for AI agents. Automate tasks online with ease. |
|
| 3 |
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection. |
|
| 4 |
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single... |
|
| 5 |
firecrawl/firecrawl
🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or... |
|
| 6 |
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can... |
|
| 7 |
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites |
|
| 8 |
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build... |
|
| 9 |
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library. |
|
| 10 |
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets,... |
|
| 11 |
omkarcloud/botasaurus
The All in One Framework to Build Undefeatable Scrapers |
|
| 12 |
d60/twikit
Twitter API Scraper | Without an API key | Twitter Internal API | Free |... |
|
| 13 |
serpapi/google-search-results-python
Google Search Results via SERP API pip Python Package |
|
| 14 |
jaebradley/basketball_reference_web_scraper
NBA Stats API via Basketball Reference |
|
| 15 |
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build... |
|
| 16 |
intoli/user-agents
A JavaScript library for generating random user agents with data that's... |
|
| 17 |
microlinkhq/browserless
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots,... |
|
| 18 |
scrapy/parsel
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors |
|
| 19 |
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution. |
|
| 20 |
rushter/selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS... |
|