All Perception Tools

Extensible browser automation and testing framework for .NET. Communicates...

Timetable Grabber - SIT is a tool that allows you to grab and export your...

This is the repo associated with the 2023 CDCS Summer School

A simple tool-kit written in python for sourcing and displaying...

cli for evaluating css and xpath selectors

A comprehensive, curated collection of the best APIs for developers

Adaptive web agent that run upto 10x faster than pure LLM agents. Learns...

Raspagem do Documento de Arrecadação do Simples Nacional MEI

scrapping de imoveis

When you need those jobs hypersonic 🚀 scrape 🔪

🧠 A parsing library for Chegg.com written in Python.

🍃 Production-ready: Just upload a photo of any plant or crop, the system...

Automated Google Forms submission tool using Selenium WebDriver - 100% success rate

Scrapy middleware interface to scrape using ProxyCrawl proxy service

Web scraping with java for fun and learning.........

SOAP - A Sockpuppet Auditing Tool for Very Large Online Platforms

🕸 List of mini projects that involve web scraping 🕸

Orchestrate web crawlers to create structured datasets from multiple data...

How to start profiles with API and connect them with Selenium using Python

Let's build with devtool-parsed CSS!

Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka...

An effective random image scraper for the website image hosting and sharing...

web scrapping all the demos

🔴 Web Scraper Application for Pinterest, Made Using TypeScript-Based...

A web scraping project to track the price of an item on Amazon UK.

Keep learning something new

A dataset of more than 55,000 clothing items in the digikala website and...

Live train information: scrape-powered API with JSON endpoints for the...

Check if a Yahoo Email ID is valid using Selenium (Python)

Scala web crawling and scraping using fs2 streams

Extract all contacts from any WhatsApp Web group in seconds. Paste a script...

Build a Web Application that Scrapes Various Websites for Data Related to...

Automatically post Github trends on Facebook page

A multi-threaded libary for web scraping in python.

A Python-based scraper that extracts business leads from Google Maps and...

A curated collection of some :heart_eyes: cool Python scripts.

A Python based customizable script for scraping links to videos hosted on...

Google images scrapper in full resolution with multi threading speed.

DevOps engineering repository dedicated to creating and maintaining the...

npm package scraped from my own web api

An opinionated interface for writing, running, and saving BackstopJS tests

An API to expose Steam games' system requirements. Currently in its first iteration.

Python script to fetch Amul Topicals (original:...

Kotlin Wrapper for Jsoup

Liteium is a lightweight Python library inspired by Selenium, designed to...

Building a Concurrent Web Scraper with Python and Selenium

Repository for the projects needed to complete the Data Analyst Nanodegree.

A little project that scrapes the discord web client and stores each...

A collection of tools to (semi-)automatically collect and analyze data from...

CLI tool made by reverse engineering Instagram API calls.

A Python library/CLI for collecting and archiving posts from the Bluesky...

DarkMatter - A high-performance web-security and proxy validation tool

Social Usernames Scraper

Parse and traverse the SSR payload NUXT_DATA - Useful for scraping Nuxt.js websites

AI-native browser automation CLI and MCP server for Chrome. 90+ commands....

manga translator with support for 100+ languages

covers python basic to advance topics, practice questions, logical problems...

Scrape Olympedia data efficiently with Threading Concurrency and analyze it...

Library for scraping of the application data from the Google Play Store.

A sample dataset of over 1000 TikTok profiles, extracted using the Bright...

In this Compendium you will find chapter summaries from each book of the...

It uses selenium to automate Whatsapp for various different functionality...

为Ta荐（TaJian.tv）工作的基于Hero的Node.js实现的去中心化爬虫程序，可抓取B站、抖音、快手、西瓜视频播放页、直播页的标题和封面图

🌐 Lightweight serverless REST API that scrapes, caches, and returns trending...

An email crawler written in python.

An intelligent AI-powered web crawler that extracts structured product data...

Browser instructions enable users to execute various Oxylabs' headless...

An easy-to-use AI Character Creator/Generator from Web Content to SillyTavern Card

Bright Data Web Unlocker Nodejs boilerplate code

Streamline your search engine research. With the Result Assessment Tool...

Esse repositório é parte dos projetos desenvolvidos pelos membros do...

This project collects Wikipedia articles from a search term entered by the...

This is an automated web scraping tool using Selenium to access and scrape...

List of SIC codes and descriptions from authoritative sources

This repository contains my experiments with Scrapy for advanced web...

Web-scraping SoundCloud.com tracks' stats using Beautiful Soup and Selenium

An API wrapper for Scrappey.com written in Python (cloudflare, datadome...

A PasteBin scrapper that doesnt rely on the PasteBin scrape API

An unofficial API for Addgene, the open-source plasmid repository.

This script scrapes the Forex Factory calendar for economic events,...

CamouFlow is a profile manager for the Camoufox anti-detect browser with...

Small algorithm for getting Antoine's coefficient to calculate vapor...

Bend CSVs to your will with declarative schemas.

A Python script that automatically scrapes email addresses found on websites...

Scrapy middleware interface to a scraper API proxy service

Web scraping of real estates with Scrapy, pydantic, FastAPI, MongoDB and MinIO

Automated tool designed to retrieve student marks data from the VTU...

AI-powered course scraper for the CUD portal built with Streamlit and...

Production-ready Pinterest scraper built with Python Scrapy. Extract pins,...

Scraping, aggregating and assessing technical ability of a candidate based...

Web crawler capable of scraping the reviews and ratings data of any app on...

web scrape facebook post and extract data

Web companion for "Fields of Gold: Scraping Web Data for Marketing Insights"

OCaml functional web scraping library

Scraper utility tool to fetch daily menus.

A scraper for LinkedIn Job Ads built with R and Node.js

Extending Selenium drivers with extra runtime goodies!

Selenium browser automation examples with Python

An AWS workflow for collecting webpages from the Internet Archive

job-search-tool is a powerful web scraping and job search automation tool...