All Perception Tools

🚀 Real-time GitHub trending dashboard with 25+ languages, cross-column...

A website prototype for entry level job seekers

Tracks a discord server's member count without a bot.

Tris is a simple NodeJS web crawler tool to help you collect links from...

HTTP request library, focused on web scraping

A PHP kit for sending a request and receiving a response over HTTP using the...

🎓 Ferramenta automatizada para baixar currículos Lattes do CNPq com bypass...

Web Scraping & Text Data Collecting and Curating for Maithili Language. Also...

Search engine system for articles using redis technology stack. This project...

Python web-scraping application on latest news with Flask

Analyzing data science books on amazon. An end to end project on data...

Automates keyword searches in Google's Top Stories using Selenium for web...

Bessere User Experience für ZiviConnect, Offline

Educational web scraping project using Python Scrapy to practice crawling...

Web scraping is the process of using bots to extract content and data from a...

An AWS project, discovering the prices of Freddo's at various UK...

A simple data scraping utility, used to extract data from 11888.gr

Automated Selenium-based scraper for extracting and analyzing job listings...

HumanitarianJobs-Extractor-Plus is an advanced Python script that automates...

Automated discovery and classification of websites content through...

Scripts used to scrape tennis match results from the web and update my...

Clean up your tweet and retweet without API from twitter 🔥.

:video_game: A Gog.com downloader

Advanced Python application leveraging the power of APIs and the pandas...

Lyrics Plugin for Spotify

Automated the process of looking for research participation opportunities by...

📝 Streamline YouTube with a simple script to copy all comments directly,...

This repository will have the code and explanation to how to scrap a HTML website.

:selfie: Instagram Engagement Data.

Get and process multiple resources from web, using asyncio (aiohttp) to...

A simple scraper for getting information from t.me links.

Python Script for scraping Apache Server Status page if present , find...

Modern Python ETL library with decorator-based API. Makes data extraction...

Digikala Crawlerیک خزنده وب قدرتمند برای جمع‌آوری و تحلیل داده‌های دیجی‌کالا...

This project provides a comprehensive solution for extracting and managing...

A powerful and lightweight web scraping library with LLM extraction...

⌬ Predictive Modeling of Pharmacological Activites

Scrapes webpages in (almost) any web format, then sends discord...

A Python web scraper that extracts course information (headline, summary,...

N-grams analysis for identifying internal linking opportunities for SEO

PC FUTSAL — A Real-World Data & Analytics Platform for Amateur Futsal

Get course recordings from moodle (for HIT students)

The Quote App is a handy tool for users to access a diverse collection of...

Data pipeline & dashboard for B2B business matching (The Peak) + ...

C program used to search for subdomains on a specific website. Programa em C...

Crawler programmed to navigate the website, parse, and scrape relevant...

Extraer datos de la salida y puesta del sol y los datos lunares diarios en la web

Skill Roadmap to becoming a WebCrawler developer
爬虫工程师 知识图谱

Ignorance is bliss, filter out bad news on BBC news website.

Powerful tool to extract data from Maxbhi.com, scrap over 1.4 million...

A web-scraping system using multiple agent scripts coordinated by a central...

Autonomous AI-powered game testing platform that uses browser automation and...

Modern Playwright-based XSS scanner for bug bounty hunters and security...

Automatic generation of YouTube compilation videos from subreddits

A Twitter bot that uses numerous APIs to recommend films, scrapes Wikipedia...

Outdated. Upgrades coming soon! Generate regularly updated visualizations of...

Commandline Tool for getting information from local WIFI web server GLOBEATHOME

Python Scripts for scrapping ERP.

This code pulls Lightning Strike data from the National Interagency Fire...

A lightweight HTML parsing library inspired by Beautiful Soup, providing...

Discography scraping using an amalgamation of bs4 and Selenium.

A collection of web scrapers

Website URL Scanner is a simple command-line tool that allows you to scan a...

A simple Dart wrapper for fetching, parsing and extracting notices from...

Content aggregator that collects metadata about news articles

A command-line tool to get Stats Update about the coronavirus pandemic....

We will analyze the website MyAnimeList using Requests, and BeautifulSoup...

A python script for collecting links from the Google's first page

A simple set of Python scripts that can be used to download and explore CVPR...

A Python script to download/update COT data and run simple search queries.

Extract general jobs data from computrabajo.com in specific location and...

Basic python program to display profile picture for any given github user name

Get schedule of coding contests from various coding platforms in your terminal.

Library based on Selenium that drastically simplifies web automation workflows

An Unofficial REST API for Hits Daily Double

Predicting highly rated board games using data scraped from BoardGameGeek

This Amazon Web Scraper script is designed to extract product information...

Automate Google Scholar citations with Selenium. I came up with this project...

Ranking real estate investment opportunities in Malta using multi-threaded...

Scripting with Python and SQL for Data Engineering Course Course - Duke University

WhySoSlow points at services that are missing for the user. The projects...

A Moodle downloader tool that downloads course contents such as pdfs, word...

RSS feed reader with web interface and SQLite data storage

Efficient Reddit scraper built with Python, utilizing the official API to...

One line web scraping by combining pandas and BeautifulSoup4

Download invoices from the GitHub billing page to your Downloads...

Helper functions for web scraping in V (vlang)

KUET Teacher Data Scrapper from KUET Website

Python scripts for parsing Wildberries, the largest Russian online retailer

Code to scrape the celeb Instagram Feed and upload it to YouTube with proper...

Algorithm to measure the degrees of separation between a user and the top of...

A Python package to facilitate acquisition and preprocessing of data from...

Petit script qui permet de télécharger les manuels d'Hatier et Hachette...

Backend for the stylish application made with flask. Implements a Website->...

Yspeed is a library that scrapes the Speedtest site

CAASES is a web crawler for extracting website accessibility information...

Extract HTML tags and metadata, optionally rename files. Supports MAFF as...

This project scrapes real estate listings from multiple property sale...

Download presentations and lectures from LMS using Chrome in headless mode

Scrape, analyse and export data of 150cc and 200cc world records for the 96...