apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js that helps you build reliable crawlers. Fast.
Language:TypeScript
Total stars: 9760
Stars trend:
22 Nov 2023
12am █▍ +11
1am ▊ +6
2am █▏ +9
3am ▍ +3
4am ▎ +2
5am ▍ +3
6am ▎ +2
7am ▋ +5
8am ████▋ +37
9am ████▉ +39
10am ███▏ +25
11am ██ +16
#typescript
#apify, #automation, #crawler, #crawling, #headless, #headlesschrome, #javascript, #nodejs, #npm, #playwright, #puppeteer, #scraper, #scraping, #typescript, #webcrawler, #webcrawling, #webscraping

apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:Python
Total stars: 208
Stars trend:
9 Jul 2024
7am ██▏ +17
8am █▍ +11
9am █▎ +10
10am ███▏ +25
11am ██▊ +22
12pm ███ +24
1pm ███▍ +27
#python
#apify, #automation, #beautifulsoup, #crawler, #crawling, #headless, #headlesschrome, #pip, #playwright, #python, #scraper, #scraping, #webcrawler, #webcrawling, #webscraping

D4Vinci/Scrapling
Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 268
Stars trend:
11 Nov 2024
6am ▌ +4
7am ▌ +4
8am ▏ +1
9am ▏ +1
10am ▏ +1
11am ▋ +5
12pm ▎ +2
1pm ▌ +4
2pm ▉ +7
3pm ██▋ +21
4pm █▊ +14
5pm ███▏ +25
#python
#automation, #crawler, #crawling, #crawlingpython, #css, #dommanipulation, #hacktoberfest, #lxml, #playwright, #python, #python3, #scraping, #selectors, #selenium, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath

D4Vinci/Scrapling
🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 2301
Stars trend:
12 Feb 2025
6am ▍ +3
7am ▎ +2
8am ▋ +5
9am ▍ +3
10am ▊ +6
11am ▉ +7
12pm █▉ +15
1pm █▌ +12
2pm █▉ +15
3pm █▌ +12
4pm ▊ +6
5pm █▋ +13
#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath

scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Language:Python
Total stars: 55667
Stars trend:
4 Jun 2025
10am ▋ +5
11am █▎ +10
12pm ▉ +7
1pm █ +8
2pm █▏ +9
3pm █▌ +12
4pm █▊ +14
5pm ▉ +7
6pm █▎ +10
7pm █▌ +12
#python
#crawler, #crawling, #framework, #hacktoberfest, #python, #scraping, #webscraping, #webscrapingpython