mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
20 Jan 2025
5pm ▏ +1
6pm ▎ +2
7pm ▉ +7
8pm ▊ +6
9pm ▉ +7
10pm █ +8
11pm ▋ +5
21 Jan 2025
12am ▉ +7
1am ▌ +4
2am ▍ +3
3am ██ +16
4am █▍ +11#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from thousands of sites
Language:Python
Total stars: 14146
Stars trend:
#python
#blueteam, #cybersecurity, #identification, #investigation, #namechecker, #opensource, #osint, #osintframework, #osintpython, #parsing, #python, #python3, #redteam, #scraping, #sherlock, #socialnetwork, #socmint, #username, #usernamechecker, #usernamesearch
🕵️♂️ Collect a dossier on a person by username from thousands of sites
Language:Python
Total stars: 14146
Stars trend:
23 Jan 2025
6am ▎ +2
7am ▏ +1
8am +0
9am ▎ +2
10am ▏ +1
11am █▎ +10
12pm ▉ +7
1pm █▊ +14
2pm █▋ +13
3pm █▉ +15
4pm █▏ +9
5pm ██▏ +17#python
#blueteam, #cybersecurity, #identification, #investigation, #namechecker, #opensource, #osint, #osintframework, #osintpython, #parsing, #python, #python3, #redteam, #scraping, #sherlock, #socialnetwork, #socmint, #username, #usernamechecker, #usernamesearch
🔥1
bjesus/pipet
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 2130
Stars trend:
#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 2130
Stars trend:
25 Jan 2025
3pm ▌ +4
4pm ██ +16
5pm █ +8
6pm █ +8
7pm █▍ +11
8pm █▊ +14
9pm ██▎ +18#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
Benexl/FastAnime
Your browser anime experience from the terminal
Language:Python
Total stars: 516
Stars trend:
#python
#anilist, #anime, #animescraper, #api, #application, #cli, #click, #fastanime, #python, #rich, #scraping
Your browser anime experience from the terminal
Language:Python
Total stars: 516
Stars trend:
28 Jan 2025
12pm ▏ +1
1pm █▋ +13
2pm ████ +32
3pm █▍ +11
4pm ▉ +7
5pm █▎ +10
6pm ▋ +5#python
#anilist, #anime, #animescraper, #api, #application, #cli, #click, #fastanime, #python, #rich, #scraping
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Language:Python
Total stars: 17596
Stars trend:
#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
Python scraper based on AI
Language:Python
Total stars: 17596
Stars trend:
31 Jan 2025
6am ▌ +4
7am ▏ +1
8am ▉ +7
9am █ +8
10am ▋ +5
11am ▉ +7
12pm ▉ +7
1pm █▍ +11
2pm █ +8
3pm █▏ +9
4pm ▉ +7
5pm ▊ +6#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
👍1
iiab/iiab
Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !
Language:Jinja
Total stars: 1085
Stars trend:
#jinja
#civictech, #communitynetworks, #curriculumdesign, #distractionfree, #diy, #education, #homeschool, #hotspot, #humanrights, #internationaldevelopment, #knowledge, #learning, #library, #medical, #meshnetworks, #offline, #prisonersrights, #privacy, #raspberrypi, #scraping
Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !
Language:Jinja
Total stars: 1085
Stars trend:
9 Feb 2025
4am ▏ +1
5am ▋ +5
6am ▋ +5
7am ▋ +5
8am █▎ +10
9am ▌ +4
10am █▍ +11
11am ▍ +3
12pm ▉ +7
1pm ▉ +7
2pm ██ +16
3pm █▎ +10#jinja
#civictech, #communitynetworks, #curriculumdesign, #distractionfree, #diy, #education, #homeschool, #hotspot, #humanrights, #internationaldevelopment, #knowledge, #learning, #library, #medical, #meshnetworks, #offline, #prisonersrights, #privacy, #raspberrypi, #scraping
D4Vinci/Scrapling
🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 2301
Stars trend:
#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 2301
Stars trend:
12 Feb 2025
6am ▍ +3
7am ▎ +2
8am ▋ +5
9am ▍ +3
10am ▊ +6
11am ▉ +7
12pm █▉ +15
1pm █▌ +12
2pm █▉ +15
3pm █▌ +12
4pm ▊ +6
5pm █▋ +13#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Language:Python
Total stars: 55667
Stars trend:
#python
#crawler, #crawling, #framework, #hacktoberfest, #python, #scraping, #webscraping, #webscrapingpython
Scrapy, a fast high-level web crawling & scraping framework for Python.
Language:Python
Total stars: 55667
Stars trend:
4 Jun 2025
10am ▋ +5
11am █▎ +10
12pm ▉ +7
1pm █ +8
2pm █▏ +9
3pm █▌ +12
4pm █▊ +14
5pm ▉ +7
6pm █▎ +10
7pm █▌ +12#python
#crawler, #crawling, #framework, #hacktoberfest, #python, #scraping, #webscraping, #webscrapingpython
jaypyles/Scraperr
Self-hosted webscraper.
Language:TypeScript
Total stars: 3597
Stars trend:
#typescript
#docker, #helm, #kubernetes, #opensource, #playwright, #python, #scraping, #selfhosted, #webscraper, #webscrapers, #webscraping, #webscraper, #webscraping
Self-hosted webscraper.
Language:TypeScript
Total stars: 3597
Stars trend:
4 Jul 2025
10am █▏ +9
11am ▌ +4
12pm █▏ +9
1pm █▌ +12
2pm █▊ +14
3pm █▌ +12
4pm ▊ +6
5pm █▏ +9
6pm ▋ +5
7pm ▋ +5#typescript
#docker, #helm, #kubernetes, #opensource, #playwright, #python, #scraping, #selfhosted, #webscraper, #webscrapers, #webscraping, #webscraper, #webscraping
D4Vinci/Scrapling
🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!
Language:Python
Total stars: 5620
Stars trend:
#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!
Language:Python
Total stars: 5620
Stars trend:
7 Jul 2025
8pm ██▏ +17
9pm █▎ +10
10pm █▋ +13
11pm █▋ +13
8 Jul 2025
12am █▎ +10
1am █▌ +12#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from thousands of sites
Language:Python
Total stars: 16024
Stars trend:
#python
#blueteam, #cybersecurity, #identification, #investigation, #namechecker, #opensource, #osint, #osintframework, #osintpython, #parsing, #python, #python3, #redteam, #scraping, #sherlock, #socialnetwork, #socmint, #username, #usernamechecker, #usernamesearch
🕵️♂️ Collect a dossier on a person by username from thousands of sites
Language:Python
Total stars: 16024
Stars trend:
17 Jul 2025
10am █▏ +9
11am █▊ +14
12pm ██ +16
1pm █▎ +10
2pm █▋ +13
3pm █▊ +14
4pm █▎ +10
5pm █▉ +15
6pm █▎ +10
7pm █▍ +11
8pm █▍ +11
9pm █▊ +14#python
#blueteam, #cybersecurity, #identification, #investigation, #namechecker, #opensource, #osint, #osintframework, #osintpython, #parsing, #python, #python3, #redteam, #scraping, #sherlock, #socialnetwork, #socmint, #username, #usernamechecker, #usernamesearch
mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 43926
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 43926
Stars trend:
30 Jul 2025
11pm ▏ +1
31 Jul 2025
12am ▉ +7
1am ▌ +4
2am █▎ +10
3am █▎ +10
4am ▌ +4
5am █▏ +9
6am █▍ +11
7am █▏ +9
8am ▋ +5
9am █▏ +9
10am █▍ +11#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Language:TypeScript
Total stars: 1201
Stars trend:
#typescript
#aiscraping, #aitools, #crawl, #data, #htmltomarkdown, #rag, #scrape, #scraping, #serp, #webscraper
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Language:TypeScript
Total stars: 1201
Stars trend:
31 Jul 2025
4pm █ +8
5pm █▍ +11
6pm ▉ +7
7pm ▋ +5
8pm █▍ +11
9pm █▏ +9
10pm ▉ +7
11pm █ +8
1 Aug 2025
12am █▌ +12
1am ▊ +6#typescript
#aiscraping, #aitools, #crawl, #data, #htmltomarkdown, #rag, #scrape, #scraping, #serp, #webscraper