mendableai/firecrawl
๐ฅ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
๐ฅ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
20 Jan 2025
5pm โ +1
6pm โ +2
7pm โ +7
8pm โ +6
9pm โ +7
10pm โ +8
11pm โ +5
21 Jan 2025
12am โ +7
1am โ +4
2am โ +3
3am โโ +16
4am โโ +11#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
โค1
bjesus/pipet
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 2130
Stars trend:
#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 2130
Stars trend:
25 Jan 2025
3pm โ +4
4pm โโ +16
5pm โ +8
6pm โ +8
7pm โโ +11
8pm โโ +14
9pm โโโ +18#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
Evil0ctal/Douyin_TikTok_Download_API
๐ใDouyin_TikTok_Download_APIใๆฏไธไธชๅผ็ฎฑๅณ็จ็้ซๆง่ฝๅผๆญฅๆ้ณใๅฟซๆใTikTokใBilibiliๆฐๆฎ็ฌๅๅทฅๅ ท๏ผๆฏๆAPI่ฐ็จ๏ผๅจ็บฟๆน้่งฃๆๅไธ่ฝฝใ
Language:Python
Total stars: 10524
Stars trend:
#python
#api, #async, #crawler, #douyin, #douyinapi, #douyinscraper, #douyintiktokapi, #douyintiktokdownload, #fastapi, #nowatermark, #onlineparsing, #python, #pywebio, #scraper, #spider, #tiktok, #tiktokapi, #tiktokscraper, #tiktoksignature, #webscraping
๐ใDouyin_TikTok_Download_APIใๆฏไธไธชๅผ็ฎฑๅณ็จ็้ซๆง่ฝๅผๆญฅๆ้ณใๅฟซๆใTikTokใBilibiliๆฐๆฎ็ฌๅๅทฅๅ ท๏ผๆฏๆAPI่ฐ็จ๏ผๅจ็บฟๆน้่งฃๆๅไธ่ฝฝใ
Language:Python
Total stars: 10524
Stars trend:
25 Jan 2025
11pm โ +3
26 Jan 2025
12am โ +4
1am โโ +10
2am โ +4
3am โ +6
4am โ +4
5am โโ +9
6am โโโ +17
7am โ +8
8am โ +4
9am โ +6#python
#api, #async, #crawler, #douyin, #douyinapi, #douyinscraper, #douyintiktokapi, #douyintiktokdownload, #fastapi, #nowatermark, #onlineparsing, #python, #pywebio, #scraper, #spider, #tiktok, #tiktokapi, #tiktokscraper, #tiktoksignature, #webscraping
iawia002/lux
๐พ Fast and simple video download library and CLI tool written in Go
Language:Go
Total stars: 28284
Stars trend:
#go
#bilibili, #crawler, #download, #downloader, #go, #golang, #iqiyi, #qq, #scraper, #tumblr, #video, #youku, #youtube
๐พ Fast and simple video download library and CLI tool written in Go
Language:Go
Total stars: 28284
Stars trend:
28 Jan 2025
1pm โโ +12
2pm โโ +10
3pm โโ +11
4pm โโ +15
5pm โ +8
6pm โ +4
7pm โ +7
8pm โ +2
9pm โ +1
10pm โ +2
11pm โโ +13#go
#bilibili, #crawler, #download, #downloader, #go, #golang, #iqiyi, #qq, #scraper, #tumblr, #video, #youku, #youtube
cyberagiinc/DevDocs
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
Language:TypeScript
Total stars: 599
Stars trend:
#typescript
#cline, #crawl4ai, #cursor, #documentation, #llm, #playwright, #python3, #scraper, #security, #typescript, #windsurf
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
Language:TypeScript
Total stars: 599
Stars trend:
8 Apr 2025
8pm โ +1
9pm โ +1
10pm โ +2
11pm โ +1
9 Apr 2025
12am โ +2
1am โ +3
2am โ +3
3am โ +1
4am โโโ +19
5am โโโโ +30
6am โโโ +18#typescript
#cline, #crawl4ai, #cursor, #documentation, #llm, #playwright, #python3, #scraper, #security, #typescript, #windsurf
๐1
TelegramScraper/Telegram-Scraper
A powerful Python tool that allows you to scrape over 10k members and messages from any groups / channels. Features include real-time scraping and much more!
Language:
Total stars: 141
Stars trend:
#membersaddingscript, #scrapetelegramusers, #scraper, #scraperpython, #telegram, #telegrambot, #telegrammessagescraper, #telegrampostviewer, #telegramscrapechannel, #telegramscrapechannels, #telegramscrapegroups, #telegramscrapeuser, #telegramscrapeusers, #telegramscraper2025, #telegramscraperandadder, #telegramscrapergithub, #telegramscrapermemberadder, #telegramscraperscript, #telegramscrapertelegramscraperadder, #telegramscraper
A powerful Python tool that allows you to scrape over 10k members and messages from any groups / channels. Features include real-time scraping and much more!
Language:
Total stars: 141
Stars trend:
9 Jun 2025
5pm โ +1
6pm โโ +12
7pm โโ +13
8pm โโโ +18
9pm โโ +13
10pm โโ +9
11pm โโ +11
10 Jun 2025
12am โ +2
1am +0
2am โ +5
3am โ +3#membersaddingscript, #scrapetelegramusers, #scraper, #scraperpython, #telegram, #telegrambot, #telegrammessagescraper, #telegrampostviewer, #telegramscrapechannel, #telegramscrapechannels, #telegramscrapegroups, #telegramscrapeuser, #telegramscrapeusers, #telegramscraper2025, #telegramscraperandadder, #telegramscrapergithub, #telegramscrapermemberadder, #telegramscraperscript, #telegramscrapertelegramscraperadder, #telegramscraper
ScrapeEmAll/Telegram-Scraper
A powerful Python script that allows you to scrape messages and media from Telegram channels using the Telethon library. Features include real-time continuous scraping, media downloading, and data export capabilities.
Language:Python
Total stars: 149
Stars trend:
#python
#afkbot, #bulkmessages, #massdm, #membersscript, #scraper, #scrapertools, #scrapy, #spammer, #telegram, #telegramadders, #telegramapi, #telegrambomber, #telegramcopygroup, #telegramcopygroups, #telegramforward, #telegramscraper2025, #telegramscrapermemberadder, #telegramsearchbot
A powerful Python script that allows you to scrape messages and media from Telegram channels using the Telethon library. Features include real-time continuous scraping, media downloading, and data export capabilities.
Language:Python
Total stars: 149
Stars trend:
17 Jun 2025
10am โโ +13
11am โโโ +21
12pm โโ +9
1pm โโ +10
2pm โโโ +19
3pm โโ +11#python
#afkbot, #bulkmessages, #massdm, #membersscript, #scraper, #scrapertools, #scrapy, #spammer, #telegram, #telegramadders, #telegramapi, #telegrambomber, #telegramcopygroup, #telegramcopygroups, #telegramforward, #telegramscraper2025, #telegramscrapermemberadder, #telegramsearchbot
NaiboWang/EasySpider
A visual no-code/code-free web crawler/spiderๆ้้๏ผไธไธชๅฏ่งๅๆต่งๅจ่ชๅจๅๆต่ฏ/ๆฐๆฎ้้/็ฌ่ซ่ฝฏไปถ๏ผๅฏไปฅๆ ไปฃ็ ๅพๅฝขๅ็่ฎพ่ฎกๅๆง่ก็ฌ่ซไปปๅกใๅซๅ๏ผServiceWrapper้ขๅWebๅบ็จ็ๆบ่ฝๅๆๅกๅฐ่ฃ ็ณป็ปใ
Language:JavaScript
Total stars: 39505
Stars trend:
#javascript
#batchprocessing, #batchscript, #codefree, #crawler, #datacollection, #frontend, #gui, #html, #inputparameters, #layman, #parameters, #robotics, #rpa, #scraper, #spider, #visual, #visualization, #visualprogramming, #web, #www
A visual no-code/code-free web crawler/spiderๆ้้๏ผไธไธชๅฏ่งๅๆต่งๅจ่ชๅจๅๆต่ฏ/ๆฐๆฎ้้/็ฌ่ซ่ฝฏไปถ๏ผๅฏไปฅๆ ไปฃ็ ๅพๅฝขๅ็่ฎพ่ฎกๅๆง่ก็ฌ่ซไปปๅกใๅซๅ๏ผServiceWrapper้ขๅWebๅบ็จ็ๆบ่ฝๅๆๅกๅฐ่ฃ ็ณป็ปใ
Language:JavaScript
Total stars: 39505
Stars trend:
3 Jul 2025
11pm โโ +12
4 Jul 2025
12am โโโ +21
1am โโโโ +26
2am โโโ +20
3am โโโ +17
4am โโ +9
5am โโ +11
6am โโ +13
7am โโ +9
8am โ +5
9am โ +2
10am โ +2#javascript
#batchprocessing, #batchscript, #codefree, #crawler, #datacollection, #frontend, #gui, #html, #inputparameters, #layman, #parameters, #robotics, #rpa, #scraper, #spider, #visual, #visualization, #visualprogramming, #web, #www
joeyism/linkedin_scraper
A library that scrapes Linkedin for user data
Language:Python
Total stars: 2736
Stars trend:
#python
#chrome, #company, #driver, #firefox, #linkedin, #linkedinprofile, #linkedinscraper, #linkedinurl, #profile, #scraper, #scrapeslinkedin, #users
A library that scrapes Linkedin for user data
Language:Python
Total stars: 2736
Stars trend:
6 Jul 2025
4pm โ +1
5pm +0
6pm +0
7pm โโ +12
8pm โโโ +17
9pm โโ +12
10pm โโ +10
11pm โโ +9
7 Jul 2025
12am โโ +15
1am โโ +10#python
#chrome, #company, #driver, #firefox, #linkedin, #linkedinprofile, #linkedinscraper, #linkedinurl, #profile, #scraper, #scrapeslinkedin, #users
mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Language:TypeScript
Total stars: 5203
Stars trend:
#typescript
#ai, #artificialintelligence, #browser, #browserautomation, #gpt, #gpt4, #langchain, #llama, #llm, #openai, #playwright, #puppeteer, #scraper
Turn any webpage into structured data using LLMs
Language:TypeScript
Total stars: 5203
Stars trend:
9 Jul 2025
12pm โ +3
1pm โโโโ +25
2pm โโ +9
3pm โ +6
4pm โ +3
5pm โ +5
6pm โ +7
7pm โ +4
8pm โ +2
9pm โ +6
10pm โ +6
11pm โ +2#typescript
#ai, #artificialintelligence, #browser, #browserautomation, #gpt, #gpt4, #langchain, #llama, #llm, #openai, #playwright, #puppeteer, #scraper
mendableai/firecrawl
๐ฅ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 43926
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
๐ฅ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 43926
Stars trend:
30 Jul 2025
11pm โ +1
31 Jul 2025
12am โ +7
1am โ +4
2am โโ +10
3am โโ +10
4am โ +4
5am โโ +9
6am โโ +11
7am โโ +9
8am โ +5
9am โโ +9
10am โโ +11#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
firecrawl/firecrawl
The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data ๐ฅ
Language:TypeScript
Total stars: 49183
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data ๐ฅ
Language:TypeScript
Total stars: 49183
Stars trend:
19 Aug 2025
1am โ +5
2am โ +5
3am โ +4
4am โ +4
5am โ +7
6am โโ +12
7am โโ +9
8am โโ +10
9am โ +4
10am โ +6
11am โ +8
12pm โโ +10#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
edoardottt/cariddi
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
Language:Go
Total stars: 2036
Stars trend:
#go
#bugbounty, #crawler, #crawling, #endpointdiscovery, #endpoints, #go, #golang, #hacktoberfest, #infosec, #osint, #penetrationtesting, #pentesting, #recon, #reconnaissance, #redteam, #scraper, #secretkeys, #secretsdetection, #security, #securitytools
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
Language:Go
Total stars: 2036
Stars trend:
19 Aug 2025
7pm โโโ +23
8pm โโโ +19
9pm โโ +9
10pm โ +7
11pm โ +3
20 Aug 2025
12am โ +3
1am โ +4
2am โ +4
3am โ +2
4am โ +6#go
#bugbounty, #crawler, #crawling, #endpointdiscovery, #endpoints, #go, #golang, #hacktoberfest, #infosec, #osint, #penetrationtesting, #pentesting, #recon, #reconnaissance, #redteam, #scraper, #secretkeys, #secretsdetection, #security, #securitytools
apify/crawlee
CrawleeโA web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:TypeScript
Total stars: 20088
Stars trend:
#typescript
#apify, #automation, #crawler, #crawling, #headless, #headlesschrome, #javascript, #nodejs, #npm, #playwright, #puppeteer, #scraper, #scraping, #typescript, #webcrawler, #webcrawling, #webscraping
CrawleeโA web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:TypeScript
Total stars: 20088
Stars trend:
19 Oct 2025
6pm โ +1
7pm +0
8pm โ +2
9pm โ +2
10pm +0
11pm +0
20 Oct 2025
12am โ +5
1am โ +6
2am โ +7
3am โ +4
4am โ +3
5am โ +6#typescript
#apify, #automation, #crawler, #crawling, #headless, #headlesschrome, #javascript, #nodejs, #npm, #playwright, #puppeteer, #scraper, #scraping, #typescript, #webcrawler, #webcrawling, #webscraping
bjesus/pipet
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 3653
Stars trend:
#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
Swiss-army tool for scraping and extracting data from online assets, made for hackers
Language:Go
Total stars: 3653
Stars trend:
21 Oct 2025
4am โ +4
5am โ +7
6am โ +8
7am โ +6
8am โ +3
9am โ +5
10am โ +1
11am โ +2
12pm โ +3
1pm โ +1#go
#css, #curl, #gjson, #json, #playwright, #scraper, #scraping
apify/crawlee-python
CrawleeโA web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:Python
Total stars: 7576
Stars trend:
#python
#apify, #automation, #beautifulsoup, #crawler, #crawling, #hacktoberfest, #headless, #headlesschrome, #pip, #playwright, #python, #scraper, #scraping, #webcrawler, #webcrawling, #webscraping
CrawleeโA web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:Python
Total stars: 7576
Stars trend:
26 Jan 2026
1am โ +3
2am โ +5
3am โ +4
4am โ +4
5am โโ +16
6am โ +5
7am โ +2
8am โโ +9
9am โ +4
10am โ +3
11am โ +5#python
#apify, #automation, #beautifulsoup, #crawler, #crawling, #hacktoberfest, #headless, #headlesschrome, #pip, #playwright, #python, #scraper, #scraping, #webcrawler, #webcrawling, #webscraping
โค1
AhmadIbrahiim/Website-downloader
๐ก Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
Language:HTML
Total stars: 2028
Stars trend:
#html
#assets, #downloader, #offlinewebpages, #scraper
๐ก Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
Language:HTML
Total stars: 2028
Stars trend:
26 Jan 2026
4am โ +1
5am โ +5
6am โ +6
7am โ +5
8am โ +4
9am โ +6
10am โ +3
11am โ +1
12pm โ +1
1pm +0
2pm โ +3#html
#assets, #downloader, #offlinewebpages, #scraper
โค1๐1
getmaxun/maxun
โจ The open-source no-code platform for web scraping, crawling, search and AI data extraction โข Turn websites into structured APIs in minutes โจ
Language:TypeScript
Total stars: 14548
Stars trend:
#typescript
#agents, #api, #automation, #browserautomation, #crawler, #crawling, #dataextraction, #nocode, #nocode, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #webscraper, #webscraping, #websearch, #webscraping
โจ The open-source no-code platform for web scraping, crawling, search and AI data extraction โข Turn websites into structured APIs in minutes โจ
Language:TypeScript
Total stars: 14548
Stars trend:
11 Feb 2026
6pm โ +1
7pm +0
8pm โโ +10
9pm โ +4
10pm โ +5
11pm โ +5
12 Feb 2026
12am โ +2
1am โ +6
2am โ +8
3am โโ +16
4am โ +5
5am โ +5#typescript
#agents, #api, #automation, #browserautomation, #crawler, #crawling, #dataextraction, #nocode, #nocode, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #webscraper, #webscraping, #websearch, #webscraping
cheeriojs/cheerio
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Language:TypeScript
Total stars: 30172
Stars trend:
#typescript
#cheerio, #dom, #hacktoberfest, #html, #htmlparser, #htmlparser2, #jquery, #parser, #scraper, #selector
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
Language:TypeScript
Total stars: 30172
Stars trend:
8 Mar 2026
5pm โ +2
6pm โ +1
7pm โ +7
8pm โ +1
9pm โ +8
10pm โ +5
11pm โ +5
9 Mar 2026
12am โ +6
1am โ +2
2am โ +6
3am โ +1
4am โโโ +17#typescript
#cheerio, #dom, #hacktoberfest, #html, #htmlparser, #htmlparser2, #jquery, #parser, #scraper, #selector
Anakin-Inc/anakin
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Language:Go
Total stars: 3295
#go
#ai, #antidetect, #golang, #markdown, #opensource, #playwright, #scraper, #selfhosted, #webcrawler, #webscraping
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Language:Go
Total stars: 3295
#go
#ai, #antidetect, #golang, #markdown, #opensource, #playwright, #scraper, #selfhosted, #webcrawler, #webscraping