mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown
Language: TypeScript
#ai #crawler #data #html_to_markdown #llm #markdown #rag #scraper #scraping #web_crawler
Stars: 469 Issues: 8 Forks: 34
https://github.com/mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown
Language: TypeScript
#ai #crawler #data #html_to_markdown #llm #markdown #rag #scraper #scraping #web_crawler
Stars: 469 Issues: 8 Forks: 34
https://github.com/mendableai/firecrawl
GitHub
GitHub - firecrawl/firecrawl: Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence.…
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥 - firecrawl/firecrawl
👍1🔥1
jasonxtn/Argus
The Ultimate Information Gathering Toolkit
Language: Python
#cms_detection #directory_finder #dns_lookup #information_gathering #osint #pastebin_monitoring #recon_tools #reconnaissance #server_info #ssl_analitcs #txt_records #virustotal #web_crawler #whois_lookup
Stars: 227 Issues: 2 Forks: 32
https://github.com/jasonxtn/Argus
The Ultimate Information Gathering Toolkit
Language: Python
#cms_detection #directory_finder #dns_lookup #information_gathering #osint #pastebin_monitoring #recon_tools #reconnaissance #server_info #ssl_analitcs #txt_records #virustotal #web_crawler #whois_lookup
Stars: 227 Issues: 2 Forks: 32
https://github.com/jasonxtn/Argus
GitHub
GitHub - jasonxtn/Argus: The Ultimate Information Gathering Toolkit
The Ultimate Information Gathering Toolkit. Contribute to jasonxtn/Argus development by creating an account on GitHub.
cxcscmu/Crawl4LLM
Official repository for "Crawl4LLM: Efficient Web Crawling for LLM Pretraining"
Language: Python
#crawler #crawling #large_language_models #llm #pre_training #pretraining #web_crawler #web_crawling
Stars: 359 Issues: 0 Forks: 25
https://github.com/cxcscmu/Crawl4LLM
Official repository for "Crawl4LLM: Efficient Web Crawling for LLM Pretraining"
Language: Python
#crawler #crawling #large_language_models #llm #pre_training #pretraining #web_crawler #web_crawling
Stars: 359 Issues: 0 Forks: 25
https://github.com/cxcscmu/Crawl4LLM
GitHub
GitHub - cxcscmu/Craw4LLM: Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining" - cxcscmu/Craw4LLM
🔥2