3 tools and resources
A next-generation crawling and spidering framework for extracting data from websites
A tool to declutter URL lists for crawling and pentesting
A tool for discovering open S3 Buckets starting from a domain using various techniques such as crawling and DNS crawling.
