katana

A fast crawler focused on execution in automation pipelines offering both headless and non-headless crawling. See also: gau, scrapy, waymore. More information: https://github.com/projectdiscovery/katana.

katana -list https://example.com,https://google.com,...

katana -u https://example.com -headless

subfinder -list path/to/domains.txt | katana -passive

katana -proxy http://127.0.0.1:8080 -headers path/to/headers.txt -u https://example.com

katana -strategy depth-first|breadth-first -depth value -rate-limit value -u https://example.com

subfinder -list path/to/domains.txt | katana -crawl-duration value -output path/to/output.txt