dirb

Scan HTTP-based webservers for directories and files. More information: http://dirb.sourceforge.net.

dirb https://example.org

dirb https://example.org path/to/wordlist.txt

dirb https://example.org -r

dirb https://example.org -a user_agent_string -c cookie_string