gau

getallurls (gau) fetches known URLs from AlienVault’s Open Threat Exchange, the Wayback Machine, and Common Crawl for any given domain.

Name:gau

Category:Discovery

Publisher:trickest

Created:6/23/2021

Container:quay.io/trickest/gau:v2.2.3-patch-1

Output Type:

License:Unknown

Source:View Source

Parameters

to · string

--tofetch urls to date (format: YYYYMM)

from · string

--fromfetch urls from date (format: YYYYMM)

json · boolean

--jsonoutput as json

subs · boolean · required

--subsinclude subdomains of target domain

proxy · string

--pHttp proxy to use

target · string · required

Target domain

retries · string

--retriesretries for HTTP client

targets · file · required

List of targets

threads · string

--threadsnumber of workers to spawn (default 1)

timeout · string

--timeouttimeout (in seconds) for HTTP client (default 45)

verbose · boolean

--verboseshow verbose output

blacklist · string

--blacklistlist of extensions to skip

mime-types · string

--mtlist of mime-types to match

status-codes · string

--mclist of status codes to match

urls-providers · string

--providerslist of providers to use (wayback,commoncrawl,otx,urlscan)

filter-mime-types · string

--ftlist of mime-types to filter

filter-parameters · boolean

--fpremove different parameters of the same endpoint

filter-status-codes · string

--fclist of status codes to filter