urlfinder

A high-speed tool for passively gathering URLs, optimized for efficient and comprehensive web asset discovery without active scanning.

Name:urlfinder

Category:Discovery

Publisher:trickest-mhmdiaa

Created:11/12/2024

Container:quay.io/trickest/urlfinder:v0.0.3

Output Type:

License:Unknown

Source:View Source

Parameters

all · boolean

-alluse all sources for enumeration (slow)

list · file · required

-listtarget domain / list to find urls for

jsonl · boolean

-jsonlwrite output in JSONL(ines) format

match · string

-matchurl to match (comma separated)

proxy · string

-proxyhttp proxy to use with urlfinder

stats · boolean

-statsreport source statistics

config · file

-configflag config file

filter · string

-filterurl to filter (comma separated)

silent · boolean

-silentshow only urls in output

sources · string

-sourcesspecific sources for discovery (e.g., -s alienvault,commoncrawl)

timeout · string

-timeoutseconds to wait before timing out (default 30)

verbose · boolean

-vshow verbose output

max-time · string

-max-timeminutes to wait for enumeration results (default 10)

no-color · boolean

-no-colordisable color in output

no-scope · boolean

-no-scopedisables host based default scope

url-scope · string

-url-scopein scope url regex to be followed by urlfinder

match-file · file

-matchlist of urls to match

rate-limit · string

-rate-limitmaximum number of http requests to send per second (global)

field-scope · string

-field-scopepre-defined scope field (dn,rdn,fqdn) or custom regex (e.g., '(company-staging.io|company.com)') (default rdn)

filter-file · file

-filterlist of urls to filter

list-sources · boolean

-list-sourceslist all available sources

url-out-scope · string

-url-out-scopeout of scope url regex to be excluded by urlfinder

url-scope-file · file

-url-scopein scope url regex to be followed by urlfinder

collect-sources · boolean

-collect-sourcesinclude all sources in the output (-json only)

exclude-sources · string

-exclude-sourcessources to exclude (e.g., -es alienvault,commoncrawl)

provider-config · file

-provider-configprovider config file

display-out-scope · boolean

-display-out-scopedisplay external endpoint from scoped crawling

rate-limit-source · string

-rate-limitsmaximum number of http requests to send per second for providers in key=value format (-rls hackertarget=10/m) (default [waybackarchive=15/m])

url-out-scope-file · file

-url-out-scopeout of scope url regex to be excluded by urlfinder