Well-Known Resource Index
Search Syntax
Terms
Search by domain, resource type, or resource-specific fields. When there are multiple terms only one needs to match.
Require and Exclude
Add +
before a term or phrase to require it, or
-
to exclude it.
Filters
Filters restrict results based on specific fields. They are written
in the form [filter]:[value]
.
Most filters accept terms or phrases as values (including support
for prefixes). Providing only *
as a value will match
resources where the relevant field exists, regardless of its value.
Some filters can only check if a field exists, so only work with
*
value. Others filter on boolean fields, so only work
with true
or false
.
Exclude and Optional
Filters act as required terms by default, but can be excluded
instead by adding -
before the filter.
Filters can also made optional adding ~
before the filter.
Multiple Options
resource:(ads_txt app_ads_txt) nytimes.com
Wrap terms or phrases in parenthesis to supply multiple options to a filter. Only one option needs to match.
Integer Filters
Integer filters accept whole numbers.
Prefix the number with
<
, <=
, >
, or >=
to filter by range.
Date Filters
scanned:>=2021-06-01 nytimes.com
Date filters accept RFC3339 formated dates in UTC.
Prefix the date with
<
, <=
, >
, or >=
to filter by range.
IP Filters
IP filters accept IP addresses, and subnets in CIDR notation.
Global Filters
status:[ok|failed]
Filter by resource scan status.
scanned:[date]
Filter by resource scan date.
domain:[value]
Filter by domain name.
resource:[value]
Filter by resource type.
scheme:[https|http]
Filter by the scheme the resource was found under.
is_www:[true|false]
Filter by whether the resource was found on the www
subdomain.
base_domain:[value]
Filter by base domain (eTLD+1).
is_base_domain:[true|false]
Filter by whether the domain is the base domain.
The www
subdomain is considered the base domain.
rank:[integer]
Filter by
Tranco list
rank of the base domain.
The top 100,000 domains are ranked.
etld:[value]
Filter by effective top-level domain (eTLD).
redir_domain:[value]
Filter by final redirect domain name, if any.
redir_base_domain:[value]
Filter by final redirect base domain (eTLD+1), if any.
redir_etld:[value]
Filter by final redirect effective top-level domain (eTLD), if any.
response_ip:[ip]
Filter by ip address of the responding server.
hash:[value]
Filter by resource sha256 hex digest.
simhash:[value]
Filter by resource simhash.
simhash_near:[value]
Filter by resource simhash, allowing similar simhashes.
Only works with full simhashes, not prefixes.
Supported Resources
The following types of
/.well-known/
resources are currently supported. Each has an associated set of
search filters.
Authorized Digital Sellers
/ads.txt
(spec)
Defined by the IAB Tech Lab, ads.txt allows sites to specify which ad system accounts are authorised to sell their ad inventory.
Resource Filter
resource:ads_txt
Filter to only ads.txt resources.
Variable Filters
Filter by the variables included in ads.txt resources.
ads_contact:[value]
Filter by the contact variable.
ads_subdomain:[value]
Filter by the subdomain variable.
ads_partner:[value]
Filter by the inventory partner domain variable.
Record Filters
Filter by the ad account records listed in ads.txt resources.
ads_system:[value]
Filter by ad system domain.
ads_seller:[value]
Filter by seller ID.
ads_account:[value]
Filter by the full account ID, in the form
[ad system]|[seller id]
.
ads_direct:[value]
Same as ads_account
, but only match accounts listed in
DIRECT
records.
ads_reseller:[value]
Same as ads_account
, but only match accounts listed in
RESELLER
records.
ads_cid:[value]
Filter by certification authority ID.
ads_extension:[value]
Filter by record extension data.
ads_inline_comment:[value]
Filter by comments at the end of record lines.
ads_placeholder:[true|false]
Filter by placeholder record presence.
ads_comment:[value]
Filter by standalone comments.
Authorized Digital Sellers for Apps
/app-ads.txt
(spec)
Defined by the IAB Tech Lab, app-ads.txt allows apps to specify which ad system accounts are authorised to sell their ad inventory.
Resource Filter
resource:app_ads_txt
Filter to only app-ads.txt resources.
Variable Filters
Filter by the variables included in app-ads.txt resources.
aads_contact:[value]
Filter by the contact variable.
aads_partner:[value]
Filter by the inventory partner domain variable.
Record Filters
Filter by the ad account records listed in app-ads.txt resources.
aads_system:[value]
Filter by ad system domain.
aads_seller:[value]
Filter by seller ID.
aads_account:[value]
Filter by the full account ID, in the form
[ad system]|[seller id]
.
aads_direct:[value]
Same as aads_account
, but only match accounts listed in
DIRECT
records.
aads_reseller:[value]
Same as aads_account
, but only match accounts listed in
RESELLER
records.
aads_cid:[value]
Filter by certification authority ID.
aads_extension:[value]
Filter by record extension data.
aads_inline_comment:[value]
Filter by comments at the end of record lines.
aads_placeholder:[true|false]
Filter by placeholder record presence.
aads_comment:[value]
Filter by standalone comments.
Apple Associated Domain
/.well-known/apple-app-site-association
(spec)
An Apple specification that allows a site to define its relationship to Apple platform apps, e.g. allow links to a site to be opened in an app instead.
Resource Filter
resource:apple_app_site_association
Filter to only apple-app-site-association resources.
Web Credential Filters
Filter by the webcredential data in apple-app-site-association resources.
asa_webcredential_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id]
.
asa_webcredential_app_prefix:[value]
Filter by app ID prefix.
asa_webcredential_bundle:[value]
Filter by bundle ID.
App Clip Filters
Filter by the appclip data in apple-app-site-association resources.
asa_appclip_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id]
.
asa_appclip_app_prefix:[value]
Filter by app ID prefix.
asa_appclip_bundle:[value]
Filter by bundle ID.
App Link Filters
Filter by the applink data in apple-app-site-association resources.
asa_applink_default:*
Filter by whether any domain-level defaults are set.
asa_applink_substitution:*
Filter by whether any substitution variables are defined.
asa_applink_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id]
.
asa_applink_app_prefix:[value]
Filter by app ID prefix.
asa_applink_bundle:[value]
Filter by bundle ID.
asa_applink_app_default:*
Filter by whether any app-level defaults are set.
asa_applink_path:*
Filter by whether components define a path pattern.
asa_applink_query:*
Filter by whether components define a query pattern.
asa_applink_fragment:*
Filter by whether components define a fragment pattern.
asa_applink_exclude:[true|false]
Filter by component exclude value.
asa_applink_case_sensitive:[true|false]
Filter by component case sensitive value.
asa_applink_percent_encoded:[true|false]
Filter by component percent encoded value.
asa_applink_comment:[value]
Filter by component comment.
Digital Asset Links
/.well-known/assetlinks.json
(spec)
A Google specification that allows a site to define its relationship to apps or other sites, e.g. allow links to a site to be opened in an app instead.
Resource Filter
resource:assetlinks
Filter to only assetlinks.json resources.
Filters
Filter by the asset links listed in assetlinks.json resources.
dal_relation:[value]
Filter by link relation type.
dal_target_namespace:[value]
Filter by link target namespace.
Namespaces: web
, android_app
, ios_app
dal_target_package:[value]
Filter by link target android package name, for
andoid_app
links.
dal_target_appid:[value]
Filter by link target iOS app ID, for
ios_app
links.
dal_include:*
Filter by whether any external assetlink.json resources are
included.
Global Privacy Control
/.well-known/gpc.json
(spec)
The Global Privacy Control is a signal user agents can send to sites, requesting that their personal information is not sold or shared with third parties. The gpc.json resource allows sites to indicate whether they respect the Global Privacy Control signal.
Resource Filter
resource:gpc
Filter to only gpc.json resources.
Filters
Filter by the asset links listed in gpc.json resources.
gpc_support:[true|false]
Filter by whether GPC is supported.
gpc_update:*
Filter by whether a last update date/time is provided.
OpenID Provider Configuration
/.well-known/openid-configuration
(spec)
An OpenID Provider Configuration resource includes metadata about an OpenID Connect provider, allowing clients to configure themselves to use the provider.
Resource Filter
resource:openid_configuration
Filter to only openid-configuration resources.
Exists Filters
oid_authorization_endpoint:*
Filter by whether an authorization endpoint is provided.
oid_token_endpoint:*
Filter by whether a token endpoint is provided.
oid_userinfo_endpoint:*
Filter by whether a userinfo endpoint is provided.
oid_jwks_uri:*
Filter by whether a JSON Web Key Set URI is provided.
oid_registration_endpoint:*
Filter by whether a registration endpoint is provided.
oid_service_documentation:*
Filter by whether a service documentation URI is provided.
oid_policy_uri:*
Filter by whether a data policy URI is provided.
oid_tos_uri:*
Filter by whether a terms of service URI is provided.
Boolean Filters
oid_claims_parameter:[true|false]
Filter by whether the claims
parameter is supported.
oid_request_parameter:[true|false]
Filter by whether the request
parameter is supported.
oid_request_uri_parameter:[true|false]
Filter by whether the request_uri
parameter is supported.
oid_require_request_uri_registration:[true|false]
Filter by whether request_uri
parameter values must be
pre-registered.
Text Filters
oid_scope:[value]
Filter by supported scopes.
oid_response_type:[value]
Filter by supported response types.
oid_response_mode:[value]
Filter by supported response modes.
oid_grant_type:[value]
Filter by supported grant types.
oid_acr:[value]
Filter by supported Authentication Context Class References.
oid_subject_type:[value]
Filter by supported subject types.
oid_display:[value]
Filter by supported display
parameter values.
oid_claim_type:[value]
Filter by supported claim types.
oid_claim:[value]
Filter by supported claims.
oid_claims_locale:[value]
Filter by supported languages for claim values.
oid_ui_locale:[value]
Filter by supported languages for the user interface.
oid_id_token_signing_alg:[value]
Filter by supported token signing algorithms.
oid_id_token_encryption_alg:[value]
Filter by supported token encryption algorithms
(alg
values).
oid_id_token_encryption_enc:[value]
Filter by supported token encryption algorithms
(enc
values).
oid_id_userinfo_signing_alg:[value]
Filter by supported userinfo signing algorithms.
oid_id_userinfo_encryption_alg:[value]
Filter by supported userinfo encryption algorithms
(alg
values).
oid_id_userinfo_encryption_enc:[value]
Filter by supported userinfo encryption algorithms
(enc
values).
oid_id_request_object_signing_alg:[value]
Filter by supported request object signing algorithms.
oid_id_request_object_encryption_alg:[value]
Filter by supported request object encryption algorithms
(alg
values).
oid_id_request_object_encryption_enc:[value]
Filter by supported request object encryption algorithms
(enc
values).
oid_token_endpoint_auth_method:[value]
Filter by supported token endpoint authentication methods.
oid_token_endpoint_auth_signing_alg:[value]
Filter by supported token endpoint authentication signing algorithms.
Robots Exclusion Standard
/robots.txt
(spec)
An informal standard that allows sites to ask web crawlers to not crawl certain urls.
Resource Filter
resource:robots_txt
Filter to only robots.txt resources.
Filters
rbt_product:[value]
Filter by robot product tokens (User-Agent
values).
rbt_product_comment:[value]
Filter by comments at the end of User-Agent
lines.
rbt_rule_pattern:[value]
Filter by path patterns (Allow
/Disallow
values).
rbt_rule_comment:[value]
Filter by comments at the end of Allow
/Disallow
lines.
rbt_allow_rule:[value]
Filter by Allow
rules, in the form
[product token]|[path pattern]
.
rbt_disallow_rule:[value]
Filter by Disallow
rules, in the form
[product token]|[path pattern]
.
rbt_crawldelay:*
Filter by whether any Crawl-delay
lines are present.
rbt_crawldelay_comment:[value]
Filter by comments at the end of Crawl-delay
lines.
rbt_sitemap:*
Filter by whether any Sitemap
lines are present.
rbt_sitemap_comment:[value]
Filter by comments at the end of Sitemap
lines.
rbt_comment:[value]
Filter by standalone comments.
security.txt
/.well-known/security.txt
(spec)
Allows sites to communicate their security policies, e.g. how to report a vulnerability.
Resource Filter
resource:security_txt
Filter to only security.txt resources.
Filters
sec_signed:[true|false]
Filter by whether the security.txt resource is signed.
sec_signer:[value]
Filter by the IDs of the keys used to sign the resource.
sec_acknowledge:*
Filter by whether an acknowledgments URI is provided.
sec_canonical:*
Filter by whether a canonical URI is provided.
sec_contact:*
Filter by whether a contact URI is provided.
sec_encryption:*
Filter by whether an encryption key URI is provided.
sec_expires:*
Filter by whether an expires datetime is provided.
sec_hiring:*
Filter by whether a hiring URI is provided.
sec_policy:*
Filter by whether a disclosure policy URI is provided.
sec_policy:[value]
Filter by the preferred languages listed.