April 16, 2025 at 7:07:14 PM UTC
VERIFY
Websites
Runtime: 905ms
On April 16, 2025 at 7:07:14 PM UTC, https://scontent.cdninstagram.com/robots.txt was accessible when tested on AS58396 in Indonesia.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.68.105.70
Query:
IN A scontent.cdninstagram.com
Engine:
system
Name
Class
TTL
Type
DATA
Answer IP Info
@
IN
A
157.240.208.63
AS32934 (Facebook, Inc.)
TCP Connections
Connection to 157.240.208.63:443 succeeded.
HTTP Requests
URL
GET https://scontent.cdninstagram.com/robots.txt
Response Headers
Content-Security-Policy:default-src 'self';script-src 'self';style-src 'self';connect-src 'self';font-src *.facebook.com data: *.fbcdn.net *.instagram.com;img-src 'self' data: blob:;media-src 'self' data: blob:;child-src 'self' data: blob:;frame-src 'self' data:;manifest-src 'self' data: blob:;object-src 'self' data: blob:;worker-src 'self' data: blob:;block-all-mixed-content;upgrade-insecure-requests;require-trusted-types-for 'script';Content-Type:text/plain; charset=utf-8Cross-Origin-Embedder-Policy:require-corpCross-Origin-Opener-Policy:same-origin-allow-popupsCross-Origin-Resource-Policy:same-originDate:Wed, 16 Apr 2025 08:20:32 GMTDocument-Policy:force-load-at-topEdge-Control:max-age=86400Expires:Thu, 17 Apr 2025 08:20:32 +0000Origin-Agent-Cluster:?1Permissions-Policy:accelerometer=(), attribution-reporting=(), autoplay=(), bluetooth=(), camera=(), ch-device-memory=(), ch-downlink=(), ch-dpr=(), ch-ect=(), ch-rtt=(), ch-save-data=(), ch-ua-arch=(), ch-ua-bitness=(), ch-viewport-height=(), ch-viewport-width=(), ch-width=(), clipboard-read=(), clipboard-write=(), compute-pressure=(), display-capture=(), encrypted-media=(), fullscreen=(self), gamepad=(), geolocation=(), gyroscope=(), hid=(), idle-detection=(), interest-cohort=(), keyboard-map=(), local-fonts=(), magnetometer=(), microphone=(), midi=(), otp-credentials=(), payment=(), picture-in-picture=(), private-state-token-issuance=(), publickey-credentials-get=(), screen-wake-lock=(), serial=(), shared-storage=(), shared-storage-select-url=(), private-state-token-redemption=(), usb=(), unload=(self), window-management=(), xr-spatial-tracking=();report-to="permissions_policy"Report-To:{"max_age":2592000,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coop\/?minimize=0"}],"group":"coop_report","include_subdomains":true}, {"max_age":21600,"endpoints":[{"url":"https:\/\/www.facebook.com\/ajax\/browser_error_reports\/"}],"group":"permissions_policy"}Reporting-Endpoints:coop_report="https://www.facebook.com/browser_reporting/coop/?minimize=0", permissions_policy="https://www.facebook.com/ajax/browser_error_reports/"Strict-Transport-Security:max-age=15552000; includeSubDomainsVary:Accept-EncodingX-Content-Type-Options:nosniffX-Fb-Debug:NXdKL3iQHAwrzKnmJHJreLsKHX8lE1sykMkzW8IgkBdosQqR0E7S86aideUgM8Yf+uacHnXPtBlCz90+QtDn/w==X-Frame-Options:DENYX-Xss-Protection:0
Response Body
# Notice: Collection of data on Instagram through automated means is # prohibited unless you have express written permission from Instagram # and may only be conducted for the limited purpose contained in said # permission. # All authorized user-agents listed on this page must comply with Meta’s # Automated Data Collection Terms available at: # https://www.facebook.com/legal/automated_data_collection_terms User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: PetalBot Disallow: / User-agent: uptimerobot Disallow: / User-agent: viberbot Disallow: / User-agent: YaK Disallow: / User-agent: Yandex Disallow: / User-agent: Applebot Disallow: / User-agent: Bingbot Disallow: / User-agent: Discordbot Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: Googlebot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Googlebot-Video Disallow: / User-agent: Googlebot-News Disallow: / User-agent: Google-InspectionTool Disallow: / User-agent: LinkedInBot Disallow: / User-agent: msnbot Disallow: / User-agent: Pinterestbot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: seznambot Disallow: / User-agent: Slurp Disallow: / User-agent: teoma Disallow: / User-agent: TelegramBot Disallow: / User-agent: Twitterbot Disallow: / User-agent: Yeti Disallow: / User-agent: * Disallow: /
Resolver
Resolver ASN
AS13335
Resolver IP
172.68.105.70
Resolver Network Name
Cloudflare Inc
Measurement UID
20250416190647.580220_ID_webconnectivity_0911d24cff937a99
Report ID
20250416T190419Z_webconnectivity_ID_58396_n1_SoPKF1wAImclBciF
Platform
windows
Software Name
ooniprobe-desktop-unattended (3.22.0)
Measurement Engine
ooniprobe-engine (3.22.0)