Web inspection / bounded requests

Web tools.

Inspect public URLs, headers, metadata, crawl signals, DNS, and TLS through a bounded fetch layer built to reject private networks.

36working tools
ready now
01

Requests & infrastructure

Trace responses and inspect the network identity behind a public site.

02

Metadata & indexing

Read the page-level signals used by search and social previews, or write structured data for a page.

03

Discovery & crawl

Review crawler rules, sitemaps, links, URL structure, and user-agent signals.

01 / WEBReady

UTM Builder

Add UTM campaign parameters to links for Google Analytics, with presets, batch mode, and a QR code.

02 / WEBReady

Robots.txt Checker

Read crawler rules, sitemap declarations, and accessibility at a glance.

03 / WEBReady

AI Crawler Checker

Understand how a site's robots rules address known AI crawlers.

04 / WEBReady

Sitemap

Validate XML or text sitemaps and inspect their URL coverage.

05 / WEBReady

llms.txt

Inspect a site’s optional llms.txt structure, links, and source text.

06 / WEBReady

Broken Links

Discover page links and safely check a bounded sample for failures.

07 / WEBReady

Link Extractor

Extract and classify up to 200 unique links from a public page.

08 / WEBReady

URL Parser

Break a URL into protocol, host, path, query, fragment, and credentials.

09 / WEBReady

User Agent Parser

Identify common browser, OS, device, engine, and bot signals locally.

10 / WEBReady

robots.txt Generator

robots.txt with rules per crawler, sitemaps, and presets including blocking AI training crawlers.

11 / WEBReady

Query String

Build or edit URL query strings as encoded key and value rows.

12 / WEBReady

Sitemap Generator

Build a valid sitemap.xml from a list of URLs, split with an index past 50,000.

13 / WEBReady

SERP Preview

Preview a title and meta description in Google results, measured in pixels.

14 / WEBReady

Keyword Density

Word and phrase frequency and density, without stop words, in seven languages.

15 / WEBReady

llms.txt generator

Write an llms.txt file for your site: a title, summary, and sections of links that language models can read.

Redirects and status codes

A 301 says a page has moved for good, and search engines move its standing to the new address; a 302 or 307 says the move is temporary, so the old address keeps it. Chains of several redirects slow every visit and dilute that signal — the redirect checker shows each hop and its status, and the HTTP status checker reports what a URL finally answers.

Signals that decide what gets indexed

Four signals interact. robots.txt decides whether a crawler may fetch a page; a noindex directive decides whether a fetched page may appear in results; the canonical link names the preferred URL among duplicates; hreflang links language versions. A page blocked in robots.txt cannot show its noindex, so it can stay indexed from links — to remove a page, allow crawling and use noindex.

Check each with its own tool: robots.txt, noindex, canonical, and hreflang; the sitemap checker confirms the pages you want indexed are listed.

Link previews

When a link is shared, platforms build the preview from Open Graph and Twitter card tags: title, description, and an image of about 1200 × 630 pixels. The Open Graph checker shows what a page declares. If a platform still shows an old preview after you fix the tags, it is serving its cached copy; most provide their own tool to refresh it.

Certificates and DNS

An expired TLS certificate takes a site offline for most visitors at once. The SSL checker shows the issuer, the names it covers, and how many days remain. After changing DNS records, answers can differ between resolvers until the old record's time-to-live runs out; the DNS lookup shows what one public resolver sees now.