CompleteSEOTools
Home › SEO Tools › Spider Simulator

Spider simulator

View a page the way a simple crawler reads it: text, headings, links and images, without the design.

About Spider Simulator

Search engine crawlers begin with the HTML a server sends them. This tool fetches that HTML and shows what is in it: the title and meta tags, an outline of the headings, the visible text, every link with its nofollow, sponsored and ugc flags, and the images with their alt text. You can choose a Googlebot style, Bingbot style, Chrome or our own checker user agent. If the text box is empty, the page probably builds its content with JavaScript.

  • Checking that important text is in the HTML and not only added by scripts.
  • Reviewing the heading outline of a page.
  • Seeing which links are marked nofollow.
  • Finding images with no alt text.

How to use Spider Simulator

1

Step 1

Enter the page address and choose a crawler.

2

Step 2

Press Simulate crawl.

3

Step 3

Read the tags, outline, text, links and images in order.

Good to know

  • Choosing Googlebot only changes the name we send. The request still comes from our server, so a site that checks a crawler's real address will treat us as an ordinary visitor.
  • This is the HTML before scripts run. Googlebot runs JavaScript, so it may see more than this tool shows.
  • The address you type is sent to our server to fetch the public page and is not stored.

Common questions

Is this exactly what Google sees?

No. It shows the raw HTML. Google also renders pages with JavaScript, applies its own rules and may see different content. Use it as a first check, not a verdict.

Why is the visible text empty?

The page probably builds its content in the browser with JavaScript, or the server sent a different page to our request, for example a challenge or a block page.

What does nofollow mean for a link?

It asks search engines not to count the link as a vote for the target. The sponsored and ugc values say the link is paid or user-generated.