Glossary · Technical

Crawl budget.

How much crawling a search engine is willing to spend on a site. It is influenced by how established and how fast the site is, and by how much of what it finds turns out to be worth having.

Why it matters.

For a site of twenty pages it is irrelevant. It starts to matter at several hundred, and it matters most for a new domain with no external links: pages that exist only in a sitemap, with nothing linking to them, sit at the back of the queue and can wait months. The remedy is internal linking and fewer, better pages — not a bigger sitemap.

How to check it yourself.

In Search Console, compare the number of pages you have published with the number indexed. A large gap on a small site is almost never a crawl budget problem — it is an internal linking problem.

Questions

Straight answers.

How do I check crawl budget on my own site?

In Search Console, compare the number of pages you have published with the number indexed. A large gap on a small site is almost never a crawl budget problem — it is an internal linking problem.

Your turn

Same check,
run on your site.

The check behind this page is the one we ran on every business above. Put your own address in and it will load your site on a phone screen, look at the certificate and the page age, and tell you what a visitor meets. No email, nothing stored.

Check my website free Read the full GTA report

Think yours needs
rebuilding?

Send us the address and what you do. We will look at what is there and tell you whether a rebuild is worth the money, or whether the problem is somewhere else entirely.

Start a project See our work