Google does not read the whole internet every day. Reading pages costs it real money in servers and bandwidth, so it allocates attention: each site gets a certain amount of visiting, and Google spends that allowance on the pages it considers worth the trip. That allowance is what the industry calls crawl budget.

The term produces a lot of unnecessary anxiety, so let me start with the reassuring part before the useful part.

If your site is small, you have enough budget

Crawl budget as a scarce resource is a big-site problem. An online store with two hundred thousand product pages can genuinely exhaust Google’s patience. A service business with thirty pages cannot; Google could read your entire site during a coffee break, and does. If someone tries to sell crawl budget optimization to your twelve-page website as ranking magic, keep a hand on your wallet.

So why write this? Because the useful idea inside crawl budget applies at every size: Google’s attention on your site is finite and can be pointed at the wrong things. Even small sites waste it, and the waste has a particular smell.

How small sites waste Google’s attention

Accidental duplicates. The same page reachable at yoursite.com/services, /services/ with a slash, an http version and a www variant counts as four URLs to crawl and one page of value. Multiply across a site and Google spends half its visit re-reading things it already has. This is fixed with redirects and a declared canonical version of every page, which is plumbing your builder should have set up on day one.

Parameter and filter pages. Search results pages, calendar views, tag archives, print versions. These multiply URLs endlessly while containing nothing anyone searches for.

The forgotten basement. Old campaign pages, a staging copy nobody deleted, thin tag pages generated by a plugin in 2019. Every crawl that lands there is a crawl not landing on the page that wins you a customer.

Broken internal paths. Links to deleted pages and chains of redirects burn visits on dead ends. This is typically the mess left behind by a redesign that did not manage its old addresses.

What to do about it, in order

First, see what Google actually crawls. Search Console’s crawl and indexing reports show which URLs Google requests and what it found; most owners have never looked and are surprised by what is in there. If real pages are missing from Google entirely, that is an indexing problem before a budget one, and the indexing guide covers it.

Second, give Google a clean map. An accurate sitemap listing exactly the pages you want found, a robots file that fences off the machinery, one canonical address per page, and redirects tidied so old URLs land in one hop.

Third, and this is the part that doubles as strategy: make the map worth crawling. Google returns more often to sites where visits keep finding fresh, linked, worthwhile pages. A tight site of genuinely useful pages that link to each other sensibly gets crawled eagerly. How pages link is its own lever, and I wrote about it in the internal linking guide.

The pattern with all of this: crawl housekeeping is never what makes a site rank, but neglecting it quietly taxes everything else you do. It is standard plumbing in every Studio Squalli build, and the free audit will show you where Google is currently spending its visits on your site, including the parts you forgot existed.