Definition

What is Crawl Budget?

The number of pages Googlebot will crawl on a site within a given window — finite, especially for large sites.

Crawl budget is real but mostly matters at scale (50,000+ URLs). For small-to-medium sites, Google crawls everything it can find through your sitemap and internal links. Budget concerns kick in when: many low-quality or duplicate pages exist; site responds slowly; or the site has tens of thousands of URLs. To preserve crawl budget: keep the sitemap clean (only canonical URLs), avoid generating low-value pages (every paginated archive URL), keep server response times under 200ms. InBuild sites avoid the common crawl-budget pitfalls because every page is meaningful and the sitemap is curated.

Learn more

Related terms

See it in action

Real templates, rendered live, next to the exported code. No account needed.