Technical SEO

Crawl Budget

The number of pages a search engine will crawl on a site within a given timeframe.

CurrentLast updated: 2026-09-16
Back to glossary

Definition

Technical SEO

Crawl budget is the number of pages search engines will crawl on a site within a given timeframe. It is determined by crawl rate limit (server capacity) and crawl demand (popularity and staleness). Large sites need to manage crawl budget so important pages get crawled instead of low-value ones.

Why it matters

On large sites, wasting crawl budget on low-value URLs can prevent important pages from being discovered.

crawl-budgetcrawlinggooglebot

Let's talk

Your next customer might not click a blue link — they'll ask an AI. Be the answer.

Book a free strategy call and I'll audit your visibility across Google, AI Overviews, ChatGPT, and Perplexity — then map out exactly what it takes to be found and cited.