Glossary: Crawl Budget
The fundamental definition of how search engines visit your website.
Crawl Budget is the combination of the number of URLs Googlebot wants to crawl and the number of URLs it can crawl on a specific website within a given timeframe.
If your website has more pages than your crawl budget allows, many of your URLs will remain unindexed or will not be updated regularly in search results.
How many simultaneous requests Google can make without crashing your server. If your site is slow, your capacity drops.
How much Google *wants* to crawl your site. This is driven by content freshness, page popularity, and overall site authority.
Read our full guide on how to optimize your crawl budget for large-scale enterprise websites.
Full Optimization GuideContinue with these guides to strengthen your technical SEO workflow.