The Crawl Statistics Report is the only official tool that provides a server-side view of how Googlebot crawls your site. It shows 90 days of data including how many crawling requests are received per day, the distribution by response code (200, 3xx, 4xx, 5xx), what the average response time is, and which resources among HTML, images, CSS, and JS are crawled.
This report is important for two reasons. First, crawl budget problems can be diagnosed. If crawling requests suddenly decreased, Googlebot may have reduced crawling due to repeated server errors. Second, check whether unnecessary resources (duplicate URLs, parameter URLs, images) are eating up the crawling budget.
Search Console navigation: → Settings → Crawl stats. Check the trend in the number of crawling requests, total download size, and response code distribution in the top chart. In the 'Host Status' tab, see details on how the server handled crawl requests.
Key takeaways
- Tracks the number of Googlebot crawling requests, response code, response time, and download size for 90 days.
- Shows crawling distribution by HTML, CSS, JS, image, and other file types.
- A sharp decrease in the number of crawling requests can be a sign of repeated server errors, and a sharp increase can be a sign of a sitemap update or increase in links.
- In the Host Status tab, check whether DNS, server connection, and robots.txt import were successful.
- This is a tool that allows you to easily understand Googlebot crawling patterns without analyzing log files.