How to Check if Google Has Crawled My Site (It Hasn't Yet)
How to check if Google has crawled my site, and what to do when it never comes: Crawl stats, Discovered vs Crawled, how long to wait. Fix it today.
Get each new plain-English SEO guide the day it comes out. Free, by email. Unsubscribe in one click.
To check if Google has crawled your site, open Google Search Console, inspect a page with the URL Inspection tool and look for a Last crawl date. If there's no date, or the screen says "URL is unknown to Google", then Googlebot (the program Google uses to read web pages) hasn't visited that page yet.
This guide covers that second case: Google never shows up. You'll learn the three signs that Google hasn't come, how to read the Crawl stats report, what "Discovered" means compared with "Crawled", and how long to wait before you should worry. If Google has visited and you want to read the rest of the inspection screen or request indexing, our guide Is my page indexed? How to check in 2 minutes walks through each line.
Once you know Google can reach your pages, the next step is the page itself. You can run a free SEO audit of your page in Claude, with no account needed.
How to check if Google has crawled my site in 30 seconds
You have two quick ways to check.
- The
site:search. On google.com, typesite:yourdomain.comand press Enter. If any of your pages appear, Google has crawled at least those pages, because it can only show a page it has visited. If nothing appears, Google either hasn't crawled the site or crawled it and kept nothing. - URL Inspection. In Search Console, paste a full page address into the bar at the top. Under Page indexing, look for Last crawl. A date means Google came. No date means it hasn't.
The site: search won't tell you when Google visited, and its result count isn't exact. Use it as a first look, then use Search Console to confirm.
Three signs Google has never come
Each of these points to the same thing: Google hasn't visited the page.
| What you see | Where | What it means |
|---|---|---|
| "URL is unknown to Google" | URL Inspection | Google has no record of the page at all |
| A sitemap listed under Discovery, but no Last crawl date | URL Inspection | Google knows the address but hasn't fetched it |
| Discovered, currently not indexed | Indexing > Pages | Google found the address and put the crawl off |
If your home page shows one of these, the problem is site-wide. If only some pages do, the problem is usually how Google finds them, or how fast your server answers.
Discovered vs Crawled: the label that tells you where to look
Two labels in the Page indexing report (Indexing > Pages) look alike but mean opposite things. Google's own Page indexing report help defines them:
| Label | Google's definition | Is it a crawl problem? |
|---|---|---|
| Discovered, currently not indexed | "The page was found by Google, but not crawled yet. Typically, Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl." | Yes. Google hasn't come yet |
| Crawled, currently not indexed | "The page was crawled by Google but not indexed." Google adds that this "doesn't necessarily indicate an issue that needs attention." | No. Google came and made a choice about the page |
This guide is about the first label. If your important pages show "Crawled, currently not indexed", Google already visited them, so crawling isn't the problem. Look at the page itself instead, starting with our indexing guide.
Google's definition mentions overload. In plain English, Google slows down when it thinks your server can't handle more visits. That's why the next report matters.
How to read the Crawl stats report
URL Inspection shows one page at a time. The Crawl stats report shows whether Google is visiting your site at all.
Where to find it: in Search Console, click Settings, then Crawl stats, then Open report.
One condition: Google says the report is available only for root-level properties. That means a Domain property (yourbusiness.com) or a URL prefix property at the root (https://yourbusiness.com), not a folder like https://yourbusiness.com/blog/. If you can't see the report, that's usually why.
Google says the report shows "how many requests were made and when, what your server response was, and any availability issues encountered." Here's what to look at if you're not technical:
- The requests chart. A line that sits at zero for weeks means Google isn't visiting. A line that suddenly drops to zero after steady visits means something changed on your site, like a new robots.txt file, a password or a host problem.
- Host status. Google uses three colours. Green means no significant availability issues in the past 90 days. Yellow means issues more than a week ago that seem fixed. Red means at least one significant issue in the last week. Google checks three things here: fetching your robots.txt file, DNS (the system that points your domain to your server) and server connectivity.
- By response. Mostly "OK (200)" is healthy. Many server errors (5xx) or "Not found (404)" responses mean Google is hitting broken or failing pages.
Small numbers are normal for a small site. A ten-page website doesn't need Google every hour. Watch the trend and the host status, not the size of the numbers.
Why Google hasn't crawled my site: the checks, in order
Go through these in order and stop at the first one that fails. The first ones are the most common reasons a small business site gets no visits.
- The site is public. Open it in a private browser window on your phone. Coming-soon pages, password protection and "hidden" modes on site builders keep Google out.
- "Hide from search engines" is off. In WordPress, go to Settings > Reading and make sure "Discourage search engines from indexing this site" is unticked. Other builders have a similar switch in their SEO settings.
- robots.txt lets Google in. Visit
yourdomain.com/robots.txt. If you seeDisallow: /underUser-agent: *, your whole site is blocked. In Crawl stats, a robots.txt problem also shows under Host status. - A sitemap is submitted. In Search Console, open Sitemaps and submit your sitemap address (often
sitemap.xml). Google calls a sitemap "an important way for Google to discover URLs on your site". - Other pages link to it. A page with no links pointing to it is hard to find. Link to it from your home page, your menu or a related service page. Our internal linking guide shows how.
- Your server answers. If Host status is red or yellow, or Crawl stats shows server errors, send a screenshot to your web host. This is also the most likely cause when many pages sit in "Discovered, currently not indexed".
If your whole site is missing from Google, not just a few pages, also read why can't I find my website on Google, which covers site-wide causes.
Want the next check in your inbox? The SEO Brief sends one email a week with the new guides: what to fix on your site, in what order, without jargon. Get it free.
How long to wait before you worry
Google gives a range, not a promise. On its recrawl help page, Google says:
- "Crawling can take anywhere from a few days to a few weeks."
- "Requesting a recrawl multiple times for the same URL won't get it crawled any faster."
- There's "a quota for submitting individual URLs".
- "Requesting a crawl does not guarantee that inclusion in search results will happen instantly or even at all."
Here's a rule of thumb based on those timings. It's our working method, not a rule from Google:
| Your situation | Check again after | Start worrying if |
|---|---|---|
| Brand new site, sitemap submitted | A few days, then weekly | Still "unknown to Google" after a few weeks, with nothing blocked |
| New page on a site Google already visits | A few days | Other pages get crawled but this one has no date after a few weeks |
| Many pages in "Discovered, currently not indexed" | A week after fixing server or host issues | The count keeps growing and Host status isn't green |
| Crawl stats chart dropped to zero | A day or two after the fix | No requests come back within a couple of weeks |
While you wait, don't keep clicking Request indexing. One request per important page is enough. More requests use up your quota and don't speed anything up.
What doesn't help
Some common fixes waste time when Google hasn't visited yet:
- Rewriting the page. Google can't judge text it hasn't read. Fix access first.
- Buying a paid indexing service. Google's documented routes are sitemaps, internal links and URL Inspection. Start there.
- Submitting the same sitemap every day. Submit it once. Google rereads sitemaps it already knows.
- Reading too much into the
site:count. Google doesn't present that number as exact.
FAQ
How do I know if Google has visited my website?
Inspect your home page in Search Console's URL Inspection tool and look for a Last crawl date under Page indexing. A date means Googlebot visited. For a quick check without logging in, search site:yourdomain.com: any result means Google crawled at least those pages.
What does "Discovered, currently not indexed" mean?
Google found the address but hasn't crawled it yet. Google says this usually happens when it expected the crawl to overload your site and rescheduled it. Check Host status in the Crawl stats report and add internal links to the pages involved.
Why is my Crawl stats report missing?
It only works on root-level properties: a Domain property, or a URL prefix property for the root of your site. If your property is set up for a folder such as /blog/, add a Domain property for the whole site.
How long does it take Google to crawl a new website?
Google says crawling can take anywhere from a few days to a few weeks. Submitting a sitemap and linking to your key pages helps Google find them. Asking for the same page again and again doesn't make it faster.
What to do today
- Inspect your home page and your top two service pages in Search Console. Write down whether each has a Last crawl date.
- Open Indexing > Pages and count how many of your key pages sit in "Discovered, currently not indexed".
- Open Settings > Crawl stats and check two things: is the chart above zero, and is Host status green?
- If any check fails, go through the six checks above in order, then request indexing once per key page.
- Once Google is visiting, run a free SEO audit of your page in Claude to audit the page itself.