Ad

Is .htaccess Password Protected Site Hidden From Search Engines?

- 1 answer

We have a website instance on a domain which is blocked by a .htaccess password. Some IPs, such as the company's network are allowed through.

  • There are no inbound links (although obviously cannot guarantee this 100%)

  • The site has no robots.txt

  • The robots meta tag is set to follow and index

With all of these conditions, is there any way that search engines could still index the site? I think not but want to make sure there is no loophole I didn't know about.

Ad

Answer

Pages that are password-protected will not be accessible to the search engines.

Search engine robots typically can’t log in to crawl pages, so content behind a login will not make it into the search index.

source: http://www.yourseoplan.com/is-password-protected-content-indexable-by-search-engines/

Also see this post from a Google employee:

No, our crawlers can't access login protected pages.

source: Gary Illyes, Google, https://productforums.google.com/forum/#!topic/news/2SdcGEWht1o

Ad
source: stackoverflow.com
Ad