Is .htaccess Password Protected Site Hidden From Search Engines?
We have a website instance on a domain which is blocked by a .htaccess password. Some IPs, such as the company's network are allowed through.
There are no inbound links (although obviously cannot guarantee this 100%)
The site has no robots.txt
The robots meta tag is set to follow and index
With all of these conditions, is there any way that search engines could still index the site? I think not but want to make sure there is no loophole I didn't know about.
Pages that are password-protected will not be accessible to the search engines.
Search engine robots typically can’t log in to crawl pages, so content behind a login will not make it into the search index.
Also see this post from a Google employee:
No, our crawlers can't access login protected pages.
source: Gary Illyes, Google, https://productforums.google.com/forum/#!topic/news/2SdcGEWht1o
- → .htaccess - not routing to public folder
- → Laravel 4.2 application occurs unnecessary redirection after uploading live server
- → Htaccess negation
- → Building sitemap for 2 wordpress install under 1 domain
- → htaccess not working properly for sub url having more slashes
- → How to give access execute specific php file in server?
- → 301 Redirection from no-www to www in wordpress
- → Cyclical redirection at the start laravel 5 project
- → Can't route in Laravel framework
- → codeigniter seo url with htaccess
- → PHP Seo Friendly URL
- → Convert URL to SEO Friendly
- → IP Canonicalization (WordPress)