Password Protected Areas and Search Engines
March 28, 2011 / Updated: March 28, 2011 / Lena Shore
Can a search engine spider do a search of content which is behind a passworded index page?
No. Search engines cannot crawl a passworded directory as they can’t invoke interface functions. Google (for instance) would have to have your login/pass and the programming to invoke the command.