The Invisible Web

[websearch]

• Tweet

http://netforbeginners.about.com/cs/secondaryweb1/a/secondaryweb.htm

Many untrained users have the naive expectation that they can locate anything on the world wide web by using Google or Yahoo or Ask.com. No, as powerful as these search engines are, they do not index everything on the world wide web. In fact, search engines index less than 10% of the entire web! That remaining 90% is called the "Invisible Web", or in other words, "The Cloaked Web" or "The Deep Web". This is the massive content that is publicly available, but hidden from regular search engines.

[Pepsi]

a bit misleading.. from the article

    * Google.com indexes 12.5 billion public web pages.
    * 71 billion static web pages are publicly-available. These pages can easily be found by Google and other search engines. (e.g. www.honda.com, www.australia.gov.au)
    * 6.5 billion static pages are hidden from the public. As private intranet content, these are the corporate pages that are only open to employees of specific companies. (e.g. employees.honda.com, secure.australia.gov.au)
    * 220+ billion database-driven pages are completely invisible to Google. These invisible pages are not the regular web pages you and I can make. Rather, these are dynamic database reports that exist only when called from large databases.
      (e.g. custom online car quote for Shelly, Australian government discussion on aboriginal taxation)

the "private intranet content" is not content on the internet, it's on private networks.   

The database-driven pages is also mis-leading.   I mean I can search google for "car quote" and get the links to the car sales sites.    But he's saying that if I enter the specifics of what I'm looking for, pull up a quote for a particular car model, that database driven content is "hidden" - I don't think it's hidden, I think it's a dynamically created page made in that instance for that user at that moment.   It's not searchable because it didn't exist until the page was created on the fly by the query I submitted and the data which was used to create the results.

[websearch]

 

http://www.edu-cyberpg.com/Internet/search.html

1000 SEARCH ENGINES
& The Invisible Web - THE HIDDEN NET