Deep Web

A Deep Web is the part of the World Wide Web that is not accessible via a Search Engine.

References

(Wikipedia, 2009) ⇒ http://en.wikipedia.org/wiki/Deep_Web
- The deep Web (also called Deepnet, the invisible Web, dark Web or the hidden Web) refers to World Wide Web content that is not part of the surface Web, which is indexed by standard search engines.
  Mike Bergman, credited with coining the phrase,[1] has said that searching on the Internet today can be compared to dragging a net across the surface of the ocean; a great deal may be caught in the net, but there is a wealth of information that is deep and therefore missed. Most of the Web's information is buried far down on dynamically generated sites, and standard search engines do not find it. Traditional search engines cannot "see" or retrieve content in the deep Web – those pages do not exist until they are created dynamically as the result of a specific search. The deep Web is several orders of magnitude larger than the surface Web. [2]

(Bergman, 2001) ⇒ Michael K. Bergman. (2001). “The Deep Web: Surfacing hidden value.” In: Journal of Electronic Publishing, 7(1).

(Kautz et al., 1997) ⇒ Henry Kautz, Bart Selman, Mehul Shah. (1997). “The Hidden Web.” In: AI Magazine, 18(2).
- ABSTRACT: The difficulty of finding information on the World Wide Web by browsing hypertext documents has led to the development and deployment of various search engines and indexing techniques. However, many information-gathering tasks are better handled by finding a referral to a human expert rather than by simply interacting with online information sources. A personal referral allows a user to judge the quality of the information he or she is receiving as well as to potentially obtain information that is deliberately not made public. The process of finding an expert who is both reliable and likely to respond to the user can be viewed as a search through the net-work of social relationships between individuals as opposed to a search through the network of hypertext documents. The goal of the REFERRAL WEB Project is to create models of social networks by data mining the web and develop tools that use the models to assist in locating experts and related information search and evaluation tasks.