Invisible Web Content

Share Article

The Web is 500x Larger Than You Think!

Searching the internet can be an exercise in frustration, returning Âsponsored resultsÂ. Most searches are conducted through MSN, Google and other search engines. These search engines log basic (non-database) webpages. When we surf the web, we see a lot of travel and shopping sites.

There is another, large volume of information, that search engines are blocked from cataloging, and it is commonly called, the ÂInvisible WebÂ. Due to technical barriers, search engines can not view scripted pages, pages requiring a password or when the webmaster excludes search engines through coding. Many of these pages reside at universities (.edu) and government (.gov) websites. Corporations also have a large number of ÂinvisibleÂ pages.

Accessing the ÂInvisible WebÂ can help when looking for information and resources. The OAIster Project, at the University of Michigan, has a large digital collection. Their Âresources can range from an old-time advertisement of Electric Refrigerators (from the Library of Congress American Memory project) to poems by Emily Dickinson (from the University of Michigan Digital Library Production Services American Verse project).Â

There are gateways that organize information in the Invisible Web. These gateways are both general and information specific websites, and are great places to begin a research project:

Infomine.ucr.edu - U. C. Collection

www2.library.ucla.edu - UCLA Library

FirstGov.gov - Government Resources

odci.gov/cia/publications - CIA Publications

loc.gov    Library of Congress

Completeplanet.com - Corporate Database Collection

You can go to Yahoo and search on a topic in their directory, or describe the type of database you need. At Google, use your subject term plus the word ÂdatabaseÂ.

Libraryspot.com is a collection of encyclopedias, maps and online libraries. Profusion.com is offered by the University of Kansas. It searches hundreds of specialized search engines and databases. The LibrarianÂs Index is located at http://www.lii.org.

For more information about the ÂInvisible WebÂ, please go to http://www.invisible-web.net.

# # #

Share article on social media or email:

View article via:

Pdf Print

Contact Author

Radha Khalsa
Visit website
http://www.prweb.com/releases/2005/03/prweb220043.htm
www.prweb.com
crawl=CC-MAIN-2017-43
23709
application/http; msgtype=response
sha1:JPG53YC65XT2XYRRW527FSHAAY3ZQR65
<urn:uuid:66458bfa-b703-4744-8e7a-1495cb63d9e4>
2017-10-22T06:43:33Z
199.83.132.9
text/html
sha1:YFVRSD7I2RUOLVVQSY2IVDI7Y6ALMWV2
<urn:uuid:29afa32c-0ed3-47fb-a5b2-2df1f99c001e>
http://www.prweb.com/releases/2005/03/prweb220043.htm
length
response
<urn:uuid:f0e7e727-9c2f-42a0-a3e5-14fdcdfaf9ea>
robots: classic
hostname: ip-10-137-158-248.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-43
operator: Common Crawl Admin
description: Wide crawl of the web for October 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf