Websites:
http://en.wikipedia.org/wiki/Search_engine
http://en.wikipedia.org/wiki/Search_Engine_Indexing_Process
http://www.google.com/technology/
http://www.robotstxt.org/wc/norobots.html
http://en.wikipedia.org/wiki/Text_corpus
Artigos e Livros:
Brin, S. & Page, L. (1998). The Anatomy of a Large-Scale Hypertextual Web Search Engine
S. Muthukrishnan – Efficient Algotithms for Document Retrieval Problems
Lawrence, S. - Winners don't take all: Characterizing the competition for links on the web
Hubbard, J. - (1999) – Indexing the Internet