Volunteers can download the Grub web crawler, which runs in the background on their PC, indexing web pages according to their content. The crawler will be used as the basis for Wikia’s forthcoming search service. By contrast, search engines like Google run their own web crawlers and keep details of the way they work secret.
Read this item from New Scientist and contribute your knowledge of Jimmy Wakes or Grub to the Whats New Media Wiki.