Showing posts with label web spider. Show all posts
Showing posts with label web spider. Show all posts

Wednesday, March 25, 2015

How to: set up a search engine

  1. Develop a "web spider" - a software program to browse the Internet.
  2. Instruct the spider to begin its "web crawl" at popular websites, building an index of the words on the pages.
  3. By following the links on the sites, the spider will quickly spread out across much of the web.
  4. Build up an index of search words found by the spider and encode and store the data for users to access.
  5. Develop search engine software - a program to sift through the millions of