Crawler

Component of a search engine that gather listings by automatically "crawling" the web. A search engine's crawler (also called a spider or robot) follows links to webpages. It makes copies of the web pages found and stores these in the search engine's index.

Return to SEO Glossary Main Page


    Bookmark & Share

    Add to: Digg Add to: Del.icio.us Add to: Google Add to: Yahoo Add to: Technorati Add to: StumbleUpon Add to: Furl Add to: Spurl Add to: Slashdot Add to: Reddit Add to: Simpy Add to: Netscape Add to: Blinklist Add to: Blogmarks Add to: Diigo Add to: Newsvine Add to: Ma.Gnolia


[top]