Website Spidering refers to the automated process of indexing a web site by a search engine. An automated program, known as a web crawler or spider, will go through a website following the links on each page, and will gather pertinent information from each page until it has properly indexed the entire website.
Website Spidering
Read more...
From http://www.rss-specifications.com
No comments:
Post a Comment