Sep 21 2008
Search engines
A search engine is a website that visits, collects, saves and organizes the content from all over the internet. Those who would like to locate something on the web, have to enter one or more keyword about what they would like to find and the search engine provides links to the content which matches with the searched keyword.
Search engines like Google, Yahoo, MSN are using so called “spiders” or “crawlers” to read the website contents. These are small programs which are simply visiting all the existent website on the web and trying to “cache” them (save a copy). Then when somebody is searching keywords, the search engines searches over his already saved data and shows you the pages which have the most relevancies to your searched keywords.
The crawlers are visiting all the already visited websites time by time and re-caching their content again if there were any changes. The visiting frequency of a search engine depends of the importance of that page from the search engine point of view. This page importance is vary at every search engine. For example Google likes if a website has lots of links leading toward it (backlinks), if it has lots of fresh content or there are lots of visitors of that website. If there are lots of links toward a website, Google will be curious why that website has so many backlink and he goes to visit it more often giving a higher PageRank.
What is a search engine indexer?
One response so far
[...] Website Directory Structure Search engines [...]