What is a search engine?
Search engines are Internet users’ main tools for finding products, services and information on the Web. Search engines allow people to search the entire web (or at least the internet pages that are in the search engine’s database.)
How does a search engine index web pages?
An engine has four parts that you need to know about for optimization purposes:
- The spider is a program that crawls the Internet, searches and gathers web pages.
- The database is where the spider will store the pages it finds.
- The search engine’s website, for example google.com, is where searchers go to extract information from the database.
- Algorithms are programs that determine which sites will appear when people enter a query on the search engine’s website.
Your site can enter the database in two ways:
- The spider will automatically find your site from a link on someone else’s site, which is the path we recommend if you can get 1 or more quality inbound links.
- You submit your URL so the spider will come out and find it.
What happens when I submit my URL to a search engine?
First, the search engine spider visits your URL immediately and schedules your page for inclusion in the search engine’s database.
Second, usually within a few weeks, the spider arrives and places your page(s) in its database.
It is not known how many pages deep the spider will crawl or how many pages it will place in the database. Usually the first time it will only be a few pages – maybe just the homepage.
Third, the spider revisits your page(s) to capture the changes you made. (The old term for this was “auto-update”.) Once a page is in the database, the spider typically revisits every few weeks. The
spider will also start to crawl your site deeper and place more and more pages in the database.
Fourth, when people use a search engine, they type keywords into a search box on the search engine’s website. They submit a request. The search engine, according to the algorithms, will display all relevant sites for this query.