How do web crawlers (like Google) find pages that aren’t linked to/from anything

230 views

I get the basic working of a web crawler. They start at a page and index it, then follow all its links and index those, and so on. Eventually they have a good enough representation of the entire internet.

Recently I made a new web page on a new domain, and soon enough it showed up in a Google search. How did Google know the address of my site (or any other one) to begin with? Is there an actual directory of every site on the internet? Or does it try random combinations of domain names?

In: 2

3 Answers

Anonymous 0 Comments

Did you test your new site using Chrome? Rest assured Google put it on the list for indexing soon after.

You are viewing 1 out of 3 answers, click here to view all answers.