1

I assumed "indexing" without any special treatment would take longer.

Is there any story behind this, or are they just being extra useful? :)

4
  • 4
    Web crawlers such as Googlebot and DuckDuckBot crawl sites once in every few seconds to update indexing and things they know about/on your site. The search results depends on the keywords as well. I don't think this question has to do anything with SE or AU, in general. – Kulfy Apr 2 at 17:13
  • 1
    I thought I was allowed to "discuss" it :) – Levente Apr 2 at 17:17
  • 4
    I never said it shouldn't be discussed :). It's just how those search engines work. – Kulfy Apr 2 at 17:19
  • @Levente this was one question I had before, and totally forgot to ask or even search for it; and here you are asking it! thank you; really! +1 – William Martens Apr 8 at 14:08
6

Google and DDG search engine bots crawl StackExchange sites regularly (usually every few seconds or 30 seconds or whatever they're set for), because we're high activity sites.

This is just how these search indexer crawlers work, it's not an SE/AU specific thing it's just how those crawlers are written.

1
  • 1
    Yeah, my amazement comes from the part how fast it happens. It exceeded my assumptions / expectations, that's all. Thank you. – Levente Apr 2 at 18:55

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .