1

I assumed "indexing" without any special treatment would take longer.

Is there any story behind this, or are they just being extra useful? :)

4
  • 4
    Web crawlers such as Googlebot and DuckDuckBot crawl sites once in every few seconds to update indexing and things they know about/on your site. The search results depends on the keywords as well. I don't think this question has to do anything with SE or AU, in general.
    – Kulfy
    Apr 2 at 17:13
  • 1
    I thought I was allowed to "discuss" it :)
    – Levente
    Apr 2 at 17:17
  • 4
    I never said it shouldn't be discussed :). It's just how those search engines work.
    – Kulfy
    Apr 2 at 17:19
  • @Levente this was one question I had before, and totally forgot to ask or even search for it; and here you are asking it! thank you; really! +1 Apr 8 at 14:08
6

Google and DDG search engine bots crawl StackExchange sites regularly (usually every few seconds or 30 seconds or whatever they're set for), because we're high activity sites.

This is just how these search indexer crawlers work, it's not an SE/AU specific thing it's just how those crawlers are written.

1
  • 1
    Yeah, my amazement comes from the part how fast it happens. It exceeded my assumptions / expectations, that's all. Thank you.
    – Levente
    Apr 2 at 18:55

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .