I assumed "indexing" without any special treatment would take longer.
Is there any story behind this, or are they just being extra useful? :)
I assumed "indexing" without any special treatment would take longer.
Is there any story behind this, or are they just being extra useful? :)
Google and DDG search engine bots crawl StackExchange sites regularly (usually every few seconds or 30 seconds or whatever they're set for), because we're high activity sites.
This is just how these search indexer crawlers work, it's not an SE/AU specific thing it's just how those crawlers are written.