.googlebot.com.
.yandex.ru.
.yandex.net.
.yandex.com.
.search.msn.com.
.crawl.baidu.com.
.crawl.baidu.jp.
.crawl.yahoo.net.
.qwant.com.
.babbar.eu.
.babbar.tech.
.crawl.amazonbot.amazon.
.crawl.sogou.com.