Views: 1196
User-agent: YandexBot
Disallow: /User-agent: YandexDirect
Disallow: /User-agent: YandexDirectDyn
Disallow: /User-agent: YandexImages
Disallow: /User-agent: YaDirectFetcher
Disallow: /User-agent: YandexBlogs
Disallow: /User-agent: YandexNews
Disallow: /User-agent: YandexPagechecker
Disallow: /User-agent: YandexMetrika
Disallow: /User-agent: YandexCalendar
Disallow: /
Also see: https://charmingwebdesign.com/blocking-ip-addresses-of-any-country-with-iptables/
‘YandexBot’ — the main indexing robot ‘YandexDirect’ — downloads information about the content on Yandex Advertising Network partner sites for selecting relevant ads; interprets robots.txt in a special way ‘YandexDirectDyn’ — generates dynamic banners and interprets robots.txt in a special way ‘YandexMedia’ — robot used to index multimedia data ‘YandexImages’ — indexing robot for Yandex.Images ‘YaDirectFetcher’ — the Yandex.Direct robot; it interprets robots.txt in a special way ‘YandexBlogs’blog search — r
Source: Using robots.txt
‘YandexBot’ — the main indexing robot’YandexDirect’ — downloads information about the content on Yandex Advertising Network partner sites for selecting relevant ads; interprets robots.txt in a special way’YandexDirectDyn’ — generates dynamic banners and interprets robots.txt in a special way’YandexMedia’ — robot used to index multimedia data’YandexImages’ — indexing robot for Yandex.Images’YaDirectFetcher’ — the Yandex.Direct robot; it interprets robots.txt in a special way’YandexBlogs’blog search — r
Source: Using robots.txt