User-agent: SemrushBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: Adsbot
Disallow: /
User-agent: grapeshot
Disallow: /

User-agent: *
Allow: /
Disallow: /pr/
Disallow: /search
Disallow: /tao/
Disallow: /lolita/tao/

Sitemap: https://www.sankengriji.com/sitemap.txt