User-agent: * Disallow: /wp-admin/ Sitemap: https://palestine-solidarity.or.kr/sitemap.xml Crawl-delay: 1 User-agent: ia_archiver Disallow: / User-agent: bingbot Crawl-delay: 10 Disallow: /photos/ User-agent: AhrefsBot User-agent: SemrushBot User-agent: Barkrowler Disallow: / User-agent: facebookexternalhit Crawl-delay: 2