User-Agent: * Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /login Disallow: /favorieten/ Disallow: /vergelijk/ Disallow: /claim/ Disallow: /review/ User-Agent: GPTBot Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /login Crawl-delay: 10 User-Agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /login Crawl-delay: 10 User-Agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /login Crawl-delay: 10 User-Agent: anthropic-ai Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /login Crawl-delay: 10 User-Agent: CCBot Disallow: / User-Agent: Bytespider Disallow: / User-Agent: Amazonbot Disallow: / User-Agent: Scrapy Disallow: / User-Agent: MJ12bot Disallow: / Sitemap: https://skincare.nl/sitemap-index.xml Sitemap: https://skincare.nl/types/sitemap.xml