# Robertson Cabinets — robots.txt # https://robertsoncabinets.com # ── Standard search engines ────────────────────────────────────────────── User-agent: * Allow: / Disallow: /images/new_preview/ Disallow: /quotes.html # ── Google ─────────────────────────────────────────────────────────────── User-agent: Googlebot Allow: / Disallow: /images/new_preview/ Disallow: /quotes.html # ── Google Images (index all project photos) ───────────────────────────── User-agent: Googlebot-Image Allow: /images/ # ── Bing ───────────────────────────────────────────────────────────────── User-agent: Bingbot Allow: / # ── AI crawlers — allow all (good for AI-powered search visibility) ─────── User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: CCBot Allow: / # ── Sitemap location ───────────────────────────────────────────────────── Sitemap: https://robertsoncabinets.com/sitemap.xml