# robots.txt for https://utahrails.net/ # updated October 18, 2026 Sitemap: https://utahrails.net/sitemap_4372390.xml # Global Access & Protected Directory Rules # Including all AI Crawlers & Search Agents User-agent: * Allow: / # Private Folders to keep bots from indexing User-agent: * Disallow: /scripts/ Disallow: /library/ Disallow: /samples-templates/ Disallow: /temp/ # Deleted Folders are no longer listed. # Meant to keep bad or old URLs from being searched for. # Folder list removed to allow search bots to receive proper 404 Not Found or 410 Gone status codes.