# Robots.txt for fforecast.net User-agent: * Allow: / Disallow: /api/ Disallow: /private/ Sitemap: https://fforecast.net/sitemap.xml # Crawl-delay for bots that support it (Googlebot ignores Crawl-delay) User-agent: Yandex Allow: / Crawl-delay: 1 User-agent: Baiduspider Allow: / Crawl-delay: 1