shkola/robots.txt
Dekart Deploy Bot 460f87746e fix(seo): не выводить прод-счётчики на dev-хостах, Clean-param для рекламных метк, dynamic URLs в JSON-LD
- functions.php: dekart_is_dev_host() + гейт для Яндекс.Метрики/GTM на dev/local
  (dev-трафик больше не попадает в прод-счётчик 99835482 под внутренним IP)
- robots.txt: Clean-param clckid/yclid/gclid/etext/y_ref (Webmaster INSIGNIFICANT_CGI_PARAMETER)
- page-elementary-school.php: захардкоженный домен заменён на home_url()
2026-09-29 17:53:51 +00:00

70 lines
1.4 KiB
Plaintext

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: /feed/
Disallow: /*/feed/
Disallow: /comments/feed/
Disallow: /?rest_route=/
Disallow: /*?s=
Disallow: /*?utm_
Disallow: /*&utm_
Disallow: /*?ref=
Disallow: /*&ref=
Disallow: /date/
Disallow: /author/
Disallow: /tag/
Disallow: /personal/
Disallow: /cabinet/
Disallow: /search/
User-agent: Googlebot
Crawl-delay: 10
User-agent: Yandex
Crawl-delay: 10
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: /feed/
Disallow: /*/feed/
Disallow: /comments/feed/
Disallow: /?rest_route=/
Disallow: /date/
Disallow: /author/
Disallow: /tag/
Disallow: /personal/
Disallow: /cabinet/
Clean-param: age&grade&sort&filter&view&sid&_openstat /
Clean-param: utm_source&utm_medium&utm_campaign&utm_content&utm_term&from /
Clean-param: ref&_openstat&sid /
Clean-param: clckid&yclid&gclid&etext&y_ref /
# Глобальная директива Sitemap (видна всем ботам)
Sitemap: https://schelkovo.dekart.school/sitemap_index.xml
# AI crawler directives
User-agent: GPTBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: CCBot
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: cohere-ai
Disallow: /