Diffstat (limited to 'views/pages/robots.txt')
| -rw-r--r-- | views/pages/robots.txt | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/views/pages/robots.txt b/views/pages/robots.txt new file mode 100644 index 0000000..aaef3f4 --- /dev/null +++ b/views/pages/robots.txt @@ -0,0 +1,7 @@ +User-agent: * +Allow: / +Disallow: /api/v1/email/ +Disallow: /ru/user/ +Disallow: /en/user/ + +Sitemap: {{ .CanonicalEndpoint }}/sitemap.xml
\ No newline at end of file |