1
0
Fork 0
blog/static/robots.txt

13 lines
223 B
Plaintext

# https://platform.openai.com/docs/gptbot
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /search/
Disallow: /page/
Disallow: /*/page/
Disallow: /tags/
Disallow: /api/
Sitemap: https://kremalicious.com/sitemap.xml