mirror of
https://github.com/kremalicious/blog.git
synced 2024-11-25 19:34:48 +01:00
13 lines
223 B
Plaintext
13 lines
223 B
Plaintext
# https://platform.openai.com/docs/gptbot
|
|
User-agent: GPTBot
|
|
Disallow: /
|
|
|
|
User-agent: *
|
|
Disallow: /search/
|
|
Disallow: /page/
|
|
Disallow: /*/page/
|
|
Disallow: /tags/
|
|
Disallow: /api/
|
|
|
|
Sitemap: https://kremalicious.com/sitemap.xml
|