portfolio/public/robots.txt

mirror of https://github.com/kremalicious/portfolio.git synced 2024-07-01 06:01:48 +02:00
# https://platform.openai.com/docs/gptbot
User-agent: GPTBot
Disallow: /

User-agent: *
Disallow: /resume
block GPTBot 2023-08-07 14:13:01 +02:00			`# https://platform.openai.com/docs/gptbot`
			`User-agent: GPTBot`
			`Disallow: /`

humans.txt & robots.txt 2018-05-06 18:38:51 +02:00			`User-agent: *`
add resume 2019-08-11 21:47:22 +02:00			`Disallow: /resume`