treehouse
/
mastodon
21
8
Fork 5
Code Issues 32 Pull Requests Projects 1 Releases Wiki Activity

Change: Block GPTBot (#26396)

lolsob-rspec
Foritus 2023-08-09 10:58:46 +01:00 committed by GitHub
parent 347fc78392
commit 2bef6e60e8
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
public/robots.txt
View File

@ -1,5 +1,8 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /media_proxy/
Disallow: /interact/