GoScrobble/web/public/robots.txt

4 lines
67 B
Plaintext
Raw Normal View History

2022-04-25 02:47:15 +00:00
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow: