Mirror-bot/nitter-status
1
0 Fork 0
mirror of https://github.com/4cuck/nitter-status.git synced 2026-10-27 00:57:39 +00:00
Code Issues Projects Releases Activity

optimize robot stuff

Browse Source
This commit is contained in:
4cuck committed 2023-10-16 23:32:10 +02:00
1 parent 2b7352fe5b
commit fec8dbc43a
4 files changed
+15 -3
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

server/static/robots.txt
+7
View File
@@ -0,0 +1,7 @@
User-Agent: *
Disallow: /api/
Allow: /
Crawl-delay: 5