GtaSixToolsBot
GtaSixToolsBot reads public RSS feeds and, where allowed, article pages, to find news about GTA VI. Its full name is GtaSixToolsBot/1.0 (+https://gtasix.tools/robot/).
- It follows robots.txt, on every request and every redirect.
- It leaves at least 1.5 seconds between two requests to the same host, and backs off for an hour or more when a server asks it to slow down.
- It stores titles, short feed summaries, links and dates. Page text stays in memory and is never saved.
- It does not run scripts and does not try to get past a paywall.
To block it, add User-agent: GtaSixToolsBot and Disallow: / to your robots.txt. To reach us, use the contact page.