User-agent: * Disallow: /secret/ Crawl-delay: 5 Allow: /docs/
Robots.txt is NOT a challenge! It's just a friendly suggestion from 1999!
If you see this message, you found our SECRET easter egg! Try typing /secret/ in your browser!
User-agent: * Disallow: /secret/ Crawl-delay: 5 Allow: /docs/
Robots.txt is NOT a challenge! It's just a friendly suggestion from 1999!
If you see this message, you found our SECRET easter egg! Try typing /secret/ in your browser!