Amazonbot is finally respecting robots.txt
1 min read
Article URL: https://xeiaso.net/notes/2026/amazonbot-respecting-robots-txt/
Comments URL: https://news.ycombinator.com/item?id=48140730
Points: 3
# Comments: 0
1 min read
Article URL: https://xeiaso.net/notes/2026/amazonbot-respecting-robots-txt/
Comments URL: https://news.ycombinator.com/item?id=48140730
Points: 3
# Comments: 0