Amazonbot is finally respecting robots.txt

Posted 15 hours ago by xena
158 points

https://xeiaso.net/notes/2026/amazonbot-respecting-robots-txt/

12 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..