I’ve been working on a little side project for the last couple days: NaughtyBot. This Chrome extension allows you to quickly and easily browse the contents of robots.txt ‘Disallow’ directives, and check the HTTP status of each path. This can be a fun way to find hidden site functionality, poorly designed security through obscurity, or […]