Yandex.ru spiders are known of disobeying robots.txt. In Apache, you can disable yandex in htaccess file. How can I do the same thing with Tomcat? I'm using ubuntu server, so I thoght about appropriate entries in hosts.deny, but I'm not sure if
ALL: yandex.ru
will be sufficient and efficient, cause bot's are often named like spider31.yandex.ru. Could you show example of blocking this bots via hosts.deny (or any other way)?