web crawler

罕见的网络爬虫

看网站LOG信息有奇怪的东西混入: 130.211.147.7 - - [23/Nov/2014:15:36:20 +0000] "GET / HTTP/1.0" 200 18701 "-" "NerdyBot" 107.22.83.14 - - [23/Nov/2014:15:13: