userAgent = Request.ServerVariables("HTTP_USER_AGENT")
'############### Spider
If inStr(userAgent,"bot") > 0 or _
inStr(userAgent,"perl") > 0 or _
inStr(userAgent,"java") > 0 or _
inStr(userAgent,"libw") > 0 or _
inStr(userAgent,"crawl") > 0 or _
inStr(userAgent,"DA ") > 0 or _
inStr(userAgent,"msn") > 0 or _
inStr(userAgent,"google") > 0 or _
inStr(userAgent,"download") > 0 then
Response.Redirect "spider_site.asp"
end if
put this in the top of inc_header.asp
ich finds genial... bei uns ist es ratzekuz dunkel und bei dene alle heller nachmittag
quote:need to reduce memory consumptions on my servers
I would have thought redirecting them to another page would increase the usage ?
Depends ; if post.asp takes 100 kilobyte bandwidth, and 0,2 seconds of CPU time, and the page you redirect them to takes 100 bytes of bandwidth and 0,00001 second of CPU time, you're saving resources.
lsakizada ; you should indeed not use it in inc_header.asp, but in each page you wish to block. If you put it in inc_header.asp all spider traffic will be redirected, and that's not what you want.
Topic Locked
Posted - 07 February 2006 : 05:34:54
