| Author |
 Topic  |
|
|
JBaldwin
Junior Member
USA
137 Posts |
 Posted - 02 August 2006 : 20:12:55
|
I went through and reinstalled IP Gate today. Everything is working fine. I blocked a test account (via Username Block not IP Ban). However. I have a guest that is always on that I want to block, it is from Inktomi and the IP starts with 72.30. so that is what I banned.
However, that IP is still crawling my forum. Any ideas? |
AbsolutelyFreerolls.com - Poker Freeroll Listings, Poker Forum and Poker News
|
|
|
gpctexas
Junior Member
320 Posts |
|
|
HuwR
Forum Admin
United Kingdom
20595 Posts |
Posted - 03 August 2006 : 02:22:25
|
| if it is a bot, try using a robot.txt file to stop it instead |
 |
|
|
JBaldwin
Junior Member
USA
137 Posts |
Posted - 03 August 2006 : 08:29:09
|
Ok. I will try that for sure. I also tried GPCtexas' suggestion as well. When I did that, the bot (Inktomi) is still crawling the site, however, in active users the page it is visiting is showing up as: "Invalid Location". I have redirection turned on to redirect to: inc_banned.asp. I am wondering if this is what the "Invalid Location" is? Here are some screenies:
Active Users Screenshot
IP Gate Logs Screenshot
I am going to go and implement a robot.txt file now to see if that keeps it off the site completely. Thanks for the advice HuwR and GPC.
|
AbsolutelyFreerolls.com - Poker Freeroll Listings, Poker Forum and Poker News
|
|
|
|
Shaggy
Support Moderator
Ireland
6780 Posts |
Posted - 03 August 2006 : 08:38:00
|
Yes, "Invalid Location" would imply that the 'bot is viewing inc_banned.asp as the Active Users Mod will only recognise the base Snitz files.
|
 Search is your friend
“I was having a mildly paranoid day, mostly due to the
fact that the mad priest lady from over the river had
taken to nailing weasels to my front door again.” |
|
|
|
Rocket468
New Member
USA
57 Posts |
Posted - 03 August 2006 : 11:00:15
|
| Just currious why you don't want you site in Yahoo? |
|
|
|
|
JBaldwin
Junior Member
USA
137 Posts |
|
|
RArch
Junior Member
United Kingdom
103 Posts |
Posted - 03 August 2006 : 13:56:21
|
quote:
Originally posted by HuwR
if it is a bot, try using a robot.txt file to stop it instead
As said, a robot.txt file in your root directory may solve your problems.
Try a search in google or likes for "robot.txt" for more info.
|
|
|
|
bobby131313
Senior Member
USA
1163 Posts |
Posted - 03 August 2006 : 14:26:39
|
quote:
Actually, I just dont want the bots crawling the forum. It is crawling member profiles, PM's etc...
It's trying to but it's not. Unless you've given Yahoo a username and password. 
Although it may look like it on the surface, they can't get anywhere an unlogged in user can't.
|
Switch the order of your title tags |
|
|
|
JBaldwin
Junior Member
USA
137 Posts |
|
|
RArch
Junior Member
United Kingdom
103 Posts |
Posted - 03 August 2006 : 19:36:11
|
Ok, it sounded like you were still searching for a solution.
|
|
|
| |
Topic |
|
Topic Locked
