T O P I C R E V I E W |
endomorph |
Posted - 17 February 2006 : 17:17:34 Can anyone help me please and sorry if I have posted in the wrong forum.
I am sure that in the past there was a MOD to allow SE spiders into private forums so they could still be spidered.
It was either a code modification or instructions on how to set up a membership for each spider.
Can anyone enlighten me as I want to lock some of my forums down but I still want them spidered.
Cheers all. < |
15 L A T E S T R E P L I E S (Newest First) |
endomorph |
Posted - 20 February 2006 : 08:38:04 Thanks Podge your the don ! OK now if I may, a little extension to your code.
On my site I have removed the IQC field from everywhere and am using it to mark members as "Paid" if they have donated. Now I want to allow those members into certain forums that I lock off. To save adding each paid member to each locked off forum's "Allowed Members" list, I want to use the ICQ field.
How would you do this in inc_func_secure ?
If viewer is not signed in, give them error page If viewer is signed in and has 'Paid' in the ICQ field, then chkForumAccess = true end if end if
Cheers< |
endomorph |
Posted - 20 February 2006 : 08:28:24 Thanks Podge worked a treat< |
MarkJH |
Posted - 18 February 2006 : 14:23:05 Hehe. < |
Podge |
Posted - 18 February 2006 : 12:13:52 Intellitext, Yahoo Ads, Clicksor, etc.
Mum's the word.< |
MarkJH |
Posted - 18 February 2006 : 12:07:14 Lord Mark at your service. < |
Podge |
Posted - 18 February 2006 : 10:30:20 I'm not sayin' nothin.< |
MarkJH |
Posted - 18 February 2006 : 09:45:14 quote: Care to share some of those legitimate reasons with me Sir Podge?
Google Adsense?< |
Podge |
Posted - 18 February 2006 : 04:59:41 Yes.< |
Davio |
Posted - 18 February 2006 : 03:22:42 You mean, Firefox Podge, don't you? < |
Podge |
Posted - 17 February 2006 : 21:30:16 The only way to find out is to try. You can get an extension for Firefocks which will allow you to change the user agent. Its called User Agent Switcher (funnily enough).< |
endomorph |
Posted - 17 February 2006 : 19:09:06 Podge,
OK I will give yours a try, but I was thinking maybe somethine like this taken from topic.asp -
userAgent = Request.ServerVariables("HTTP_USER_AGENT")
If inStr(userAgent,"bot") > 0 then
chkForumAccess = true
elseif mLev = 4 then
AdminAllowed = 1
ForumChkSkipAllowed = 1
elseif mLev = 3 then
if chkForumModerator(Forum_ID, chkString(strDBNTUserName,"decode")) = "1" then
AdminAllowed = 1
ForumChkSkipAllowed = 1
else
if lcase(strNoCookies) = "1" then
AdminAllowed = 1
ForumChkSkipAllowed = 0
else
AdminAllowed = 0
ForumChkSkipAllowed = 0
end if
end if
elseif lcase(strNoCookies) = "1" then
AdminAllowed = 1
ForumChkSkipAllowed = 0
else
AdminAllowed = 0
ForumChkSkipAllowed = 0
end if
end if
Red code is original, green code is new. Would this work ? Maybe not as secure as yours.< |
Podge |
Posted - 17 February 2006 : 18:50:43 This is untested but it should give you a starting point. Don't hold me responsible if its not secure or if someone finds a way around it.
Add the following after the line in red on inc_func_secure.asp
function chkForumAccess(fForum, UserNum, Display)
if (left(Request.ServerVariables("HTTP_USER_AGENT"), 6) = "Google") and & _
(Request.ServerVariables("REMOTE_ADDR") > Dot2LongIP("127.0.64.1") AND & _
Request.ServerVariables("REMOTE_ADDR") < Dot2LongIP("127.0.79.254") then
chkForumAccess = true
exit function
end if
You can alter the user agent bit above to suit your needs and you'll need to find out the i.p. addresses of the bots you want to allow.
Put the following function somwhere on inc_func_secure.asp
Function Dot2LongIP (ByVal DottedIP)
Dim i, pos
Dim PrevPos, num
If DottedIP = "" Then
Dot2LongIP = 0
Else
For i = 1 To 4
pos = InStr(PrevPos + 1, DottedIP, ".", 1)
If i = 4 Then
pos = Len(DottedIP) + 1
End If
num = Int(Mid(DottedIP, PrevPos + 1, pos - PrevPos - 1))
PrevPos = pos
Dot2LongIP = ((num Mod 256) * (256 ^ (4 - i))) + Dot2LongIP
Next
End If
End Function < |
endomorph |
Posted - 17 February 2006 : 18:32:28 It's the loss of pages in the SERPS that would be a bigger killer for me. I also need Adsense Mediabot to still go in to make sure the ads remain on target.
Anyway chaps, back to the coding. Could I use this as a basis to start with -
userAgent = Request.ServerVariables("HTTP_USER_AGENT")
'############### Spider If inStr(userAgent,"bot") > 0 or _ inStr(userAgent,"perl") > 0 or _ inStr(userAgent,"java") > 0 or _ inStr(userAgent,"libw") > 0 or _ inStr(userAgent,"crawl") > 0 or _ inStr(userAgent,"DA ") > 0 or _ inStr(userAgent,"msn") > 0 or _ inStr(userAgent,"google") > 0 or _ inStr(userAgent,"download") > 0 then
< |
Davio |
Posted - 17 February 2006 : 18:30:15 Sounds like it is more ideal to have a mod that pulls a sentence or 2 randomly from topics in your private forums and display them prominently somewhere public.
Or to pull the title of the topics and display them publicly, so you could entice them. Isn't there a mod that displays part of the title of the last topic in a forum on the default.asp page? Mosuing over it would display the full title in a caption.
That could be used to entice persons to join up. Just some ideas anyway. < |
endomorph |
Posted - 17 February 2006 : 18:25:15 If I stop the search engines from spidering the forums, I would loose around 2000 pages in the serps.
I am using the logic of "People are nosey and want to know what is behind a closed door" to help with donations on my site. The information is interesting, not confidential/secure. Besides, most of my users are not savvy enought to realise they they view a cache of the page.< |