| Author |
 Topic  |
|
dabugster
Junior Member
USA
168 Posts |
 Posted - 08 May 2005 : 22:15:04
|
Cool ... i got it.
I will try to put it up on my board later to see if it works better.
Thanks a lot!
|
 |
|
|
samyot
Junior Member
Canada
242 Posts |
|
|
hellind
Junior Member
Singapore
123 Posts |
Posted - 10 May 2005 : 12:56:30
|
I emailed AspWiz and no reply.
He had asked Chuck to take over, why dont' Chuck take the honours and email AspWiz? :) |
|
|
|
dabugster
Junior Member
USA
168 Posts |
Posted - 18 May 2005 : 10:33:10
|
Has anyone else used this:
ASP Stats Generator
It is a free stats generator, and while it does not tell you if the visitor is a spider or not, it does tell you the browser and OS. Even some really new ones.
Any one know how to implement this system in to this spider mod?
It uses some XML pages but i fugure someone with more ASP expierience that i might be able to adapt it.
I have been trying to play around with it, to no avail.
Mine is getting to where there are too many 'Unknown System'and 'Unknown User Agent'
And everyone is a visitor, even when it says, 'Inktomi.com'
It has been driving me crazy lately and no matter what i try it seem like it never works right.
|
|
|
|
hellind
Junior Member
Singapore
123 Posts |
Posted - 27 May 2005 : 08:27:45
|
Basically we have to use the built-in list.
So delete
AgentCSVStr = Application("AUCACHE")
If Application("AUDataLastCached") <> "" or request.querystring("mode") = "reset" Then
If CDate(Application("AUDataLastCached")) < now()-2 or request.querystring("mode") = "reset" Then 'Update Cache every 2 days
DoCache()
else
AgentCSVStr = Application("AUCACHE")
end if
else
DoCache()
end if
And whenever you get the email, you update the list yourself.
|
|
|
|
dabugster
Junior Member
USA
168 Posts |
Posted - 27 May 2005 : 12:12:03
|
Cool!!!!!
That worked!
Thank you hellhind, i was getting so sick of everyone being a guest all the time and all that unknow system and browser.
It works perfect now.
I have been getting like 25 emails a day and i try to add them where i think i should, but just to be sure, when i get these emails:
New User Agent Reported by: Ratdaddyvince.com Forum ( http://www.ratdaddyvince.com )
User Agent String = "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
User Agent IP: 68.142.250.11
Script date: 21.10.2004
User Agent Update Location: http://www.dotmagic.co.uk/activeuseragents.htm
User Agent Update Info: :: <span style="background-color:red; color:white; padding:2px;">ASP Script Update is available. <a href="">Click Here.</a> </span>
What part of that do i add and where?
Here is a link to my active_users.asp page:
http://www.ratdaddyvince.com/forum/active_users.txt |
|
|
|
hellind
Junior Member
Singapore
123 Posts |
Posted - 27 May 2005 : 13:52:04
|
From your email, the useragent is
"Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
And the format of AgentCsvStr has three parts seperated by ||.
Useragent-to-match || Site || System
Therefore you should another line to AgentCsvStr, if it doesn't exist already:
"Yahoo! Slurp||YAHOO||SEARCH ENGINE SPIDER" & vbcrlf & _
PS: "Yahoo! Slurp" matches the UA string, so it is a hit.
YAHOO || SEARCH ENGINE SPIDER can be anything you want it displayed.
|
|
|
|
hellind
Junior Member
Singapore
123 Posts |
|
|
dabugster
Junior Member
USA
168 Posts |
Posted - 27 May 2005 : 14:30:22
|
I added those like that cause i didn't know what i was supposed to add.
Now that you explained it to me, i changed the list to the one in that link you posted.
Now will it still email me when there is a crawler on my site that isn't in the list?
|
|
|
|
hellind
Junior Member
Singapore
123 Posts |
Posted - 28 May 2005 : 01:41:32
|
It is emailing you because you need to use the builtin list, and not the list by ASPWIZ.
You delete this as was instructed before.
AgentCSVStr = Application("AUCACHE")
If Application("AUDataLastCached") <> "" or request.querystring("mode") = "reset" Then
If CDate(Application("AUDataLastCached")) < now()-2 or request.querystring("mode") = "reset" Then 'Update Cache every 2 days
DoCache()
else
AgentCSVStr = Application("AUCACHE")
end if
else
DoCache()
end if
|
|
|
|
dabugster
Junior Member
USA
168 Posts |
Posted - 28 May 2005 : 02:02:31
|
Well it is working now so that is all that matters to me i guess.
Thanks Bro
BUG
|
|
|
|
dabugster
Junior Member
USA
168 Posts |
Posted - 31 May 2005 : 10:38:27
|
I found a new spider.
Become.com's BecomeBot
Here is the code i added for it:
"Anonymization.Net||Anonymous Web Surfing||WEB ANONYMYZER" & vbcrlf & _
"BecomeBot/2.||Become.com||SEARCH ENGINE SPIDER" & vbcrlf & _
"lmspider||lmspider lmspider@scansoft.com||Speech Recognition Research Bot"
then
if instr(ua, "WebCrawler") then strBrowser = "Webcrawler.com"
if instr(ua, "wombat") then strBrowser = "Web Wombat"
if instr(ua, "BecomeBot/2.") then strBrowser = "BecomeBot.com"
then
elseif instr(ua, "FreeBSD") then
strSystem = "FreeBSD"
elseif instr(ua, "BecomeBot/2.") then
strSystem = "SEARCH ENGINE SPIDER"
else
strSystem = "<span title=""" & ua & """>Unknown System</span>"
end if
|
|
|
|
dabugster
Junior Member
USA
168 Posts |
|
|
Topic |
|
Topic Locked
