Snitz Forums 2000
Snitz Forums 2000
Home | Profile | Register | Active Topics | Members | Search | FAQ
Username:
Password:
Save Password
Forgot your Password?

 All Forums
 Help Groups for Snitz Forums 2000 Users
 Help: General / Classic ASP versions(v3.4.XX)
 Google Indexing and Snitz Forums
 New Topic  Topic Locked
 Printer Friendly
Author Previous Topic Topic Next Topic  

wildfiction
Junior Member

167 Posts

Posted - 03 May 2005 :  12:09:14  Show Profile  Visit wildfiction's Homepage
If I use Google to search on the two words "acetrades" and "fraud" it comes up with a this in the second position (will obviously have changed by the time you search and that's why I've pasted it here):

E-mini Futures Day Trading Online - Active Topics... by: guy Jump to Last Post. New Posts, Ace Trades - www.acetrades.com ... New Posts, Fight Fraud, guy, 0, 15, 04/21/2005 05:19:36 ...
emini.deltat1.com/forum/active.asp - 62k - Cached - Similar pages

Google has indexed the active.asp page in my forum and so when you click the link it doesn't go to the topic that it should go to. Anyway around this? Basically need to make sure that Google links to the topic with the parameters like this:
emini.deltat1.com/forum/topic.asp?TOPIC_ID=121

instead of like this:
emini.deltat1.com/forum/active.asp

Thanks.

Podge
Support Moderator

Ireland
3776 Posts

Posted - 03 May 2005 :  12:18:20  Show Profile  Send Podge an ICQ Message  Send Podge a Yahoo! Message
Edit your robots.txt file to prevent their robot from indexing active.asp
You cannot force the robot to index topic.asp

http://www.searchengineworld.com/robots/robots_tutorial.htm

Podge.

The Hunger Site - Click to donate free food | My Blog | Snitz 3.4.05 AutoInstall (Beta!)

My Mods: CAPTCHA Mod | GateKeeper Mod
Tutorial: Enable subscriptions on your board

Warning: The post above or below may contain nuts.
Go to Top of Page

wildfiction
Junior Member

167 Posts

Posted - 08 May 2005 :  08:04:13  Show Profile  Visit wildfiction's Homepage
Podge, Do you not think that it would be better to have Google index that (the wrong) page rather than not index it at all? That way the user can then find the search feature in the forum and redo the search from there?
Go to Top of Page

Podge
Support Moderator

Ireland
3776 Posts

Posted - 08 May 2005 :  09:03:39  Show Profile  Send Podge an ICQ Message  Send Podge a Yahoo! Message
I thought you didn't want google to index your active.asp page. Obviously the more link in google you have the better. If you give google some time it will probably index the topic as well as the active.asp page.

You could try this - http://www.snitzbitz.com/mods/details.asp?Version=All&mid=40

Podge.

The Hunger Site - Click to donate free food | My Blog | Snitz 3.4.05 AutoInstall (Beta!)

My Mods: CAPTCHA Mod | GateKeeper Mod
Tutorial: Enable subscriptions on your board

Warning: The post above or below may contain nuts.
Go to Top of Page

wildfiction
Junior Member

167 Posts

Posted - 12 May 2005 :  09:20:18  Show Profile  Visit wildfiction's Homepage
Thanks Podge - I've just installed it and run it and it "processed a bunch of topics" - what exactly did it do?
Go to Top of Page

Mur
Zapped Profile

24 Posts

Posted - 14 May 2005 :  12:15:34  Show Profile  Visit Mur's Homepage
quote:
Originally posted by wildfiction

Thanks Podge - I've just installed it and run it and it "processed a bunch of topics" - what exactly did it do?



That mod should have placed a simple copy of the subject line in a folder called /Topics/ if it was setup correctly. Then it links to another page that will redirect and show the topic.

One style of the mod should create a link page for robots to follow. Trick is to place a link inside your header and footer that is the same as the background color so it's not clicked on much by visitors but robots can find it.

Your files should be located in a folder like:
http://www.mursplace.com/topics/default.htm

Here you can be really creative and add your META about your site then when you click on a link you can add as much from the post as you would like.
My Test link posted here shows topics and replies added to the search engine pages. (Not that google likes me at all) but on typical sites it works good.
Example: http://www.mursplace.com/topics/88.htm
Shows some information about the post and then redirects you to the actual post.

Here's another example of a robots index page

http://www.mursplace.com/robots.asp

(This mod is on snitzbliz.com Robots Mod I think. )

the link is next to my logo and to the right of my footer ad I just use font color same as background color so spiders see it and visitors don't.

Hope this gives you some good info on just what that mod you installed does. (If you did create the topics folder)



Go to Top of Page

wildfiction
Junior Member

167 Posts

Posted - 14 May 2005 :  15:43:11  Show Profile  Visit wildfiction's Homepage
Thanks Mur.

I'm still surfing around your site at the moment trying to get a feel of how you've done this.

What still confuses me is that the SE's need help correctly indexing the topics. It's a fairly natural human progression to navigate from the top down to each topic and I would imagine that the SE's would do the same and correctly index the text according to each page.

I think what was confusing me was that the active.asp page will change from day to day and that, as Podge pointed out, perhaps I shouldn't be letting the SE's index it.

I'll carry on surfing your site until I get the gist of it.

Many thanks for your careful explanation and the help.
Go to Top of Page

-gary
Development Team Member

406 Posts

Posted - 14 May 2005 :  16:29:53  Show Profile
quote:
Originally posted by Mur

Trick is to place a link inside your header and footer that is the same as the background color so it's not clicked on much by visitors but robots can find it.


Put it inside this: <div style="text-indent: -9999px;"></div>

Only robots, text readers and pre 4.0 browsers will see it.

KawiForums.com


Go to Top of Page

Mur
Zapped Profile

24 Posts

Posted - 14 May 2005 :  18:54:31  Show Profile  Visit Mur's Homepage
Search engines are strange at times.
They don't pick a random entry page but they do follow links.

What I have found which may apply here is bots pick links within the entry page they take.
So if you have a Robots.txt file they will open that read what not to search then go from there.

User-agent: *
Disallow: /nav
Disallow: /cgi-bin
Disallow: active_users.asp
Disallow: my_private.asp
etc.

Then what I see from my stat reports they pick a few links to follow then store other links for when they come back.

If you think of your site as an endless loop you can make the bot return often even if your content doesn't update much.
I take out external links from the header like external banner ads. I've have tracked bots that enter the main site page only to follow the banner ad link right away.
I use inside banners so the links return to different sections.
Then if you place a hidden link (I like Gary's method above) it will index that. Also a fun way to get things indexed is to name your images long content maybe 255 characters of descriptive content. alt="...". Place a couple small image links with only 1x1.gif size in the header and footer. bots will read the image name and if you link it they will follow it as well. Doesn't slow down you load time with 1x1 image either.

Without getting into each and every detail your best bet is to take your Adsense and place it at the bottom of your page. Above and below your Google ads place your topics/default.htm page link and some image linked to your topics index page. Do the same at the top.
Above or to the right of your logo is where I would place another link to your topics pages. Pick a full link to a topic that you think is of interest and use it in one of your robot trap links.

In your forum.asp page remove all external links (including google or place it at the bottom but repeat the bot trap links above and below it. I use the word "advertisement" above and below google ads and link to my ads.

The rule is to feed the bot with links within your site so if it only stays for a few minutes it can store several return links to continue searching.

I think I'm getting off topic now.
Disallow pages policy.asp, register.asp, members.asp etc.
then feed the bot with topic links.

Good luck.

Side Note for users that have the Events Calendar load at the bottom of forum pages.
(Ask the forum users that have cal.asp (the events mod) at the bottom or top of every forum page how many entry and exit hits show in their stats for Search Bots. I had google for months returning daily indexing calendar events dates from 1901 to 2026. That stopped completely when I placed disallow: cal.asp in the robots.txt and place the bot traps above and below the cal.asp page.)
SE's are blind and need to be directed.

Go to Top of Page

hellind
Junior Member

Singapore
123 Posts

Posted - 15 May 2005 :  02:45:38  Show Profile
Hey Mur, what is the script that created the topics/default.htm?

I think this is the vital link for the Topic AddOn Mod.

Go to Top of Page

Mur
Zapped Profile

24 Posts

Posted - 17 May 2005 :  04:38:52  Show Profile  Visit Mur's Homepage
The Topic Maker:
Author David
http://www.snitzbitz.com/mods/details.asp?Version=All&mid=40

It's listed as a 3.4.01 mod but I have it loaded on 3.4.05 and works fine.

You will have to edit the code to fit your site.

Go to Top of Page

wildfiction
Junior Member

167 Posts

Posted - 17 June 2005 :  05:48:50  Show Profile  Visit wildfiction's Homepage
How about using Google Sitemaps as described here to resolve this problem:

http://forum.snitz.com/forum/topic.asp?TOPIC_ID=58563
http://www.headvert.com/random/topic.asp?TOPIC_ID=31

Go to Top of Page

hellind
Junior Member

Singapore
123 Posts

Posted - 22 July 2005 :  13:27:44  Show Profile
Does anyone of you guys have your forums indexed by Search engines?

For e.g. when I search for "I think this is the vital link for the Topic AddOn Mod" quoted from the reply two post above, in google, it returns nil.

Go to Top of Page

MarcelG
Retired Support Moderator

Netherlands
2625 Posts

Posted - 22 July 2005 :  15:04:45  Show Profile  Visit MarcelG's Homepage
Yep ; some examples of hits:
http://www.google.com/search?hl=en&lr=&safe=off&c2coff=1&q=marcelg
http://www.google.com/search?hl=en&lr=&safe=off&c2coff=1&q=compleet+nederlands


portfolio - linkshrinker - oxle - twitter
Go to Top of Page
  Previous Topic Topic Next Topic  
 New Topic  Topic Locked
 Printer Friendly
Jump To:
Snitz Forums 2000 © 2000-2021 Snitz™ Communications Go To Top Of Page
This page was generated in 0.5 seconds. Powered By: Snitz Forums 2000 Version 3.4.07