Snitz Forums 2000
Snitz Forums 2000
Home | Profile | Register | Active Topics | Members | Search | FAQ
Username:
Password:
Save Password
Forgot your Password?

 All Forums
 Community Forums
 Community Discussions (All other subjects)
 Trouble getting Google to list site
 New Topic  Topic Locked
 Printer Friendly
Previous Page
Author Previous Topic Topic Next Topic
Page: of 3

StephenD
Senior Member

Australia
1044 Posts

Posted - 07 August 2005 :  19:36:55  Show Profile  Send StephenD a Yahoo! Message
I'm going through the site access logs and the googlebot has been visiting almost every day with the last visit on Saturday just gone. The pages that get crawled are urllist.txt, robots.txt and index.asp most of the time. Back on the 18th July it looks like it crawled a few other pages. My robots.txt file looks like this:
USER-AGENT: *
Disallow: /secure/
Disallow: /pasword.asp
Disallow: /Privacy.asp

My urllist.txt looks like this:
http://www.staffcheck.com.au/index.asp priority=1.0 changefreq = 'monthly'
http://www.staffcheck.com.au/vetting.asp priority=0.9 changefreq = 'monthly'
http://www.staffcheck.com.au/clearance.asp priority=0.8 changefreq = 'monthly'
http://www.staffcheck.com.au/risk.asp priority=0.7
http://www.staffcheck.com.au/about.asp priority=0.6
http://www.staffcheck.com.au/services.asp priority=0.5 changefreq = 'monthly'
http://www.staffcheck.com.au/contact.asp priority=0.4 changefreq = 'monthly'
http://www.staffcheck.com.au/awareness.asp priority=0.3
http://www.staffcheck.com.au/privacy.asp priority=0.1

I'm checking with my host now to see if there is any possible conflicts because I transferred this domain across from another host a few months ago.
Go to Top of Page

StephenD
Senior Member

Australia
1044 Posts

Posted - 07 August 2005 :  19:38:44  Show Profile  Send StephenD a Yahoo! Message
I'm going to strip out all the metatags too which seem to be a waste of time and according to everything I read.
Go to Top of Page

pdrg
Support Moderator

United Kingdom
2897 Posts

Posted - 08 August 2005 :  07:32:05  Show Profile  Send pdrg a Yahoo! Message
metatags were a great idea abused by greedy pay-per-click merchants...not unlike SMTP/email, but we don't have a choice about email yet...
Go to Top of Page

Ghostnetworks
New Member

95 Posts

Posted - 09 August 2005 :  05:54:22  Show Profile  Visit Ghostnetworks's Homepage
Why don't you add it to your "Cool Links" in your preferences on this forum?
So far, those links are restricted to this thread only.

This board gets tons of traffic and your personal profile will be linked on every post you've ever made.
I actually managed to get a site listed a while back that way.

Go to Top of Page

Shaggy
Support Moderator

Ireland
6780 Posts

Posted - 09 August 2005 :  05:57:30  Show Profile
But Googlebot would not be to access his profile as it's not a member


Search is your friend
“I was having a mildly paranoid day, mostly due to the
fact that the mad priest lady from over the river had
taken to nailing weasels to my front door again.”
Go to Top of Page

StephenD
Senior Member

Australia
1044 Posts

Posted - 09 August 2005 :  06:06:14  Show Profile  Send StephenD a Yahoo! Message
You mean in my Sig? I can do that ...
Go to Top of Page

Ghostnetworks
New Member

95 Posts

Posted - 09 August 2005 :  06:28:55  Show Profile  Visit Ghostnetworks's Homepage
LOL there we go!
It's too bad this board doesn't allow profile views like a lot of others.
Free search engine billboard

Go to Top of Page

pdrg
Support Moderator

United Kingdom
2897 Posts

Posted - 09 August 2005 :  06:34:20  Show Profile  Send pdrg a Yahoo! Message
Maybe we should set up an account for a Mr Google Bot ;-)

just a thought, the 404 redirects could actually work against you if the bot/ranking engine notices they're artificially generated traffic and not from a context-related link...who knows? Certainly not me, but I do know the only value a search business has is the quality and relevence of it's ranking, so beware of getting sandboxed!
Go to Top of Page

StephenD
Senior Member

Australia
1044 Posts

Posted - 09 August 2005 :  07:50:08  Show Profile  Send StephenD a Yahoo! Message
Ok, metatags are gone, Shadownetworks, thank you for your assistance but if you could please stop redirecting your 404 traffic for the time being at least. I really appreciate all your advice and help guys. I'm going to give it another 5 weeks and then all bets are off...I'll turn the mail server into a spam engine if I have to!!
Go to Top of Page

Ghostnetworks
New Member

95 Posts

Posted - 11 August 2005 :  11:25:23  Show Profile  Visit Ghostnetworks's Homepage
You're welcome.

quote:
Originally posted by StephenD

Shadownetworks

Dang! I should have taken up that name instead

Oh well, I guess I'm stuck with what I have now.
Okie, the redirects have been taken down. You shouldn't be getting any more traffic from 404/401s.

edit_
You know that redirect was probably a bad idea...
Last I checked, I get several thousand 404 hits a month and I don't know how that affected your traffic stats.
There are a lot of users that move files/directories around and its very difficult to coordinate user files because of this.

edit, edit_
Woah...
There's already another "StaffCheck" listed. And first list too.
http://www.google.com/search?hl=en&q=staffcheck

This could complicate things a bit.


Edited by - Ghostnetworks on 11 August 2005 11:34:31
Go to Top of Page

StephenD
Senior Member

Australia
1044 Posts

Posted - 20 August 2005 :  01:49:33  Show Profile  Send StephenD a Yahoo! Message
Well finally Google listed the site yesterday. Middle of the page for worldwide searches of "Staff Check" or "Staffcheck" and top of the list for searches in Australia only. Fantastic! Thanks to everyone who helped and offered advice.
Go to Top of Page

pdrg
Support Moderator

United Kingdom
2897 Posts

Posted - 22 August 2005 :  03:28:55  Show Profile  Send pdrg a Yahoo! Message
Woohoo!! Bit of a rush when you're finally 'real', isn't it!

Nice one mate, congratulations :D
Go to Top of Page

Doughnut
Starting Member

United Kingdom
40 Posts

Posted - 18 March 2006 :  06:09:53  Show Profile  Visit Doughnut's Homepage
Ello,
Looks like some really useful stuff here, I'll have a good look through the resources mentioned....

Does anyone know if these site submission people are of any use, you know the ones that tell you they can get your site top listed in the major search engines for whatever fee they charge?

As well as my own site I run a tiny one for a local shop and feel I'm letting em down with the poor search engine rankings, is it better to just check out all the info here or has anyone found that these submission firms work?

Thanks
Go to Top of Page
Page: of 3 Previous Topic Topic Next Topic  
Previous Page
 New Topic  Topic Locked
 Printer Friendly
Jump To:
Snitz Forums 2000 © 2000-2021 Snitz™ Communications Go To Top Of Page
This page was generated in 0.3 seconds. Powered By: Snitz Forums 2000 Version 3.4.07