Welcome Guest.   Make a donation to an author on the site September 20, 2014, 11:02:53 AM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.


You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
Free DonationCoder.com Member Kit: Submit Request.
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
Pages: Prev 1 [2]   Go Down
  Reply  |  New Topic  |  Print  
Author Topic: For what it's worth, DC Homepage is now google PageRank 6  (Read 13962 times)
mahesh2k
Supporting Member
**
Posts: 1,408



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #25 on: February 16, 2011, 03:27:29 PM »

If you want to avoid search results then just block

Quote
Disallow: /Forums/bb/index.php?action=search

I don't see any good reasons for blocking plenty of other pages where google should crawl. e.g.

Quote
/forum/index.php?action=recent
/forum/index.php?action=recentdense

I'll check with SMF docs or forums which robots.txt settings members prefer to avoid this problem.
Logged
JavaJones
Review 2.0 Designer
Charter Member
***
Posts: 2,537



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #26 on: February 16, 2011, 04:37:17 PM »

I assume mouser that you didn't really change the robots.txt with the move anyway, so that's probably not the explanation. Yes?

- Oshyan
Logged

The New Adventures of Oshyan Greene - A life in pictures...
mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #27 on: February 16, 2011, 06:09:24 PM »

Quote
I assume mouser that you didn't really change the robots.txt with the move anyway, so that's probably not the explanation. Yes?

very good point -- although i have played with it a little bit since the move, those disallows were mostly all there before and it didn't affect anything.

Quote
/forum/index.php?action=recent
/forum/index.php?action=recentdense

again these are pages that have lists of posts.. i suppose it wouldn't hurt to let the spider go to these pages, its just that it makes no sense indexing them since they change their content every day and just provide alternate ways to get to other pages that can be easily traversed by viewing forum pages from the board index.  though maybe it makes sense to let the spider go to those pages and just put meta tags on them to tell the spider not to save the contents of those pages in their indices.
Logged
mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #28 on: February 17, 2011, 02:51:37 PM »

I found some interesting settings in the webmaster tools site for donationcoder.com, not sure how they got this way, OR if they have any impact, but given that the topic parameter is what signifies what page of forum posts the user is reading, it seems kind of important.



I've changed them, lets' see if it has any effect.  Of course because this is google there is no way to get a straight answer about if it will have an effect, how long it will take to see any change, etc.
Logged
timns
Supporting Member
**
Posts: 1,209



Veni, vidi, debuggi

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #29 on: February 17, 2011, 02:59:41 PM »

Maybe we were hacked by some competing forum!  ohmy
Logged

mahesh2k
Supporting Member
**
Posts: 1,408



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #30 on: February 17, 2011, 03:26:36 PM »

That looks like parameters from the robots.txt. Google is allowing us to manually set priority to the crawled content. Now you can decide what to let in or out. Except 'search', all other pages should be let google decide.
Logged
mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #31 on: February 19, 2011, 02:33:32 PM »

Just to confirm, after the server move at the end of december, we did basically completely lose all forum search engine traffic, resulting in a loss of about half of our traffic.  And it has not improved in the two months since then.

Take that as a warning if you ever have a website and consider moving content.

Google is the almighty god and if you somehow manage to upset it, you will never know why or how to fix, you will just be punished swiftly and silently.
Logged
jgpaiva
Global Moderator
*****
Posts: 4,710



Artificial Idiocy

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #32 on: February 19, 2011, 07:07:52 PM »

Are things getting better? From what I understand, it has only indexed at least one recent topic: http://www.google.com/sea...&prmd=ivns&tbas=0 (although I think it only indexed this one topic)
Logged

mahesh2k
Supporting Member
**
Posts: 1,408



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #33 on: February 20, 2011, 03:04:38 AM »

Mouser, i moved my website on 12th december from psychz network to hostgator. I didn't lost  traffic on any of my sites. It doesn't look like issue of downtime to me at all. In case of Doco, this is robots.txt issue which google will now resolve over period of time. By the way, do read post on google webmaster about planned downtime.
Logged
mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #34 on: February 24, 2011, 07:29:39 PM »

A week or two after i submitted a request to google to "re-index the site" here is the response i just got.

You have to love the deliberate obfuscation, deniability, and general deliberate doubletalk fog of the reply:

Quote
We received a request from a site owner to reconsider how we index the following site: http://www.donationcoder.com/.
We've now reviewed your site. When we review a site, we check to see if it's in violation of our Webmaster Guidelines. If we don't find any problems, we'll reconsider our indexing of your site. If your site still doesn't appear in our search results, check our Help Center for steps you can take.

So..

In other words they've reviewed the site and checked to see if its in violation or if there are any problems.  But they don't feel like telling us if they found any problems.  And therefore they might or might not eventually reconsider re-indexing the site at some point in the future.  And if they do or don't decide to do this, that's their little secret -- and we should go search the web one day if we eventually come to the conclusion that enough time has passed that something should have changed.

Google -- proof that when you get big enough, you just don't have to give a f*ck about people.
« Last Edit: February 24, 2011, 07:36:40 PM by mouser » Logged
timns
Supporting Member
**
Posts: 1,209



Veni, vidi, debuggi

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #35 on: February 24, 2011, 09:28:21 PM »

I did a few google searches for pretty recent posts, and I'm getting hits now - this is good, right?
Logged

JavaJones
Review 2.0 Designer
Charter Member
***
Posts: 2,537



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #36 on: February 25, 2011, 12:53:21 AM »

I agree, that's a pretty crappy response. In general I do find Google's "support" to be pretty bad. They pretty much put stuff out there in whatever condition it's in and the best you can do is hope it works. If it doesn't, you generally can't expect to talk to anyone, much less ever find out why, or IF it might be fixed, nevermind *when*. That being said, I wonder if there are some legal issues in terms of search and "fairness" that make them want to stick to vague responses.

- Oshyan
Logged

The New Adventures of Oshyan Greene - A life in pictures...
mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #37 on: February 25, 2011, 12:56:19 AM »

After a few miscellaneous changes, it looks like dc is starting to have some of the sitemap urls picked up, thats a good sign.

And it looks like google is *finally* starting to listen to our sitemap at least a little:


ps. i posted this in wrong thread, im moving it now.
« Last Edit: February 26, 2011, 05:33:37 AM by mouser » Logged
jgpaiva
Global Moderator
*****
Posts: 4,710



Artificial Idiocy

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #38 on: March 13, 2011, 07:44:57 PM »

Looks like this is fixed, right? I can see results in google for stuff posted yesterday.
On a related note, how's the pagerank now?
Logged

app103
That scary taskbar girl
Global Moderator
*****
Posts: 5,210



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #39 on: March 14, 2011, 02:12:29 AM »

On a related note, how's the pagerank now?

Forum still has no page rank.  Sad
Logged

mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #40 on: March 14, 2011, 02:15:46 AM »

It may be a long time still before we get our page rank back, or not -- only google knows and they don't tell us lowly mortals what they do or why.

But at least the urls are gradually being picked up from the sitemap, and new threads seem to be indexed very quickly now, within hours, so that's the really important thing.  (when and whether google actually ranks our results high on the page i do not know).

PageRank can go F* itself.
« Last Edit: March 14, 2011, 02:17:44 AM by mouser » Logged
jgpaiva
Global Moderator
*****
Posts: 4,710



Artificial Idiocy

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #41 on: March 14, 2011, 04:40:53 AM »

smiley ok!
Logged

mouser
First Author
Administrator
*****
Posts: 33,369



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #42 on: March 30, 2011, 09:17:08 PM »

We are now up to 50% coverage of the sitemap (the sitemap in question basically represents 25,000 most recent forum threads) and forum posts are now in google an hour or two after they are posted, which is actually pretty darn impressive on google's part.  And sitemap coverage has been going up daily .

We became almost invisible there for a while, but it seems like people should be able to find our forum content pretty well now when they do a web search, and it's only getting better.  And that's a good thing thumbs up
Logged
jgpaiva
Global Moderator
*****
Posts: 4,710



Artificial Idiocy

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #43 on: March 31, 2011, 07:02:15 AM »

Glad to know that!

Thanks for keeping us up to date on this!  Thmbsup
Logged

Pages: Prev 1 [2]   Go Up
  Reply  |  New Topic  |  Print  
 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.043s | Server load: 0.26 ]