topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Tuesday March 19, 2024, 5:47 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: For what it's worth, DC Homepage is now google PageRank 6  (Read 30594 times)

mahesh2k

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,426
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #25 on: February 16, 2011, 03:27 PM »
If you want to avoid search results then just block

Disallow: /Forums/bb/index.php?action=search

I don't see any good reasons for blocking plenty of other pages where google should crawl. e.g.

/forum/index.php?action=recent
/forum/index.php?action=recentdense

I'll check with SMF docs or forums which robots.txt settings members prefer to avoid this problem.

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,739
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #26 on: February 16, 2011, 04:37 PM »
I assume mouser that you didn't really change the robots.txt with the move anyway, so that's probably not the explanation. Yes?

- Oshyan

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #27 on: February 16, 2011, 06:09 PM »
I assume mouser that you didn't really change the robots.txt with the move anyway, so that's probably not the explanation. Yes?

very good point -- although i have played with it a little bit since the move, those disallows were mostly all there before and it didn't affect anything.

/forum/index.php?action=recent
/forum/index.php?action=recentdense

again these are pages that have lists of posts.. i suppose it wouldn't hurt to let the spider go to these pages, its just that it makes no sense indexing them since they change their content every day and just provide alternate ways to get to other pages that can be easily traversed by viewing forum pages from the board index.  though maybe it makes sense to let the spider go to those pages and just put meta tags on them to tell the spider not to save the contents of those pages in their indices.

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #28 on: February 17, 2011, 02:51 PM »
I found some interesting settings in the webmaster tools site for donationcoder.com, not sure how they got this way, OR if they have any impact, but given that the topic parameter is what signifies what page of forum posts the user is reading, it seems kind of important.

Screenshot - 2_17_2011 , 2_45_19 PM.png

I've changed them, lets' see if it has any effect.  Of course because this is google there is no way to get a straight answer about if it will have an effect, how long it will take to see any change, etc.

timns

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,211
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #29 on: February 17, 2011, 02:59 PM »
Maybe we were hacked by some competing forum!  :o

mahesh2k

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,426
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #30 on: February 17, 2011, 03:26 PM »
That looks like parameters from the robots.txt. Google is allowing us to manually set priority to the crawled content. Now you can decide what to let in or out. Except 'search', all other pages should be let google decide.

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #31 on: February 19, 2011, 02:33 PM »
Just to confirm, after the server move at the end of december, we did basically completely lose all forum search engine traffic, resulting in a loss of about half of our traffic.  And it has not improved in the two months since then.

Take that as a warning if you ever have a website and consider moving content.

Google is the almighty god and if you somehow manage to upset it, you will never know why or how to fix, you will just be punished swiftly and silently.

jgpaiva

  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 4,727
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #32 on: February 19, 2011, 07:07 PM »
Are things getting better? From what I understand, it has only indexed at least one recent topic: http://www.google.co...prmd=ivns&tbas=0 (although I think it only indexed this one topic)

mahesh2k

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,426
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #33 on: February 20, 2011, 03:04 AM »
Mouser, i moved my website on 12th december from psychz network to hostgator. I didn't lost  traffic on any of my sites. It doesn't look like issue of downtime to me at all. In case of Doco, this is robots.txt issue which google will now resolve over period of time. By the way, do read post on google webmaster about planned downtime.

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: My google page rank dropped to 0, anyone have any ideas why?
« Reply #34 on: February 24, 2011, 07:29 PM »
A week or two after i submitted a request to google to "re-index the site" here is the response i just got.

You have to love the deliberate obfuscation, deniability, and general deliberate doubletalk fog of the reply:

We received a request from a site owner to reconsider how we index the following site: https://www.donationcoder.com/.
We've now reviewed your site. When we review a site, we check to see if it's in violation of our Webmaster Guidelines. If we don't find any problems, we'll reconsider our indexing of your site. If your site still doesn't appear in our search results, check our Help Center for steps you can take.

So..

In other words they've reviewed the site and checked to see if its in violation or if there are any problems.  But they don't feel like telling us if they found any problems.  And therefore they might or might not eventually reconsider re-indexing the site at some point in the future.  And if they do or don't decide to do this, that's their little secret -- and we should go search the web one day if we eventually come to the conclusion that enough time has passed that something should have changed.

Google -- proof that when you get big enough, you just don't have to give a f*ck about people.
« Last Edit: February 24, 2011, 07:36 PM by mouser »

timns

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,211
    • View Profile
    • Donate to Member
Re: My google page rank dropped to 0, anyone have any ideas why?
« Reply #35 on: February 24, 2011, 09:28 PM »
I did a few google searches for pretty recent posts, and I'm getting hits now - this is good, right?

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,739
    • View Profile
    • Donate to Member
Re: My google page rank dropped to 0, anyone have any ideas why?
« Reply #36 on: February 25, 2011, 12:53 AM »
I agree, that's a pretty crappy response. In general I do find Google's "support" to be pretty bad. They pretty much put stuff out there in whatever condition it's in and the best you can do is hope it works. If it doesn't, you generally can't expect to talk to anyone, much less ever find out why, or IF it might be fixed, nevermind *when*. That being said, I wonder if there are some legal issues in terms of search and "fairness" that make them want to stick to vague responses.

- Oshyan

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: My google page rank dropped to 0, anyone have any ideas why?
« Reply #37 on: February 25, 2011, 12:56 AM »
After a few miscellaneous changes, it looks like dc is starting to have some of the sitemap urls picked up, thats a good sign.

And it looks like google is *finally* starting to listen to our sitemap at least a little:
Screenshot - 2_26_2011 , 5_31_49 AM.png

ps. i posted this in wrong thread, im moving it now.
« Last Edit: February 26, 2011, 05:33 AM by mouser »

jgpaiva

  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 4,727
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #38 on: March 13, 2011, 07:44 PM »
Looks like this is fixed, right? I can see results in google for stuff posted yesterday.
On a related note, how's the pagerank now?

app103

  • That scary taskbar girl
  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 5,884
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #39 on: March 14, 2011, 02:12 AM »
On a related note, how's the pagerank now?

Forum still has no page rank.  :(

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #40 on: March 14, 2011, 02:15 AM »
It may be a long time still before we get our page rank back, or not -- only google knows and they don't tell us lowly mortals what they do or why.

But at least the urls are gradually being picked up from the sitemap, and new threads seem to be indexed very quickly now, within hours, so that's the really important thing.  (when and whether google actually ranks our results high on the page i do not know).

PageRank can go F* itself.
« Last Edit: March 14, 2011, 02:17 AM by mouser »

jgpaiva

  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 4,727
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #41 on: March 14, 2011, 04:40 AM »
:) ok!

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #42 on: March 30, 2011, 09:17 PM »
We are now up to 50% coverage of the sitemap (the sitemap in question basically represents 25,000 most recent forum threads) and forum posts are now in google an hour or two after they are posted, which is actually pretty darn impressive on google's part.  And sitemap coverage has been going up daily .

We became almost invisible there for a while, but it seems like people should be able to find our forum content pretty well now when they do a web search, and it's only getting better.  And that's a good thing :up:

jgpaiva

  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 4,727
    • View Profile
    • Donate to Member
Re: For what it's worth, DC Homepage is now google PageRank 6
« Reply #43 on: March 31, 2011, 07:02 AM »
Glad to know that!

Thanks for keeping us up to date on this!  :Thmbsup: