topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday March 28, 2024, 6:36 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: DonationCoder.com New Server Migration Coming Soon  (Read 22132 times)

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
DonationCoder.com New Server Migration Coming Soon
« on: December 10, 2010, 11:13 AM »
Ok we are going to be moving the DC domain to a new server in the next couple of days (over the weekend probably).

This could go completely smoothly, or may hit some hiccups, and may mean a day or two of strangeness as the new server address propagates through the domain name servers.

I will post again right before we pull the trigger, and then the forum will close while we migrate the database, and then re-open on the new server.

So everyone grab your teddy bears and baby cody plushies and hold tight over the weekend, and wish Gothi[c] good luck as he drives the truck full of dynamite over the bridge.

SERVER CHANGEOVER HAPPENING TODAY - SUNDAY 12/12/10

We did not go ahead with the server changeover due to difficulties getting the mysql database operations optimized.  See post below.
« Last Edit: December 13, 2010, 04:27 AM by mouser »

KynloStephen66515

  • Animated Giffer in Chief
  • Honorary Member
  • Joined in 2010
  • **
  • Posts: 3,741
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming in a Few Days
« Reply #1 on: December 10, 2010, 11:18 AM »
Mouser should have added:

If you have any problems getting to the forums over the weekend, please visit the IRC chat room
« Last Edit: December 10, 2010, 12:01 PM by Stephen66515 »

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming in a Few Days
« Reply #2 on: December 10, 2010, 11:22 AM »
I should note that we aren't planning any site/forum changes at this time.. so the migration should be fairly painless and you shouldn't see any real differences.  [some more substantial site changes are planned for 2011 though!]

y0himba

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 448
  • Yar.
    • View Profile
    • y0himba.net
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming in a Few Days
« Reply #3 on: December 11, 2010, 08:46 AM »
I should note that we aren't planning any site/forum changes at this time.. so the migration should be fairly painless and you shouldn't see any real differences.
 
Famous last words anyone?  :P

[some more substantial site changes are planned for 2011 though!]
As my teenager would say: "OMGOMGOMGOMGOMGOMGOMG!" I can't wait to see what's coming! :up: :tellme:

rgdot

  • Supporting Member
  • Joined in 2009
  • **
  • Posts: 2,192
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming in a Few Days
« Reply #4 on: December 11, 2010, 12:43 PM »
Wasn't there an alternate site set up for when main DC goes down? I have it bookmarked but it's lost in the maze that is my bookmarks.


app103

  • That scary taskbar girl
  • Global Moderator
  • Joined in 2006
  • *****
  • Posts: 5,884
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming in a Few Days
« Reply #5 on: December 11, 2010, 05:00 PM »
Also, you can follow DC on twitter, friendfeed, and facebook. If anything goes wrong, those would be good places to find out news.

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #6 on: December 12, 2010, 06:33 AM »
SERVER CHANGEOVER HAPPENING TODAY - SUNDAY 12/12/10
« Last Edit: December 13, 2010, 05:05 AM by mouser »

Carol Haynes

  • Waffles for England (patent pending)
  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 8,066
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #7 on: December 12, 2010, 06:59 AM »
Good luck (or has it already happened - in which case well done!)

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #8 on: December 12, 2010, 07:01 AM »
Visit the temporary standalone chat page to join the chat channel (irc #donationcoder on efnet) if the forum is closed while we are migrating.

f0dder

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,153
  • [Well, THAT escalated quickly!]
    • View Profile
    • f0dder's place
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #9 on: December 12, 2010, 07:17 AM »
Drumroll!
- carpe noctem

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,857
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #10 on: December 12, 2010, 08:48 AM »
And because it will run as a VM, it will cease to exist in any real sense and become an imaginary place.

Going forward, every night at midnight, it will also turn into a pumpkin. "For maintenance." :P

Ah virtual servers! "Nothing is real. And nothing to get hung about."
« Last Edit: December 12, 2010, 10:52 AM by 40hz »

Stoic Joker

  • Honorary Member
  • Joined in 2008
  • **
  • Posts: 6,646
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #11 on: December 12, 2010, 11:24 AM »
Ah virtual servers! "Nothing is real. And nothing to get hung about."
A Beatles quote? The last thing we need now is buggs ... You'll get us in a Strawberry (fields) jam.

 :D

cranioscopical

  • Friend of the Site
  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 4,776
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #12 on: December 12, 2010, 12:29 PM »
it will run as a VM, it will cease to exist in any real sense
You're  a real nowhere man!

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,857
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #13 on: December 12, 2010, 12:52 PM »
it will run as a VM, it will cease to exist in any real sense
;D
You're  a real nowhere man!
-cranioscopical (December 12, 2010, 12:29 PM)

Actually, what I really want is to be a paperback writer!

Seriously. 8)
« Last Edit: December 12, 2010, 12:55 PM by 40hz »

cranioscopical

  • Friend of the Site
  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 4,776
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Today (sunday 12/12/10)
« Reply #14 on: December 12, 2010, 05:39 PM »
Actually, what I really want is to be a paperback writer!

Seriously. 8)

Well you know we all wanna change the world!


  :Thmbsup: good for you!



mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #15 on: December 13, 2010, 04:29 AM »
This is still the old server..
We had everything reproduced and tested on the new server, EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.  Problem is being worked on and we will move when it is solved.  Obviously the last thing we want is to move servers and have the forum feel slower.

Apologies for the downtime!

We are back up on the same server as we have been -- the move to the new server will happen later this week probably.
Thank you for your patience.
« Last Edit: December 13, 2010, 04:31 AM by mouser »

techidave

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 1,044
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #16 on: December 13, 2010, 05:25 AM »
It's too bad you had some problems with the switch over.  But I am glad that you didn't keep it there while trying to work the problems out.

We have faith in you guys that you will soon get the problem resolved!   :up:

cranioscopical

  • Friend of the Site
  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 4,776
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #17 on: December 13, 2010, 08:02 AM »
We had everything reproduced and tested on the new server, EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.  Problem is being worked on and we will move when it is solved.  Obviously the last thing we want is to move servers and have the forum feel slower.
Thanks for the update, and thanks for planning things so that this kind of glitch can be dealt with elegantly!

The gem cannot be polished without friction, nor man perfected without trials.


f0dder

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,153
  • [Well, THAT escalated quickly!]
    • View Profile
    • f0dder's place
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #18 on: December 13, 2010, 09:02 AM »
EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.
Are you switching from an older version to 5.1 and getting bad speed, or is it 5.1-on-old-hardware to 5.1-virtualized that's giving you trouble?
- carpe noctem

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #19 on: December 13, 2010, 09:19 AM »
We are moving from mysql5.0x to mysql5.1x, and moving from a native 4gb linux install (centos) to a virtual machine (VmWare ESX) gentoo install on a machine with 8gb.  Both using same Dual Processor Quad Core cpu.

We seem to have tracked down the problem to mysql performance when sorting larger tables..
We've played with dozens of mysql settings with very little effect.

More details as we figure out more.
« Last Edit: December 13, 2010, 09:26 AM by mouser »

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,857
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #20 on: December 13, 2010, 09:28 AM »
FWIW the forums seem to be loading noticeably quicker today than previously. At first I chalked it up to the transition until I read your notice. Did you do some heavy duty clean-up or optimizations to the drives or database prior to trying the transition?

I checked the stats on my network and router and they're in line with their averages so I suspect the improvement I'm seeing is due to something you've done on your end.

Luck! :Thmbsup:

Carol Haynes

  • Waffles for England (patent pending)
  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 8,066
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #21 on: December 13, 2010, 09:59 AM »
What a bummer - good luck later on in the week!  :-* :-* :-*

Gothi[c]

  • DC Server Admin
  • Charter Honorary Member
  • Joined in 2006
  • ***
  • Posts: 873
    • View Profile
    • linkerror
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #22 on: December 16, 2010, 04:54 PM »
Fixed the MySQL slowness...

This was a really weird one to debug.

When the MySQL sort resorted to a filesort it was actually running FASTER than in memory. (It's supposed to be the other way around).
All MySQL and MyISAM buffers etc were set correctly so it was quite a mystery in which nothing much was making sense.
It was as if the world was turned upside down, and queries that were supposed to be slow in theory, ran faster than those that were supposed to be fast.

It turned out that the problem wasn't with the MySQL configuration at all, but rather an option in the hardened kernel we were running.
( We use a security hardened kernel which prevents many buffer overflow exploits from working through the well known PaX and grsecurity kernel patches )

The culprit turned out to be the "prevent invalid userland pointer dereference" PaX option.
When running a google query for this issue there's only two results, one of which, an ubuntu hardened guide (pdf), mentions the following:


Restrict mprotect
→ YES if you are running a physical server
→ NO if it is a virtual one

Prevent invalid userland pointer dereference
* If you are running on a physical machine → YES
* If it is a virtual Machine it will slow it down a lot →  NO


Glad to see that confirmed. It doesn't really explain the theory as to why unfortunately.
Too bad google only returned this result after we had already found which option caused the problem after lots of debugging :D

The MySQL query that was taking over 14 seconds to complete now runs in less than a second.
« Last Edit: December 16, 2010, 04:55 PM by Gothi[c] »

cranioscopical

  • Friend of the Site
  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 4,776
    • View Profile
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #23 on: December 16, 2010, 06:18 PM »
Well done, we're lucky to have you!

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: DonationCoder.com New Server Migration Coming Soon
« Reply #24 on: December 16, 2010, 06:22 PM »
we're lucky to have you!

amen -- gothi[c] has spent days working on this.. when he gets his teeth into an issue, he just does not let go until he solves it.  we are *VERY* lucky to have him as part of DC and taking such good care of our servers.