Welcome Guest.   Make a donation to an author on the site November 27, 2014, 05:57:33 AM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.


You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
The N.A.N.Y. Challenge 2012! Download dozens of custom programs!
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
Pages: [1] 2 Next   Go Down
  Reply  |  New Topic  |  Print  
Author Topic: DonationCoder.com New Server Migration Coming Soon  (Read 12038 times)
mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« on: December 10, 2010, 11:13:20 AM »

Ok we are going to be moving the DC domain to a new server in the next couple of days (over the weekend probably).

This could go completely smoothly, or may hit some hiccups, and may mean a day or two of strangeness as the new server address propagates through the domain name servers.

I will post again right before we pull the trigger, and then the forum will close while we migrate the database, and then re-open on the new server.

So everyone grab your teddy bears and baby cody plushies and hold tight over the weekend, and wish Gothi[c] good luck as he drives the truck full of dynamite over the bridge.

SERVER CHANGEOVER HAPPENING TODAY - SUNDAY 12/12/10

We did not go ahead with the server changeover due to difficulties getting the mysql database operations optimized.  See post below.
« Last Edit: December 13, 2010, 04:27:46 AM by mouser » Logged
Stephen66515
Animated Giffer in Chief
Honorary Member
**
Posts: 2,786



see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #1 on: December 10, 2010, 11:18:18 AM »

Mouser should have added:

If you have any problems getting to the forums over the weekend, please visit the IRC chat room
« Last Edit: December 10, 2010, 12:01:41 PM by Stephen66515 » Logged

No trees were harmed during the creation of this message.  Millions of electrons, however, were terribly inconvenienced

"Think left and think right and think low and think high. Oh, the things you can think up if only you try!" - Dr. Seuss
mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #2 on: December 10, 2010, 11:22:29 AM »

I should note that we aren't planning any site/forum changes at this time.. so the migration should be fairly painless and you shouldn't see any real differences.  [some more substantial site changes are planned for 2011 though!]
Logged
y0himba
Charter Member
***
Posts: 424



Yar.

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #3 on: December 11, 2010, 08:46:43 AM »

I should note that we aren't planning any site/forum changes at this time.. so the migration should be fairly painless and you shouldn't see any real differences.
 
Famous last words anyone?  tongue

[some more substantial site changes are planned for 2011 though!]
As my teenager would say: "OMGOMGOMGOMGOMGOMGOMG!" I can't wait to see what's coming! thumbs up tellme
Logged

My Web Site:  http://www.y0himba.net
rgdot
Supporting Member
**
Posts: 1,665


View Profile WWW Give some DonationCredits to this forum member
« Reply #4 on: December 11, 2010, 12:43:33 PM »

Wasn't there an alternate site set up for when main DC goes down? I have it bookmarked but it's lost in the maze that is my bookmarks.

Logged
app103
That scary taskbar girl
Global Moderator
*****
Posts: 5,327



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #5 on: December 11, 2010, 05:00:05 PM »

Also, you can follow DC on twitter, friendfeed, and facebook. If anything goes wrong, those would be good places to find out news.
Logged

mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #6 on: December 12, 2010, 06:33:46 AM »

SERVER CHANGEOVER HAPPENING TODAY - SUNDAY 12/12/10
« Last Edit: December 13, 2010, 05:05:25 AM by mouser » Logged
Carol Haynes
Waffles for England (patent pending)
Global Moderator
*****
Posts: 7,958



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #7 on: December 12, 2010, 06:59:30 AM »

Good luck (or has it already happened - in which case well done!)
Logged

mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #8 on: December 12, 2010, 07:01:03 AM »

Visit the temporary standalone chat page to join the chat channel (irc #donationcoder on efnet) if the forum is closed while we are migrating.
Logged
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #9 on: December 12, 2010, 07:17:25 AM »

Drumroll!
Logged

- carpe noctem
40hz
Supporting Member
**
Posts: 10,873



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #10 on: December 12, 2010, 08:48:18 AM »

And because it will run as a VM, it will cease to exist in any real sense and become an imaginary place.

Going forward, every night at midnight, it will also turn into a pumpkin. "For maintenance." tongue

Ah virtual servers! "Nothing is real. And nothing to get hung about."
« Last Edit: December 12, 2010, 10:52:53 AM by 40hz » Logged

Don't you see? It's turtles all the way down!
Stoic Joker
Honorary Member
**
Posts: 5,404



View Profile WWW Give some DonationCredits to this forum member
« Reply #11 on: December 12, 2010, 11:24:26 AM »

Ah virtual servers! "Nothing is real. And nothing to get hung about."
A Beatles quote? The last thing we need now is buggs ... You'll get us in a Strawberry (fields) jam.

 cheesy
Logged
cranioscopical
Friend of the Site
Supporting Member
**
Posts: 4,196



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #12 on: December 12, 2010, 12:29:39 PM »

it will run as a VM, it will cease to exist in any real sense
You're  a real nowhere man!
Logged

Chris
40hz
Supporting Member
**
Posts: 10,873



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #13 on: December 12, 2010, 12:52:42 PM »

it will run as a VM, it will cease to exist in any real sense
Grin
You're  a real nowhere man!

Actually, what I really want is to be a paperback writer!

Seriously. Cool
« Last Edit: December 12, 2010, 12:55:44 PM by 40hz » Logged

Don't you see? It's turtles all the way down!
cranioscopical
Friend of the Site
Supporting Member
**
Posts: 4,196



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #14 on: December 12, 2010, 05:39:22 PM »

Actually, what I really want is to be a paperback writer!

Seriously. Cool

Well you know we all wanna change the world!


  Thmbsup good for you!


Logged

Chris
mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #15 on: December 13, 2010, 04:29:12 AM »

This is still the old server..
We had everything reproduced and tested on the new server, EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.  Problem is being worked on and we will move when it is solved.  Obviously the last thing we want is to move servers and have the forum feel slower.

Apologies for the downtime!

We are back up on the same server as we have been -- the move to the new server will happen later this week probably.
Thank you for your patience.
« Last Edit: December 13, 2010, 04:31:00 AM by mouser » Logged
techidave
Supporting Member
**
Posts: 965


see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #16 on: December 13, 2010, 05:25:22 AM »

It's too bad you had some problems with the switch over.  But I am glad that you didn't keep it there while trying to work the problems out.

We have faith in you guys that you will soon get the problem resolved!   thumbs up
Logged
cranioscopical
Friend of the Site
Supporting Member
**
Posts: 4,196



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #17 on: December 13, 2010, 08:02:41 AM »

We had everything reproduced and tested on the new server, EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.  Problem is being worked on and we will move when it is solved.  Obviously the last thing we want is to move servers and have the forum feel slower.
Thanks for the update, and thanks for planning things so that this kind of glitch can be dealt with elegantly!

The gem cannot be polished without friction, nor man perfected without trials.

Logged

Chris
f0dder
Charter Honorary Member
***
Posts: 8,774



[Well, THAT escalated quickly!]

see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #18 on: December 13, 2010, 09:02:33 AM »

EXCEPT we could not get the new mysql 5.1 database stuff running at a good speed.
Are you switching from an older version to 5.1 and getting bad speed, or is it 5.1-on-old-hardware to 5.1-virtualized that's giving you trouble?
Logged

- carpe noctem
mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #19 on: December 13, 2010, 09:19:39 AM »

We are moving from mysql5.0x to mysql5.1x, and moving from a native 4gb linux install (centos) to a virtual machine (VmWare ESX) gentoo install on a machine with 8gb.  Both using same Dual Processor Quad Core cpu.

We seem to have tracked down the problem to mysql performance when sorting larger tables..
We've played with dozens of mysql settings with very little effect.

More details as we figure out more.
« Last Edit: December 13, 2010, 09:26:26 AM by mouser » Logged
40hz
Supporting Member
**
Posts: 10,873



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #20 on: December 13, 2010, 09:28:44 AM »

FWIW the forums seem to be loading noticeably quicker today than previously. At first I chalked it up to the transition until I read your notice. Did you do some heavy duty clean-up or optimizations to the drives or database prior to trying the transition?

I checked the stats on my network and router and they're in line with their averages so I suspect the improvement I'm seeing is due to something you've done on your end.

Luck! Thmbsup
Logged

Don't you see? It's turtles all the way down!
Carol Haynes
Waffles for England (patent pending)
Global Moderator
*****
Posts: 7,958



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #21 on: December 13, 2010, 09:59:16 AM »

What a bummer - good luck later on in the week!  Kiss Kiss Kiss
Logged

Gothi[c]
DC Server Admin
Charter Honorary Member
***
Posts: 857



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #22 on: December 16, 2010, 04:54:05 PM »

Fixed the MySQL slowness...

This was a really weird one to debug.

When the MySQL sort resorted to a filesort it was actually running FASTER than in memory. (It's supposed to be the other way around).
All MySQL and MyISAM buffers etc were set correctly so it was quite a mystery in which nothing much was making sense.
It was as if the world was turned upside down, and queries that were supposed to be slow in theory, ran faster than those that were supposed to be fast.

It turned out that the problem wasn't with the MySQL configuration at all, but rather an option in the hardened kernel we were running.
( We use a security hardened kernel which prevents many buffer overflow exploits from working through the well known PaX and grsecurity kernel patches )

The culprit turned out to be the "prevent invalid userland pointer dereference" PaX option.
When running a google query for this issue there's only two results, one of which, an ubuntu hardened guide (pdf), mentions the following:

Quote

Restrict mprotect
→ YES if you are running a physical server
→ NO if it is a virtual one

Prevent invalid userland pointer dereference
* If you are running on a physical machine → YES
* If it is a virtual Machine it will slow it down a lot →  NO


Glad to see that confirmed. It doesn't really explain the theory as to why unfortunately.
Too bad google only returned this result after we had already found which option caused the problem after lots of debugging cheesy

The MySQL query that was taking over 14 seconds to complete now runs in less than a second.
« Last Edit: December 16, 2010, 04:55:50 PM by Gothi[c] » Logged
cranioscopical
Friend of the Site
Supporting Member
**
Posts: 4,196



see users location on a map View Profile Read user's biography. Give some DonationCredits to this forum member
« Reply #23 on: December 16, 2010, 06:18:37 PM »

Well done, we're lucky to have you!
Logged

Chris
mouser
First Author
Administrator
*****
Posts: 33,700



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #24 on: December 16, 2010, 06:22:45 PM »

Quote
we're lucky to have you!

amen -- gothi[c] has spent days working on this.. when he gets his teeth into an issue, he just does not let go until he solves it.  we are *VERY* lucky to have him as part of DC and taking such good care of our servers.

Logged
Pages: [1] 2 Next   Go Up
  Reply  |  New Topic  |  Print  
 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.051s | Server load: 0.05 ]