topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday March 28, 2024, 10:15 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: Report on server downtime on August 8th  (Read 14323 times)

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Report on server downtime on August 8th
« on: August 09, 2006, 05:06 AM »
The server was the subject of some kind of mail attack yesterday, August 8th. and was down for most of the day.

It looks like our current host (we pay $210 a month for this account!! yipes!) is not staffed by people who have a good grasp on things (www.servstra.com) as i've written about before and i don't think they know what happened or how to prevent it from happening again, so it may be that we will get attacked in the exact same way in the coming days.

Basically it looks like some spammer used random fake email addresses from donationcoder.com to spam people, and so all the messages were bouncing back to us.  It's not clear yet to me (nor i guess to the server admins) whether this spammer somehow actually got our server to send these emails out to random addresses, or whether they just managed to spoof our address on the return address.  I will report more as I find out more.

If so, don't panic!  I am always on top of it and doing my best to get us up asap, and the site will never be down for long.  what doesn't kill us just makes us stronger.  and in the world of hosting, what does kill us only kills us for a little while.

Remember in the early days of the site a year ago we had some growing pains as we moved to a dedicated server, but once we got it sorted we had a blazing fast server and user space.  Well it seems now we are experiencing a bit more growing pains and I'm working to split us up onto 2 servers, a main server for the website, and an auxiallary server for user accounts, which we can have fun on and give our members some space for their own stuff.

Anyway, back to work and fun.  And thank you for being understanding.  The only thing I can tell you is that I try my heart out to get us up as fast as possibile and I'm always working to try to make this site and server better, faster, stronger, more stable, etc., but it's a learning experience for me.  I appreciate the understanding and patience.

« Last Edit: August 09, 2006, 05:09 AM by mouser »

AbteriX

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 1,149
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #1 on: August 09, 2006, 05:24 AM »
Thank you for all of your support  :Thmbsup: Very appreciated  :-*
It was a dull morning without DC.


what doesn't kill us just makes us stronger
-Mr. Mouser
The same proverb we have in germany too :D

Carol Haynes

  • Waffles for England (patent pending)
  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 8,066
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #2 on: August 09, 2006, 06:15 AM »
I guessed it might be a DoS attack or something similar.

I have been getting increasing amounts of crap to my domain names (random user names) and lots of 'undeliverable' receipts from spoofed email addresses based on my domain names.

I think I will point my sites back to my domain name manager and then use web forwarding to my domain space on the DC servers. That way I can manage mail via their servers and it will reduce the amount a crap (at least a little) that is filtering through the DC servers. It souldn't make much difference to me in the long run (just accessing my domains will need an extra hop or two).

Glad it is all sorted for the mo!

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #3 on: August 09, 2006, 06:20 AM »
i am going to hire us a professional server management contract so we will get to a state where we are well cared for and protected by people who know what they are doing - i have no intention of resting until our servers are as stable as is humanly possible.

nudone

  • Cody's Creator
  • Columnist
  • Joined in 2005
  • ***
  • Posts: 4,119
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #4 on: August 09, 2006, 06:23 AM »
great to see everything back to normal - DC does leave a very noticeable hole when it's not there.

will a new host be sought or are there advantages staying put?

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #5 on: August 09, 2006, 06:27 AM »
a new host is being sought, no doubt about it.
ive already got a new secondary server set up and im migrating all secondary accounts as we speak (donationcoders.com etc.)

after i finish that and learn how to do it smoothly without major interruption i will move to stage two, getting us a new primary server, and hiring a proper management company to handle it as if it was filled with state secrets.

nudone

  • Cody's Creator
  • Columnist
  • Joined in 2005
  • ***
  • Posts: 4,119
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #6 on: August 09, 2006, 06:33 AM »
fantastic.  :Thmbsup:

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #7 on: August 09, 2006, 06:53 AM »
i think the best way to view these outages are as little lessons.  lessons that can teach us how to improve stability and security, and ensure that we have skilled people who know how to handle issues.  we will be the better for it in the long term when it is important.

i'm actually extremely excited about splitting our stuff onto 2 servers, one primary one for the main site and another one dedicated to hosting user accounts and stuff.  it will make it 100x more secure for us, and make providing web space/blogging accounts, etc, to users much easier and worry free.  it's a bit more money on server costs of course, but well worth it for peace of mind and for the flexibility we will have in providing services for members.

nudone

  • Cody's Creator
  • Columnist
  • Joined in 2005
  • ***
  • Posts: 4,119
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #8 on: August 09, 2006, 07:01 AM »
i agree, these are very valuable lessons - better to learn (or begin learning) now rather than at a later time when DC is perhaps even more of a target for attack - drawing more attention will no doubt bring more nuisance in at the same time.

all in all, it looks like a bright DC future. i'm sure everyone is relieved you are on top of it all, mouser.

housetier

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 1,321
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #9 on: August 09, 2006, 08:06 AM »
* housetier gives mouser some love to put his heart at ease  :-* :-* :-*

tsaint

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 497
  • Hi from the a*** end of the earth
    • View Profile
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #10 on: August 09, 2006, 08:15 AM »
simple one:thanks VERY much mouser for all your time and worry and effort you're putting into this.
On the bright side I managed to do a bit extra work at school today because of the down time. I think at least one of my classes benefitted.
tony

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #11 on: August 09, 2006, 09:13 AM »
i appreciate very much the supportive words, and again i do apologize to everyone who has a site on donationcoder.com server.  what i can tell you is this, if it's any consolation: the moment there is any trouble on the server, i am planted in front of the screen and contacting tech support and talking to people constantly, as long as it takes, to get the problem fixed. i take nothing for granted and assume that such problems require my constant attention until they get fixed.  i know it doesnt make up for the site being offline but i just want you guys to know that i do not take such things lightly and i am sitting in front of the screen for the entire day trying to get it solved as quickly as possible.

nudone

  • Cody's Creator
  • Columnist
  • Joined in 2005
  • ***
  • Posts: 4,119
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #12 on: August 09, 2006, 09:33 AM »
cody would just like to express how he feels about the current DC hosts and the recurring server downtime.

AbteriX

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 1,149
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #13 on: August 09, 2006, 09:48 AM »
@nudone
 ;D  :Thmbsup:

housetier

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 1,321
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #14 on: August 09, 2006, 09:53 AM »
great one nudone ;D  :mrgreen: :lol:

mouser

  • First Author
  • Administrator
  • Joined in 2005
  • *****
  • Posts: 40,896
    • View Profile
    • Mouser's Software Zone on DonationCoder.com
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #15 on: August 09, 2006, 09:53 AM »


nudone that is priceless..  as i said earlier, we have to get all these cody illustrations into a flash game.

nudone

  • Cody's Creator
  • Columnist
  • Joined in 2005
  • ***
  • Posts: 4,119
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #16 on: August 09, 2006, 09:56 AM »
(note that cody has taken off the red stockings he was so fond of wearing.)

here's a quick sketch of cody's first reaction to the DC server downtime - be warned. do not view if you are easily upset.
Spoiler
cody-dead-01.jpg

« Last Edit: August 09, 2006, 10:13 AM by nudone »

f0dder

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,153
  • [Well, THAT escalated quickly!]
    • View Profile
    • f0dder's place
    • Read more about this member.
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #17 on: August 09, 2006, 01:33 PM »
Good job, mouser.

I hate those spam/flood/etc kiddies >_<
- carpe noctem

Josh

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Points: 45
  • Posts: 3,411
    • View Profile
    • Donate to Member
Re: Report on server downtime on August 8th
« Reply #18 on: August 09, 2006, 03:23 PM »
Mouser, if you have a chance, hop on irc. I would like to help you examine any logs you have available to further determine the exact happenings since your hosting company is of no use.

Good to see us back online thou! I was lost without dc