Articles / Hardware outage at freshmeat

Hardware outage at freshmeat

As you may or may not have noticed, freshmeat has suffered from some major downtime from 11am EST to 5pm EST. Both database servers crashed hard and refused to boot with various kernel revisions and mylex driver modules. OSDN's netop staff worked hard to get a replacement machine up and running which neither cooperated nicely at first. The site is up in semi-stable state right now and searches are still disabled while we're working on getting the search database server back up and running. Please bear with us and sorry for the inconvenience.

RSS Recent comments

16 Jan 2002 19:31 xris

Reason?
Hi,

it would bei nice to hear something about the
reasons for the crash, as soon as they're detected...

regards, chris

16 Jan 2002 20:43 valdez

Re: Reason?
Yes, let us know what happened, il will be very interesting!
Thank you for the good work!!!

16 Jan 2002 20:54 gafami

Re: Reason?
hope u get everything back to normal real soon, i also had a major crash on 2 of our servers last weekend...

cheers,
-joerg

> Hi,
>
> it would bei nice to hear something
> about the
> reasons for the crash, as soon as
> they're detected...
>
> regards, chris
>

16 Jan 2002 23:03 tiger66y2k

It's okay...
With as many times as your site has helped me out. I don't mind it being down a couple hours so that you guys can do hardware/software upgrades or replacements. Not at all... Keep up the *great* work guys!!

16 Jan 2002 23:05 bytor4232

Whew
I was scared! I visit your site about 10 times a day, if not more. Glad your back!

16 Jan 2002 23:20 phirate

Freshmeat
Hey, check it out, a generic thread where we can express out appreciation of all freshmeat has done for us software junkies.

THANKS GUYS. YOU KICK ASS.

:)

17 Jan 2002 02:47 msameer

God bless you
i also visit it more than 5 times a day for various reasons

god be with you guys and keep the great work

17 Jan 2002 05:02 YannS

Thanks for this wonderfull tool !
I would like to join the concert of thanks. With a disponibility of 24/24 hours on 365/365 days, how could we blame you ? :)

Thanks again, yann.

17 Jan 2002 09:23 thissurfer

Thanks
all the quick help/solutions your software database has brought me could never be repaid. although I was nervous at first, i assumed if the site isn't up, it must be a serious problem and will be taken care of as quickly as possible.

THANKS for all the good work (and keeping the users informed about what happened)

17 Jan 2002 11:36 markana

I was worried....
Good work getting it back up... I wasn't sure if it was at our end, your end, or somewhere in-between. Next time something happens, how about posting a notice over at at OSDN main page? Otherwise, people sit around like worried parents waiting for the overdue teenager to come home :-)

17 Jan 2002 14:05 alram84us

Great Work :)
This is why OSDN rocks! As soon as a problem is encountered, a notice is sent to members and other affiliated sites. Great job, guys! :)

18 Jan 2002 18:39 yazz

Re: I was worried....

> Good work getting it back up... I wasn't
> sure if it was at our end, your end, or
> somewhere in-between. Next time
> something happens, how about posting a
> notice over at at OSDN main page?
> Otherwise, people sit around like
> worried parents waiting for the overdue
> teenager to come home :-)

Humm... I'll bring that up at the next meeting we have. Just need a easy way to do it. Like a small side box on the site that people could see if there are any outages or planned maintance happening....

18 Jan 2002 18:54 yazz

Re: Reason?

> Hi,
>
> it would bei nice to hear something
> about the
> reasons for the crash, as soon as
> they're detected...
>
> regards, chris
>

Well to put it simply have you ever planned an upgrade to a new kernel then find out it won't work? Hardware that is supported just won't work. One of thoses lovely little things you can't really plan for.

You might ask why the kernel upgrade? The answer would be the machine was not being very stable under the other kernel. The DB was just not getting along with the setup and if given time would lock up the machine.

Thats the basic facts without going into great detail of the hair pulling and long irc chats. For the moment there are still unsolved issues but we are working on real solutions to keep everything working.

Belive it or not Freshmeat has some of the best uptime records of OSDN machines.

Oh by the way Scoop rocks!

11 Mar 2002 17:38 ondruska

Notice
Hi,

Next time you could place a dumb web server with a simple note: "We've got troubles, try again in X hours."

Peter

22 Mar 2002 13:36 darkonc

Re: I was worried....

> Humm... I'll bring that up at the next
> meeting we have. Just need a easy way to
> do it. Like a small side box on the site
> that people could see if there are any
> outages or planned maintance
> happening....

Just pull a box from somebody's desk. If all you're doing is serving a single static page, it's not gonna need massive disk I/O or anything -- just apache (/tux) and an ethernet card that won't melt down under the pressure.

26 Mar 2002 01:51 googleman

Lol...
How about calling the national disaster dudes and have them broadcast a warning across the nation! nah, too much...
Perhaps put a notice opn all opf the OSDN websites? that way everyone who visits an OSDN website will know. Don't make it too large though, too big would be an eye sore.

25 Sep 2002 15:21 dunbar

OK, keep hunting
Patiently yours.....

Screenshot

Project Spotlight

Vendetta Online

A multiplatform, 3D space-combat MMORPG.

Screenshot

Project Spotlight

opendkim

A C implementation of the DKIM message signing/verifying standard, both an API and a filter.