Outages, planned and otherwise...

[Tim]

Who can guess how many issues we've had in the past 24 hours? 1?...No. 2?...Getting warmer. 3? Bingo! Oh, wait, D'oh! :(

Issue the first: Around 10pm or so last night, our fileserver went offline unexpectedly for the first time, well, ever. Remotely bouncing the power brought it back up rather quickly and the site was online again in about 10 minutes. I'm not quite sure what caused this, although my best guess would be a kernel panic having to do with the newer kernel necessitated by the recent memory upgrade. Anyway, I'll be keeping an eye on this.

Issue the second: We had planned to upgrade the internal switch to gigabit on all ports early this morning as well as make some housekeeping type updates to a few of the servers. This actually went just as planned with the site coming back online after about 30 minutes or so. However, after about 30 minutes of smooth running, the real problem began.

Issue the third: As I'm sure many of you noticed, our internet provider, Cogent, had two separate fiber cuts around 10am today affecting traffic all across southern and northeastern U.S. It has taken them some time, but all of the traffic has been re-routed around the affected lines and NG should be available to all of our users as of around 3pm EST.

While there was little any of us could do about the Cogent issue, I'll still apologize for the downtime caused by all three incidences. As always we'll do our best to make sure these are few and far between.... well, at least fewer and farther between than the last 24 hours :)

-Tim

[kinggila]

Thank for the updates Tim, but LOL at you double posting. I've had problems with NG today, but everything's fine now.

[bigexplosions]

Well, I geuss that explains everything messing up, LIKE THE TWO SAME NEW TOPICS I AM SEEING.

[Ken-Korrupt]

lol, n00b.

I was wondering what exactly happened this morning.....

[Jinzoa]

glad to know it was nothing real extreme

[Tim]

I don't know what you're talking about. Double-posting, not me ;)

[Back-Door-Baron]

Ahhh, I see the second topic was quickly corrected. Well, I am sure all the other problems will be corrected in as short of a time. We have faith in you, Tim.

[Jessii]

I'm glad that you figured out what's going on and that you're keeping an eye on it :D

[TheChaosDemon]

Yeah the double post just dissapeared :(

[Tim]

At 11/17/05 04:01 PM, Jinzoa wrote: glad to know it was nothing real extreme

Hmm, one of the main Internet backbones went down for 5 hours, you don't get much more extreme than that. Although in the grand scheme of things, I suppose there are worse things going on in the world.

[TheShrike]

At 11/17/05 04:01 PM, Tim wrote: I don't know what you're talking about. Double-posting, not me ;)

Oh, no, of course not. =p

[Tim]

At 11/17/05 04:02 PM, BareNakedMike wrote: I can stand the Outage, but that was the best accident by an Admin Ive seen :)

Nice photoshop work ;)

(that's it tim, deny deny deny)

[JoS]

At 11/17/05 04:04 PM, Tim wrote:

At 11/17/05 04:02 PM, BareNakedMike wrote: I can stand the Outage, but that was the best accident by an Admin Ive seen :)

Nice photoshop work ;)

(that's it tim, deny deny deny)

Tim stop spamming or I will have to ban you.

[randomwolf1]

Heh, well at least it works now =D

I thought I'd finally have an excuse to get a new computer though =(

[Chumbawamba]

Shucks, and I wasn't here to see the drama going on. Maybe next time... Well, hopefully there will be no "next time", but you know... gotta get me a piece of that drama action.

[Wylo]

Yay, the topics about the downtime will finally die.

At 11/17/05 04:06 PM, BareNakedMike wrote: Jokes on you, I dont have photoshop ;)

Could've used something else. ;)

[W31RD0]

At 11/17/05 03:57 PM, Tim wrote: Issue the third: As I'm sure many of you noticed, our internet provider, Cogent, had two separate fiber cuts around 10am today affecting traffic all across southern and northeastern U.S. It has taken them some time, but all of the traffic has been re-routed around the affected lines and NG should be available to all of our users as of around 3pm EST.

Holy crap, I wonder what other sites had outages or companies that were affected by this.

[Mogly]

OFMG POST REEL NEWZ ON ThE FRONT PAge PLesse thankou

shame, ebaums plan is all falling into place MUHAHAHA

[bigexplosions]

This thing is really messing up, like a while ago I say all this HTML text in the flash portal and I had to refresh my page about 20 times just to get this page to show up.

[Warrickneff]

At 11/17/05 03:57 PM, Tim wrote: While there was little any of us could do about the Cogent issue, I'll still apologize for the downtime caused by all three incidences. As always we'll do our best to make sure these are few and far between.... well, at least fewer and farther between than the last 24 hours :)

-Tim

Apology accepted.

Although I was at school and just thought my proxy was being buggered it still irked me a bit.

Newgrounds is such an addiction now.....

[liam]

At 11/17/05 04:04 PM, Tim wrote: Nice photoshop work ;)

Terrible quality though, looks rushed.

(that's it tim, deny deny deny)

Omg how many posts do you plan on making today?

[WillPostForFood]

=P yeah sucks to have problems. hope you can keep everything sorted out

[BananaBreadMuffin]

At 11/17/05 03:57 PM, Tim wrote: my best guess would be a kernel panic having to do with the newer kernel

ker·nel Audio pronunciation of "kernel" ( P ) Pronunciation Key (kûrnl)
n.

1. A grain or seed, as of a cereal grass, enclosed in a husk.
2. The inner, usually edible seed of a nut or fruit stone.
3. The most material and central part; the core: “that hard kernel of gaiety that never breaks” (Evelyn Waugh).

Something tells me that it wasn't sweetcorn upsetting your fileservers....

[Miikro]

Well, I'm glad to see everything seems to be running fine now. I was a bit weirded out this morning when i opened NG and got a 404 page.

[ExtraLife]

oh really...will there be another unexpected crash soon?

lmfao

[ramagi]

Just make sure you are not tripping over the power cords.
That would be embarrassing.

[Murch]

Lol, good. Cause this morning, it wouldn't come on, and i was like, "damn roadrunner won't work again!!!!!"

[XwaynecoltX]

I probably was sleeping, since lastnight seemed fine on my side and all, hope it all works out though...

~X~

[Evark]

So that explains why everything went all silly-nilly everywhere.

Did they get the backbone back up, or are they rerouting everything through somewhere else, because if so... crazy.

But otherwise, crazy. GLad to hear everything's working on the Newgrounds side of things. You know what they say though, rule of three and such (bad/good things happen in threes).

[kory-stokes]

Did anyone try that new game Gunz?