Tip: Click here to scan for System Errors and Optimize PC performance

Back To Announcements & Rules

Ozzu Downtime

  • Bigwebmaster
  • Site Admin
  • Site Admin
  • User avatar
  • Joined: Dec 20, 2002
  • Posts: 7321
  • Loc: Seattle, WA
  • Status: Offline

Post June 2nd, 2008, 3:03 pm

On Saturday, May 31st at 2:55pm PDT in the H1 data center where ozzu is located, electrical gear shorted, creating an explosion and fire that knocked down three walls surrounding the electrical equipment room. Thankfully, no one was injured.

This caused a loss of power to all of the networking gear and servers. The fire marshall wouldn't allow the backup generators to come online and much of the wiring was destroyed anyhow. I am very pleased that the ozzu server was not destroyed in the explosion and now everything is back up and online as of about 1 PM PDT today.

All I can say is it has been a very frustrating weekend and I am glad everything is back online. I think I might be taking a few days off soon.
Ozzu Hosting - Want your website on a fast server like Ozzu?
Contact US for more information about our plans and rates
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post June 2nd, 2008, 3:03 pm

  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 22454
  • Loc: Pittsburgh PA
  • Status: Offline

Post June 2nd, 2008, 5:17 pm

I wouldn't blame you. Was great to see you on top of everything for the duration. You had OZZU back as timely as possible and worked a way to have updates where few others could have. My hat's off to you again chief!
"The web is a dominatrix. Every where I turn, I see little buttons ordering me to Submit."
Play sports pools and discuss sports topics at Boasting Rights Sports Forum
Get paid to write articles - www.associatedcontent.com
  • SpooF
  • Ice Cream
  • Bronze Member
  • User avatar
  • Joined: May 22, 2004
  • Posts: 2825
  • Loc: Richland, WA
  • Status: Offline

Post June 2nd, 2008, 5:18 pm

Made a backup yet ;) lol
College Taught Me - And we're not talking about the classes!
@travisperson
  • Bigwebmaster
  • Site Admin
  • Site Admin
  • User avatar
  • Joined: Dec 20, 2002
  • Posts: 7321
  • Loc: Seattle, WA
  • Status: Offline

Post June 3rd, 2008, 4:06 pm

This morning at approximately 12:45 a.m. PDT, the temporary generator supplying power to the servers and environmental control systems located in Phase 1 of our H1 facility shut down. This was caused by some faulty current sensors in the output breaker. The sensors detected an out of balance current condition that did not exist.

Technicians from the generator company were onsite within 15 minutes. After working on the breaker for an hour, they believed the issue was remedied, and the generator was restarted. As the servers and environmental control systems were brought back online, the breaker again caused the generator to trip offline.

Fixing the faulty breaker on the generator powering H1 Phase 1 was not successful.

The new H1 Generator has arrived on site and after load testing they finally brought floor 1 back online and that is why ozzu is now fixed.

For half of the day today ozzu was being loaded from a backup server. I may completely move ozzu out of the datacenter that is having problems to avoid any future downtime. I will keep everyone posted.
Ozzu Hosting - Want your website on a fast server like Ozzu?
Contact US for more information about our plans and rates
  • SpooF
  • Ice Cream
  • Bronze Member
  • User avatar
  • Joined: May 22, 2004
  • Posts: 2825
  • Loc: Richland, WA
  • Status: Offline

Post June 3rd, 2008, 6:56 pm

Did you move to the Dallas center?
College Taught Me - And we're not talking about the classes!
@travisperson
  • labrego
  • GoGo
  • Web Master
  • User avatar
  • Joined: May 25, 2004
  • Posts: 2733
  • Loc: Mexico
  • Status: Offline

Post June 4th, 2008, 8:17 am

ATNO/TW wrote:
I wouldn't blame you. Was great to see you on top of everything for the duration. You had OZZU back as timely as possible and worked a way to have updates where few others could have. My hat's off to you again chief!


Ditto. Great work boss!
Que nunca olvide que todo lo que tengo y lo que soy proviene de ti, es para ti, y únicamente tiene sentido en ti.

Page 1 of 1

Post Information

  • Total Posts in this topic: 6 posts
  • Users browsing this forum: No registered users and 3 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© Unmelted Enterprises 1998-2009. Driven by phpBB © 2001-2009 phpBB Group.