Outage Information
by George RobertsLast night we experienced a complete infrastructure power outage due to a problem with a power distribution unit that delivers power to our cabinet at our datacenter. Unfortunately, it took some time to diagnose exactly what particular piece of equipment was causing the problem and then to resolve the issue.
The problem has been resolved at this time, however, we will need to schedule a short downtime in the next week or so to upgrade a piece of power hardware to reduce the chances of an outage like this happening again in the future.
By way of apology for the extended downtime, we will be issuing $10 service credits for all ServerProtect customers and $2 service credits for all DomainProtect customers. This credit will appear in your account in the next week or so.
May 24th, 2008 at 4:35 am
Thanks for taking care of this so quickly folks. Fortunately for users, it came at a time of a very light mail load and few people here in the US actually realized it was out/down. Excellent handling by EAS/George/Ken - Thank you!
May 24th, 2008 at 4:46 am
So quickly? Aproximately 8 hours?? thats quick? Quick would have been to walk down the cage and see that your PDU has no “blinky blinky” lights on it .. and get Infrastructure management out of the break room to route power from the spare .. oh wait.. no spare?
hmm
May 24th, 2008 at 4:50 am
Correction 6hr’s but it was PEAK Email hours for my customers
May 24th, 2008 at 6:37 am
Thank you for posting the cause. Maybe backup (MX) service will be available sooner than later.
May 24th, 2008 at 9:49 am
George - what is the plan in terms of creating some redundancy so that we can seutp a 2nd MX record with a unit in a separate data center to minimize this type of issue? I agree with Jeff that backup MX would be a great feature.
May 25th, 2008 at 1:30 am
I agree with both Jeff and Eric. Backup MX in a different datacenter would be great.
May 25th, 2008 at 9:01 am
That was bad timing, Im a new customer on a trial and very nearly walked away thinking it was an unreliable service unaware of your power outage.
June 14th, 2008 at 8:50 am
Hi George,
Can you please check invoive number 6302 dated 13th of June - we did not receive any credit??
Thanks Adam
June 14th, 2008 at 1:43 pm
We’re still working on it. Unfortunately, ModernBill doesn’t make it easy to credit everyone at once.
June 16th, 2008 at 9:29 am
Bloody modern bill…lol
Thanks