http://ayende.comAyende @ RahienCopyright (C) Ayende Rahien 2004 - 2021 (c) 202660@Ayende: Ah, okay, that's a lot better than I initially thought. I should have remembered that you're smart. I personally would never trust anything important to just two zones, but I understand that a lot of companies are budget-conscious and can take a short outage, especially if they can point at someone else to blame.http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment6http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment6Mon, 02 Jul 2012 16:47:24 GMTHummm, wondering whether this was the pesky leap second introduced on 30 June at midnight..http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment5http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment5Mon, 02 Jul 2012 14:48:33 GMTChristopher, We are running in multiple availability zones, and we are putting non replicated clients in multiple zones. I'll post a full discussion of this tomorrow, but the reason you saw a lot of activity about that is that most of our free plans resided on that region. "The secondary node" is actually a RavenDB term, which refers to the secondary node that you fail to. The question if you have tertiary or more actually depend on your plan. And N node in a replicated plan are on a different availability zone.http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment4http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment4Sun, 01 Jul 2012 19:39:12 GMTHave you considered hosting RavenHQ servers in multiple availability zones and regions, and randomizing your non-replicated customers between zones? It sucks to have a large portion of your customer base experience an outage because of you. By hosting in multiple zones, you can reduce the portion of your customer base that any single incident affects. Also, when you say "the secondary node", I immediately get worried. Is there a tertiary node? Are all the secondary nodes in the same zone as each other?http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment3http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment3Sat, 30 Jun 2012 16:44:00 GMTNetflix, Pinterest en Instagram are/where offline too.http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment2http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment2Sat, 30 Jun 2012 11:01:44 GMTNeeds more chaos monkey! http://www.codinghorror.com/blog/2011/04/working-with-the-chaos-monkey.html Fail early, fail often! :)http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment1http://ayende.com/156737/ravenhq-amazon-ec2-outage#comment1Fri, 29 Jun 2012 16:30:54 GMT