Ayende @ Rahien

Hi!
My name is Oren Eini
Founder of Hibernating Rhinos LTD and RavenDB.
You can reach me by phone or email:

ayende@ayende.com

+972 52-548-6969

, @ Q c

Posts: 10 | Comments: 37

filter by tags archive

Things you never want to hear from a support person dealing with a production server crash

time to read 1 min | 84 words

I got all of the following during a recent support call to deal with a hard server crash:

  • I have never seen something like that before.
  • Our internal tools crash when they connect to your servers.
  • We are probably not going to recover this server.
  • You do have a backup, right?

Thankfully, it turned out to be something stupid that was fixed very quickly. But it sure was scary.


Comments

dan
dan

you do have a backup, right?

Alex Simkin

So, what was that stupid thing?

configurator

You left out the most interesting part! What was the problem?

Mr_Simple

I always start those conversations with, "No sweat, we'll just restore your backup." It's more fun to watch them puke sooner than later.

I figure if I waste 1/3 of my life doing backups everyone else can too.

Comment preview

Comments have been closed on this topic.

FUTURE POSTS

  1. Production postmortem: The case of the memory eater and high load - about one day from now
  2. Production postmortem: The case of the lying configuration file - 3 days from now
  3. Production postmortem: The industry at large - 4 days from now
  4. The insidious cost of allocations - 5 days from now
  5. Find the bug: The concurrent memory buster - 6 days from now

And 4 more posts are pending...

There are posts all the way to Sep 10, 2015

RECENT SERIES

  1. Find the bug (5):
    20 Apr 2011 - Why do I get a Null Reference Exception?
  2. Production postmortem (10):
    14 Aug 2015 - The case of the man in the middle
  3. What is new in RavenDB 3.5 (7):
    12 Aug 2015 - Monitoring support
  4. Career planning (6):
    24 Jul 2015 - The immortal choices aren't
View all series

Syndication

Main feed Feed Stats
Comments feed   Comments Feed Stats