I came in today and the CAD server was down. Nothing had really changed, but everything was apparently broken and everyone had pretty well left by the time I rolled in at 2. I came upon my frazzled boss trying to troubleshoot the problem.
Me: Can I try a few things?
Him: Do you know what you’re doing?
Me: Does the host do automatic backups?
Him: Yes. Weekly.
Me: Then I know enough.
–30 minutes later–
Me: It’s up.
Him: How did you do that?
Me: I turned it off and turned it back on again.
Him: I tried that!
Me: How many times did you do it?
Him: Once.
Me: Ah… There’s the problem. I did it three times and between the 2nd and 3rd tries I turned off and on all the services manually. Remember *whisper* Windows Server 2003 can smell fear.
Insanity sometimes receives the quant definition of doing the same thing over and over an expecting different results. When it comes to near million-dollar pieces of software deployed across multiple servers with a Java frontend, it appears insanity is a requirement of operation.