Brett's dashboard

The site is back to the primary database server now. :-)

There might be a short outage or two tomorrow early afternoon (PST) as we're planning to upgrade a bunch of servers -- and that should be the last outage for a while (famous last words). The upgrades will make it easier to improve the high availability setup and it'll give us room to install some new hardware to make everything faster.

- ask

Thanks for the update.

Hi Brett,

No - just a database server reboot gone wrong. Instead of taking a few minutes it took hours to get the server back up. :-(

Usually I'd failover to the other database server first, but as luck would have it the primary database server was already out and the reboot was to look into a problem with the backup db server (it showed some signs of having bad RAM).

The primary DB server should be back up later today so we'll have redundancy again (and the site should get faster).

- ask

ps. Apologies for only responding now - the service was of course back up long ago but I had a long power outage at home yesterday (falling powerlines due to wind), so my computer time was limited to the laptop battery and the UPS keeping the network equipment up. :-) Thankfully Robert was around, too, to look after getting the server running again or I would have had to run downtown to the datacenter.