This afternoon we had a classic "eye dee one zero tee" error when a tech plugged a cable we'd thrown out into one of the ports on our 5.5KVA UPS and created a short. The result was that the protection circuitry on the UPS kicked in and it immediately powered down / "tripped".
Result, was 2 x DNS servers, 2 x mail servers, 1 x web server, 1 x firewall, 1 x Cisco router, 1 x Diginet modemthing, 2 x Mikrotik routers and 1 x trixbox down.
I never realised how long it would take to get all the equipment back up, but after close on half an hour everything was ticking along - or so I thought.
It turns out that trixbox didn't log in to one of our voip providers. After a long struggle, trying to analyse the log files, I used the famous Microsoft cure-all and restarted the trixbox.
Problem gone.
Under normal circumstances, the trixbox will never bomb out as a result of a lack of power - not with a big UPS and a generator to back it up. But, what can I do to ensure that trixbox will log in properly next time somebody does something stupid?
Should I just write this off against bad luck and hope it never happens again?
Result, was 2 x DNS servers, 2 x mail servers, 1 x web server, 1 x firewall, 1 x Cisco router, 1 x Diginet modemthing, 2 x Mikrotik routers and 1 x trixbox down.
I never realised how long it would take to get all the equipment back up, but after close on half an hour everything was ticking along - or so I thought.
It turns out that trixbox didn't log in to one of our voip providers. After a long struggle, trying to analyse the log files, I used the famous Microsoft cure-all and restarted the trixbox.
Problem gone.
Under normal circumstances, the trixbox will never bomb out as a result of a lack of power - not with a big UPS and a generator to back it up. But, what can I do to ensure that trixbox will log in properly next time somebody does something stupid?
Should I just write this off against bad luck and hope it never happens again?