Hi,
At approximately 20h00 last night our main web server became unstable.
Your web sites are hosted on this server.
Attempts to recover the server failed due to severe data corruption on the system drive.
At about 03h00 hours today, the main drive was replaced. As at 05h30 the new drive format completed and the OS is being loaded. We are working on this full time.
Once the operating system is reinstalled, all the web servers, user access lists, ftp servers and accounts and so on will be re-created. Databases (ie MySQL and SQL server was not affected and is still online).
Indications are that these seemingly unrelated incidents during the last weeks are related. We are now considering the possibility of foul play and that our servers were deliberately attacked. It seems likely. Our first priority is to recover as much of our services as quickly as possible - only then will be conduct a forensic audit to investigate the possibility of criminal activity.
Given the circumstances and lead-up to this, we are very concerned that our backups of your web content was deliberately subverted - but we can only check that once the server is online again.
Deliberate damage to our backups seem likely though. Please make preparations to re-upload your web content to the server as soon as you receive confirmation from us that your access accounts and server was recovered. Our advice would be to prepare for the worst and contact your web developer (or your own backups) with the view of uploading your content in the event our recovery attempts fail.
All resources at our disposal is assigned to resolve this issue as soon as possible - we will be updating facebook.com (
http://www.facebook.com/cozahost), Twitter (
http://twitter.com/cozahost) and Ops (
http://ops.cozahost.com) with our progress.
Note that we expect the helpdesk to be extremely busy dealing with this, so if you can avoid phoning by using the network status announcement on our phone line or (better) Facebook or Twitter to keep tabs on our progress it will be much appreciated...and allow the helpdesk agents to productively help with the recovery process.
Regards,
Waldo
Sign up with Google
Or am I missing something completely?
