Nextgennews.net down and out

[savage]

We are aware of the issue and we are looking into it.

It's not a easy thing to fix unfortuantely, but we will most certainly get to the bottom of this, and all customers affected will be credited as well.

Sorry about the issue guys. This is a biggy

 

[savage]

Hi Guys,

We've seemed to have our hand on the issue. A few (not all) the front-end servers has been fixed and patched. It looks like the issue are resolved.

Can someone perhaps just test and confirm? If it is indeed fixed, we will roll out the fix to the rest of the servers ASAP.

 

[cavedog]

Hi Guys,

We've seemed to have our hand on the issue. A few (not all) the front-end servers has been fixed and patched. It looks like the issue are resolved.

Can someone perhaps just test and confirm? If it is indeed fixed, we will roll out the fix to the rest of the servers ASAP.

Looks like its working but SSL on port 443 is still down. Had to switch to port 119 non ssl for it to work.

 

[savage]

There will be intermittent connectivity issues due to high load. This will come right over the next few hours as we patch the remaining servers and bring them back online...

Everything should be back to normal in the next few hours, after which we will pull usage stats and pass credits to users as and where they are due.

Can't apologize enough about this guys. Something strange (still unknown) changed which caused the UTF-8 character encodings to go all whacked.

 

[savage]

Hi,

We have had an hardware failure on one server (which is being addressed) and all other servers has now been patched and are online. We are back operating normally at this point in time with normal load and performance on our cluster So everything should be back up and running without any issues.

Anyone still experiencing issues, please contact us through the support desk so that your problem(s) may be addressed. No need to come and request refunds / credits, they will be allocated to you over the next day or so (it's a manual process).

Premium Subscribers will get 4 days of free access, whilst Block Subscribers will get credited 125% of what they have downloaded between Thursday the 30th, and today, Sunday the 2nd.

 

[Neo_X]

Hi,

We have had an hardware failure on one server (which is being addressed) and all other servers has now been patched and are online. We are back operating normally at this point in time with normal load and performance on our cluster So everything should be back up and running without any issues.

Anyone still experiencing issues, please contact us through the support desk so that your problem(s) may be addressed. No need to come and request refunds / credits, they will be allocated to you over the next day or so (it's a manual process).

Premium Subscribers will get 4 days of free access, whilst Block Subscribers will get credited 125% of what they have downloaded between Thursday the 30th, and today, Sunday the 2nd.

Awesome news!
Just have to trust Murphy to always know when its weekend.....

glad you got it sorted though

 

[achuman]

The service seems very up and down today. I don't think its my ISP as I'm remoting into my box at home using teamviewer with no issues.

 

[savage]

The service seems very up and down today. I don't think its my ISP as I'm remoting into my box at home using teamviewer with no issues.

We are not experiencing any issues today so far, and load is not that high either. What errors (if any) do you see in the client?

 

[achuman]

We are not experiencing any issues today so far, and load is not that high either. What errors (if any) do you see in the client?

I managed to get hold of the support guys. They are sorting out the problem.

 

[X-Gamer]

Hi,

We have had an hardware failure on one server (which is being addressed) and all other servers has now been patched and are online. We are back operating normally at this point in time with normal load and performance on our cluster So everything should be back up and running without any issues.

Anyone still experiencing issues, please contact us through the support desk so that your problem(s) may be addressed. No need to come and request refunds / credits, they will be allocated to you over the next day or so (it's a manual process).

Premium Subscribers will get 4 days of free access, whilst Block Subscribers will get credited 125% of what they have downloaded between Thursday the 30th, and today, Sunday the 2nd.

Awesome, thanks.

One other thing. My exchange is really crappy after power failures and only stabilises after about 5 days. So my DSL frequently disconnects.

2014-11-03 18:24:40,664 WARNING: Cannot connect to server news.nextgennews.net:443 [502 Your connection has been refused as you are already connected from 197.89.31.194]
2014-11-03 17:55:09,252 WARNING: Cannot connect to server news.nextgennews.net:443 [502 Your connection has been refused as you are already connected from 197.83.235.127]

This causes the server to think I'm still connected from the old IP, which blocks me from connecting again. Is there a way to refresh it quicker so I can connect again?

 

[savage]

Unfortunately not at this point in time. We're doing the checks as fast as possible.

Our new server software will handle this, much, much better, but it's unfortunately too early to even talk about any kind of ETA at this stage.

 

[Mr Feesh]

Unfortunately not at this point in time. We're doing the checks as fast as possible.

Our new server software will handle this, much, much better, but it's unfortunately too early to even talk about any kind of ETA at this stage.

is the server down again?

 

[savage]

Hi,

Nothing is/was down. We are up and running...

 

[Nimz]

Also having issues

 

[Mr Feesh]

Hi,

Nothing is/was down. We are up and running...

have had multiple downloads fail the last few days

 

[jarrodr]

I had the issue yesterday. Was told to re add the nzbs, worked.

 

[brucem]

I also had some corrupted downloads, when I readded they worked fine

 

[savage]

All intermittent SSL connectivity issues, as well as CRC/Corruption issues should be resolved.

If you have a failed download and re-adding them didn't work, mail us the NZB as we'd more than likely need to remove the content from the caches. Please read carefully - re-add the NZB - that does not mean retry the parts that failed. You will need to re-download the entire NZB from scratch to ensure proper data consistency.

The root cause was due to a switch that was misconfigured by our transit provider, where they enabled 9216 bytes MTU settings (Jumbo Frames) on their interfaces without communicating it to us, and we of course rejecting everything over the standard of 1500 bytes.

Our load balancers doesn't give detailed interface statistics, so it was nearly impossible to see that this was the issue, until of course the transit provider finally provided some of their interface statistics and configurations from their switches

It amazes me everytime how much ass sucking and ball licking is required to get a large telco to simply cut & paste a interface configuration for you - even more so when it's your own interface that you're connected too...

 

[Mr Feesh]

All intermittent SSL connectivity issues, as well as CRC/Corruption issues should be resolved.

If you have a failed download and re-adding them didn't work, mail us the NZB as we'd more than likely need to remove the content from the caches. Please read carefully - re-add the NZB - that does not mean retry the parts that failed. You will need to re-download the entire NZB from scratch to ensure proper data consistency.

The root cause was due to a switch that was misconfigured by our transit provider, where they enabled 9216 bytes MTU settings (Jumbo Frames) on their interfaces without communicating it to us, and we of course rejecting everything over the standard of 1500 bytes.

Our load balancers doesn't give detailed interface statistics, so it was nearly impossible to see that this was the issue, until of course the transit provider finally provided some of their interface statistics and configurations from their switches

It amazes me everytime how much ass sucking and ball licking is required to get a large telco to simply cut & paste a interface configuration for you - even more so when it's your own interface that you're connected too...

pm me your email because I have had downloads fail still, some new like 1 day old only.

 

[nugpot]

Zero successful again this morning. All worked fine via another News service.