Internet connection issue with a UK Data Centre

Resolved
Resolved
After 2 weeks, 3 days, 21 hours, and 17 minutes

As of 10:00 UTC, our engineering teams completed work to restore full resilience within the London DC.

We thank you for your patience while we addressed the issue and apologize for any inconvenience this may have caused. This will be the final update for this issue.

Monitoring
After 1 week, 4 days, 3 hours, and 52 minutes

Please be advised that we are still waiting on remaining work to be completed in order to declare and operate with full resilience. At this point we do not have an update available.

Next update will be posted once site work is fully completed.

Monitoring
After 4 days, 2 hours, and 43 minutes

The work on restoration of full resilience within the London DC is not yet completed, therefore the incident will continue to remain in partial restore status. There is no customer impact. We will make further posting at 10am UTC Monday, March 27th or sooner as further information becomes available.

Monitoring
After 20 hours and 59 minutes

At this time there is no customer impact but we are leaving this incident in partial restore whilst engineering teams work to restore full resilience within the London DC. We will make further posting at 10am UTC on Monday or as soon as further information becomes available.

Monitoring
After 2 hours and 33 minutes

We have declared a partial restore, traffic is being routed normally and there is no customer impact. We are leaving this incident in monitoring status whilst our engineers continue to work on a networking appliance in the London DC. We will make a further posting at 10am UTC or as soon as further information becomes available.

Monitoring
After 37 minutes

Please be advised that our UK data centre is now back in service. Our engineers are currently working to re-route traffic to ensure that customers get their regional landing pages for searches and other content. We will continue to monitor the affected areas closely and we will make a further posting at 16:00 hours or sooner if the situation changes.

Identified
After 22 minutes

Engineers have identified a fault within the UK DC and have failed over the affected equipment. They are now bringing the DC back into service for testing. Please be aware that UK customers may get a mixture of UK and EU content whilst the testing is in progress. We will make a further posting at 14:30 or as soon as testing has concluded.

Investigating

Please be aware that we are experiencing an internet connection issue to one of our UK data centers. Customers with the web security service have reported connection failures. Our engineering team have already failed over all traffic to other EU data centers. If you are still experiencing connection issues please try restarting browsers / proxy servers and clearing DNS cache. We will make a further posting at 14:30UTC or as soon as we have further information.

Began at: