US data center ongoing troubleshooting from maintenance

Resolved
Resolved

Functionality has been restored and appliances should be back to an OK state. All backend services are back to normal. During the time period between 02:00 am PDT through approximately 08:50 am PDT, data was lost for various portions of the Hosted UI and notifications were not sent. However, appliances were processing data successfully as configured - email processing was not impacted and blocking would have successfully been working but would not be reported in the UI or generate a notification. A detailed post-mortem will follow next week.

If you have ongoing issues, please reach out to the VMware Support team on Customer Connect https://customerconnect.vmware.com/support

Monitoring

A fix has been implemented and we are monitoring the results.

Identified

The issue has been identified and a fix is being implemented.

Investigating

Update 08:00 PDT: Our Ops team continues to investigate the issues related to the maintenance reported in https://lastline.statuspage.io/incidents/rs5vkpcy5nfh which expired. We are still experiencing some issues in our US data center. Hosted and On-Premise appliances are reporting offline in the hosted portal for some customers. Further information to follow.

Began at:

Affected components