Resolved

The previous reported concern with email delays in the NAM region has been resolved. The service is fully restored and there is no longer an impact to customers. This incident is resolved.

Monitoring

Email queues on the Broadcom infrastructure are back to normal levels. Customers sending and receiving emails using NAM based infrastructure will no longer experience email delays.

Any remaining emails queued on third party or customer MTAs will be delivered based on their respective retry schedules.

We are closely monitoring the email service and will provide our next update on August 28, 2020 at 22:00 UTC, or as soon as more information becomes available.

Update

The majority of existing queued emails on Broadcom infrastructure have successfully delivered. Any emails queued on third party or customer MTAs will be delivered based on their respective retry schedules.

We are closely monitoring the email service will provide further updates as more information becomes available.

Update

Emails previously queued on Broadcom infrastructure are successfully delivering. Any emails queued on third party or customer MTAs will be delivered based on their respective retry schedules. A subset of customers may continue to experience email delays while the backlog clears.

We will provide an update at 18:00 UTC, or as soon as more information becomes available.

Identified

As of 16:02 UTC, we have applied mitigation to address the configuration errors. Emails previously queued have started delivering. Any emails queued on third party or customer MTAs will be delivered based on their respective retry schedules. Customers will no longer experience errors while connecting but may continue to experience delays while sending and receiving emails.

We will provide an update at 17:30 UTC, or as soon as more information becomes available.

Investigating

We are aware of customers provisioned on NAM infrastructure currently experiencing intermittent configuration errors while sending and receiving emails. Impacted customers will experience error message ‘421-the config data could not be retrieved (code CDS111)’. We are investigating this issue as a priority and have engaged all appropriate teams at Broadcom.

Please note that there is no impact to protection services, and all other aspects of our services remain functional.

We will provide an update as soon as more information becomes available.

Began at:

Affected components