Email Delays in NAM and EMEA Region

Resolved
Resolved

We have monitored the service for stability and this incident shall now be closed.

Monitoring

Email queues are back to pre incident levels. We will now monitor the service for stability and provide updates as soon as new information becomes available.

Identified

Email queues are dropping at a steady pace. Customers should start seeing emails getting successfully delivered. We will provide updates as new information becomes available.

Identified

As per our ongoing investigation, it is suspected that the issue may be occurring due to a subset of application servers becoming unresponsive due to memory issues. While the troubleshooting continues, we are a implementing a workaround of rolling restarts which is helping to reduce the queuing. Where the email queues are still present and we are working to manually clear the queues where possible. We will provide updates once new information becomes available.

Investigating

We continue to investigate this issue as high priority. Note that there is no impact to protection services. We will provide updates as new information becomes available.

Investigating

We continue to investigate this issue as high priority. We will provide updates as new information becomes available.

Investigating

We are seeing email queues building across multiple NAM and EMEA regions. Customers will experience delays in sending/receiving emails. We are continuing to investigate this issue and have engaged our platform provider. We will provide updates as new information becomes available.

Investigating

A subset of NAM and EMEA infrastructure originally impacted by this issue remains out of service. Customers emails will remain queued on these servers and will attempt delivery once the underlying issue is resolved and the servers are placed back online. All new emails continue to deliver without any delays.

Our engineering teams remain engaged and are actively investigating the issue. We will provide updates as more information becomes available.

Investigating

We continue to investigate the underlying cause of this issue. We will provide an update as soon as more information becomes available.

Investigating

We have identified that in addition to the NAM region, customers in the EMEA region are also impacted and experiencing delays sending and receiving emails. We will deliver queued email following our retry schedule once service is restored.

Our engineering teams are engaged and actively investigating the issue. We will provide updates as more information becomes available.

Investigating

We are aware of a subset of customers provisioned on our NAM infrastructure experiencing delays sending and receiving emails. We will deliver queued email following our retry schedule once service is restored.

We are currently investigating this issue and will provide updates as new information becomes available. Please note that there is no impact to protection services, and all other aspects of our services remain functional.

Began at:

Affected components