Network Paths in Failed State despite producing Delivery data

Broadcom Engineering has continued to monitor the stability and consistency of Network Paths and their states across the last several days. Our mitigation appears to have been successful and Network Path States have stabilized.

Broadcom Engineering has applied a mitigation against the known paths exhibiting this issue. We will keep this status page open and monitor across the next couple of days to ensure that the issue fully resolved.

We have continued to monitor this problem through the weekend, and have confirmed that a small number of paths, spread across all application nodes are continuing to experience this issue.

Affected paths will show in a 'Failed' state, despite successfully producing Delivery data. This inconsistent state may impact alerting for affected paths.

Broadcom Engineering is continuing to investigate the issue and will post updates here.

Placing this incident in a 'recovering' state.

Broadcom Engineering has applied a mitigation to this issue that we believe has been effective for the majority of paths. Network path statuses should be up to date at this point. We will continue to monitor this issue through the weekend and will provide updates here.

Broadcom Engineering has identified the root cause of the issue and we are working on a mitigation, which we will apply as soon as possible. We will post further updates here.

Broadcom Engineering is aware of an issue whereby Network Path States for some Network Paths are displaying as 'Failed' despite continuing to produce Delivery data.

This problem has been confirmed on the App-13 and App-20 application nodes, but we suspect this is affecting all application nodes.

Broadcom Engineering is investigating the issue and will post further updates here.