Intermittent drop in incoming traffic

Resolved
Resolved

We confirm that there have been no traffic drops observed since 1808 GMT and incoming requests are being processed as expected. Teams will continue to monitor transaction volume statistics, gather detailed impact data and investiagation for root cause.

A detailed report on the problem will be shared in due course.

Monitoring

We have not observed any further traffic drops since the last event at 1808 and the network policy change following that.

Teams continue to monitor closely and next update will be provided at 2100.

Monitoring

We confirm that further changes have been made to our network policy to capture and filter the disruptive traffic responsible for the drops and last event of drop in traffic was noticed at 1808 GMT.

We would get back to you with the next update at 2000 GMT.

Monitoring

We have again observed a drop in traffic coming into the Arcot network between 1731 GMT and 1756 GMT and have engaged the network teams that were on standby to analyze if the traffic pattern for the disruptive activity has changed and needs additional measures to mitigate impact.

We shall get back to you with the next update by 1900 GMT.

Monitoring

With the last set of network policy changes , there have been no further traffic drop events since the last update at 1630 GMT. We continue to notice stable incoming traffic and are closely monitoring the same.

We shall get back to you with the next update by 1930 GMT.

Monitoring

We confirm that the last few events for transaction drop were observed prior to the last set of network policy changes that were implemented at 1539 GMT: 1530 - 1531 GMT 1532 - 1534 GMT 1538 - 1539 GMT

Teams are closely monitoring the network traffic patterns and are on standby in case further impact is noticed.

Our next update will follow at 1730 GMT.

Monitoring

Further investigation reveals that we are seeing what appears to be a distributed attack on the Arcot network and we are working with our operational security teams and network providers to investigate and mitigate the impact from that.

There have been no further traffic drop events since the last update at 1430 GMT. The teams working on recovery continue to watch this activity closely and are tweaking network policies to help avoid impact to Arcot services.

Out next update will follow at 1630 GMT.

Investigating

We notice additional drop and recovery events for incoming traffic on our network.

Following is a list of instances captured:

1411 - 1412 GMT 1415 - 1416 GMT 1420 - 1421 GMT

Our Network experts are working on this issue on high priority and we shall get back to you with the next update by 1530 GMT.

Investigating

We continue to observe sharp drop and recovery events for incoming traffic on our network. We have ruled out issue with ISP at this point. Our Network experts are engaged on a call right now conducting a deep-dive investigation.

Following is a list of instances captured: 1156 - 1157 GMT 1241 - 1242 GMT 1248 - 1249 GMT 1252 - 1252 GMT 1255 - 1256 GMT 1257 - 1258 GMT

We will keep you posted on the progress on this investigation. We shall provide the next update by 1430 GMT.

Began at:

Affected components
  • Arcot
    • Arcot for Issuers (AfI)
      • Secure2
      • SecureF
      • Secure4
      • Secure7
      • Secure5
      • SecureT