» Published on Mon, 20 Nov 2023 16:30:00 +0000

• Resolved

  The shop.coop.co.uk service has been stable since we re-balanced traffic across both regions at 10.50 this morning. Root cause investigation is ongoing and will be addressed in the Post Incident Review. No further updates.

  » Updated Tue, 21 Nov 2023 16:57:00 +0000

• Update

  Service continues to remain stable with no issues observed overnight. The causing component of the issue was identified and resolved. We are now looking to re-route and return the traffic to normal operations this morning. Once this has been completed, this will remain in watch status for the remainder of the day. Investigations on root cause will continue and be addressed in the Post Incident Review. Final update at 5pm or earlier if the situation dictates.

  » Updated Tue, 21 Nov 2023 10:34:00 +0000

• Update

  As of 4.33pm, there should no longer be any customer impact even for those who were originally affected. Further investigations into the incident confirmed that the issue is with a missing MS Azure configuration and not due to the code release itself. The release merely highlighted the symptoms. We are still investigating the cause of the Azure configuration issue. As the service is stable due to all traffic being routed via a non impacted location, this incident is in watch status and investigate the cause further in the morning. We have asked Naveo for data to aid investigation. Next update 10am Tuesday 21st November

  » Updated Mon, 20 Nov 2023 17:18:00 +0000

• Investigating

  At 3.50pm, we identified an issue on the shop.coop.co.uk service whereby up to 50% of customers would have experienced a degraded service leaving them unable to shop. This was due to a new release. The impacted traffic was re-routed at 4.10pm to mitigate any further issues of this for customers starting new journeys. This will currently be impacting customers who were on the site between this duration and we are looking to resolve impacted customer journeys. There is a workaround for impacted customers which is to abort the order, clear their device cookies and to start again. Downgrading to a Severity 3. Next update 5.30pm

  » Updated Mon, 20 Nov 2023 16:30:00 +0000