» Published on
An issue with shop.coop.co.uk was highlighted, causing baskets to not display correctly as well as only around 800 products were available to purchase. Investigations concluded this was due to a data issue within the extracts supplied to Naveo. These extracts were regenerated and a complete re-index was executed to resolve the issue. A PIR will be opened to investigate the root cause.
» UpdatedAll necessary indexing to bring the site live has now been completed. Missing products, product categories, product details and basket are now loading. The maintenance page has been removed, and all health checks have passed. The incident will remain under Watch Status overnight to monitor service stability. Next Update: 18/11 10:30
» UpdatedThe Engineering team, with assistance from the on call cloud team, have manually completed the processes to re-generate the output to Naveo. Following this Naveo have re-run the indexer. Restoration efforts are progressing. The team are currently attempting to re-run the Algolia index to address the product search issues. Next Update: 21:30
» UpdatedNaveo attempted to perform the re-index earlier in the day, but noticed an anomaly in the size of the data. Coop support staff concluded that there may have been an issue with the range import job from CTS. Following a rerun of the CTSLIVE outputs, the Engineering team are currently unable to rerun the processes to regenerate outputs to Naveo due to a permissions issue within Azure. The assistance of the Coop Cloud team has been sought to see if they can assist with this. The maintenance page on shop.coop.co.uk remains in place.
» UpdatedFollowing investigations with Naveo: this issue happened due to the price data export being sent to Naveo containing incorrect data. Involved teams continue to investigate further on running export processes to correct the data in Naveo. On testing the site the basket is loading, however multiple products are not displaying when doing a manual search and product category pages are not loading. Maintenance page still deployed. Next update 15:30.
» UpdatedFollowing investigations with Naveo: this issue happened due to the price data export being sent to Naveo containing incorrect data. Involved teams continue to investigate further on running export processes to correct the data in Naveo. On testing the site the basket is loading, however multiple products are not displaying when doing a manual search and product category pages are not loading. Maintenance page still deployed. Next update 15:30.
» UpdatedNaveo have responded this morning to ask if we are still seeing issues. Initial testing shows that baskets appear to be loading ok. However some product categories appear to be not be loading via the aisle links as well as some products missing when searching. This has been fed back to Naveo who are investigating this. Next update 10:30
» UpdatedCustomers using the service are experiencing issues with viewing products which are showing as unavailable as well as viewing their baskets. As a result of this, the maintenance page has been deployed whilst we await interaction with our third party suppliers Naveo. Next update Sunday 10am or earlier if the situation warrants.
» Updated