» Published on
Deep dive technical investigations highlighted that the connection between Salesforce and DAPI was preventing Membership transactions from processing. The DAPI side of the link was inaccessible. Technical teams completed a redeploy of the data and this has restored service. In parallel, activities have been agreed to address any outstanding membership transactions which had been requested and unable to be processed during this incident. These activities will be completed as part of a PIR and post incident activity. The Salesforce system has remained stable overnight and through this morning. No further updates.
» UpdatedDeep dive technical investigations highlighted that the connection between Salesforce and DAPI was preventing Membership transactions from processing. The DAPI side of the link was inaccessible. Technical teams completed a redeploy of the data and this has restored service. In parallel, activities have been agreed to address any outstanding membership transactions which had been requested and unable to be processed during this incident. The MI stakeholders have agreed to keep this incident in WATCH status to monitor service status and complete the necessary background activities. Further post incident actions will be completed as part of the PIR. Next update 09/02 10:30
» UpdatedDeep dive investigations continue. The current impact has been highlighted at around 14,400 memberships unable to be processed, this will increase daily. Focused investigations are now on the production system link from Salesforce to DAPI. This issue has been replicated within the pre-prod environment and works as expected. Any customers (public) signing up to new memberships from the self service solution are successful. CBS colleagues are seeing significant issues with their processing activities. Key focus remains between MI stakeholders and support teams. A follow up MI bridge call has been scheduled for 10:00 tomorrow to review all activities and gather updates. Next update 08/02 11:00
» UpdatedCBS colleagues have reported an issue whereby some activities are unable to be completed in Salesforce. Following an initial MI bridge call this morning, a number of next step activities have been agreed between the MI stakeholders, and these will be progressed urgently. In parallel, Salesforce have confirmed critical priority of the incident, assigning an engineer to work with our Digital teams to investigate. CBS colleagues have provided an impact statement to allow focused investigations on specific elements of the end-to-end process. MI bridge call will be reconvened at 14:30. Next update 15:30.
» UpdatedCBS Colleagues reported an issue whereby some activities are unable to be completed in Salesforce. Investigations have been ongoing throughout 5th February and today, and remediation activities are being explored. An urgent call has been logged with Salesforce and internal investigations by Digital support teams are also continuing in parallel. The current workaround is that CBS colleagues can input any actions retrospectively once the issues is fixed. An Major Incident call has been convened for tomorrow morning. Next update tomorrow at 10:30am.
» Updated