During the deployment of a hotfix, one of the application services hosting the Manager API, failed to deploy.
This was due to the files in the service folder having their permissions changed so that they could not be modified.
After engaging with our suppliers it transpired that this was a general fault in the EU West region.
This fault was not visible to us as we consult the global status view when making a decision to deploy.
In order to ensure that these faults are captured so that we do not deploy when infrastructure is degraded, we will now consult the regional status boards.
Customers was not affected by this deployment failure but our backend components briefly ended up running different versions of our code.
iRiS Systems Engineering