Major Cloud Providers – Monthly Outage Recap November

MS Azure

11/29/18 Azure Data Lake Store/Data Lake Analytics – North Europe Between 08:30 and 13:39 UTC on 29 Nov 2018, a subset of customers using Azure Data Lake Store and/or Data Lake Analytics may have experienced difficulties accessing resources hosted in this region. Data ingress or egress operations may have also timed-out or failed. Azure Data Lake Analytics customers may have experienced job failures. In addition, customers using other services with dependencies upon Azure Data Lake Store resources in this region – such as Databricks, Data Catalog, HDInsight and Data Factory – may also have experienced downstream impact. 

11/28/18 Storage – West US 2 – Mitigated Between 04:20 and 12:30 UTC on 28 Nov 2018, a subset of Storage customers in West US 2 may have experienced difficulties connecting to resources hosted in this region. Customers using resources dependent on Storage may have also seen impact.

11/27/18 Multi-Factor Authentication

Between 14:25 UTC and 17:08 UTC on 27 Nov 2018, customers using Multi-Factor Authentication (MFA) may have experienced intermittent issues signing into Azure resources, such as Azure Active Directory, when MFA is required by policy. Impacted customers may have encountered timeout errors.

11/27/18 DownDetector

Problems at Microsoft Azure

Microsoft Azure is having issues since 9:49 AM EST. Most reported problems:

  • Cloud services (47%)
  • Website hosting (43%)
  • Virtual machines (8%)

11/26/18 Virtual Network – UK South and UK West Between 11:19 and 16:56 UTC on 26 Nov 2018, a subset of customers using Virtual Network in UK South and UK West may have experienced difficulties connecting to resources hosted in these regions. Some customers using Global VNET peering or replication between these regions may have experienced latency or connectivity issues.

11/19/18 RCA – Issues connecting to Azure resources in Europe, Asia and the Americas regions using Multi-Factor Authentication Between 04:39 UTC and 18:38 UTC on 19 November 2018, Microsoft Azure AD Multi-Factor Authentication (MFA) services experienced an outage. Users of Azure Active Directory authentication services – including users of Office 365, Azure, Dynamics and other services which use Azure Active Directory for authentication – were unable to log in if MFA was required as determined by their organization’s policy.

11/19/18 DownDetector

Problems at Microsoft Azure

Microsoft Azure is having issues since 10:21 AM EST. Most reported problems:

  • Cloud services (60%)
  • Website hosting (40%)

11/14/18 Azure DevTest Labs – Mitigated Between 20:29 and 22:28 UTC on 14 Nov 2018, a subset of customers using Azure DevTest Labs may have received failure notifications when attempting to access their Labs via the Azure Portal.

11/13/18 App Service & Function Apps Between 11:10 and 12:25 UTC on 13 Nov 2018, you were identified as a customer using App Service and/or Function Apps who may have received intermittent HTTP 500-level response codes, have experienced timeouts or high latency when accessing App Service (Web, Mobile and API Apps) deployments hosted in these regions. Impacted customers may have also seen issues with their Azure App Service Scaling settings.

11/8/18 Azure App Service and Functions App – Mitigated Between 22:48 UTC on 08 Nov 2018 and 13:30 UTC on 09 Nov 2018, a subset of customers using App Services may have experienced errors when accessing the Azure Functions blade, or experienced issues when accessing app settings in the portal 

11/2/18 Azure Portal Timeouts and Latency Between 23:05 UTC on 02 Nov 2018 and 00:21 UTC on 03 Nov 2018, some customers may have experienced high latency or timeouts when viewing resources or loading blades through the Azure Portal

 

AWS

11/22/18 AWS suffered an hour-long network failure on November 22, which halted the services of major local online shopping malls and cryptocurrency exchanges. AWS later said the error, which lasted 84 minutes, was caused by a DNS server error in some parts of Seoul.

11/13/18  DownDetector

Problems at Amazon Web Services Amazon Web Services is having issues since 6:00 PM EST. Most reported problems:

  • Log-in (70%)
  • S3 (20%)
  • EC2 (10%)

 

Other Platforms

11/29/18 VMware Cloud backend service Availability issue VMware Cloud backend services are experiencing an Availability issue. Users may not be able to login to the consoles of our VMware Cloud Services. Start Time: November 29, 2018 08:45 PM UTC End Time: November 29, 2018 10:15 PM UTC

VMware Cloud Services intermittent login issue VMware Cloud Services are experiencing intermittent console login issues. Users may not be able to login to the consoles of our VMware Cloud Services. Start Time: November 29, 2018 11:15 PM UTC End Time: N/A

11/29/18 SAP Cloud Platform Canada (Toronto) [neo-ca1] – Service Advisory Since approximately 05:46 UTC on 29 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform.  Impact: [Neo] API Management. End time 08:17 UTC on 29 Nov 2018. 

11/28/18 VMware AppDefense Service Availability issue VMware AppDefense Service is experiencing an Availability issue. User may not be able to access the service or may experience trouble while accessing the service. Start Time: November 28, 2018 04:40 PM UTC End Time: November 28, 2018 07:11 PM UTC

11/22/18 VMware Kubernetes Engine Performance Degradation issue VMware Kubernetes Engine Service is experiencing Performance Degradation issue. Start Time: November 22, 2018 12:15 AM UTC End Time: November 22, 2018 01:50 AM UTC 

11/20/18 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 07:20 UTC on 20 Nov 2018, customers may have once again experienced high network latency on the SAP Cloud Platform. End time approximately 08:52 UTC on 20 Nov 2018.

11/19/18 Google Cloud Console Incident #18006 Google Cloud Console project creation when enabling APIs broken. Incident began at 2018-11-19 15:58 and ended at 2018-11-19 23:02

11/18/18 SAP Cloud Platform Europe (Rot) [cf-eu1] – Service Advisory Between approximately 15:30 UTC on 16 Nov 2018 and 12:12 UTC on 18 Nov, customers may have experienced a disruption on the SAP Cloud Platform Cloud Foundry Environment (CF-EU1). Lifecycle operations for Cloud Foundry applications, as well as connections to existing service instances are currently impacted

11/14/18 VMware Cloud Services – Backend Service Intermittent Availability Issue VMware Cloud backend services are experiencing an intermittent availability issue. User may not be able to add a credit card and change payment method. Start Time: November 14, 2018 07:30 AM UTC  End Time: November 14, 2018 08:30 AM UTC

11/14/18 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 09:16 UTC on 14 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. OAuth functionality may be impacted. Service restored as of approximately 10:38 UTC

11/13/18 SAP Cloud Platform Europe (Netherlands) [cf-eu20] – Service Advisory Since approximately 12:55 UTC on 13 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Lifecycle management operations may be unavailable. Existing and already deployed applications wouldn’t be impacted 

11/12/18 Google Cloud Networking Incident #18018 Connectivity issues connecting to Google services including Google APIs, Load balancers, instances and other external IP addresses. We have reports of Google Cloud IP addresses being erroneously advertised by internet service providers other than Google. 1 hour 23 minutes

11/8/18 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 12:45 UTC on 08 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Service restored as of approximately 13:22 UTC

Europe (Rot) [CF-EU1] – Service Advisory Since approximately 12:45 UTC on 08 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. HANA is inaccessible from CF Runtime as well as cloud cockpit. Service restored as of approximately 13:22 UTC

11/8/18 Problems at Go Daddy

Go Daddy is having issues since 2:08 PM EST. Most reported problems:

  • Domains (52%)
  • Hosting (37%)
  • Web tools (10%)

11/7/18 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 13:25 UTC on 07 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Applications and services may be unavailable. Service restored approximately 15:28 UTC

11/6/18 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 11:53 UTC on 05 Nov 2018, customers may experienced sporadic disruption on the SAP Cloud Platform, impacting Lifecycle management operations for Java applications (starting of Java applications). Service restored approximately 09:20 UTC 

11/5/18 SAP Cloud Platform Europe (Rot) [neo-eu1]- Service Advisory Since approximately 05:30 UTC on 05 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Service restored as of approximately 09:03 UTC

11/4/18 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 23:51 UTC on 03 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Lifecycle management operations for Java applications may not be possible. Service has been restored as of approximately 13:02 UTC

11/3/18 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 00:13 UTC on 03 Nov 2018, customers may have experienced a disruption on the SAP Cloud Platform. Service has been restored as of approximately 03:03 UTC

11/2/18 Google Cloud Functions Incident #18004 Creation of new google cloud functions and update of current one are failing. 18 minutes

11/2/18 Google Cloud Functions Incident #18003 We are experiencing an issue with Google Cloud functions were the creation of new functions and update of current one are failing, beginning at Friday, 2018-11-02 02:31 US/Pacific. Early investigation indicate(s) that approximately 25% of requests are affected by this issue. 37 minutes