Major Cloud Providers – Monthly Outage Recap June

MS Azure

-DownDetector

6/5/19 Problems at Microsoft AzureMicrosoft Azure is having issues since 3:29 PM EDT. Most reported problems:

  • Cloud services (50%)
  • Website hosting (40%)
  • Virtual machines (10%)

6/14/19 RCA – Virtual Machines and Virtual Networks (Management) – North EuropeBetween 15:45 and 20:58 UTC on 14 Jun 2019, a subset of customers using Virtual Machines, Virtual Machine Scale Sets, and/or Virtual Networks in the North Europe region may have experienced failures when attempting service management operations including create, update, delete, and scale. Azure Cloud Shell customers may have seen the error message “Failed to provision a Cloud Shell.”

AWS

6/27/19

VMware Cloud Services Console Login/Functionality IssuesThis incident affected: VMware Cloud on AWS

Start Time: June 27, 2019 05:10 PM UTC 
End Time: June 27,2019 06:10 PM UTC

VMware Cloud on AWS Console availability issue.Users may experience issues accessing the VMware Cloud on AWS Console. 

Start Time: June 27, 2019 07:10 PM UTC 
End Time: June 27, 2019 07:40 PM UTC

6/25/19 VMware Cloud on AWS Console Availability issue User may not be able to access the console or may experience trouble while accessing the console.

Start Time: June 25, 2019 01:20 AM UTC
End Time: June 25, 2019 06:26 AM UTC

-DownDetector

6/24/19 Problems at Amazon Web Services

Amazon Web Services is having issues since 7:32 AM EDT.

6/20/19 VMware Cloud on AWS: Intermittent capacity issues in US-East-1 RegionNew provisioning or adding host would fail for new and existing orgs in US-West-1.

Start Time: June 20, 2019, 05:40 PM UTC 
End Time: July 03, 2019, 01:00 PM UTC

-DownDetector

6/13/19 Problems at Amazon Web Services

Amazon Web Services is having issues since 1:36 PM EDT.

6/5/19 VMware Cloud on AWS – SDDC provisioning failures Provisioning of New SDDC/deployment will not work. 

Start Time : 05 June 2019 02:20 AM UTC
End time : 05 June 2019 04:40 AM UTC

-DownDetector

6/2/19  Problems at Amazon Web Services

Amazon Web Services is having issues since 3:20 PM EDT. Most reported problems:

  • EC2 (50%)
  • AWS Console (30%)
  • S3 (20%)

Other Platforms

6/28/19 VMware Skyline Service Intermittent Availability issue Users may not be able to login to SKYLINE-ADVISOR via my.vmware.com. 

Start Time: June 28, 2019 03:55 PM UTC 
End Time: June 28, 2019 06:01 PM UTC 

6/27/19 VMware Cloud Services Console Login/Functionality Issues

Start Time: June 27, 2019 05:10 PM UTC 
End Time: June 27,2019 06:10 PM UTC

6/26/19

VMware AppDefense service Intermittent Availability issue Users will not see alerts displayed in the UI.

Start Time: June 26, 2019 06:35 PM UTC 
End Time: June 26, 2019 07:21 PM UTC 

Google Cloud Networking Incident #19014 Cloud VPN endpoints in us-east1 and us-east4 experiencing elevated rates of packet loss. Incident began at 2019-06-26 15:08 and ended at 2019-06-26 15:37 (US/Pacific) lasting 28 minutes

6/24/19 SAP Cloud Platform Europe (Frankfurt) [neo-eu2] – Service Advisory Since approximately 07:57 UTC until 10:50 UTC, HTML5 applications are unavailable. UI Theme Designer is unavailable

6/23/19

-SAP Cloud Platform US East (Ashburn) [neo-us1] – Service Advisory Since approximately 06:55 UTC until 07:33 UTC, Forms by Adobe is unavailable

-SAP Cloud Platform Identity Authentication – Europe – Service Advisory Since approximately 04:16 UTC until 04:51 UTC, A general disruption is impacting the availability of applications and services

6/22/19

Intermittent Console Login issues for our VMware Cloud Services. Users may experience intermittent issues when attempting to login to the consoles

Start : June 22, 2019 08:50 PM UTC
End : June 22, 2019 09:43 PM UTC

-SAP Cloud Platform Australia (Sydney) [neo-ap1] – Service Advisory Since approximately 16:28 UTC until 17:50 UTC, A general disruption is impacting the availability of applications and services

6/21/19 SAP Cloud Platform Europe (Frankfurt) [neo-eu2] – Service Advisory Since approximately 14:15 UTC until 15:39 UTC, A general disruption is impacting the availability of applications and services

6/20/19 SAP Cloud Platform Identity Authentication – Europe – Service Advisory Since approximately 01:26 UTC until 02:45 UTC, A general disruption is impacting the availability of applications and services

6/18/19 Intermittent Console Login issues for our VMware Cloud Services Intermittent issues when attempting to login to the consoles or our VMware Cloud Services.

Start Time: June 18, 2019, 5:55 PM UTC 
End Time: June 18, 2019, 7:13 PM UTC

6/14/19 Vmware Cloud PKS Availability Issue VMware Cloud PKS is experiencing degraded performance. Customers may experience issues with provisioning of new cluster. 

Start Time: June 14, 2019, 7:00 AM UTC
End Time: June 14, 2019, 3:05 PM UTC

6/13/19 Google Cloud Networking Incident #19013 We are investigating an issue with network connectivity in southamerica-east1. Incident began at 2019-06-13 10:04 and ended at 2019-06-13 11:03 (US/Pacific) lasting 59 minutes

6/12/19

-Google Cloud Networking Incident #19012 We are investigating a Cloud Networking issue in europe-west6. Incident began at 2019-06-12 08:09 and ended at 2019-06-12 08:37 (all times are US/Pacific) lasting 28 minutes

-Google Cloud Networking Incident #19011 CloudNetworking issue is currently affecting instances in the following zones europe-west1-b us-central1-c, europe-west1-d, europe-west1-c, asia-northeast1-b, us-east4-a, us-east4-c asia-northeast1-a, us-west1-a, us-east4-b and asia-northeast1-c . Incident began at 2019-06-12 03:13 and ended at 2019-06-12 05:07 (US/Pacific).

-Cloud Developer Tools Incident #19001 Google Cloud functions deployments are experiencing a 20% error rate. Incident began at 2019-06-12 02:17 and ended at 2019-06-12 03:13 (US/Pacific) lasting 55 minutes

Google Cloud Functions Incident #19003 We are investigating timeouts with Google Cloud Functions deployments. Incident began at 2019-06-12 02:10 and ended at 2019-06-12 03:15 (US/Pacific) lasting 1 hour 5 minutes

6/8/19 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 06:00 UTC until 07:30 UTC, Customer will not be able to Model and Deploy the Business Rules.  Business Rules service is partially available

6/7/19 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 09:15 UTC until 09:33 UTC, Forms by Adobe is unavailable

6/6/19

SAP Cloud PlatformUS East (Sterling) [neo-us3] – Service Advisory Since approximately 09:19 UTC until 13:36 UTC Portal sites are unavailable

SAP Cloud Platform Europe (Frankfurt) [cf-eu10] – Service Advisory Since approximately 10:27 UTC until 12:29 UTC Ingestion of IoT sensor data is not possible

Google Cloud Console Incident #19006 Users trying to add API restrictions to an API key in Cloud Console may see an incomplete list of possible APIs to restrict their keys to. Incident began at 2019-06-06 11:56 and ended at 2019-06-07 04:20 (US/Pacific) lasting 16 hours 24 minutes

6/5/19

-SAP Cloud Platform Europe (Frankfurt) [neo-eu2] – Service Advisory Since approximately 14:42 UTC until 16:57 UTC Lifecycle management operations for Java applications cannot be executed

-SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 10:30 UTC on 05 Jun 2019 until 11:30 UTC Users might experience an issue while loading Web IDE. Web IDE Full-Stack is unavailable

-SAP Cloud Platform US Central (IA) [cf-us30] – Service Advisory Since approximately 10:30 UTC on 05 Jun 2019 until 11:30 UTC, Users might experience an issue while loading Web IDE. Web IDE Full-Stack is unavailable

6/4/19

VMware Skyline Service Availability issue User may not be able to access the service or may experience trouble while accessing the service.

Start Time: June 04, 2019 08:30 AM UTC 
End Time: June 04, 2019 11:34 AM UTC 

Google Cloud Networking Incident #19010 Cloud network programming delays in us-east1 and us-east4 and Load balancer health check failures in us-east4-a. Incident began at 2019-06-04 14:23 and ended at 2019-06-04 15:31 (US/Pacific) lasting 1 hour 8 minutes

6/2/19

– SAP Cloud Platform US Central (IA) [cf-us30] – Service Advisory Since approximately 19:05 UTC until approximately 23:00 UTC, Lifecycle management operations cannot be executed

-SAP Cloud Platform US East (Sterling) [neo-us3] – Service Advisory Between approximately 05:09 and 05:49 UTC on 02 June 2019, A general disruption is impacting the availability of applications and services

SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Between approximately 02:12 and 02:40 UTC and again between approximately 03:01 and 03:05 UTC on 02 June 2019, A general disruption is impacting the availability of applications and services

-Google Cloud Networking Incident #19009 Google Cloud projects running services in multiple US regions experienced elevated packet loss as a result of network congestion for a duration of between 3 hours 19 minutes, and 4 hours 25 minutes. The duration and degree of packet loss varied considerably from region to region and is explained in detail below. Incident began at 2019-06-02 11:45 and ended at 2019-06-02 15:40 (all times are US/Pacific).6/1/19SAP Cloud Platform Australia (Sydney) [neo-ap1] – Service Advisory Since approximately 15:27 UTC until approximately 17:51 UTC A general disruption is impacting the availability of applications and services