Jump to content

Recommended Posts

Posted (edited)

Arbor is declaring major incident - Site down.

 

Quote

We are aware that customers are currently experiencing errors and are unable to log in to their Arbor site this morning.

We sincerely apologise for the disruption this is causing. Our engineering team is fully engaged and investigating this as an urgent priority. We will post our next update as soon as we have more information.

 

Edited by Sonic007
  • Like 1
Posted (edited)
8 minutes ago, Squelch said:

The sky is falling in our school.

 

I know how you feel.

Edited by Sonic007
Posted
Quote

Investigating

We’re continuing to investigate ongoing reports of customers encountering site unavailability and are currently working with our cloud service provider to identify a resolution.

We’re very sorry for any disruption caused and are working on this as an urgent priority.

 

Posted

Update from Arbor

Quote

Our engineers have implemented a fix for the site unavailability issues. All customers should now be able to access their Arbor sites, however, the initial loading of your Arbor site will take longer than usual.

We sincerely apologise for the disruption caused and would like to thank customers for their continued patience.

 

Posted

I see there was a major incident reported on May 22nd. Anyone know if it is related. It does look as though Arbor are being clear about the issue, and have fixes it quickly. The challenge now is to avoid a repeat in the future.

Posted

SATS results today, I wonder if the service fell down when schools started inputting exam results all at once? I'm guessing I've no idea about the process. 

Posted

AWS is having a momont today, I don't know if they are connected but it is breaking LightSpeed filtering. We have no Youtube across all our sites.

 

  • Like 1
Posted
Quote

We want to reach out directly to update you on the site unavailability customers experienced this morning, and to explain what happened and how we responded.



What happened - a global AWS outage affecting websites across the world

Between approximately 08:54 and 09:37 BST this morning, Arbor sites were unavailable for customers. This was caused by a global outage affecting Amazon Web Services' (AWS) CloudFront content delivery network affecting websites across the world. This was not an Arbor-specific issue, and AWS have confirmed it as a widespread, global incident affecting CloudFront customers across multiple regions.



How we responded - we mitigated impact within 43 minutes

Our team identified the issue quickly and immediately began working to mitigate its impact, without waiting for AWS to resolve the problem on their end. Within 43 minutes of the incident starting, we had implemented a workaround by rerouting traffic away from the affected CloudFront infrastructure to an alternative load balancer. This restored access to Arbor sites for all customers.



  • 08:54 BST - Incident detected
  • 09:37 BST - Workaround implemented; sites restored
  • 09:44 BST - Full customer access confirmed



You may have noticed that initial page loads were slightly slower than usual after sites came back online - this was an expected, temporary side effect of the workaround and not a sign of any ongoing issues.



What happens next - sites will be unavailable 9pm-10pm tonight to revert changes

AWS have confirmed that the CloudFront issue is fully resolved. We are planning essential maintenance tonight at 9pm-10pm BST to switch back to our standard configuration, which means your site will be unavailable for that period - you can check our status page for more information. Following this, we will carry out a full retrospective of today's incident and provide a detailed post incident review (PIR) for you.



We're extremely sorry for the disruption this caused to you and your school, we did everything we could to try to mitigate this. We know how important it is for Arbor to be available, particularly at busy times of the school year, and we take incidents like this extremely seriously.


James Weatherill,
CEO at  Arbor Education

 

Posted

@JamesWeatherill, it's the communincations that sets Arbor apart - well done and thank you - not that I'm an Arbor user, but I have an interview soon for a organisation that wants someone to lead a migration... so who knows what the future may hold!

  • Like 2

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now



×
×
  • Create New...