SchoolsBroadband Posted November 9, 2014 Posted November 9, 2014 Hello everyone, firstly I'm very sorry for the trouble cause and secondly I'm very sorry its taken me a while to comment on this as I'm normally pretty quick but I've been away on business for a week. We did a huge upgrade to our Lightspeed cluster which was done to Improve resilience Get rid of IP conflict issues Speed up reporting Allow the platform to scale better I've spoken to my technical team and I believe the issues stem from some problems with Lightspeed patches we were told to apply which have had a knock on effect to the AD integration and also some other issues. Any of our customers should have had numerous email updates over the week keeping you constantly informed both pre and post deployment. If anyone still has a problem please send me a PM and I'll get someone to look into it straight away. I am very frustrated this issue occurred and we're doing a lot of work with Lightspeed to protect us against similar future problems during upgrades. Sorry again. Dave 2
Simcfc73 Posted November 9, 2014 Posted November 9, 2014 Although I was impressed with Lightspeed I was put off with it being a US company....who adore IOS
Edu-IT Posted November 9, 2014 Posted November 9, 2014 Although I was impressed with Lightspeed I was put off with it being a US company....who adore IOS What's wrong with them being a US company?
Wubbalubbadub Posted November 10, 2014 Author Posted November 10, 2014 **UPDATE** Day 9 and we are STILL having issues since this update. Only just got Youtube to start filtering back to the educational version again! So at least that is now sorted. However we have found kids have found a games hosted on a Google sub domain. Only way to block is some weird method (No idea what he said) which would basically mean blocking some youtube videos as well! Also blocked HTTPS sites now come back as "cannot display this page" rather than the Lightspeed block page! All in all not impressed & currently researching alternatives. Matt
Wubbalubbadub Posted November 10, 2014 Author Posted November 10, 2014 Had a chat with the managing director today! Always nice! Answered a few of my questions and promised to follow them up for me! So there not all bad over there! Lets see what I get back from the update!
Wubbalubbadub Posted November 11, 2014 Author Posted November 11, 2014 **Update** Day 10 and were still having issues!
eshaq786 Posted November 12, 2014 Posted November 12, 2014 Our Schools Broadband Internet is slow today due to a hardware failure of a 3rd party supplier (Entanet). See here for further details. Entanet NOC We are seeing packet loss and extremely slow internet due to the failure although we are not totally cut off.
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 Yes our suppliers are working on it and as you can imagine we're not best pleased either. It's not just effecting us but lots of ISP's. All of our leased line customers and EoFTTC customers (standard primary connection now) are not effected. We're emailing all of our customers every hour or so with an update. Thanks for your patience. David
mrbios Posted November 12, 2014 Posted November 12, 2014 All of our leased line customers and EoFTTC customers (standard primary connection now) are not effected. We're a leased line customer and seeing a huge slow down today (0.3mb down speedtests on a 100mb leased line), so it is effecting us. Phoned twice, been updated twice, just waiting for improvement, are your technical people assuming leased lines are unaffected then?
IrritableTech Posted November 12, 2014 Posted November 12, 2014 We're a leased line customer and seeing a huge slow down today (0.3mb down speedtests on a 100mb leased line), so it is effecting us. Phoned twice, been updated twice, just waiting for improvement, are your technical people assuming leased lines are unaffected then? Our fibre circuit is fine - do you know who provides yours? I find speedtests fairly useless generally but yours does seem very very low. A few of our primaries are struggling today - but I think there is a desire at Schools Broadband to move all customers onto their own network eventually and remove third party ADSL & FTTC providers.
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 We're a leased line customer and seeing a huge slow down today (0.3mb down speedtests on a 100mb leased line), so it is effecting us. Phoned twice, been updated twice, just waiting for improvement, are your technical people assuming leased lines are unaffected then? err nope definitely no problems on leased lines. If you're who I think you are then your currently doing 99Mbit on your 100Mbit leased line and that's why you're seeing slow speeds and packet loss I'll send you a PM Dave
mrbios Posted November 12, 2014 Posted November 12, 2014 lol so all morning i've been thinking we were a part of a different problem entirely *doh* Investigating now Thanks Dave
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 you wouldn't be the first person to blame us for something when it wasn't actually the problem you thought it was so no worries. Just happy I could help Dave
Wubbalubbadub Posted November 12, 2014 Author Posted November 12, 2014 Were still having issues from the update & now Iv got 4 primary schools on your ADSL phoning me! Bah Its a bad week for you guys!
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 Were still having issues from the update & now Iv got 4 primary schools on your ADSL phoning me! Bah Its a bad week for you guys! yes we've had better. Just had a call from our carrier account manager apologising profusely too. The replacement router blade hardware hasn't made a difference so a full reboot of a metro core node is currently in progress. This issue is affecting over 200,000 DSL and FTTC circuits. We'll keep on updating you via the official channels. Most circuits are up just running slowly. Just to make you all fully aware this isn't an issue with our network, rather a carrier interconnect and their equipment. We've actually weathered a 5Gbit DDoS today too for good measure.... Thanks for your patience. Dave
Wubbalubbadub Posted November 12, 2014 Author Posted November 12, 2014 And any news on when my issues are actually going to be sorted? Carol said she would call me back before 4? Still no block page showing on blocked HTTPS sites... and in fact been told its now impossible to do it! Something you might want to put on future sales... "We will block the sites, but there will be no block page & your users will now phone you saying the internet is down!" When its not... Its just you cant put the block page now. Not good. yes we've had better. Just had a call from our carrier account manager apologizing profusely too. The replacement router blade hardware hasn't made a difference so a full reboot of a metro core node is currently in progress. This issue is affecting over 200,000 DSL and FTTC circuits. We'll keep on updating you via the official channels. Most circuits are up just running slowly. Just to make you all fully aware this isn't an issue with our network, rather a carrier interconnect and their equipment. We've actually weathered a 5Gbit DDoS today too for good measure.... Thanks for your patience. Dave
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 PM'd Matt, ref HTTPS issues this is only on certain wildcard SSL certificate spanning multiple domains. It is not for every SSL site. All filtering companies are constantly playing cat and mouse with certain websites as they change things and blocking gets more and more difficult. Your issue is logged with Lightspeed who are our filtering vendors and they are looking into a resolution for you. And as promised you'll have heard from Carole David
Wubbalubbadub Posted November 12, 2014 Author Posted November 12, 2014 Yup got the call. Feeling a bit more confident that things are actually being looked into! Lets see what tomorrow brings!
SchoolsBroadband Posted November 12, 2014 Posted November 12, 2014 All DSL & FTTC services are now fully restored. If you're not online please reboot your router. A full service report will be sent to you as soon as we have the intricacies from our carriers. Thanks David
XiJ Posted November 12, 2014 Posted November 12, 2014 Been updated with plenty of e-mails today which I really appreciate. Also Carl in tech support helped me out yesterday (wish we could have had some training in the Fortigate / light speed system rather learn as we go though) Been really impressed with SB last few weeks
IrritableTech Posted November 12, 2014 Posted November 12, 2014 Also Carl in tech support helped me out yesterday (wish we could have had some training in the Fortigate / light speed system rather learn as we go though) Been really impressed with SB last few weeks They do run training sessions around the country every so often. I think I'm right in saying there's been some this week in Northamptonshire? Lightspeed is fairly straight forward - and there's some useful videos on their site. Fortinet is more complicated but again, there's quite a bit of info out there.
Wubbalubbadub Posted November 12, 2014 Author Posted November 12, 2014 Really! I'm in Northamptonshire why didn't they let anyone know!? Probably did.... I always miss the good stuff!
IrritableTech Posted November 12, 2014 Posted November 12, 2014 Still time... http://www.schoolsbroadband.co.uk/the-schools-broadband-roadshow-is-coming They've been publicising it on their website, Twitter...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now