Power Cut...help...

[Mark182]

We had a massive powercut/ serge yesterday. This seemed to take out some UPS's and switches. Out of 72 switches 17 failed to come back online. They are a mixture of Cisco 3560s, 2690s & 3750s. When booting they get stuck at 'SYST' and nothing else. I have disconnected all the connections IE Fiber SFP ect and then power cycled on holding 'MODE' for 30 seconds. This seemed to fix two of them but the rest as soon as they boot up the fan will spin for a second and go straight to 'SYST' light on green. When I plug the console cable in and try a putty connection, still deal.

 

I am right in thinking its game over for them? I've looked on the net back that's all I seem to see as that its hardware issue. Any advice would help massively.

 

I have all the configs backed but no hardware.

[FN-GM]

When you plug in via the console and boot the switches what do you see on screen? Try this instead of plugging in after attempted boot.

[Dos_Box]

You're not BA by any chance?

[Mark182]

You're not BA by any chance?

 

Ha, no.

 

- - - Updated - - -

 

When you plug in via the console and boot the switches what do you see on screen? Try this instead of plugging in after attempted boot.

 

 

Just blank and then fails to connect. I will post a screenshot in a sec.

[IanT]

Are any of the Cisco 3560s, 2690s & 3750s stacked?

[ricki]

Try removing all power from them for about 5 mins sometimes they start to work but config may have gone. They may need to be reset and configure d again

[Mark182]

Are any of the Cisco 3560s, 2690s & 3750s stacked?

 

Yeah, our core is stacked

 

- - - Updated - - -

 

Try removing all power from them for about 5 mins sometimes they start to work but config may have gone. They may need to be reset and configure d again

tried that

[Mark182]

They are stuck like this. cannot get in via console cable. fan spins for around 2 seconds then dies down and nothing. Not even pressing mode or power cycling with more pressed in for 15/30 seconds.

[ricki]

Flashing light normally mean cannot find is. If you can get into console try typing boot. It will tell you what's happening

 

Richard

[ricki]

Iso sorry

[Mark182]

Flashing light normally mean cannot find is. If you can get into console try typing boot. It will tell you what's happening

 

Richard

 

It's a solid light and when consoled in with cable and putty doesn't display anything, a blank black screen.

[ricki]

You have removed any stacking cables and things plugged into it. Once it starts to boot it runs diags and if something is wrong it can get stuck

[Mark182]

Yeah, removed all cables. I have it on the desk next to me with only power and console cable plugged in. As soon as I power on fan spins for a few seconds then 'SYST' light is solid green. The open session with putty doesn't display any life.

[ricki]

If you hold the mode button in while powering up for a minute it should reset the switch. If this does not work I think it's time to talk to Cisco support

[Mark182]

They are pretty much dead. Only managed to bring two back to life!

[AlanD]

We're all these in the same building? You didn't have anything naughty such as copper running between buildings?

Can you swap power supplies between these switched?

[tobiasclarity]

Do they have lifetime warranty support like HP? (Serious question not a dig)

[AlanD]

Oh...I forgot about that...netgear has "lifetime warranty" too - so I would be surprised if they were not covered to some extent...In fact Netgear were really good when I bricked one switch doing a firmware upgrade...and they were ready to courier me a next day replacement - before I offered to reinstall the boot code via the serial cable...and that worked and I recovered a working switch.

[Mark182]

I have spoken to Cisco and I believe not. I am been passed to a team higher up. I have managed to get refurbs in place and back up working. Thank goodness for backing up the configs! ha. Managed to source most of the kit from a local supplier on Friday, spent Friday night reinstalling the back up configs on them. Then spent most of sat and was in at 5:30 today so all good. Edited June 5, 2017 by Mark182

[Mark182]

We're all these in the same building? You didn't have anything naughty such as copper running between buildings?

Can you swap power supplies between these switched?

 

Same building buddy. It only seems to have been POE switches that blew.

[pete]

@Mark182 we claimed on the insurance when we lost a lot of switches (lightning strike).

[tobiasclarity]

I have spoken to Cisco and I believe not. I am been passed to a team higher up. I have managed to get refurbs in place and back up working. Thank goodness for backing up the configs! ha. Managed to source most of the kit from a local supplier on Friday, spent Friday night reinstalling the back up configs on them. Then spent most of sat and was in at 5:30 today so all good.

Splendid, pleased to read this this morning!

[ricki]

If you don't have ups battery backup on each cabinet use it as a good reason to get them

[Davit2005]

It's a solid light and when consoled in with cable and putty doesn't display anything, a blank black screen.

 

Jus checking are you using correct Cisco console settings. Speed = 9600, Databits = 8, Stop Bits = 1, Parity = None, Flow Control = try None.

 

Normally you'd get something at console even if IOS has gone.

[Mark182]

If you don't have ups battery backup on each cabinet use it as a good reason to get them

 

We do in each cab. With the power cut the power kept flicking on and off every 30 seconds for just over 2 hours 30 mins so that wasn't good.

 

 

- - - Updated - - -

 

Jus checking are you using correct Cisco console settings. Speed = 9600, Databits = 8, Stop Bits = 1, Parity = None, Flow Control = try None.

 

Normally you'd get something at console even if IOS has gone.

 

 

Yeah, tried everything