ipran故障案例分析

-.z.基站闪断故障案例分析摘要：*IPRAN站点在运行过程中出现频繁的设备闪断故障，造成此站点下挂4个3G站、3个4G站业务频繁闪断。背景2016年8月24日上午在网优人员给局方维护人员打来，说有数个站点出现频繁断站，然后过几分钟就好；我方工程师在收到局方告知后，立即与维护人员取得联系，为了不影响局方的业务以及考核指标，决定先将此站点下挂的站点端口进展关闭处理。问题描述及排查登录到闪断的设备上，一般成环的节点很少会出现瞬断，但是不排除。首先检查瞬断节点的收发光功率；如果没问题就逐条检查环上的其他节点的光功率。一般情况下是光口实际收光超出临界值；z*r10#showperf-valueinterfacegei_5/1optical-rcv-cur(dBm):optical-rcv-min(dBm):optical-rcv-ma*(dBm):z*r10#showperf-valueinterfacegei_6/1optical-rcv-cur(dBm):optical-rcv-min(dBm):optical-rcv-ma*(dBm):检查设备温度，看风扇状态：设备温度过高会导致板卡假死，当温度降到板卡可以承受的温度的时候，板卡又会起来，所以就会出现闪断。z*r10#showversionZ*R10RouterOperatingSystemSoftware,ZTECorporationZ*CTN6220Software,VersionZ*CTN0V2.10.00P02B10,RELEASESOFTWARECopyright(c)2001-2014byZTECorporationCompiledApr242015,18:46:39Systemimagefilesareflash:</flash/img/z*r10.zar>Systemuptimeis244day(s),16hour(s),53minute(s)[SCCU,panel1,master]MainProcessor:PowerPCMPC8544ProcessorSystemMemory:1024Mbytes,SystemFLASH:128MbytesSystemNVRAM:8Kbytes,SystemTemperature:41℃SystemSerial:16383,SystemBaudRate:9600SystemClock:PTPstratum3BoardType:RSCCP2SerialNumber:2,PartNumber:3CPUCPLDVersion:N/A,PCICPLDVersion:N/AFPGAVersion:V6.1,MainPCBNumber:101001[SCCU,panel2,slave]MainProcessor:PowerPCMPC8544ProcessorSystemMemory:1024Mbytes,SystemFLASH:128MbytesSystemNVRAM:8Kbytes,SystemTemperature:43℃SystemSerial:16383,SystemBaudRate:9600SystemClock:PTPstratum3BoardType:RSCCP2SerialNumber:8,PartNumber:3CPUCPLDVersion:N/A,PCICPLDVersion:N/AFPGAVersion:V6.1,MainPCBNumber:101001[NPCI,panel1]MainProcessor:W90N740ProcessorSystemMemory:16Mbytes,SystemTemperature:N/ABoardType:R4EGC,LogicBoardType:R4EGC_ETHPortNumber:4SerialNumber:8,PartNumber:5FPGAVersion:V0.8,MainPCBNumber:081001[NPCI,panel2]MainProcessor:MPC8321ProcessorSystemMemory:128Mbytes,SystemTemperature:43℃BoardType:R16E1F,LogicBoardType:(TDM+IMA)PortNumber:16SerialNumber:5,PartNumber:3FPGAVersion:V2.1,MainPCBNumber:080902[NPCI,panel5]MainProcessor:W90N740ProcessorSystemMemory:16Mbytes,SystemTemperature:43℃BoardType:R4EGC,LogicBoardType:R4EGC_ETHPortNumber:4SerialNumber:0,PartNumber:5FPGAVersion:V0.8,MainPCBNumber:081001[NPCI,panel6]MainProcessor:W90N740ProcessorSystemMemory:16Mbytes,SystemTemperature:43℃BoardType:R4EGC,LogicBoardType:R4EGC_ETHPortNumber:4SerialNumber:6,PartNumber:5FPGAVersion:V0.8,MainPCBNumber:081001z*r10#showfan-informationPCBVersion:100801Fan1:NormalWorkFan2:NormalWorkFan3:NormalWorkFan4:NormalWork查看端口是否有错包，当端口错包累计到一定程度后，很大可能性会出现设备闪断。z*r10#showinterfacegei_5/1gei_5/1isup,lineprotocolisup,detectstatusisOKBynameisnoneDescriptionisnoneTheportisopticalDuple*fullSmbipg12Smbmccbandwidth10MbitsMccvlanidis3024Smbmccpriority7NoloopbackBW1000000KbitsLastclearingof"showinterface"countersnever120secondsinputrate:2428214Bps,8820pps120secondsoutputrate:1571473Bps,7147ppsInterfacepeakrate:input20166528Bpsoutput8806412BpsInterfaceutilization:input1%,output1%Input:Packets:8Bytes:163Unicasts:5Multicasts:30086051Broadcasts:2LittUndersize:0Oversize:0CRC-ERROR:259107Dropped:2869615Fragments:0Jabber:0MacR*Err:0Errframe:0Disframe:2869615UnicErrors:0MultiErrors:0BroErrors:0GoodJumb:259107460764B:065-127B:128-255B:9959552083256-511B:512-1023B:7465987381024-Ma*:8579079454AlignErrors:0Output:Packets:7Bytes:997Unicasts:7Multicasts:30022986Broadcasts:4Collisions:0LateCollision:0ColliTimes:0FlowContr:0DeE*ceFrame:0DecolliFra:0NonUniFrame:30022990ErrBytes:0ErrFrame:0MacControl:0JabberFrame:0GoodJumb:167604028LittUndersize:064B:065-127B:128-255B:256-511B:512-1023B:5325916111024-Ma*:604042360Oversize:0z*r10#showinterfacegei_6/1gei_6/1isup,lineprotocolisup,detectstatusisOKBynameisnoneDescriptionisnoneTheportisopticalDuple*fullSmbipg12Smbmccbandwidth10MbitsMccvlanidis0Smbmccpriority7NoloopbackBW1000000KbitsLastclearingof"showinterface"countersnever120secondsinputrate:83450Bps,809pps120secondsoutputrate:150818Bps,484ppsInterfacepeakrate:input2781929Bps,output10989989BpsInterfaceutilization:input0%,output0%Input:Packets:Bytes:10Unicasts:Multicasts:30425156Broadcasts:2LittUndersize:0Oversize:0CRC-ERROR:0Dropped:348Fragments:0Jabber:0MacR*Err:0Errframe:0Disframe:348UnicErrors:0MultiErrors:0BroErrors:0GoodJumb:732268264B:2114280465-127B:128-255B:763326971256-511B:42375277512-1023B:333074401024-Ma*:43759574AlignErrors:0Output:Packets:6444180948Bytes:08Unicasts:6414093903Multicasts:30087045Broadcasts:0Collisions:0LateCollision:0