课件教案成果lte observation toolbox baseband

1、LTE Observation &LTE Toolbox &LTE BasebandYu xiaolong20140310Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-161 (38)Ericsson InternalLTE ObservationPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA

2、1Date: 2014-03-162 (38)Ericsson Internal§ LTE Observation Internal Observability§ LTE Toolbox LTE MSRBS Toolbox CDA/PMD Web Tools Ewrieshark§ LTE RAC and Baseband Trace and CTR/UETR L3 signalling Baseband trace CTR/UETRInternal observabilityDelivery mechanismsPrep: Xiaolong yu Appr:Ch

3、ecked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-163 (38)Ericsson Internalinternal observabilityTraces Trace Types in the eNodeB CPP Trace & Error Base Band LPP Trace It can be outputted via CPP Trace & Error and/or HiCap Measurement, Trace and Debug (MTD) is com

4、plement to LPP TracesTracesTrace & ErrorHiCapMTDDUL RDR is used for detailed analysis of baseband algorithms Rose RT (RRT) signal traceRDRRRTIt can be outputted via PMD orTRACE_ERRORSRIOTRACE_ERRORULMA4HiCapULMA3RDR ULMA2ULMA1MTDRULPTrace & ErrorTorPrep: Xiaolong yu Appr:Checked:LTE Observat

5、ion &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-164 (38)Ericsson InternalO&M EthernetDL Ethe etrace & ErrRCPPTRACE_ERROTrorace & ErrRRTObservability and TroubleshootingCustomer ObservabilityInternalObservability (Troubleshooting)Prep: Xiaolong yu Appr:Checked:LTE Observation

6、&LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-165 (38)Ericsson Internalinternal observabilitySystem Crash DumpsØ Base Band Core DumpObservability and TroubleshootingULMA = GCPU processor 4 ULMAsEvery ULMA has 32 dsp.EM = External MemoryInternal Observability (Troubleshooting)Customer

7、Observability/d/logfiles/dspdumps/System Crash DumpsBase Band Core DumpØ Post Mortem Dump (PMD) Crash dump file for Main Processor running CPP /c/pmd/<sequential number>/ Path 000100 is for Main Processor. /c/logfiles/dspdumps/ Path 00_01 is for that specific DUL boardDULPost Mortem Dump

8、(PMD)CPPPost Mortem DumpSRIOULMA4ULMA3ULMA2ULMA1PPBase Band DumpPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-166 (38)Ericsson InternalO&M EthernetDL/UL EthernetRULTE ToolboxPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &

9、amp;LTE BasebandRev: PA1Date: 2014-03-167 (38)Ericsson Internal§ LTE Observation Internal Observability§ LTE Toolbox LTE MSRBS Toolbox CDA/PMD Web Tools Ewrieshark§ LTE RAC and Baseband Trace and CTR/UETR L3 signalling Baseband trace CTR/UETRLTE MSRBS TOOLBOXPrep: Xiaolong yu Appr:Che

10、cked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-168 (38)Ericsson InternalLTE MSRBS Toolbox ContentPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-169 (38)Ericsson InternalLTE MSRBS Toolbox ReferenceLTE Flowfox relies

11、 on either one of the following tools: LTNG (Logtool NG decoder) internal restricted LTE Decoder internal restricted LTE Decoder Japy internal restrictedThe baseband support also relies on either one of the following tools: LTNG (Logtool NG decoder) internal restricted TET.pl and decode internal res

12、trictedNote: LTE Flowfox cannot be sold to customers due to the fact that its dependencies are internally restrictedNote: Output of LTE Flowfox (Anonymous or Customer format) may be provided to the customer.LTE Flowfox website:Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE

13、BasebandRev: PA1Date: 2014-03-1610 (38)Ericsson InternalLTE Logtool§LTE LogTool is an Ericsson "inner source", multi-platform protocol analyzer framework. It is built using the eclipse RCP platform and Plug-in technology and is therefore easy to manage and extend.LTE LogTool is availa

14、ble for Solaris 10, Windows (XP and later)and Linux platforms.Currently it can read PCAP files, NethawkM5, GMLOG, binary files, CPP T&E text files and PM event files (ROP files). It can also connect directly to eNB or TraceRouter to perform online real time analysis. It supports most IP protocol

15、s (IP/UDP/TCP/SCTP/RTP), most LTE protocols (RRC, X2AP,S1AP,NAS, Baseband text (Strid), Baseband signals, PM events and RDR) and most protocols.User guide:§§§Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1611 (38)Ericsson Intern

16、alCDA/PMD Web ToolsCDA and PMD Web Tools is an online toolbox which provides an interface for decoding LTE crash dumps.Two crash decoders are available:§CDAThe Core Dump Analyzer (CDA) is a tool to analyze core dumpsfrom ULMA. CDA is also the name for teral concept ofextracting useful informati

17、on in human-readable format from anULMA memory image.PMDHammerHead PMD->PDF is a tool to analyze Post Mortem Dumps (PMD) for the Main Processor (MP). A PDF report will be sent back to the user along with the unpacked PMD (into ZPM textual format)Link:§§Prep: Xiaolong yu Appr:Checked:LTE

18、 Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1612 (38)Ericsson InternalWireshark§Wireshark is a network packet analyzer. A network packet analyzer will try to capture network data packets and to decode and display captured packet data as detailed as possible.One can thin

19、k of a network packet analyzer as a measuring device used to examine what's going on inside a network cable, just like a voltmeter is used by an electrician to examine what's going on inside an electric cable (but at a higher level, of course).Here are some examples people use Wireshark for

20、: network administrators use it to troubleshoot network problems network security engineers use it to examine security problems developers use it to debug protocol implementations people use it to learn network protocol internalsLink:§§§§Prep: Xiaolong yu Appr:Checked:LTE Observa

21、tion &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1613 (38)Ericsson InternalTrace Group-trace1: Error reporting via Trace Objects. This is either made via one of the function Trace Objects in case the error can be related to a specific function or via the Trace Object GENERAL_ERROR in cas

22、e the error can not be related to a specific function Trace Object.-trace2: Start, stop and expirations of timers.-trace3: General Trace Information-trace4: Incarnation, Destruction, Importation, Deportation of Capsule/process.-trace5: Decisions, e.g. if, else, choicepoints etc.-trace6: Tracing Inco

23、ming/Outgoing messages-trace7: Tracing Incoming/Outgoing message data-trace8: SP bag tracing (for uehUeCtxt)-trace9: not specifiedPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1614 (38)Ericsson InternalTrace group status§Check trace group

24、 statuste status <trace object>fte s/cabePrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1615 (38)Ericsson InternalEnable and disable trace§§§§Enable traceste enable <trace group> <trace obiect>te e <trac

25、e group> <trace obiect>enable the tracelhsh 000200 te enable <trace group> <trace object> gcpu/rru/duenable traces on§§§§Disable traceste disable <trace group> <trace obiect>lhsh 00512 te enable <trace group> <trace obiect>disable trac

26、es on gcpu/rru§§§Reset traces group to default valuete defaultte default -restartdeactivate all saved trace groups to default valuePrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1616 (38)Ericsson InternalRead te loanuallyView T&a

27、mp;E logs in Main Processor, BaseBand and RUte log readView Main Processor T&E log (stored in RAM)lhsh gcpu00256 te log readView one BaseBand DSP (via GCPU00256) T&E loglhsh BXP_0_1 te log read View T&E log in RUlh all te log read 60 View last 60s T&E logs in Main Processor, BaseBand

28、 and RU Working with te log commandte log clear:This subcommand clears the Trace and Error log. All currently stored log entries are removed.Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1617 (38)Ericsson InternalTarget monitor (1)§The mo

29、st basic part of observability is to be able to monitorthe messages coming out of the Trace & Error Log. In order to do this, we need to setup a target monitor from the eNodeBStarting UDP target monitor on eNodeB§310003> tm status (check if the TM is inactive)310003> tm -udp 10.9.6.20

30、3 (start a UDP target monitor )310003> tm -attach 2 000100 (attach board 000100 to themonitor handler 2)310003> tm -savePrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1618 (38)Ericsson InternalTarget monitor (2)_MON mon command issue a se

31、t of OSE shell commands ("secmode" and"tm") in order to open TCP or UDP ports to monitor traces.mon/monu/mond/mon?/mon- <board(s)|<boardGroup(s)>mon 000100 / all000100,gcpu,ru monu 000100 mon-mon?open a monitoring session in TCP mode to thopen a monitoring session in UDP

32、 mode with router/viewer close all monitoring sessionprint the target monitor status and list of monitored boards.§monu: start the monitor in UDP mode with router/viewer. In UDP mode, unlimitednumber ofsessions can be connected to the sam(s)§mon-: close all monitoring handles on the node.&

33、#167;mon?: print the target monitor status (TCP or UDP) and list of monitored boards.Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1619 (38)Ericsson InternalBegin monitoring with “MON”§Sintax: mon/mon+/mon-/mon? <boardGroup(s)>05336

34、6_LOS_ROBLES> mon 000100* Opening new handle:$ lhsh 000100 tm -tcp -win 1New monitor router process 0x125043c is started and listening to port 33079. To attach link handlers, use handle 3.* Attaching boards to handle:$ lhsh -v 000100 tm -attach 3 000100To start the monitor client, run the followi

35、ng command (type "h mon" for more info):/home/eusgrko/moshell/monitor6054 10.197.217.158 33079$moncommand = /home/ehehuan/moshell/monitor6054 10.230.194.2 33077Open another cigwin windows: and paste the outputPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE Baseband

36、Rev: PA1Date: 2014-03-1620 (38)Ericsson InternalA Basic Example§§1.begin the trace on the sitete te te te te uetee e e e eall all all all allFt_RRC_ASN Ft_S1AP_ASN Ft_X2AP_ASN Ft_LTE_EXCEPTION LTE_EXCEPTIONenable -allue -allcellsave *(be careful to use this command in live network)§mo

37、n 000100 (The command will then be given by moshell )§(output:/home/ehehuan/moshell/monitor6054 10.230.194.2 33077) /(enb oamip:10.230.194.2)§§§2. open another terminal ,paste the output3. paste the output:and save the trace log/home/ehehuan/moshell/monitor6054 10.230.194.2 33077

38、 | tee attach_dhl.log & /(enb oam ip:10.230.194.2)3.1view live flowtail -f attach_dhl.log | /home/ehehuan/ltetools/ltng -s |/home/ehehuan/ltetools/lteflowfox.pl -lac4. mon-5. Create HTML report for post analysis (from server):§§§| /home/ehehuan/ltetools/ltng -s > attach_dhl_dec

39、oded_logfilecat attach_dhl.log§§/home/ehehuan/ltetools/lteflowfox.pl -f attach_dhl_decoded_logfile6.stop the tracete default -restart te defaultmtd killmon-all/bbtrace/Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1621 (38)Ericsson I

40、nternalL3 signaling decoding and parsing§Basic ASN (RRC,NAS,S1AP,X2AP) trace :§te te te te te ue totee e e eeall all all allallFt_RRC_ASN Ft_S1AP_ASN Ft_X2AP_ASN Ft_LTE_EXCEPTIONLTE_EXCEPTIONenable-allue-allcell(becarefulusethiscommandinlivenetwork)§save*Prep: Xiaolong yu Appr:Checked

41、:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1622 (38)Ericsson InternalL3 signaling decoding and parsing§§Different ASN DecodersWith so many different decoders its easy to get confused about which to use. The currently available decoders are:1 ltedecoder2 ltng R

42、ECOMMENDED§§§Ltngis the latest decoder, which is based on Logtool. Itbrings decoding functionality of Logtool, is well maintained, and is delivered without the GUI component.§/home/ehehuan/moshell/monitor6054 10.230.194.2attach.log &33077 | teecat attach.log | /home/ehehuan/l

43、tetools/ltng s >> attach_dec.logNote: You must use -s option when running LTNG this way in order to specify STDIN. You can also use -p to specify which protocol stack to use.§§Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1623

44、(38)Ericsson InternalL3 signaling decoding and parsing§§Parsing tool :Lteflowfox.pl creates message sequence charts that are either HTML or text based. It uses decoded L3 ASN messages as input.| /home/ehehuan/ltetools/ltng -scat attach_dhl.log>>attach_dec/home/ehehuan/ltetools/lteflo

45、wfox.pl-fattach_decPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1624 (38)Ericsson InternalBaseband ObservabilityL1/L2 functionality (e.g. Scheduling) is handled in the baseband module§§LTE RBS introduces MTD (Measurement, Test &

46、 Debug)§MTD is a framework which lets us enable traces for specific signals, and some of these will give us very useful information when troubleshooting.§MTD allows troubleshooters to:Interact with the baseband module via observability primitivesRetrieve signals§For our observability

47、purpose, MTD is used to peek at signals and their contents§Combined with HiCap tracing, MTD provides a powerful toolkit toinvestigate baseband issuesPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1625 (38)Ericsson InternalBaseband Trace Gr

48、oupsPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1626 (38)Ericsson InternalThe detailed Traces for specific trace objectMIB and SIBTraceslhsh gcpu00768 te e all UpDlRreBl_Smiblhsh gcpu00768 te e all UpDlRreFt_SYSTEM_INFOmtd peek -ta dlMacPeBl

49、 -sig LPP_UP_DLMACPE_CI_DL_CCH_ALLOC_IND -dir INCOMINGPCFICH and DCI formatTraceslhsh gcpu01024 te e all UpcDlMacCeFt PDCCHPHICH Ack InfoTracesmtd peek -tar dlMacPeBl -sig LPP UP DLMACPE CI UL HARQ ALLOC IND -dir 2 -rep 65535Prep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE Ba

50、sebandRev: PA1Date: 2014-03-1627 (38)Ericsson Internalmtd peek -ta dlMacPeBl -sig UP_DLRLCPE_EI_MIB_DATA_INDThe detailed Traces for specific trace object# dlMode, dlPrb, dlNdf, nrOfUe (the -filter flag will make 0-allocations to not be traced)mtd peek -ta dlMacCeBl -signal LPP_UP_DLMACPE_CI_DL_UE_AL

51、LOC_IND -filter(U16SIG)8,NEQ,(U16)0x00# rxPwrPucch, rxPwrPusch, dlHarqIndication, dlHarqProcessId, ri, cqi, ulPrbmtd peek -ta ulL1PeBl -si LPP_UP_ULMACPE_CI_UL_L1_MEASRPRT2_DL_IND -dir OUTGOING mtd peek -ta ulL1PeBl -si LPP_UP_ULMACPE_CI_UL_L1_MEASRPRT2_UL_IND -dir OUTGOING# phr, bsr, ulBlermtd peek

52、 -ta ulMacCeBl -signal LPP_UP_ULMACPE_CI_UL_MAC_CTRL_INFO_IND# dlMcs, dlModulation, dlTbs, dlAssignableBits, dlNdi, dlGinrOuterLoopAdjlhsh gcpu01024 te e trace4 UpcDlMacCeFt_DL_SCHEDULERPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1628 (38)Er

53、icsson InternalThe detailed Traces for specific trace object§§Random AccessMessages for Random Access are included in different traces. These are broken up and correlated for the specific messages.MSG1 ExampleMSG1: Preamble detection will trigger this signal:mtd peek -target ulCellPeBl -si

54、gnal LPP_UP_ULCELLPE_CI_SCHEDULE_RA_RESPONSE_IND lhsh gcpu00256 te e all UpUlCellPeBlMaster_Icilhsh gcpu01024 te e all UpcUlCellCeFt_RANDOM_ACCESSMSG2 ExampleMSG2: To check RACH response aka message 2:mtd peek -ta dlMacPeBl -si LPP_UP_DLMACPE_CI_RA_MSG2_ALLOC_INDMSG2: Triggerd by scheduling of RaMsg

55、2 wich contains the grant for RaMsg3:mtd peek -ta ulMacPeBl -sig LPP_UP_ULMACPE_CI_RA_MSG3_INDPrep: Xiaolong yu Appr:Checked:LTE Observation &LTE Toolbox &LTE BasebandRev: PA1Date: 2014-03-1629 (38)Ericsson Internal§Random AccessMSG3 ExampleMSG3: aka RRC Connection Request:mtd peek -ta

56、ulCellCeBl -sig LPP UPC ULCELLCE EI RELEASE RA MSG3 BB_UE_REF_IND mtd peek -ta ulMacPeBl -sig LPP_UP_ULMACPE_CI_RELEASE_RA_MSG3_INDMSG4 ExampleMSG4: See what's scheduled for MSG4, check nrOfComMsg:mtd peek -ta dlMacPeBl -sig LPP_UP_DLMACPE_CI_DL_CCH_ALLOC_IND -dir INCOMINGMSG5 ExampleMSG5: Check for CRC, Check UL grant:mtd peek -ta ulMacPeBl -si LPP_UP_ULMACPE_CI_UL_MAC_CTRL_INFO_IND -di 3 -rep 65535 mtd peek -ta ulMacPeBl -si LPP_UP_ULMACPE_CI_UL_UE_ALLOC_IND -di 2 -rep 65535Prep: Xiaolong yu Appr:Checked:LTE Observatio