nms troubleshooting instructions

Upload: ariel-asayag

Post on 07-Jul-2018

230 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/18/2019 NMS Troubleshooting Instructions

    1/15

    Tellabs ®  8000 Network Manager 

    Instructions for Troubleshooting

    26.2.08

    Version 1.0

  • 8/18/2019 NMS Troubleshooting Instructions

    2/15

    Document Information

    Tellabs® 8000 Network Manager Instructions for Troubleshooting

    Version 1.0© 201 Tellabs.

  • 8/18/2019 NMS Troubleshooting Instructions

    3/15

    Document Information

    Version 1.0

    © 201 Tellabs.Tellabs® 8000 Network Manager Instructions for Troubleshooting

    3

  • 8/18/2019 NMS Troubleshooting Instructions

    4/15

    Table of !ontents

    Table of Contents

    1 Check atabase Maintenance an! Configuration....................................................."

    1.1 Check and Execute Maintenance Scripts.........................................................................................................

    1.2 Check database server settings........................................................................................................................

    1.3 Check database server internal data storage....................................................................................................

    1.4 Get the change message rate...........................................................................................................................

    2 atabase #er$er Monitoring.......................................................................................%

    2.1 Sbase errorlog...............................................................................................................................................

    2.2 !n a "indo#s $atabase Server........................................................................................................................

    2.3 !n a Solaris $atabase Server............................................................................................................................

    & #tan!ar! 'orkstation Monitoring..............................................................................(

    ) #en! us.......................................................................................................................1&

    Tellabs® 8000 Network Manager Instructions for Troubleshooting

    Version 1.0© 201 Tellabs.

    4

  • 8/18/2019 NMS Troubleshooting Instructions

    5/15

    Database "er#er Monitoring

    1 Check atabase Maintenance an!Configuration

    1.1 Check an! *+ecute Maintenance #cri,ts

    • When was the last time that maintenance scripts were run?

    • If not known, or scripts have been run over a week ago run ReorgIndex.cmd and

    UpdStat.cmd

    1.2 Check !atabase ser$er settings

    • isql –SDBSRVR –Usa –P -w145 -i ase_info.sql –o

    ase_info.log

    • Check that ase_info.log was generated and save it for later use

    • Browse ase_info.log for errors and wrong settings

    1.& Check !atabase NM# settings

    • isql –SDBSRVR –DDBNAME –Usa –P -w145 -i nms_info.sql –o

    nms_info.log

    • Check that nms _info.log was generated and save it for later use

    • Browse nms_info.log for errors and unusual data

    1.) Check !atabase ser$er internal !ata storage

    Run CheckDb.cmd • Check resulting CheckDb.log was generated and save it for later use

    • Check Checkb.log for errors

    1." -et the change essage rate

    • isql –SDBSRVR –DDBNAME –Usa –P –w145 –i changes.sql –o

    changes.log

    • Check the changes.log was generated and save it for later use

    • Check changes.log for errors

    Version 1.0

    © 201 Tellabs.Tellabs® 8000 Network Manager Instructions for Troubleshooting

  • 8/18/2019 NMS Troubleshooting Instructions

    6/15

    Database "er#er Monitoring

     

    Tellabs® 8000 Network Manager Instructions for Troubleshooting

    Version 1.0© 201 Tellabs.

  • 8/18/2019 NMS Troubleshooting Instructions

    7/15

    Database "er#er Monitoring

    2 atabase #er$er Monitoring

    2.1 #/base errorlog

    • Check the errorlog and save it for later use

    2.2 In a 'in!ows atabase #er$er 

    • s!steminfo.e"e output in Windows #$%&''( )or *+ccessories -!stem ools -!stem

    Information /"port +ll +s e"t 0ile1 if 2- is not Windows #$%&''(3 

    • /vent4iewer -!stem%+pplication log 5 *Control $anel +dministrative ools /vent 4iewer1,

    then for +pplication and -!stem logs save logs like this6

    Version 1.0

    © 201 Tellabs.Tellabs® 8000 Network Manager Instructions for Troubleshooting

  • 8/18/2019 NMS Troubleshooting Instructions

    8/15

    Database "er#er Monitoring

    2.& In a #olaris atabase #er$er 

    • 7et memor! statistics b! running shell script in telnet or --8 session6

    $stat 60 while rea! line !o echo 3!ate 45T55!5/3 7line !one $stat.log9

    • 7et disk usage statistics b! running shell script in telnet or --8 session6

    iostat :+;nce 60 while rea! line !o echo 3!ate 45T55!5/3 7line !one

    iostat.log9

    • 7et C$9 usage statistics b! running shell script in telnet or --8 session6

    ,stat 60 while rea! line !o echo 3!ate 45T55!5/3 7line !one ,stat.log9

    • 7et *op :'1 most active processes b! running shell script in telnet or --8 session6

    ,rstat :s c,u :n " 60 while rea! line !o echo 3!ate 45T55!5/3 7line !one ,rstat.log9

    Tellabs® 8000 Network Manager Instructions for Troubleshooting

    Version 1.0© 201 Tellabs.

  • 8/18/2019 NMS Troubleshooting Instructions

    9/15

    Database "er#er Monitoring

    hen please collect and send us the output logs6

    ;ip stats.;ip vmstat.log iostat.log mpstat.log prstat.log

    o stop performance collection check whether statistics process are running6

    $ ps -e|grep stat

     221 ? 0:00 statd

     5859 pts/1 0:00 iostat

     6142 pts/1 0:00 mpstat

     5797 pts/1 0:00 vmstat

     6583 pts/1 0:00 prstat

    and if the! are running use kill command6

    $ kill 5797

    $ kill 5859

    $ kill 6142

    $ kill 6583

  • 8/18/2019 NMS Troubleshooting Instructions

    10/15

    Database "er#er Monitoring

    & NM# Co,uter Monitoring

    %pplicable &or all Servers'Standard "orkstation'(o#er "orkstation

    &.1 Turning on the NM# Tracing

    :. -hut down >- software in workstation&. +dd to >-.I>I6 OBJS_SQLTEST=TRUE

    (. Replace in %NMSDIR%\java\extern\phoenix\apps\emsa\SAR-INF\environment.xml6 with help of e.g. >otepad word *ERROR@ with word @DEBUG@

    A. Run >- trace with all trace levels6NMSDIR%\nmstrace.exe 0123456789 * trace.log y

    . C$9 load and other statistics *Control $anel +dministrative ools 5 $erformance1 and there goto Counter

  • 8/18/2019 NMS Troubleshooting Instructions

    11/15

    Database "er#er Monitoring

    hen choose *$rocess1 performance obEect, select *evcl1 process then first * $rocessor ime1, click*+dd1then *$rivate B!tes1 like shown below, click *+dd16

     

    three counters to log ever! : second to *comma delimited1 disk file ).C-43,

    Version 1.0

    © 201 Tellabs.Tellabs® 8000 Network Manager Instructions for Troubleshooting

    11

  • 8/18/2019 NMS Troubleshooting Instructions

    12/15

    Database "er#er Monitoring

    usuall! located in C6F$erf

  • 8/18/2019 NMS Troubleshooting Instructions

    13/15

    Database "er#er Monitoring

    then *2G1 and *-tart1, make sure *H'''_std_ws_overview1 marked as green meaning performance datacollection is active.

    &.2 Turning on #/ste Monitoring

     . s!steminfo.e"e output as in &.&J. /vent4iewer -!stem%+pplication log, same as &.&H. netstat 5ba K C2$9/R>+/_netstat.t"t

    Version 1.0

    © 201 Tellabs.Tellabs® 8000 Network Manager Instructions for Troubleshooting

    13

  • 8/18/2019 NMS Troubleshooting Instructions

    14/15

    Database "er#er Monitoring

    L. ipconfig %all K C2$9/R>+/_ipconfig.t"t:'. ossm K C2$9/R>+/_ossm.t"t output

    &.&

  • 8/18/2019 NMS Troubleshooting Instructions

    15/15

    Database "er#er Monitoring

    ) Material to #en! for =urther #tu!/

    • ase_info.log 

    • nms_info.log

    • CheckDb.log

    • changes.log

    • C2$9/R>+/_netstat.t"t

    • C2$9/R>+/_ipconfig.t"t

    • C2$9/R>+/_ossm.t"t

    •  +