Jump to content
Калькуляторы

высокая загрузка CPU 7609

Добрый день.

В последние сутки периодически наблюдаю высокую загрузку 7609.

В результате отваливаются ldp, msdp.

Что конкретно грузит - так и не разобрался, по proc monitor в моменты нагрузки жрет все процесс IPRM (но это, видимо, следствие, а не причина).

CPU utilization for five seconds: 99%/14%; one minute: 44%; five minutes: 37%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
513     6348340    587660      10802 63.43% 16.86%  5.88%   0 IPRM             
534   610660040  10348924      59007 17.51%  2.60%  2.05%   0 BGP Scanner     

 

Конфигурация такая:

show module 
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
 2   48  CEF720 48 port 1000mb SFP              WS-X6748-SFP       SAL1316NJUZ
 3    8  CEF720 8 port 10GE with DFC            WS-X6708-10GE      SAL1222RSC0
 5    2  Route Switch Processor 720 (Active)    RSP720-3CXL-GE     JAE1347ONF4
 9   48  CEF720 48 port 10/100/1000mb Ethernet  WS-X6748-GE-TX     SAL134110Y5

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
 2  0025.4558.3854 to 0025.4558.3883   1.13  12.2(18r)S1  12.2(33)SRD5 Ok
 3  001e.f7f7.c168 to 001e.f7f7.c16f   1.4   12.2(18r)S1  12.2(33)SRD5 Ok
 5  001c.584e.d5a8 to 001c.584e.d5ab   5.9   12.2(33r)SRD 12.2(33)SRD5 Ok
 9  0027.0d8a.a408 to 0027.0d8a.a437   3.2   12.2(18r)S1  12.2(33)SRD5 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status 
---- --------------------------- ------------------ ----------- ------- -------
 2  Distributed Forwarding Card WS-F6700-DFC3BXL   SAL1229XVHZ  5.3    Ok
 3  Distributed Forwarding Card WS-F6700-DFC3CXL   SAL1217NGBK  1.1    Ok
 5  Policy Feature Card 3       7600-PFC3CXL       JAE1348OZZF  1.1    Ok
 5  C7600 MSFC4 Daughterboard   7600-MSFC4         JAE1347OGFQ  1.4    Ok
 9  Centralized Forwarding Card WS-F6700-CFC       SAL1310L9VQ  4.1    Ok

Mod  Online Diag Status 
---- -------------------
 2  Pass
 3  Pass
 5  Pass
 9  Pass

 

Есть подозрение на второй модуль:

show platform hardware capacity 
System Resources
 PFC operating mode: PFC3BXL
 Supervisor redundancy mode: administratively sso, operationally sso
 Switching resources: Module   Part number               Series      CEF mode
                      2        WS-X6748-SFP              CEF720          dCEF
                      3        WS-X6708-10GE             CEF720          dCEF
                      5        RSP720-3CXL-GE        supervisor           CEF
                      9        WS-X6748-GE-TX            CEF720           CEF

Power Resources
 Power supply redundancy mode: administratively redundant
                               operationally redundant
 System power: 3795W, 0W (0%) inline, 2346W (62%) total allocated
 Powered devices: 0 total, 0 Class3, 0 Class2, 0 Class1, 0 Class0, 0 Cisco

Flash/NVRAM Resources
 Usage: Module Device               Bytes:      Total          Used     %Used
        2      dfc#2-bootflash:              15990784        975252        6%
        3      dfc#3-bootflash:              15990784             0        0%
        5  SP  sup-bootdisk:                518791168     467795968       90%
        5  SP  const_nvram:                    127212          2596        2%
        5  SP  hidden-nvram:                  4059328        348723        9%
        5  RP  nvram:                         4059328        348723        9%
        5  RP  bootdisk:                    518791168             0        0%
        9      dfc#9-bootflash:              15990784             0        0%

CPU Resources
 CPU utilization: Module             5 seconds       1 minute       5 minutes
                  2                  33% /  2%            33%             34%
                  3                   3% /  0%             4%              4%
                  5  RP              19% / 14%            22%             31%
                  5  SP               8% /  0%             6%              6%
                  9                   0% /  0%             0%              0%

 

Как бы мне понять, какой порт кузьмит?

show interfaces stats/switching явных аномалий не выявляют.

Спасибо

Share this post


Link to post
Share on other sites

В момент загрузки:

debug netdr clear-capture
debug netdr capture [rx|tx]
show netdr captured-packets

Получите дамп всех пакетов высыпавшихся на CPU.

Сравните пакеты, найдите похожие, зарежте их.

Профит!

Edited by secandr

Share this post


Link to post
Share on other sites

По данной проблеме ничего не знаю, но мне интересно - зачем у вас DFC3BXL "белой вороной" среди окружения *3CXL?

 

P.S. есть такие команды

debug mpls ip iprm

Edited by Tosha

Share this post


Link to post
Share on other sites

Заметил, что очень много кушает процесс Net Input

4.79% 2.39% 1.98% 0 Net Input

 

Чем он отличается от IP input и каковы рекомендации по уменьшению загрузки?

Share this post


Link to post
Share on other sites

Google подсказал:

Net Input	

Handles otherwise unknown packets. This is done at process
level so that input queuing comes into play. If you operate
at interrupt level, you could very easily lock up the router.


Handles some known protocols which you may decide should be
offered to bridging. In this case, net_input either sends
the packet to NULL, or bridges it.

можно попробовать порезать все лишнее.

Edited by Tosha

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this