Jump to content
Калькуляторы

Cisco3750. Периодические проблемы с control plane Потери пакетов до SVI интерфейсов

Reply to this topic

fox_m   

fox_m
Posted

Коллеги,

 

Последнее время, несколько раз в сутки, Nagios не может достучаться до C3750 из за того, что есть потери (до 30%) пакетов до SVI интерфейса коммутатора. Если в этот момент зайти на коммутатор удаленно, то все заметно тормозит. Через минуту-две все прекращается. Причем это касается, судя по всему, всех SVI интерфейсов коммутатора. На транзитном трафике, судя по всему, проблема не отражается. Такое ощущение, что проблема в control plane. Загрузка ЦП в момент проблемы может подскакивать до 40-60%. На коммутаторе есть SVI, которые доступны из Интернет. Может флуд какой-то? Что можно посмотреть? IOS там не самый новый и защиты control plane там нет.

Share this post

Link to post
Share on other sites

fox_m   

fox_m
Posted 

CPU utilization for five seconds: 17%/0%; one minute: 10%; five minutes: 10%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
  4   555575940  25053306      22175  9.10%  1.43%  1.06%   0 Check heaps      
348         594       181       3281  0.63%  0.32%  0.14%   2 Virtual Exec     
352        3532       852       4145  0.31%  0.37%  0.30%   8 Virtual Exec     
339     8204303  74996914        109  0.15%  0.01%  0.00%   0 EIGRP-IPv4       
351          26        40        650  0.15%  0.02%  0.00%   7 Virtual Exec     
 88    48175708   5418853       8890  0.15%  0.09%  0.06%   0 HULC Tcam Memory 
220   2919568011746032988        167  0.15%  0.21%  0.22%   0 Spanning Tree    
145     86136371286961103          6  0.15%  0.06%  0.02%   0 Hulc LED Process 
206   2205623281233565827        178  0.15%  0.32%  0.39%   0 IP Input         
 21    34932430 156443852        223  0.15%  0.05%  0.05%   0 IPC Seat Manager 
 72     9593714  57690168        166  0.15%  0.04%  0.00%   0 hrpc <- response 
329   214806378 306643613        700  0.15%  0.22%  0.31%   0 SNMP ENGINE      
323   140157218 630217891        222  0.15%  0.34%  0.32%   0 PIM Process      
 14         102        76       1342  0.00%  0.00%  0.00%   0 Entity MIB API   
 13           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager   
 12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit 
 15           0         1          0  0.00%  0.00%  0.00%   0 IFS Agent Manage 
 16        4720    904143          5  0.00%  0.00%  0.00%   0 IPC Dynamic Cach 
 17           0         1          0  0.00%  0.00%  0.00%   0 IPC Zone Manager 
 11           0       227          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT 
 18       62344  53889284          1  0.00%  0.00%  0.00%   0 IPC Periodic Tim 
 23         126         4      31500  0.00%  0.00%  0.00%   0 PrstVbl          
 24       74501  53889289          1  0.00%  0.00%  0.00%   0 Dynamic ARP Insp 
 19       53993  60284074          0  0.00%  0.00%  0.00%   0 IPC Managed Time 
 20       53707  53889302          0  0.00%  0.00%  0.00%   0 IPC Deferred Por 
 27           0         1          0  0.00%  0.00%  0.00%   0 License IPC serv

 

CPU utilization for five seconds: 9%/0%; one minute: 10%; five minutes: 10%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
206   2205628071233567996        178  1.11%  0.48%  0.42%   0 IP Input         
323   140157565 630218954        222  0.47%  0.33%  0.32%   0 PIM Process      
194     3530061  13879151        254  0.31%  0.06%  0.01%   0 AAA Server       
352        3790       883       4292  0.31%  0.27%  0.28%   8 Virtual Exec     
351           8         2       4000  0.15%  0.01%  0.00%   7 Virtual Exec     
236     3574967   8156981        438  0.15%  0.02%  0.00%   0 TCP Protocols    
 43     1405379  16247508         86  0.15%  0.01%  0.00%   0 HC Counter Timer 
  9   102933589  89211124       1153  0.15%  0.17%  0.18%   0 ARP Input        
200     6266048  12133249        516  0.15%  0.01%  0.00%   0 CDP Protocol     
320     6357544 173540159         36  0.15%  0.01%  0.00%   0 LACP Protocol    
220   2919570381746034659        167  0.15%  0.20%  0.22%   0 Spanning Tree    
 68     56822022865270141          0  0.15%  0.02%  0.00%   0 Fifo Error Detec 
 13           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager   
 12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit 
 11           0       227          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT 
 10           0         1          0  0.00%  0.00%  0.00%   0 CEF MIB API      
 14         102        76       1342  0.00%  0.00%  0.00%   0 Entity MIB API   
 15           0         1          0  0.00%  0.00%  0.00%   0 IFS Agent Manage 
 20       53707  53889396          0  0.00%  0.00%  0.00%   0 IPC Deferred Por 
 16        4720    904144          5  0.00%  0.00%  0.00%   0 IPC Dynamic Cach 
  8           0         1          0  0.00%  0.00%  0.00%   0 Crash writer     
 23         126         4      31500  0.00%  0.00%  0.00%   0 PrstVbl          
 24       74501  53889383          1  0.00%  0.00%  0.00%   0 Dynamic ARP Insp 
 18       62344  53889378          1  0.00%  0.00%  0.00%   0 IPC Periodic Tim

 

CPU utilization for five seconds: 18%/0%; one minute: 10%; five minutes: 10%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
  4   555577224  25053364      22175  9.42%  1.45%  1.07%   0 Check heaps      
348        1233       335       3680  1.91%  0.52%  0.26%   2 Virtual Exec     
206   2205629241233568587        178  0.47%  0.46%  0.42%   0 IP Input         
323   140157640 630219225        222  0.31%  0.31%  0.32%   0 PIM Process      
 88    48175820   5418865       8890  0.15%  0.08%  0.06%   0 HULC Tcam Memory 
145     86136711286963966          6  0.15%  0.02%  0.01%   0 Hulc LED Process 
200     6266065  12133257        516  0.15%  0.03%  0.00%   0 CDP Protocol     
  9   102933655  89211185       1153  0.15%  0.18%  0.18%   0 ARP Input        
234    24536856 326667219         75  0.15%  0.05%  0.05%   0 MDFS LC Process  
352        3866       892       4334  0.15%  0.26%  0.28%   8 Virtual Exec     
 11           0       227          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT 
 12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit 
 10           0         1          0  0.00%  0.00%  0.00%   0 CEF MIB API      
 15           0         1          0  0.00%  0.00%  0.00%   0 IFS Agent Manage 
  8           0         1          0  0.00%  0.00%  0.00%   0 Crash writer     
 14         102        76       1342  0.00%  0.00%  0.00%   0 Entity MIB API   
 13           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager   
 19       53993  60284198          0  0.00%  0.00%  0.00%   0 IPC Managed Time 
 16        4720    904145          5  0.00%  0.00%  0.00%   0 IPC Dynamic Cach 
 21    34932498 156444143        223  0.00%  0.03%  0.04%   0 IPC Seat Manager 
 22           0         1          0  0.00%  0.00%  0.00%   0 IPC Session Serv 
 23         126         4      31500  0.00%  0.00%  0.00%   0 PrstVbl          
 24       74501  53889409          1  0.00%  0.00%  0.00%   0 Dynamic ARP Insp 
 17           0         1          0  0.00%  0.00%  0.00%   0 IPC Zone Manager 
 26           0         1          0  0.00%  0.00%  0.00%   0 License IPC stat 
 18       62344  53889404          1  0.00%  0.00%  0.00%   0 IPC Periodic Tim 
 28       59919  53889289          1  0.00%  0.00%  0.00%   0 GraphIt

 

Как-то так.

Share this post

Link to post
Share on other sites

fox_m   

fox_m
Posted

sh tcp br показывает, что есть tcp соединения (23 порт) на SVI интерфейсы, которые видны из Интернет (acl там нет)

 

00455520  xxx.xxx.xxx.69.23         212.93.119.204.45689   CLOSED
005D7E58  xxx.xxx.xxx.49.23         175.100.91.171.34773   FINWAIT1
002ED3C0  xxx.xxx.xxx.81.23         14.160.30.95.34433     FINWAIT1
00498610  xxx.xxx.xxx.41.23         183.81.81.31.45813     FINWAIT1
002EC69C  10.100.2.201.23         10.100.2.102.56953     ESTAB
005A58AC  xxx.xxx.xxx.41.23         183.81.81.31.45878     FINWAIT1
005CD374  xxx.xxx.xxx.57.23         189.58.2.68.42507      CLOSED
00612F10  xxx.xxx.xxx.41.23         177.68.251.45.37356    FINWAIT1
00612F10  xxx.xxx.xxx.41.23         177.68.251.45.37356    FINWAIT1
007B2D4C  10.100.2.201.23         10.100.2.102.49769     ESTAB
005F8588  xxx.xxx.xxx.81.23         183.93.49.23.43568     CLOSED
004222D0  xxx.xxx.xxx.41.23         177.68.251.45.37339    CLOSED
00304594  xxx.xxx.xxx.41.23         183.81.81.31.45400     FINWAIT1
005AC8E4  xxx.xxx.xxx.57.22         109.228.26.80.51388    FINWAIT1
004EA990  xxx.xxx.xxx.81.23         210.125.160.31.37745   ESTAB
0025BEA4  10.100.4.8.37425        10.100.4.2.179         ESTAB
00376840  10.100.4.8.32001        10.100.4.1.179         ESTAB
0029C910  xxx.xxx.xxx.69.23         72.238.221.88.35456    FINWAIT1
0002D554  xxx.xxx.xxx.41.23         183.81.81.31.45521     CLOSED
04AF5958  xxx.xxx.xxx.121.23        110.35.209.154.4424    CLOSED
0049B8AC  xxx.xxx.xxx.69.23         148.240.168.135.49868  CLOSED
061A3A10  xxx.xxx.xxx.61.23         210.125.160.31.47901   ESTAB
004A9A10  xxx.xxx.xxx.81.23         14.160.30.95.34738     FINWAIT1
005A76F4  xxx.xxx.xxx.81.23         14.160.30.95.34289     CLOSED
005EE794  xxx.xxx.xxx.69.23         191.109.224.37.34124   TIMEWAIT
061A6540  xxx.xxx.xxx.57.23299      xxx.xxx.xxx.58.179       ESTAB
00448D94  xxx.xxx.xxx.61.23611      xxx.xxx.xxx.62.179       ESTAB
0030149C  xxx.xxx.xxx.45.23         177.96.186.205.37990   CLOSED

Share this post

Link to post
Share on other sites

fox_m   

fox_m
Posted

Дык, а где высокая нагрузка то? Выше 18% не видать...

 

Ну я по истории смотрел. Возможно, в момент проблемы, действительно больше 20% не поднималась.

Share this post

Link to post
Share on other sites

ShyLion   

ShyLion
Posted

sh tcp br показывает, что есть tcp соединения (23 порт) на SVI интерфейсы, которые видны из Интернет (acl там нет)

 

00455520  xxx.xxx.xxx.69.23         212.93.119.204.45689   CLOSED
005D7E58  xxx.xxx.xxx.49.23         175.100.91.171.34773   FINWAIT1
002ED3C0  xxx.xxx.xxx.81.23         14.160.30.95.34433     FINWAIT1
00498610  xxx.xxx.xxx.41.23         183.81.81.31.45813     FINWAIT1
002EC69C  10.100.2.201.23         10.100.2.102.56953     ESTAB
005A58AC  xxx.xxx.xxx.41.23         183.81.81.31.45878     FINWAIT1
005CD374  xxx.xxx.xxx.57.23         189.58.2.68.42507      CLOSED
00612F10  xxx.xxx.xxx.41.23         177.68.251.45.37356    FINWAIT1
00612F10  xxx.xxx.xxx.41.23         177.68.251.45.37356    FINWAIT1
007B2D4C  10.100.2.201.23         10.100.2.102.49769     ESTAB
005F8588  xxx.xxx.xxx.81.23         183.93.49.23.43568     CLOSED
004222D0  xxx.xxx.xxx.41.23         177.68.251.45.37339    CLOSED
00304594  xxx.xxx.xxx.41.23         183.81.81.31.45400     FINWAIT1
005AC8E4  xxx.xxx.xxx.57.22         109.228.26.80.51388    FINWAIT1
004EA990  xxx.xxx.xxx.81.23         210.125.160.31.37745   ESTAB
0025BEA4  10.100.4.8.37425        10.100.4.2.179         ESTAB
00376840  10.100.4.8.32001        10.100.4.1.179         ESTAB
0029C910  xxx.xxx.xxx.69.23         72.238.221.88.35456    FINWAIT1
0002D554  xxx.xxx.xxx.41.23         183.81.81.31.45521     CLOSED
04AF5958  xxx.xxx.xxx.121.23        110.35.209.154.4424    CLOSED
0049B8AC  xxx.xxx.xxx.69.23         148.240.168.135.49868  CLOSED
061A3A10  xxx.xxx.xxx.61.23         210.125.160.31.47901   ESTAB
004A9A10  xxx.xxx.xxx.81.23         14.160.30.95.34738     FINWAIT1
005A76F4  xxx.xxx.xxx.81.23         14.160.30.95.34289     CLOSED
005EE794  xxx.xxx.xxx.69.23         191.109.224.37.34124   TIMEWAIT
061A6540  xxx.xxx.xxx.57.23299      xxx.xxx.xxx.58.179       ESTAB
00448D94  xxx.xxx.xxx.61.23611      xxx.xxx.xxx.62.179       ESTAB
0030149C  xxx.xxx.xxx.45.23         177.96.186.205.37990   CLOSED

 

telnet открыт снаружи? Сильно.

Share this post

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Followers 0
Go to topic listing Активное оборудование Ethernet, IP, MPLS, SDN/NFV...