Bear_UA Posted March 19, 2020 Posted March 19, 2020 Здравствуйте Столкнулся с странной проблемой. Для начала железо Шасси 7604 Модули 1 2 Supervisor Engine 720 (Active) WS-SUP720-3B 3 4 CEF720 4 port 10-Gigabit Ethernet WS-X6704-10GE 1 Policy Feature Card 3 WS-F6K-PFC3BXL 1 MSFC3 Daughterboard WS-SUP720 3 Distributed Forwarding Card WS-F6700-DFC3BXL Построен транк 4х10г с другим L2 молотилкой (транк был вначале 2х10г, потом 3х10г, сейчас сделали 4х10г) В периоды пиковой нагрузки (~25g вход/выход) начинаются потери пакетов в районе 1-2% причем когда нагрузка чуть спадает до 24-23 гиг и ниже - все нормализируется. show fabric util показывает в те моменты slot channel speed Ingress % Egress % 1 0 20G 0 0 3 0 20G 34 33 3 1 20G 33 34 Тоесть запас по пропускной способности судя по всему еще приличный. При этом наблюдаем рост следующего каунтера Input queue: 0/2000/0/0 (size/max/drops/flushes) Начинают здесь расти drops на каждом из портов. Чуть нагрузка спадает, счетчик перестает расти, становится все хорошо. При этом прокачка iperf между двумя серверами терминированными в этом коммутаторе падает до 20-60мбит. Чуть спадает нагрузка - скорость стабилизируется. Трафик что бежит через L2 молотилку (не проходит через циску) - потерь нет. Нагрузки на CPU ни на циске ни на L2 молотилке нет. Подскажите может что-то можно подкрутить в конфиге или посмотреть еще какие-то счетчики. Пытался гуглить похожую проблему - результатов не дало :( Заранее благодарю за помощь. Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 22 минуты назад, pvl сказал: У 7600 пропускная способность 20Гбит на слот. Вот у вас даже так и написано. Если объединить 4х10Gbit в итоге всё равно 4 порта упрутся в 20Гбит. Но как же show fabric util? И что такое channel 0 и 1? И если пропускная 20г на слот то почему прокачка в обе стороны в районе 25 гиг? Может можно что-то подкрутить всетаки? Вставить ник Quote
zhenya` Posted March 19, 2020 Posted March 19, 2020 Че эт 20. 40 гиг там. 4 портовая карта лайнрейт. Буфера у неё правда небольшие. Нетфлоу? Спан? Кос? трафик то нормально размазывается по портам? Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 (edited) 10 минут назад, zhenya` сказал: Че эт 20. 40 гиг там. 4 портовая карта лайнрейт. Буфера у неё правда небольшие. Нетфлоу? Спан? Кос? трафик то нормально размазывается по портам? Трафик размазывается по портам равномерно - 6-6.5g на каждый порт (рисуем графики по lacp и по каждому порту отдельно) Нетфлоу нет. Кос тоже. По этим портам просто принимается и раздается трафик. Никаких особых хитрых схем нет. Приняли по бгп 2 аплинка + IX, раздали клиентам. Есть полисеры на портах у некоторых клиентов. Больше ничего хитрого. Edited March 19, 2020 by Bear_UA Вставить ник Quote
fractal Posted March 19, 2020 Posted March 19, 2020 3 минуты назад, Bear_UA сказал: Трафик размазывается по портам равномерно - 6-6.5g на каждый порт (рисуем графики по lacp и по каждому порту отдельно) Нетфлоу нет. Кос тоже. По этим портам просто принимается и раздается трафик. Никаких особых хитрых схем нет. Приняли по бгп 2 аплинка + IX, раздали клиентам. Есть полисеры на портах у некоторых клиентов. Больше ничего хитрого. настраивайте кос, у нее буфера не хватает просто Вставить ник Quote
zhenya` Posted March 19, 2020 Posted March 19, 2020 show platform hardware capacity forwarding Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 2 минуты назад, zhenya` сказал: show platform hardware capacity forwarding L2 Forwarding Resources MAC Table usage: Module Collisions Total Used %Used 1 0 65536 973 1% 3 0 65536 1021 2% VPN CAM usage: Total Used %Used 512 0 0% L3 Forwarding Resources FIB TCAM usage: Total Used %Used 72 bits (IPv4, MPLS, EoM) 524288 35663 7% 144 bits (IP mcast, IPv6) 262144 8 1% detail: Protocol Used %Used IPv4 35661 7% MPLS 1 1% EoM 1 1% IPv6 1 1% IPv4 mcast 4 1% IPv6 mcast 3 1% Adjacency usage: Total Used %Used 1048576 477 1% Forwarding engine load: Module pps peak-pps peak-time 1 379 174418 15:48:25 Kiev Wed Jan 4 2017 3 3269264 13017709 20:38:57 Kiev Mon Dec 18 2017 Сейчас не ЧНН еще. Но не думаю что оно возрастет намного. Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 1 минуту назад, zhenya` сказал: sh mls statistics Statistics for Earl in Module 1 L2 Forwarding Engine Total packets Switched : 134730036216 L3 Forwarding Engine Total packets Processed : 39133842410 @ 257 pps Total packets L3 Switched : 52175430 @ 0 pps Total Packets Bridged : 28006479304 Total Packets FIB Switched : 52175430 Total Packets ACL Routed : 0 Total Packets Netflow Switched : 0 Total Mcast Packets Switched/Routed : 427357121 Total ip packets with TOS changed : 403 Total ip packets with COS changed : 2419 Total non ip packets COS changed : 0 Total packets dropped by ACL : 0 Total packets dropped by Policing : 0 Total packets exceeding CIR : 0 Total packets exceeding PIR : 0 Errors MAC/IP length inconsistencies : 0 Short IP packets received : 0 IP header checksum errors : 0 TTL failures : 0 MTU failures : 0 Statistics for Earl in Module 3 L2 Forwarding Engine Total packets Switched : 156247021523318 L3 Forwarding Engine Total packets Processed : 156209371662880 @ 3173431 pps Total packets L3 Switched : 156011279605685 @ 3172486 pps Total Packets Bridged : 76992757707 Total Packets FIB Switched : 156011279605684 Total Packets ACL Routed : 0 Total Packets Netflow Switched : 1 Total Mcast Packets Switched/Routed : 26215187619 Total ip packets with TOS changed : 7999516077002 Total ip packets with COS changed : 3166693229738 Total non ip packets COS changed : 0 Total packets dropped by ACL : 35676660 Total packets dropped by Policing : 49757820730 Total packets exceeding CIR : 49760619046 Total packets exceeding PIR : 49760619046 Errors MAC/IP length inconsistencies : 2053406 Short IP packets received : 0 IP header checksum errors : 6859487 TTL failures : 5841745069 MTU failures : 0 Total packets L3 Processed by all Modules: 156248505505290 @ 3173688 pps Вставить ник Quote
zhenya` Posted March 19, 2020 Posted March 19, 2020 show run | i mls sh fabric channel-counters 3 show mls qos show queueing interface xx Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 11 минут назад, zhenya` сказал: show run | i mls sh fabric channel-counters 3 show mls qos show queueing interface xx #show run | i mls mls netflow interface no mls netflow mls qos aggregate-policer .... 16 строк aggregate-policer на разные скорости mls qos mls rate-limit unicast ip icmp redirect 100 10 mls qos vlan-based mls qos vlan-based mls qos vlan-based mls qos vlan-based mls qos vlan-based #show fabric channel-counters 3 slot channel rxErrors txErrors txDrops lbusDrops 3 0 0 0 0 0 3 1 104 0 0 0 #show mls qos QoS is enabled globally Port QoS is enabled globally Policy marking depends on port_trust QoS ip packet dscp rewrite enabled globally Input mode for GRE Tunnel is Pipe mode Input mode for MPLS is Pipe mode QoS is vlan-based on the following interfaces: Te3/1 Te3/2 Te3/3 Te3/4 Po1 Vlan or Portchannel(Multi-Earl) policies supported: Yes Egress policies supported: Yes Global Policy-map: ingress[] ----- Module [1] ----- QoS global counters: Total packets: 28486218469 IP shortcut packets: 0 Packets dropped by policing: 0 IP packets with TOS changed by policing: 403 IP packets with COS changed by policing: 2419 Non-IP packets with COS changed by policing: 0 MPLS packets with EXP changed by policing: 0 ----- Module [3] ----- QoS global counters: Total packets: 156118213081850 IP shortcut packets: 0 Packets dropped by policing: 49758137866 IP packets with TOS changed by policing: 7999736089259 IP packets with COS changed by policing: 3166806328645 Non-IP packets with COS changed by policing: 0 MPLS packets with EXP changed by policing: 0 #show queueing int te3/1 Interface TenGigabitEthernet3/1 queueing strategy: Weighted Round-Robin Port QoS is enabled globally Queueing on Te3/1: Tx Enabled Rx Enabled Trust boundary disabled Port is untrusted Extend trust state: not trusted [COS = 0] Default COS is 0 Queueing Mode In Tx direction: mode-cos Transmit queues [type = 1p7q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 Priority 01 WRR bandwidth ratios: 100[queue 1] 150[queue 2] 200[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] queue-limit ratios: 50[queue 1] 20[queue 2] 15[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 15[Pri Queue] queue tail-drop-thresholds -------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 2 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 3 70[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 4 5 6 7 queue thresh cos-map --------------------------------------- 1 1 0 1 2 1 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 4 2 3 2 4 2 5 2 6 2 7 2 8 3 1 6 7 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 5 Queueing Mode In Rx direction: mode-cos Receive queues [type = 8q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 WRR 08 WRR bandwidth ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue-limit ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue tail-drop-thresholds -------------------------- 1 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 40[2] 50[3] 50[4] 50[5] 50[6] 50[7] 50[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 80[2] 90[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 1 2 3 4 5 6 7 8 queue thresh cos-map --------------------------------------- 1 1 0 1 2 3 4 5 6 7 1 2 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 2 4 2 5 2 6 2 7 2 8 3 1 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 8 2 8 3 8 4 8 5 8 6 8 7 8 8 Packets dropped on Transmit: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 ] 2 0 [2 3 4 ] 3 0 [6 7 ] 8 0 [5 ] Packets dropped on Receive: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 2 3 4 5 6 7 ] #show queueing int te3/2 Interface TenGigabitEthernet3/2 queueing strategy: Weighted Round-Robin Port QoS is enabled globally Queueing on Te3/2: Tx Enabled Rx Enabled Trust boundary disabled Port is untrusted Extend trust state: not trusted [COS = 0] Default COS is 0 Queueing Mode In Tx direction: mode-cos Transmit queues [type = 1p7q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 Priority 01 WRR bandwidth ratios: 100[queue 1] 150[queue 2] 200[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] queue-limit ratios: 50[queue 1] 20[queue 2] 15[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 15[Pri Queue] queue tail-drop-thresholds -------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 2 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 3 70[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 4 5 6 7 queue thresh cos-map --------------------------------------- 1 1 0 1 2 1 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 4 2 3 2 4 2 5 2 6 2 7 2 8 3 1 6 7 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 5 Queueing Mode In Rx direction: mode-cos Receive queues [type = 8q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 WRR 08 WRR bandwidth ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue-limit ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue tail-drop-thresholds -------------------------- 1 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 40[2] 50[3] 50[4] 50[5] 50[6] 50[7] 50[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 80[2] 90[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 1 2 3 4 5 6 7 8 queue thresh cos-map --------------------------------------- 1 1 0 1 2 3 4 5 6 7 1 2 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 2 4 2 5 2 6 2 7 2 8 3 1 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 8 2 8 3 8 4 8 5 8 6 8 7 8 8 Packets dropped on Transmit: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 ] 2 0 [2 3 4 ] 3 0 [6 7 ] 8 0 [5 ] Packets dropped on Receive: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 2 3 4 5 6 7 ] #show queueing int te3/3 Interface TenGigabitEthernet3/3 queueing strategy: Weighted Round-Robin Port QoS is enabled globally Queueing on Te3/3: Tx Enabled Rx Enabled Trust boundary disabled Port is untrusted Extend trust state: not trusted [COS = 0] Default COS is 0 Queueing Mode In Tx direction: mode-cos Transmit queues [type = 1p7q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 Priority 01 WRR bandwidth ratios: 100[queue 1] 150[queue 2] 200[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] queue-limit ratios: 50[queue 1] 20[queue 2] 15[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 15[Pri Queue] queue tail-drop-thresholds -------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 2 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 3 70[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 4 5 6 7 queue thresh cos-map --------------------------------------- 1 1 0 1 2 1 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 4 2 3 2 4 2 5 2 6 2 7 2 8 3 1 6 7 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 5 Queueing Mode In Rx direction: mode-cos Receive queues [type = 8q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 WRR 08 WRR bandwidth ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue-limit ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue tail-drop-thresholds -------------------------- 1 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 40[2] 50[3] 50[4] 50[5] 50[6] 50[7] 50[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 80[2] 90[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 1 2 3 4 5 6 7 8 queue thresh cos-map --------------------------------------- 1 1 0 1 2 3 4 5 6 7 1 2 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 2 4 2 5 2 6 2 7 2 8 3 1 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 8 2 8 3 8 4 8 5 8 6 8 7 8 8 Packets dropped on Transmit: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 ] 2 0 [2 3 4 ] 3 0 [6 7 ] 8 0 [5 ] Packets dropped on Receive: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 2 3 4 5 6 7 ] #show queueing int te3/4 Interface TenGigabitEthernet3/4 queueing strategy: Weighted Round-Robin Port QoS is enabled globally Queueing on Te3/4: Tx Enabled Rx Enabled Trust boundary disabled Port is untrusted Extend trust state: not trusted [COS = 0] Default COS is 0 Queueing Mode In Tx direction: mode-cos Transmit queues [type = 1p7q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 Priority 01 WRR bandwidth ratios: 100[queue 1] 150[queue 2] 200[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] queue-limit ratios: 50[queue 1] 20[queue 2] 15[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 15[Pri Queue] queue tail-drop-thresholds -------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 2 40[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 3 70[1] 70[2] 70[3] 70[4] 70[5] 70[6] 70[7] 70[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 70[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 4 5 6 7 queue thresh cos-map --------------------------------------- 1 1 0 1 2 1 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 4 2 3 2 4 2 5 2 6 2 7 2 8 3 1 6 7 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 5 Queueing Mode In Rx direction: mode-cos Receive queues [type = 8q8t]: Queue Id Scheduling Num of thresholds ----------------------------------------- 01 WRR 08 02 WRR 08 03 WRR 08 04 WRR 08 05 WRR 08 06 WRR 08 07 WRR 08 08 WRR 08 WRR bandwidth ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue-limit ratios: 100[queue 1] 0[queue 2] 0[queue 3] 0[queue 4] 0[queue 5] 0[queue 6] 0[queue 7] 0[queue 8] queue tail-drop-thresholds -------------------------- 1 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-min-thresholds ---------------------------------- 1 40[1] 40[2] 50[3] 50[4] 50[5] 50[6] 50[7] 50[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] queue random-detect-max-thresholds ---------------------------------- 1 70[1] 80[2] 90[3] 100[4] 100[5] 100[6] 100[7] 100[8] 2 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 3 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 4 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 5 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 6 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 7 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] 8 100[1] 100[2] 100[3] 100[4] 100[5] 100[6] 100[7] 100[8] WRED disabled queues: 1 2 3 4 5 6 7 8 queue thresh cos-map --------------------------------------- 1 1 0 1 2 3 4 5 6 7 1 2 1 3 1 4 1 5 1 6 1 7 1 8 2 1 2 2 2 3 2 4 2 5 2 6 2 7 2 8 3 1 3 2 3 3 3 4 3 5 3 6 3 7 3 8 4 1 4 2 4 3 4 4 4 5 4 6 4 7 4 8 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 6 1 6 2 6 3 6 4 6 5 6 6 6 7 6 8 7 1 7 2 7 3 7 4 7 5 7 6 7 7 7 8 8 1 8 2 8 3 8 4 8 5 8 6 8 7 8 8 Packets dropped on Transmit: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 ] 2 0 [2 3 4 ] 3 0 [6 7 ] 8 0 [5 ] Packets dropped on Receive: BPDU packets: 0 queue dropped [cos-map] ------------------------------------------------------------ 1 0 [0 1 2 3 4 5 6 7 ] Вставить ник Quote
Bear_UA Posted March 19, 2020 Author Posted March 19, 2020 4 часа назад, pvl сказал: Вот же ж, здесь уже обсуждали Там у человека другие платы и другая ситуация. У меня плата 6704-10GE Судя по Datasheet у нее Switch fabric connection 40 Gbps (80 Gbps full duplex) А у меня получается 25-26g full duplex. Возможно есть какие-то крутилки о которых я не знаю.. потому и спрашиваю... Вставить ник Quote
UglyAdmin Posted March 20, 2020 Posted March 20, 2020 Ну как раз - говорили, что мелкие портовые буферы это платы начинают сказываться после 8 Гбит на порт. У Вас уже близко. Вставить ник Quote
Bear_UA Posted March 21, 2020 Author Posted March 21, 2020 В 20.03.2020 в 07:58, UglyAdmin сказал: Ну как раз - говорили, что мелкие портовые буферы это платы начинают сказываться после 8 Гбит на порт. У Вас уже близко. 8г фулл дуплекса? Вставить ник Quote
UglyAdmin Posted March 21, 2020 Posted March 21, 2020 8г на порт в любую сторону, не суммарно. Вставить ник Quote
Bear_UA Posted March 21, 2020 Author Posted March 21, 2020 9 часов назад, UglyAdmin сказал: 8г на порт в любую сторону, не суммарно. Да ладно. Как тогда у меня при LACP в два порта было 20г на отдачу? Вставить ник Quote
Bear_UA Posted March 21, 2020 Author Posted March 21, 2020 (edited) Справился с одной проблемой путем добавления еще одной платы в шасси - появилась другая. Вводные данные: Есть две платы 6704-10GE - сделан один port-channel на 8 портов с другим свитчом Нарезаются скоростя клиентам путем создания policy-map с class-map class-default и привязыванием к vlan интерфейсу. Пока не добавили вторую плату все работало как часы. После добавления - все поломалось Вот пример #show policy-map int vlan 15 Vlan15 Service-policy input: Ktoto_IN class-map: class-default (match-any) Match: any police aggregate Ktoto_IN : 5000000000 bps 32000000 limit 32000000 extended limit Earl in slot 1 : 0 bytes 5 minute offered rate 0 bps aggregate-forwarded 0 bytes action: transmit exceeded 0 bytes action: drop aggregate-forward 0 bps exceed 0 bps Earl in slot 3 : 88079805651099 bytes 5 minute offered rate 634548920 bps aggregate-forwarded 88079805651099 bytes action: transmit exceeded 0 bytes action: drop aggregate-forward 600133816 bps exceed 0 bps Earl in slot 4 : 751590650048 bytes 5 minute offered rate 542746400 bps aggregate-forwarded 751590650048 bytes action: transmit exceeded 0 bytes action: drop aggregate-forward 552807352 bps exceed 0 bps Service-policy output: Ktoto_OUT class-map: class-default (match-any) Match: any police aggregate Ktoto_OUT : 5000000000 bps 32000000 limit 32000000 extended limit Earl in slot 1 : 407773267 bytes 5 minute offered rate 2368 bps aggregate-forwarded 407773267 bytes action: transmit exceeded 0 bytes action: drop aggregate-forward 3632 bps exceed 0 bps Earl in slot 3 : 602569565167035 bytes 5 minute offered rate 2899312112 bps aggregate-forwarded 602452614311334 bytes action: transmit exceeded 116950855701 bytes action: drop aggregate-forward 2883222784 bps exceed 0 bps Earl in slot 4 : 4149957849571 bytes 5 minute offered rate 2861219224 bps aggregate-forwarded 4149957849571 bytes action: transmit exceeded 0 bytes action: drop aggregate-forward 2959532552 bps exceed 0 bps Как мы видим из вывода - делается полисер на одной плате в 5g и на второй плате в 5g (хоть стоит и police aggregate) соотв. клиент получает канал шире чем должен был бы. Такая же ситуация и на не аггрегированных полисерах. Подскажите - как можно решить данную проблему? Edited March 21, 2020 by Bear_UA Вставить ник Quote
sdy_moscow Posted March 22, 2020 Posted March 22, 2020 @Bear_UA Насколько помнится полисер не умеет работать на двух фабриках одновременно. Так-что ответ - никак. Или полисить где-то в другом месте. Вставить ник Quote
UglyAdmin Posted March 22, 2020 Posted March 22, 2020 8 часов назад, Bear_UA сказал: Да ладно. Как тогда у меня при LACP в два порта было 20г на отдачу? Оно работает, просто с потерями пакетов. Вставить ник Quote
.png.5d2afa2996cc6a85d0f2c09b92dd0a28.png)
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.