Jump to content

Проблема с HP NC7170 Dual Port PCI-X

romarioschneider
 Share

Recommended Posts

romarioschneider

romarioschneider

Posted
Posted (edited)

Всем доброго времени суток!

 

В распоряжении сервер, который работает под CentOS 6.5 x86_64 комплектации Minimal + были доустановлены пакеты наподобие bridge-utils, apcupsd и такого плана. После установки системы она была обновлена (yum update) 24.12.2013 (kernel 2.6.32-431.1.2.0.1.el6.x86_64).

 

Hardware:

 

Мат. плата: ASUS P8B-M (https://www.asus.com/Commercial_Servers_Workstations/P8BM/)

Процессор: Intel® Core i3-2100 CPU @ 3.10GHz (http://ark.intel.com/ru/products/53422/intel-core-i3-2100-processor-3m-cache-3_10-ghz)

Сеть - 4 интерфейса Intel, на мат. плате:

1) eth0-br0 Intel Corporation 82574L Gigabit Network Connection

2) eth1-br1 Intel Corporation 82574L Gigabit Network Connection

HP NC7170 PCI-X Dual Port 1000T Gigabit Server Adapter

3) eth2-br2 Intel Corporation 82546GB Gigabit Ethernet Controller (rev 03)

4) eth3-br3 Intel Corporation 82546GB Gigabit Ethernet Controller (rev 03)

 

HP NC7170 PCI-X вставлена в единственный PCI слот мат. платы.

 

На хост-машине крутятся виртуалки KVM, которые включены в сеть через интерфейсы типа brX. Вывод утилиты ifconfig:

br0       Link encap:Ethernet  HWaddr AC:22:0B:XX:XX:XX
         inet addr:192.168.1.253  Bcast:192.168.1.255  Mask:255.255.255.0
         inet6 addr: fe80::ae22:bff:fe8a:d7bd/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:1015960 errors:0 dropped:0 overruns:0 frame:0
         TX packets:2974 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:85047707 (81.1 MiB)  TX bytes:322859 (315.2 KiB)

br1       Link encap:Ethernet  HWaddr AC:22:0B:XX:XX:XX
         inet addr:172.20.1.253  Bcast:172.20.1.255  Mask:255.255.255.0
         inet6 addr: fe80::ae22:bff:fe8a:d7be/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:427077 errors:0 dropped:0 overruns:0 frame:0
         TX packets:11551 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:24694614 (23.5 MiB)  TX bytes:847559 (827.6 KiB)

br2       Link encap:Ethernet  HWaddr 00:1A:4B:XX:XX:XX
         inet addr:172.20.2.253  Bcast:172.20.2.255  Mask:255.255.255.0
         inet6 addr: fe80::21a:4bff:fe06:3e1c/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:17738 errors:0 dropped:0 overruns:0 frame:0
         TX packets:56 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:1044289 (1019.8 KiB)  TX bytes:3976 (3.8 KiB)

br3       Link encap:Ethernet  HWaddr 00:1A:4B:XX:XX:XX
         inet addr:172.20.3.253  Bcast:172.20.3.255  Mask:255.255.255.0
         inet6 addr: fe80::21a:4bff:fe06:3e1d/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:276310 errors:0 dropped:0 overruns:0 frame:0
         TX packets:424 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:16556143 (15.7 MiB)  TX bytes:33441 (32.6 KiB)

eth0      Link encap:Ethernet  HWaddr AC:22:0B:XX:XX:XX
         inet6 addr: fe80::ae22:bff:fe8a:d7bd/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:160737312 errors:0 dropped:0 overruns:0 frame:0
         TX packets:240118258 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:34946475333 (32.5 GiB)  TX bytes:296969688044 (276.5 GiB)
         Interrupt:16 Memory:df300000-df320000

eth1      Link encap:Ethernet  HWaddr AC:22:0B:XX:XX:XX
         inet6 addr: fe80::ae22:bff:fe8a:d7be/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:154657961 errors:0 dropped:0 overruns:0 frame:0
         TX packets:84687832 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:174022321150 (162.0 GiB)  TX bytes:21236834056 (19.7 GiB)
         Interrupt:17 Memory:df200000-df220000

eth2      Link encap:Ethernet  HWaddr 00:1A:4B:XX:XX:XX
         inet6 addr: fe80::21a:4bff:fe06:3e1c/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:230237128 errors:0 dropped:0 overruns:0 frame:0
         TX packets:179550159 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:219398039354 (204.3 GiB)  TX bytes:101852760105 (94.8 GiB)

eth3      Link encap:Ethernet  HWaddr 00:1A:4B:XX:XX:XX
         inet6 addr: fe80::21a:4bff:fe06:3e1d/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:310332 errors:0 dropped:0 overruns:0 frame:0
         TX packets:806 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:30858593 (29.4 MiB)  TX bytes:107706 (105.1 KiB)

Интерфейсы eth1-eth3 подключены по 4-м жилам к коммутатору D-Link DES-3828, на котором накручены VLAN и интерфейсы с сетями 172.20.X.X/24 и находятся в одной подсети 172.20.X.X/16.

 

Доп. информация:

 

cat /etc/proc/interrupts

0:        181          0          0          0   IO-APIC-edge      timer
 1:          2          0          0          0   IO-APIC-edge      i8042
 3:          2          0          0          0   IO-APIC-edge
 4:          2          0          0          0   IO-APIC-edge
 8:          1          0          0          0   IO-APIC-edge      rtc0
 9:          0          0          0          0   IO-APIC-fasteoi   acpi
12:          4          0          0          0   IO-APIC-edge      i8042
16:         28          0          0          0   IO-APIC-fasteoi   ehci_hcd:usb1
19:     230633          0          0          0   IO-APIC-fasteoi   ata_piix, ata_piix
20:  168571999          0          0          0   IO-APIC-fasteoi   eth2
21:     227746          0          0          0   IO-APIC-fasteoi   eth3
23:        124          0          0          0   IO-APIC-fasteoi   ehci_hcd:usb2
24:        342          0          0          0  HPET_MSI-edge      hpet2
25:          0          0          0          0  HPET_MSI-edge      hpet3
26:          0          0          0          0  HPET_MSI-edge      hpet4
27:          0          0          0          0  HPET_MSI-edge      hpet5
30:  140780253          0          0          0   PCI-MSI-edge      eth0-rx-0
31:  212335356          0          0          0   PCI-MSI-edge      eth0-tx-0
32:          2          0          0          0   PCI-MSI-edge      eth0
33:   87282042          0          0          0   PCI-MSI-edge      eth1-rx-0
34:   82358034          0          0          0   PCI-MSI-edge      eth1-tx-0
35:          2          0          0          0   PCI-MSI-edge      eth1
NMI:      45346      41773      44018      36816   Non-maskable interrupts
LOC:  160097992  126081215  198375164  103966291   Local timer interrupts
SPU:          0          0          0          0   Spurious interrupts
PMI:      45346      41773      44018      36816   Performance monitoring interrupts
IWI:          0          0          0          0   IRQ work interrupts
RES:   59871254  104272004   95495779   92920403   Rescheduling interrupts
CAL:   26630872    1099860   26666884    1097463   Function call interrupts
TLB:       1588       2330       2629       3919   TLB shootdowns
TRM:          0          0          0          0   Thermal event interrupts
THR:          0          0          0          0   Threshold APIC interrupts
MCE:          0          0          0          0   Machine check exceptions
MCP:        344        344        344        344   Machine check polls
ERR:          0
MIS:          0

Файл ifcfg-eth2 (файлы аналогичны для всех интерфейсов ethX):

DEVICE=eth2
HWADDR=00:1A:4B:XX:XX:XX
TYPE=Ethernet
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV6INIT=no
NAME="System eth2"
BRIDGE="br2"

Файл ifcfg-br2 (файлы аналогичны для всех интерфейсов brX):

DEVICE=br2
NM_CONTROLLED=no
ONBOOT=yes
TYPE=Bridge
BOOTPROTO=static
IPADDR=172.20.2.253
GATEWAY=172.20.2.1
NETMASK=255.255.255.0
DEFROUTE=no
IPV6INIT=no
IPV4_FAILURE_FATAL=yes
NAME="System br2"

Проблема: с интерфейсами eth0 и eth1 и всем, что с ними связано, проблем нет, а с остальными наблюдается следующая ситуация. Доступ к виртуалкам через eth2 (br2) и eth3 (br3) есть, а на саму хост-машину - нет (в том числе пинг-запросы). Но почему я упомянул коммутатор? Если из консоли DES-3828 запустить ping на адреса br2 и br3 - ответы приходят. Во всех других случаях ответов нет.

 

После несложных манипуляций с интерфейсами eth2 и eth3 утилитой ethtool ее вывод выглядит так:

Settings for eth2:
       Supported ports: [ TP ]
       Supported link modes:   10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Supported pause frame use: No
       Supports auto-negotiation: Yes
       Advertised link modes:  10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Advertised pause frame use: No
       Advertised auto-negotiation: Yes
       Speed: 100Mb/s
       Duplex: Full
       Port: Twisted Pair
       PHYAD: 1
       Transceiver: internal
       Auto-negotiation: on
       MDI-X: Unknown
       Supports Wake-on: umbg
       Wake-on: d
       Current message level: 0x00000007 (7)
                              drv probe link

Features for eth2:
rx-checksumming: off
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: off
large-receive-offload: off
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off
receive-hashing: off

Settings for eth3:
       Supported ports: [ TP ]
       Supported link modes:   10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Supported pause frame use: No
       Supports auto-negotiation: Yes
       Advertised link modes:  10baseT/Half 10baseT/Full
                               100baseT/Half 100baseT/Full
                               1000baseT/Full
       Advertised pause frame use: No
       Advertised auto-negotiation: Yes
       Speed: 100Mb/s
       Duplex: Full
       Port: Twisted Pair
       PHYAD: 1
       Transceiver: internal
       Auto-negotiation: on
       MDI-X: Unknown
       Supports Wake-on: d
       Wake-on: d
       Current message level: 0x00000007 (7)
                              drv probe link
       Link detected: yes

Features for eth3:
rx-checksumming: off
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off
receive-hashing: off

Но ситуация не изменилась. Прошу помощи. Спасибо!

Edited by romarioschneider

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
 Share
Go to topic listing
×
×
  • Create New...