Jump to content
Калькуляторы

Linux interrupts SMP Прерывания от системного таймера грузят только CPU0

cat /proc/interrupts
            CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7
   0: 1887460523          0          0          0          0          0          0          0   IO-APIC-edge      timer
   1:          5          0          0          0          0          0          0          0   IO-APIC-edge      i8042
   4:          1          0          0          0          0          0          0          0   IO-APIC-edge
   8:         60          0          0          0          0          0          0          0   IO-APIC-edge      rtc0
   9:          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   acpi
  14:     756618          0          0          0          0          0          0          0   IO-APIC-edge      ata_piix
  15:          0          0          0          0          0          0          0          0   IO-APIC-edge      ata_piix
  16:         38          0          0          0          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb3
  18:          2          0          0          0          0          0          0          0   IO-APIC-fasteoi   ehci_hcd:usb1, uhci_hcd:usb6
  19:          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   ata_piix, uhci_hcd:usb5
  23:          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   ehci_hcd:usb2, uhci_hcd:usb4
  55:          4          0          0          0          0          0          0          0   PCI-MSI-edge      eth0
  56: 1643532664          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-0
  57:          5 1737203636          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-1
  58:          5          0 2561956177          0          0          0          0          0   PCI-MSI-edge      eth0-tx-0
  59:          5          0          0 2618170981          0          0          0          0   PCI-MSI-edge      eth0-tx-1
  60:          4          0          0          0          0          0          0          0   PCI-MSI-edge      eth1
  61:          5          0          0          0 1960894818          0          0          0   PCI-MSI-edge      eth1-rx-0
  62:          4          0          0          0          0 1994152509          0          0   PCI-MSI-edge      eth1-rx-1
  63:          4          0          0          0          0          0 3343611560          0   PCI-MSI-edge      eth1-tx-0
  64:          4          0          0          0          0          0          0    2065419   PCI-MSI-edge      eth1-tx-1
NMI:    7704654      41605     160940     106106     199608     239168      20572       9129   Non-maskable interrupts
LOC:  103085495 1351629945  360371307  359123490 2010271296 2028174767  362856000  362785890   Local timer interrupts
SPU:          0          0          0          0          0          0          0          0   Spurious interrupts
PMI:          0          0          0          0          0          0          0          0   Performance monitoring interrupts
PND:          0          0          0          0          0          0          0          0   Performance pending work
RES:       7248       3475       2349       2309        366       3244       2217       2073   Rescheduling interrupts
CAL:         26         38         42         41     460157         40         41         42   Function call interrupts
TLB:       1532        884        169         10       5119       5934        151          8   TLB shootdowns
ERR:          0
MIS:          0

cat /proc/irq/0/smp_affinity
ffff

cat /sys/devices/system/clocksource/clocksource0/current_clocksource
tsc

 

На других серверах прерывания от таймера (irq 0) обрабатываются всеми CPU и их кол-во ничтожно мало:

cat /proc/interrupts
           CPU0       CPU1       CPU2       CPU3
  0:       6374       5798       6369       5844   IO-APIC-edge      timer
  9:          0          0          0          0   IO-APIC-fasteoi   acpi
14:          0          0          0          0   IO-APIC-edge      ata_piix
15:          0          0          0          0   IO-APIC-edge      ata_piix
16:          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb5
18:          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb4
19:     724106     677568     724901     676228   IO-APIC-fasteoi   ata_piix, uhci_hcd:usb3
23:         10          9         10         10   IO-APIC-fasteoi   ehci_hcd:usb1, uhci_hcd:usb2
79: 1056044290          2 1055924526          0   PCI-MSI-edge      eth1
80:          0 3371465553          1 3371183698   PCI-MSI-edge      eth0
NMI:          0          0          0          0   Non-maskable interrupts
LOC: 3358006264 2708537017 3306706609 2491989335   Local timer interrupts
SPU:          0          0          0          0   Spurious interrupts
CNT:          0          0          0          0   Performance counter interrupts
PND:          0          0          0          0   Performance pending work
RES:       2418       3978       4110       3360   Rescheduling interrupts
CAL:        132        112        131        123   Function call interrupts
TLB:     107845     358113     109483     360469   TLB shootdowns
ERR:          0
MIS:          0

Куда копать?

Edited by shaytan

Share this post


Link to post
Share on other sites

на других серверах clocksource тоже tsc?

Share this post


Link to post
Share on other sites

на другом сервере наверное Tickless kernel

Share this post


Link to post
Share on other sites

Tickless System - в ядре не включена на всех серверах.

clocksource везде tsc.

 

Единственное отличие в ядрах - это драйвер сетевой карты. Там где таймер грузит CPU0 используется igb.

Edited by shaytan

Share this post


Link to post
Share on other sites

У меня так (igb)

# cat /proc/interrupts
           CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7       CPU8       CPU9       CPU10      CPU11      CPU12      CPU13      CPU14      CPU15
  0:         36          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-edge      timer
  1:          2          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-edge      i8042
  8:          1          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-edge      rtc0
  9:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   acpi
12:          4          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-edge      i8042
16:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb1
18:          2          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   ehci_hcd:usb5, uhci_hcd:usb7
19:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb3, uhci_hcd:usb6
21:         55          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb2
23:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   IO-APIC-fasteoi   uhci_hcd:usb4, ehci_hcd:usb8
1251:    3673294          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      ahci
1252:          1          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      none-edge
1258:          4          0          0          0          0          0          0          0          0          0          0          0          0          0          0 1376429509   PCI-MSI-edge      eth3-tx-0
1259:          3          0          0          0          0          0          0          0          0          0          0          0          0          0 1137924776          0   PCI-MSI-edge      eth3-rx-0
1260:          1          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth3
1261:          3          0          0          0          0          0          0          0          0          0          0          0          0 1451771203          0          0   PCI-MSI-edge      eth2-tx-0
1262:          3          0          0          0          0          0          0          0          0          0          0          0 1260105200          0          0          0   PCI-MSI-edge      eth2-rx-0
1263:          1          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth2
1264:          5          0          0          0          0          0          0          0          0          0          0 1407699724          0          0          0          0   PCI-MSI-edge      eth1-tx-0
1265:          3          0          0          0          0          0          0          0          0          0 1340320459          0          0          0          0          0   PCI-MSI-edge      eth1-rx-0
1266:          1          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth1
1267:          3          0          0          0          0          0          0          0          0     212826          0          0          0          0          0          0   PCI-MSI-edge      eth0-tx-3
1268:          3          0          0          0          0          0          0          0     212826          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-tx-2
1269:          3          0          0          0          0          0          0     212826          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-tx-1
1270:          5          0          0          0          0          0 3006023887          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-tx-0
1271:         23          0          0          0          0 1106456484          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-3
1272:         32          0          0          0 1145335785          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-2
1273:         15          0          0 1140364416          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-1
1274:         31          0 1139908203          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0-rx-0
1275:         62          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   PCI-MSI-edge      eth0
NMI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Non-maskable interrupts
LOC:   18807804    4373216   89325354   89162889   88248477   88152167   85669410   37755936   42128777   33831256   91893902   81404190   91082055   81226957   90725347   80677291   Local timer interrupts
RES:      22957       5729      17056      12600       9526      11853       9136    2806176    1745684      20939      50450      16084      19530      21003      19434      14494   Rescheduling interrupts
CAL:    1901491    1901278    1901750    1901752    1901754    1901755    1901752    1901749    1878408     106813    1888688    1892285    1898810    1897068    1853277    1897696   function call interrupts
TLB:       8743       5191       9529      10972      11727      10176      16533       8996      38335     142299      80560      61786      65239     166810      97358      84900   TLB shootdowns
TRM:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Thermal event interrupts
THR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Threshold APIC interrupts
SPU:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Spurious interrupts
ERR:          0

# cat /proc/irq/0/smp_affinity
0000ffff

# cat /sys/devices/system/clocksource/clocksource0/current_clocksource
tsc

Share this post


Link to post
Share on other sites

Похоже проблема в железе (PIC)

На железе HP DL160G5 (Intel 5400 Chipset) проблемы нет, а стоит переставить систему на HP DL160G6 (Intel 5520 Chipset) так проблема появляется.

 

Здесь описана аналогичная ситуация.

Edited by shaytan

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this