Jump to content
Калькуляторы

kernel panic - Ubuntu 13.10 не знаю куда рыть (( постоянный kernel panic

постоянный кернел паник..

 

есть железяка стояла фра .. чувствовала себя хорошо аптайм был по 60 - 100 дней ребут был разве что по долгому пропаданию электроэнергии ..

пришлось поставить линукс из за переноса оборудования в другое место где требовалась именно линукс система ... проще всего было поставить Ubuntu 13.10 server ( как мне показалось )

и вот проблема сервер сам по себе произвольно не с чем не связанно перезагружаться начал ... думал греется сделали хорошее охлаждение потом начал грешить на сетевку.. отложенные прерывания и т.д. трафик на сервере не большой где то до 80 мегабит .. ткнулся в интегрированную ..

думал проц может или память или винт .. накидал на серв фильмов на 100 гиг заархивил .. серв пережил.. спокойно .. но потом через время снова кернел паник отписал.

стоит на удалении оочень большом... монитора там нет если посмотреть на экран надо .. то берем под мышку монитор клаву и вперед .. бегать к нему каждый раз при зависании неудобно

обслуживает около 100 абонентов .. ну абона сесть нас уже хотят .. серв кернел паник выскакивает иногда 2 раза за день, иногда 1 раз в 3 дня .. хаотично ..

напряжение стабильное .. стоит упс смарт ..

куда рыть не знаю уже подумываем или сменить систему или железо .. а то просто достало и нас и клиентов ..

 

поставил crash kernel ..

но не имею особо опыт анализа ...

вот что пишет ..

ругается на участок памяти а что там не знаю как посмотреть ..

 

Sun Dec 22 20:00:29 2013
UPTIME: 05:41:12
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

 

Sun Dec 22 14:18:46 2013
     UPTIME: 01:54:24
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 3
    COMMAND: "ksoftirqd/0"
       TASK: ffff8800b328aee0  [THREAD_INFO: ffff8800b32a8000]
        CPU: 0
      STATE: TASK_RUNNING (PANIC)

 

crash: cannot determine thread return address
     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash2/VmCore
       CPUS: 2
       DATE: Thu Dec 26 16:23:34 2013
     UPTIME: 20:07:27
LOAD AVERAGE: 0.09, 0.05, 0.05
      TASKS: 144
   NODENAME: lesnoe
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1995 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

куда рыть ?

Share this post


Link to post
Share on other sites

Это машина намекает, что с FreeBSD паников не будет :)

Share this post


Link to post
Share on other sites

Плохо понял фразу, что обязательно понадобился линукс. Ну если машина долго работала нормально под фрей - какой смысл было ставить линукс? Где то автор тут темнит...

Share this post


Link to post
Share on other sites

Кто вообще не LTS в продакшен ставит? Для начала юзайте 12.04.

Share this post


Link to post
Share on other sites

а куда рыть если не менять систему ?

может какую железяку, какой то драйвер или еще че... ?

Edited by Animal

Share this post


Link to post
Share on other sites

Попробовать для начала поставить vanilla kernel (без убунтовских патчей)

А вообще паник сообщение могло и не сохранится, на сервере IPMI есть?

Share this post


Link to post
Share on other sites

IPMI

crash kernel эт не то?

вот он стоит .. и выводит вот это все .. но я с ним работать не умею . вот вчера тоже был паника ядра вот что крэш кернел отписал:

root@sr:~# crash /usr/lib/debug/boot/vmlinux-3.11.0-12-generic /home/root1/crash3/VmCore

crash 6.1.6
Copyright (C) 2002-2013  Red Hat, Inc.
Copyright (C) 2004, 2005, 2006, 2010  IBM Corporation
Copyright (C) 1999-2006  Hewlett-Packard Co
Copyright (C) 2005, 2006, 2011, 2012  Fujitsu Limited
Copyright (C) 2006, 2007  VA Linux Systems Japan K.K.
Copyright (C) 2005, 2011  NEC Corporation
Copyright (C) 1999, 2002, 2007  Silicon Graphics, Inc.
Copyright (C) 1999, 2000, 2001, 2002  Mission Critical Linux, Inc.
This program is free software, covered by the GNU General Public License,
and you are welcome to change it and/or distribute copies of it under
certain conditions.  Enter "help copying" to see the conditions.
This program has absolutely no warranty.  Enter "help warranty" for details.

GNU gdb (GDB) 7.3.1
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-unknown-linux-gnu"...

crash: cannot determine thread return address
     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash3/VmCore
       CPUS: 2
       DATE: Sun Dec 29 21:57:06 2013
     UPTIME: 2 days, 06:19:33
LOAD AVERAGE: 0.10, 0.14, 0.12
      TASKS: 147
   NODENAME: xxx
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1995 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

crash>
crash> bt
PID: 1      TASK: ffff8800b3288000  CPU: 1   COMMAND: "init"
#0 [ffff8800b3291a20] machine_kexec at ffffffff81048332
#1 [ffff8800b3291a70] crash_kexec at ffffffff810d0413
#2 [ffff8800b3291b38] oops_end at ffffffff816eda58
#3 [ffff8800b3291b60] no_context at ffffffff816defbb
#4 [ffff8800b3291ba8] __bad_area_nosemaphore at ffffffff816df03b
#5 [ffff8800b3291bf0] bad_area_nosemaphore at ffffffff816df1a7
#6 [ffff8800b3291c00] __do_page_fault at ffffffff816f07ce
#7 [ffff8800b3291cf8] do_page_fault at ffffffff816f0a0c
#8 [ffff8800b3291d20] page_fault at ffffffff816ece18
   [exception RIP: kmem_cache_alloc+99]
   RIP: ffffffff8118d773  RSP: ffff8800b3291dd8  RFLAGS: 00010286
   RAX: 0000000000000000  RBX: ffff8800b20ec240  RCX: 000000000037facc
   RDX: 000000000037facb  RSI: 00000000000080d0  RDI: ffff8800b7401800
   RBP: ffff8800b3291e08   R8: 00000000000173c0   R9: ffff8800b740c430
   R10: 0000000000000000  R11: 0000000000000293  R12: ffff8801b20eccc0
   R13: 00000000000080d0  R14: ffff8800b7401800  R15: ffffffff811f246b
   ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
#9 [ffff8800b3291e10] locks_alloc_lock at ffffffff811f246b
#10 [ffff8800b3291e28] __posix_lock_file at ffffffff811f3380
#11 [ffff8800b3291e78] vfs_lock_file at ffffffff811f3e57
#12 [ffff8800b3291e88] fcntl_setlk at ffffffff811f4d30
#13 [ffff8800b3291f38] sys_fcntl at ffffffff811b7cd1
#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d
   RIP: 00007f5e09bc8b66  RSP: 00007fff64f169d0  RFLAGS: 00010246
   RAX: 0000000000000048  RBX: ffffffff816f521d  RCX: 0000000000000009
   RDX: 00007fff64f16840  RSI: 0000000000000007  RDI: 0000000000000011
   RBP: 00007fff64f169e0   R8: 00007fff64f16900   R9: 00007fff64f169e0
   R10: 0000000000000008  R11: 0000000000000293  R12: 00007f5e0baa06f0
   R13: 0000000000000001  R14: 0000000000000000  R15: 0000000000000000
   ORIG_RAX: 0000000000000048  CS: 0033  SS: 002b
crash>

Share this post


Link to post
Share on other sites

Очень странное сообщение с паникой. Если судить по нему, то вылетает на файловых операциях.

Везде такой backtrace? (я по нему и сужу о проблемах с файловыми операциями)

ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018

#9 [ffff8800b3291e10] locks_alloc_lock at ffffffff811f246b

#10 [ffff8800b3291e28] __posix_lock_file at ffffffff811f3380

#11 [ffff8800b3291e78] vfs_lock_file at ffffffff811f3e57

#12 [ffff8800b3291e88] fcntl_setlk at ffffffff811f4d30

#13 [ffff8800b3291f38] sys_fcntl at ffffffff811b7cd1

#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d

 

У вас нет экзотических файловых систем или сетевых дисков?

Share this post


Link to post
Share on other sites

Для начала посмотрите SMART HDD.

root@xxx:~# smartctl  /dev/sda
smartctl 6.2 2013-04-20 r3812 [x86_64-linux-3.11.0-12-generic] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

ATA device successfully opened

Use 'smartctl -a' (or '-x') to print SMART (and more) information

root@lesnoe:~# smartctl -a  /dev/sda
smartctl 6.2 2013-04-20 r3812 [x86_64-linux-3.11.0-12-generic] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     SAMSUNG SpinPoint S250
Device Model:     SAMSUNG HD200HJ
Serial Number:    S16KJ9BP908438
LU WWN Device Id: 5 0000f0 09b908438
Firmware Version: KF100-06
User Capacity:    200,049,647,616 bytes [200 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA/ATAPI-7, ATA8-ACS T13/1699-D revision 3b
Local Time is:    Mon Dec 30 23:22:38 2013 EET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                       was completed without error.
                                       Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                       without error or no self-test has ever
                                       been run.
Total time to complete Offline
data collection:                ( 3091) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                       Auto Offline data collection on/off support.
                                       Suspend Offline collection upon new
                                       command.
                                       Offline surface scan supported.
                                       Self-test supported.
                                       No Conveyance Self-test supported.
                                       Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                       power-saving mode.
                                       Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                       General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (  52) minutes.
SCT capabilities:              (0x003f) SCT Status supported.
                                       SCT Error Recovery Control supported.
                                       SCT Feature Control supported.
                                       SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
 1 Raw_Read_Error_Rate     0x000f   100   100   051    Pre-fail  Always       -       0
 3 Spin_Up_Time            0x0007   253   253   025    Pre-fail  Always       -       4352
 4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       384
 5 Reallocated_Sector_Ct   0x0033   253   253   010    Pre-fail  Always       -       0
 7 Seek_Error_Rate         0x000f   253   253   051    Pre-fail  Always       -       0
 8 Seek_Time_Performance   0x0025   253   253   015    Pre-fail  Offline      -       9279
 9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       44243
10 Spin_Retry_Count        0x0033   253   253   051    Pre-fail  Always       -       0
11 Calibration_Retry_Count 0x0012   253   253   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       293
13 Read_Soft_Error_Rate    0x000e   100   100   000    Old_age   Always       -       44832442
184 End-to-End_Error        0x0033   253   253   099    Pre-fail  Always       -       0
187 Reported_Uncorrect      0x0032   253   253   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   253   253   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   133   001   000    Old_age   Always       -       35 (0 0 55 0 0)
194 Temperature_Celsius     0x0022   133   001   000    Old_age   Always       -       35 (0 0 54 0 0)
195 Hardware_ECC_Recovered  0x001a   100   100   000    Old_age   Always       -       44832442
196 Reallocated_Event_Count 0x0032   253   253   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0012   253   253   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   253   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x000a   100   100   000    Old_age   Always       -       0
201 Soft_Read_Error_Rate    0x000a   100   100   000    Old_age   Always       -       0
202 Data_Address_Mark_Errs  0x0032   253   253   000    Old_age   Always       -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     43603         -
# 2  Short offline       Completed without error       00%     43578         -
# 3  Short offline       Completed without error       00%     43554         -
# 4  Short offline       Completed without error       00%     43530         -
# 5  Short offline       Completed without error       00%     43506         -
# 6  Extended offline    Completed without error       00%     43484         -
# 7  Short offline       Completed without error       00%     43482         -
# 8  Short offline       Completed without error       00%     43458         -
# 9  Short offline       Completed without error       00%     43434         -
#10  Short offline       Completed without error       00%     43410         -
#11  Short offline       Completed without error       00%     43386         -
#12  Short offline       Completed without error       00%     43362         -
#13  Short offline       Completed without error       00%     43338         -
#14  Extended offline    Completed without error       00%     43316         -
#15  Short offline       Completed without error       00%     43314         -
#16  Short offline       Completed without error       00%     43290         -
#17  Short offline       Completed without error       00%     43266         -
#18  Short offline       Completed without error       00%     43242         -
#19  Short offline       Completed without error       00%     43218         -
#20  Short offline       Completed without error       00%     43194         -
#21  Short offline       Completed without error       00%     43170         -

SMART Selective self-test log data structure revision number 0
Note: revision number not 1 implies that no selective self-test has ever been run
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
   1        0        0  Not_testing
   2        0        0  Not_testing
   3        0        0  Not_testing
   4        0        0  Not_testing
   5        0        0  Not_testing
Selective self-test flags (0x0):
 After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

root@xxx:~#

 

хм .. но проблем вроде не было с винтом ..

 

Очень странное сообщение с паникой. Если судить по нему, то вылетает на файловых операциях.

Везде такой backtrace? (я по нему и сужу о проблемах с файловыми операциями)

ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018

#9 [ffff8800b3291e10] locks_alloc_lock at ffffffff811f246b

#10 [ffff8800b3291e28] __posix_lock_file at ffffffff811f3380

#11 [ffff8800b3291e78] vfs_lock_file at ffffffff811f3e57

#12 [ffff8800b3291e88] fcntl_setlk at ffffffff811f4d30

#13 [ffff8800b3291f38] sys_fcntl at ffffffff811b7cd1

#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d

 

У вас нет экзотических файловых систем или сетевых дисков?

 

вот 1:

crash: cannot determine thread return address
     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash2/VmCore
       CPUS: 2
       DATE: Thu Dec 26 16:23:34 2013
     UPTIME: 20:07:27
LOAD AVERAGE: 0.09, 0.05, 0.05
      TASKS: 144
   NODENAME: lesnoe
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1995 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

crash> bt
PID: 1      TASK: ffff8800b3288000  CPU: 1   COMMAND: "init"
#0 [ffff8800b3291aa8] machine_kexec at ffffffff81048332
#1 [ffff8800b3291af8] crash_kexec at ffffffff810d0413
#2 [ffff8800b3291bc0] oops_end at ffffffff816eda58
#3 [ffff8800b3291be8] no_context at ffffffff816defbb
#4 [ffff8800b3291c30] __bad_area_nosemaphore at ffffffff816df03b
#5 [ffff8800b3291c78] bad_area at ffffffff816df3b8
#6 [ffff8800b3291ca0] __do_page_fault at ffffffff816f0938
#7 [ffff8800b3291d98] do_page_fault at ffffffff816f0a0c
#8 [ffff8800b3291dc0] page_fault at ffffffff816ece18
   [exception RIP: kmem_cache_alloc_trace+110]
   RIP: ffffffff8118d89e  RSP: ffff8800b3291e78  RFLAGS: 00010206
   RAX: 0000000000000000  RBX: ffff8800b2871d40  RCX: 00000000000f9037
   RDX: 00000000000f9036  RSI: 00000000000080d0  RDI: ffffffff811afb40
   RBP: ffff8800b3291ea8   R8: 00000000000173c0   R9: 726f7774656e2f6e
   R10: 0000000000000000  R11: 0000000000000202  R12: 0000000100000000
   R13: 00000000000080d0  R14: 0000000000000088  R15: ffff8800b7401800
   ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
#9 [ffff8800b3291eb0] alloc_pipe_info at ffffffff811afb40
#10 [ffff8800b3291ec8] create_pipe_files at ffffffff811b00e6
#11 [ffff8800b3291f08] __do_pipe_flags at ffffffff811b02d4
#12 [ffff8800b3291f40] sys_pipe2 at ffffffff811b0400
#13 [ffff8800b3291f70] sys_pipe at ffffffff811b0490
#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d
   RIP: 00007f69e1e21e57  RSP: 00007fff562d5c40  RFLAGS: 00010246
   RAX: 0000000000000016  RBX: ffffffff816f521d  RCX: 0000000000000000
   RDX: 00007f69e3ae509f  RSI: 00000000ffffffff  RDI: 00007fff562d5de8
   RBP: 00007fff562d5de8   R8: 0000000000000000   R9: 726f7774656e2f6e
   R10: 0000000000000000  R11: 0000000000000202  R12: ffffffff811b0490
   R13: ffff8800b3291f78  R14: 00007f69e3ae67b0  R15: 00007fff562d5dd8
   ORIG_RAX: 0000000000000016  CS: 0033  SS: 002b
crash>

 

 

и

 

crash: cannot determine thread return address
     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash/VmCore
       CPUS: 2
       DATE: Sun Dec 22 14:18:46 2013
     UPTIME: 01:54:24
LOAD AVERAGE: 0.05, 0.05, 0.05
      TASKS: 147
   NODENAME: lesnoe
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1995 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 3
    COMMAND: "ksoftirqd/0"
       TASK: ffff8800b328aee0  [THREAD_INFO: ffff8800b32a8000]
        CPU: 0
      STATE: TASK_RUNNING (PANIC)

crash>
crash>
crash> bt
PID: 3      TASK: ffff8800b328aee0  CPU: 0   COMMAND: "ksoftirqd/0"
#0 [ffff8800b32a96a0] machine_kexec at ffffffff81048332
#1 [ffff8800b32a96f0] crash_kexec at ffffffff810d0413
#2 [ffff8800b32a97b8] oops_end at ffffffff816eda58
#3 [ffff8800b32a97e0] no_context at ffffffff816defbb
#4 [ffff8800b32a9828] __bad_area_nosemaphore at ffffffff816df03b
#5 [ffff8800b32a9870] bad_area_nosemaphore at ffffffff816df1a7
#6 [ffff8800b32a9880] __do_page_fault at ffffffff816f07ce
#7 [ffff8800b32a9978] do_page_fault at ffffffff816f0a0c
#8 [ffff8800b32a99a0] page_fault at ffffffff816ece18
   [exception RIP: __kmalloc+139]
   RIP: ffffffff8118dd6b  RSP: ffff8800b32a9a50  RFLAGS: 00010206
   RAX: 0000000000000000  RBX: ffffffff81cd29c0  RCX: 000000000024ef2f
   RDX: 000000000024ef2e  RSI: 0000000000000000  RDI: ffffffffa01658a3
   RBP: ffff8800b32a9a80   R8: 00000000000173c0   R9: 00000000ffffffff
   R10: ffff8800b32a9b38  R11: 000000007b0bcfa6  R12: 0000000100000000
   R13: 0000000000008020  R14: 00000000000000b8  R15: ffff8800b7401800
   ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
#9 [ffff8800b32a9a88] __nf_ct_ext_add_length at ffffffffa01658a3 [nf_conntrack]
#10 [ffff8800b32a9ad0] nf_conntrack_in at ffffffffa015fa0c [nf_conntrack]
#11 [ffff8800b32a9ba8] ipv4_conntrack_in at ffffffffa017a2f1 [nf_conntrack_ipv4]
#12 [ffff8800b32a9bb8] nf_iterate at ffffffff8161cb5b
#13 [ffff8800b32a9c00] nf_hook_slow at ffffffff8161cbe4
#14 [ffff8800b32a9c68] ip_rcv at ffffffff81623a74
#15 [ffff8800b32a9c98] __netif_receive_skb_core at ffffffff815eec66
#16 [ffff8800b32a9cf0] __netif_receive_skb at ffffffff815eee68
#17 [ffff8800b32a9d10] netif_receive_skb at ffffffff815eeed3
#18 [ffff8800b32a9d38] rhine_napipoll at ffffffffa0092a10 [via_rhine]
#19 [ffff8800b32a9da0] net_rx_action at ffffffff815ef20c
#20 [ffff8800b32a9df8] __do_softirq at ffffffff81067397
#21 [ffff8800b32a9e68] run_ksoftirqd at ffffffff81067510
#22 [ffff8800b32a9e80] smpboot_thread_fn at ffffffff8108cadf
#23 [ffff8800b32a9ed0] kthread at ffffffff810847b0
#24 [ffff8800b32a9f50] ret_from_fork at ffffffff816f516c

 

и

 

     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash1/VmCore
       CPUS: 2
       DATE: Sun Dec 22 20:00:29 2013
     UPTIME: 05:41:12
LOAD AVERAGE: 0.13, 0.16, 0.20
      TASKS: 159
   NODENAME: lesnoe
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1995 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

crash> bt
PID: 1      TASK: ffff8800b3288000  CPU: 1   COMMAND: "init"
#0 [ffff8800b3291aa8] machine_kexec at ffffffff81048332
#1 [ffff8800b3291af8] crash_kexec at ffffffff810d0413
#2 [ffff8800b3291bc0] oops_end at ffffffff816eda58
#3 [ffff8800b3291be8] no_context at ffffffff816defbb
#4 [ffff8800b3291c30] __bad_area_nosemaphore at ffffffff816df03b
#5 [ffff8800b3291c78] bad_area at ffffffff816df3b8
#6 [ffff8800b3291ca0] __do_page_fault at ffffffff816f0938
#7 [ffff8800b3291d98] do_page_fault at ffffffff816f0a0c
#8 [ffff8800b3291dc0] page_fault at ffffffff816ece18
   [exception RIP: kmem_cache_alloc_trace+110]
   RIP: ffffffff8118d89e  RSP: ffff8800b3291e78  RFLAGS: 00010206
   RAX: 0000000000000000  RBX: ffff8800b28b9680  RCX: 00000000000c31f4
   RDX: 00000000000c31f3  RSI: 00000000000080d0  RDI: ffffffff811afb40
   RBP: ffff8800b3291ea8   R8: 00000000000173c0   R9: 0000000000000001
   R10: 0000000000000004  R11: 0000000000000297  R12: 0000000100000000
   R13: 00000000000080d0  R14: 0000000000000088  R15: ffff8800b7401800
   ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
#9 [ffff8800b3291eb0] alloc_pipe_info at ffffffff811afb40
#10 [ffff8800b3291ec8] create_pipe_files at ffffffff811b00e6
#11 [ffff8800b3291f08] __do_pipe_flags at ffffffff811b02d4
#12 [ffff8800b3291f40] sys_pipe2 at ffffffff811b0400
#13 [ffff8800b3291f70] sys_pipe at ffffffff811b0490
#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d
   RIP: 00007f617947ae57  RSP: 00007fff42949af0  RFLAGS: 00010246
   RAX: 0000000000000016  RBX: ffffffff816f521d  RCX: 00007f617974f770
   RDX: 00007f617b544dc0  RSI: 00007f617b52f290  RDI: 00007fff42947a00
   RBP: 00007f617b520c90   R8: 0000000000000008   R9: 0000000000000001
   R10: 0000000000000004  R11: 0000000000000297  R12: ffffffff811b0490
   R13: ffff8800b3291f78  R14: 00007f617b4cfa20  R15: 0000000000000001
   ORIG_RAX: 0000000000000016  CS: 0033  SS: 002b

Share this post


Link to post
Share on other sites

Да, это не fs, в одном из случаев вылет на netfilter. Но во всех случаях фигурирует kmalloc

Кстати судя по сетевому бектрейсу - используется Via Rhine карта, очень редкий и ненадежный зверек с кривым драйвером. Попробуйте поставить что-то другое, более надежное, или отключить offloading на ней (ethtool -K ethX gso off gro off tso off lro off как минимум).

Во всех случаях вылет на памяти, т.е. скорее всего что-то повреждает kobjects.

Share this post


Link to post
Share on other sites

root@xxx:~# ethtool -K eth0     gso off gro off  tso off lro off
Cannot change tcp-segmentation-offload
Cannot change large-receive-offload

root@xxx:~# ethtool -K eth0     gso off gro off
root@xxx:~#

 

сейчас все через интегрированную сетевку использую.. "VIA Technologies, Inc. VT6102 [Rhine-II] (rev 7c)"

 

 

до этого использовал " Intel Corporation 82575EB Gigabit "

 

что с первой что со второй перезагрузка имеет место быть ((

 

root@xxx:~# lspci | grep net
00:12.0 Ethernet controller: VIA Technologies, Inc. VT6102 [Rhine-II] (rev 7c)
02:00.0 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
02:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
root@xxx:~# lspci | grep net

Edited by Animal

Share this post


Link to post
Share on other sites

можно ли весь lspci?

и ps ax , в особенности интересует процесс который использует pipe

 

Ядро обновляли до последнего?

apt-get dist-upgrade

Share this post


Link to post
Share on other sites

Скорее всего действительно VT6102 в комбинации с 64-битным DMA... Уберите драйвер VT6102 из системы.

Ну, либо именно сама железка (CPU-MB-RAM) битая.

Share this post


Link to post
Share on other sites

можно ли весь lspci?

и ps ax , в особенности интересует процесс который использует pipe

 

Ядро обновляли до последнего?

apt-get dist-upgrade

 

lspci

 

root@xxx:~# lspci
00:00.0 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:00.1 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:00.2 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:00.3 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:00.4 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:00.5 PIC: VIA Technologies, Inc. CN896/VN896/P4M900 I/O APIC Interrupt Controller
00:00.6 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Security Device
00:00.7 Host bridge: VIA Technologies, Inc. CN896/VN896/P4M900 Host Bridge
00:01.0 PCI bridge: VIA Technologies, Inc. VT8237/VX700 PCI Bridge
00:02.0 PCI bridge: VIA Technologies, Inc. CN896/VN896/P4M900 PCI to PCI Bridge Controller (rev 80)
00:03.0 PCI bridge: VIA Technologies, Inc. CN896/VN896/P4M900 PCI to PCI Bridge Controller (rev 80)
00:0f.0 IDE interface: VIA Technologies, Inc. VT8237/8251 Serial ATA Controller
00:0f.1 IDE interface: VIA Technologies, Inc. VT82C586A/B/VT82C686/A/B/VT823x/A/C PIPC Bus Master IDE (rev 07)
00:10.0 USB controller: VIA Technologies, Inc. VT82xxxxx UHCI USB 1.1 Controller (rev b0)
00:10.1 USB controller: VIA Technologies, Inc. VT82xxxxx UHCI USB 1.1 Controller (rev b0)
00:10.2 USB controller: VIA Technologies, Inc. VT82xxxxx UHCI USB 1.1 Controller (rev b0)
00:10.3 USB controller: VIA Technologies, Inc. VT82xxxxx UHCI USB 1.1 Controller (rev b0)
00:10.4 USB controller: VIA Technologies, Inc. USB 2.0 (rev 90)
00:11.0 ISA bridge: VIA Technologies, Inc. VT8237S PCI to ISA Bridge
00:11.7 Host bridge: VIA Technologies, Inc. VT8237/8251 Ultra VLINK Controller
00:12.0 Ethernet controller: VIA Technologies, Inc. VT6102 [Rhine-II] (rev 7c)
00:13.0 Host bridge: VIA Technologies, Inc. VT8237A Host Bridge
01:00.0 VGA compatible controller: VIA Technologies, Inc. CN896/VN896/P4M900 [Chrome 9 HC] (rev 01)
02:00.0 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
02:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
root@xxx:~#

 

 

и ps ax

root@xxx:~# ps ax
 PID TTY      STAT   TIME COMMAND
   1 ?        Ss     1:42 /sbin/init
   2 ?        S      0:00 [kthreadd]
   3 ?        S      2:18 [ksoftirqd/0]
   5 ?        S<     0:00 [kworker/0:0H]
   7 ?        S      0:01 [migration/0]
   8 ?        S      0:00 [rcu_bh]
   9 ?        S      0:00 [rcuob/0]
  10 ?        S      0:00 [rcuob/1]
  11 ?        S      0:00 [rcuob/2]
  12 ?        S      0:00 [rcuob/3]
  13 ?        S      1:15 [rcu_sched]
  14 ?        S      1:03 [rcuos/0]
  15 ?        S      0:11 [rcuos/1]
  16 ?        S      0:00 [rcuos/2]
  17 ?        S      0:00 [rcuos/3]
  18 ?        S      0:00 [watchdog/0]
  19 ?        S      0:00 [watchdog/1]
  20 ?        S      0:00 [migration/1]
  21 ?        S      0:01 [ksoftirqd/1]
  22 ?        S      0:00 [kworker/1:0]
  23 ?        S<     0:00 [kworker/1:0H]
  24 ?        S<     0:00 [khelper]
  25 ?        S      0:00 [kdevtmpfs]
  26 ?        S<     0:00 [netns]
  27 ?        S<     0:00 [writeback]
  28 ?        S<     0:00 [kintegrityd]
  29 ?        S<     0:00 [bioset]
  31 ?        S<     0:00 [kblockd]
  32 ?        S<     0:00 [ata_sff]
  33 ?        S      0:00 [khubd]
  34 ?        S<     0:00 [md]
  35 ?        S<     0:00 [devfreq_wq]
  36 ?        S      2:10 [kworker/0:1]
  37 ?        S      0:53 [kworker/1:1]
  38 ?        S      0:00 [khungtaskd]
  39 ?        S      0:00 [kswapd0]
  40 ?        SN     0:00 [ksmd]
  41 ?        SN     0:00 [khugepaged]
  42 ?        S      0:00 [fsnotify_mark]
  43 ?        S      0:00 [ecryptfs-kthrea]
  44 ?        S<     0:00 [crypto]
  56 ?        S<     0:00 [kthrotld]
  77 ?        S<     0:00 [deferwq]
  78 ?        S<     0:00 [charger_manager]
  79 ?        S      0:00 [kworker/0:2]
 122 ?        S      0:00 [scsi_eh_0]
 123 ?        S      0:00 [scsi_eh_1]
 124 ?        S      0:00 [kworker/u8:2]
 125 ?        S      0:00 [scsi_eh_2]
 126 ?        S      0:03 [kworker/u8:3]
 127 ?        S      0:00 [scsi_eh_3]
 176 ?        S      0:05 [jbd2/sda1-8]
 177 ?        S<     0:00 [ext4-rsv-conver]
 178 ?        S<     0:00 [ext4-unrsv-conv]
 215 ?        S      0:19 mountall --daemon
 315 ?        S      0:20 upstart-udev-bridge --daemon
 320 ?        Ss     0:11 /lib/systemd/systemd-udevd --daemon
 365 ?        S<     0:00 [kpsmoused]
 770 ?        S      0:16 upstart-socket-bridge --daemon
 787 ?        Ss     0:00 rpcbind
1027 ?        Ss     0:00 /usr/sbin/vsftpd
1131 ?        S<     0:00 [kdmflush]
1137 ?        S<     0:00 [bioset]
1138 ?        S<     0:00 [kcryptd_io]
1139 ?        S<     0:00 [kcryptd]
1140 ?        S<     0:00 [bioset]
1227 ?        Ss     0:18 dbus-daemon --system --fork
1296 ?        Ss     0:00 /lib/systemd/systemd-logind
1300 ?        Sl     0:25 rsyslogd -c5
1336 ?        S      0:16 upstart-file-bridge --daemon
1394 tty4     Ss+    0:00 /sbin/getty -8 38400 tty4
1401 tty5     Ss+    0:00 /sbin/getty -8 38400 tty5
1411 tty2     Ss+    0:00 /sbin/getty -8 38400 tty2
1412 tty3     Ss+    0:00 /sbin/getty -8 38400 tty3
1415 tty6     Ss+    0:00 /sbin/getty -8 38400 tty6
1445 ?        Ss     0:01 /usr/sbin/sshd -D
1450 ?        Ss     0:00 acpid -c /etc/acpi/events -s /var/run/acpid.socket
1451 ?        Ss     0:00 cron
1452 ?        Ss     0:00 atd
1489 ?        Ss     1:16 /usr/sbin/squid3 -N -YC -f /etc/squid3/squid.conf
1490 ?        Ssl    1:44 /usr/sbin/mysqld
1515 ?        Ss     0:01 (logfile-daemon) /var/log/squid3/access.log
1530 ?        Ssl    0:09 whoopsie
1708 ?        Ssl   25:49 /usr/sbin/named -u bind
1733 ?        Ss     0:00 /usr/sbin/sensord -f daemon
1757 ?        S      3:29 /usr/sbin/snmpd -Lsd -Lf /dev/null -u snmp -g snmp -I -smux mteTrigger mteTriggerConf -p /var/run/snmpd.pid
1800 ?        SNs    0:49 /usr/sbin/nagios3 -d /etc/nagios3/nagios.cfg
1890 ?        Ss     0:04 /usr/sbin/apache2 -k start
1893 ?        S      0:00 /usr/sbin/apache2 -k start
1894 ?        S      0:00 /usr/sbin/apache2 -k start
1897 ?        S      0:00 /usr/sbin/apache2 -k start
1925 ?        Ssl    0:15 /usr/local/sbin/accel-pppd -c /etc/accel-ppp.conf -d
2063 tty1     Ss+    0:00 /sbin/getty -8 38400 tty1
2148 ?        S      0:00 [kauditd]
3019 ?        S<     0:00 [kworker/u9:0]
3459 pts/3    R+     0:00 ps ax
6972 ?        S      0:00 /usr/sbin/apache2 -k start
7556 ?        S      0:00 /usr/sbin/apache2 -k start
10157 ?        Ss     0:00 sshd: root1 [priv]
10250 ?        R      0:00 sshd: root1@pts/3
10251 pts/3    Ss     0:00 -bash
10391 pts/3    S      0:00 sudo -s
10392 pts/3    S      0:00 /bin/bash
16325 ?        S      0:00 /usr/sbin/apache2 -k start
16328 ?        S      0:00 /usr/sbin/apache2 -k start
16329 ?        S      0:00 /usr/sbin/apache2 -k start
16331 ?        S      0:00 /usr/sbin/apache2 -k start
16333 ?        S      0:00 /usr/sbin/apache2 -k start
23052 ?        S<     0:00 [kworker/u9:1]
26484 ?        Ss     0:01 (pinger)
29879 ?        Ss     0:05 dhcpd -user dhcpd -group dhcpd -f -q -4 -pf /run/dhcp-server/dhcpd.pid -cf /etc/dhcp/dhcpd.conf
31217 ?        S<     0:00 [kworker/u9:2]
root@xxx:~#

Share this post


Link to post
Share on other sites

Скорее всего действительно VT6102 в комбинации с 64-битным DMA... Уберите драйвер VT6102 из системы.

Ну, либо именно сама железка (CPU-MB-RAM) битая.

та вродь сама железяка на фре безотказно работала .. но на интегрированной была сетевке .. хотя вот сейчас на интегрированной тоже не пашет .. вот и я думаю может все же проблема в 64б-итной системе с этим VT6102

сейчас

root@xxx:~# uptime
21:34:25 up 1 day,  8:12,  1 user,  load average: 0.00, 0.02, 0.05
root@xxx:~#

c root@xxx:~# ethtool -K eth0 gso off gro off

пока полет нормальный .. обычно 4 дня uptime не превышал .. так что пока ждем)

а вот

apt-get dist-upgrade

мало ли что там еще за глюки выскочат .. ехать в поля в "чегиря" в январские праздники и собирать новый сервер вообще не хочется )( пусть перезагружается себе время от времени) может все же как то получится устроить проблему, но если нет .. то будем по крайностям идти или железо менять .. или с 64-бита на 32-переходить ..

Edited by Animal

Share this post


Link to post
Share on other sites

увы ребут .. (( "накаркал"

 

root@lesnoe:~# crash /usr/lib/debug/boot/vmlinux-3.11.0-12-generic /home/root1/crash4/VmCore

crash 6.1.6
Copyright (C) 2002-2013  Red Hat, Inc.
Copyright (C) 2004, 2005, 2006, 2010  IBM Corporation
Copyright (C) 1999-2006  Hewlett-Packard Co
Copyright (C) 2005, 2006, 2011, 2012  Fujitsu Limited
Copyright (C) 2006, 2007  VA Linux Systems Japan K.K.
Copyright (C) 2005, 2011  NEC Corporation
Copyright (C) 1999, 2002, 2007  Silicon Graphics, Inc.
Copyright (C) 1999, 2000, 2001, 2002  Mission Critical Linux, Inc.
This program is free software, covered by the GNU General Public License,
and you are welcome to change it and/or distribute copies of it under
certain conditions.  Enter "help copying" to see the conditions.
This program has absolutely no warranty.  Enter "help warranty" for details.

GNU gdb (GDB) 7.3.1
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-unknown-linux-gnu"...

crash: cannot determine thread return address
     KERNEL: /usr/lib/debug/boot/vmlinux-3.11.0-12-generic
   DUMPFILE: /home/root1/crash4/VmCore
       CPUS: 2
       DATE: Wed Jan  1 23:16:04 2014
     UPTIME: 00:53:04
LOAD AVERAGE: 0.00, 0.01, 0.05
      TASKS: 144
   NODENAME: xxx
    RELEASE: 3.11.0-12-generic
    VERSION: #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013
    MACHINE: x86_64  (1994 Mhz)
     MEMORY: 2.9 GB
      PANIC:
WARNING: log buf data structure(s) have changed
""
        PID: 1
    COMMAND: "init"
       TASK: ffff8800b3288000  [THREAD_INFO: ffff8800b3290000]
        CPU: 1
      STATE: TASK_RUNNING (PANIC)

crash> bt
PID: 1      TASK: ffff8800b3288000  CPU: 1   COMMAND: "init"
#0 [ffff8800b3291aa8] machine_kexec at ffffffff81048332
#1 [ffff8800b3291af8] crash_kexec at ffffffff810d0413
#2 [ffff8800b3291bc0] oops_end at ffffffff816eda58
#3 [ffff8800b3291be8] no_context at ffffffff816defbb
#4 [ffff8800b3291c30] __bad_area_nosemaphore at ffffffff816df03b
#5 [ffff8800b3291c78] bad_area at ffffffff816df3b8
#6 [ffff8800b3291ca0] __do_page_fault at ffffffff816f0938
#7 [ffff8800b3291d98] do_page_fault at ffffffff816f0a0c
#8 [ffff8800b3291dc0] page_fault at ffffffff816ece18
   [exception RIP: kmem_cache_alloc_trace+110]
   RIP: ffffffff8118d89e  RSP: ffff8800b3291e78  RFLAGS: 00010206
   RAX: 0000000000000000  RBX: ffff8800afb158c0  RCX: 000000000001ca3e
   RDX: 000000000001ca3d  RSI: 00000000000080d0  RDI: ffffffff811afb40
   RBP: ffff8800b3291ea8   R8: 00000000000173c0   R9: 726f7774656e2f6e
   R10: 0000000000000000  R11: 0000000000000202  R12: 0000000100000000
   R13: 00000000000080d0  R14: 0000000000000088  R15: ffff8800b7401800
   ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
#9 [ffff8800b3291eb0] alloc_pipe_info at ffffffff811afb40
#10 [ffff8800b3291ec8] create_pipe_files at ffffffff811b00e6
#11 [ffff8800b3291f08] __do_pipe_flags at ffffffff811b02d4
#12 [ffff8800b3291f40] sys_pipe2 at ffffffff811b0400
#13 [ffff8800b3291f70] sys_pipe at ffffffff811b0490
#14 [ffff8800b3291f80] system_call_fastpath at ffffffff816f521d
   RIP: 00007ffd6c24fe57  RSP: 00007fff1d7fe220  RFLAGS: 00000246
   RAX: 0000000000000016  RBX: ffffffff816f521d  RCX: 0000000000000005
   RDX: 00007ffd6eb864df  RSI: 00000000ffffffff  RDI: 00007fff1d7fe1e8
   RBP: 00007fff1d7fe1e8   R8: 0000000000000000   R9: 726f7774656e2f6e
   R10: 0000000000000000  R11: 0000000000000202  R12: ffffffff811b0490
   R13: ffff8800b3291f78  R14: 00007ffd6eaff6a0  R15: 000000000000000e
   ORIG_RAX: 0000000000000016  CS: 0033  SS: 002b
crash>

crash>  ps
  PID    PPID  CPU       TASK        ST  %MEM     VSZ    RSS  COMM
>     0      0   0  ffffffff81c15440  RU   0.0       0      0  [swapper/0]
     0      0   1  ffff8800b32dc650  RU   0.0       0      0  [swapper/1]
>     1      0   1  ffff8800b3288000  RU   0.1   27232   2980  init
     2      0   1  ffff8800b3289770  IN   0.0       0      0  [kthreadd]
     3      2   0  ffff8800b328aee0  IN   0.0       0      0  [ksoftirqd/0]
     5      2   0  ffff8800b328ddc0  IN   0.0       0      0  [kworker/0:0H]
     7      2   0  ffff8800b32b1770  IN   0.0       0      0  [migration/0]
     8      2   0  ffff8800b32b2ee0  IN   0.0       0      0  [rcu_bh]
     9      2   0  ffff8800b32b4650  IN   0.0       0      0  [rcuob/0]
    10      2   0  ffff8800b32b5dc0  IN   0.0       0      0  [rcuob/1]
    11      2   0  ffff8800b32c0000  IN   0.0       0      0  [rcuob/2]
    12      2   0  ffff8800b32c1770  IN   0.0       0      0  [rcuob/3]
    13      2   0  ffff8800b32c2ee0  IN   0.0       0      0  [rcu_sched]
    14      2   1  ffff8800b32c4650  IN   0.0       0      0  [rcuos/0]
    15      2   0  ffff8800b32c5dc0  IN   0.0       0      0  [rcuos/1]
    16      2   1  ffff8800b32d8000  IN   0.0       0      0  [rcuos/2]
    17      2   1  ffff8800b32d9770  IN   0.0       0      0  [rcuos/3]
    18      2   0  ffff8800b32daee0  IN   0.0       0      0  [watchdog/0]
    19      2   1  ffff8800b32f1770  IN   0.0       0      0  [watchdog/1]
    20      2   1  ffff8800b32f2ee0  IN   0.0       0      0  [migration/1]
    21      2   1  ffff8800b32f4650  IN   0.0       0      0  [ksoftirqd/1]
    22      2   1  ffff8800b32f5dc0  IN   0.0       0      0  [kworker/1:0]
    23      2   1  ffff8800b3308000  IN   0.0       0      0  [kworker/1:0H]
    24      2   1  ffff8800b3309770  IN   0.0       0      0  [khelper]
    25      2   1  ffff8800b3368000  IN   0.0       0      0  [kdevtmpfs]
    26      2   0  ffff8800b3369770  IN   0.0       0      0  [netns]
    27      2   0  ffff8800b336aee0  IN   0.0       0      0  [writeback]
    28      2   1  ffff8800b330aee0  IN   0.0       0      0  [kintegrityd]
    29      2   1  ffff8800b330c650  IN   0.0       0      0  [bioset]
    30      2   1  ffff8800b336c650  IN   0.0       0      0  [kworker/u9:0]
    31      2   0  ffff8800b336ddc0  IN   0.0       0      0  [kblockd]
    32      2   1  ffff8800b330ddc0  IN   0.0       0      0  [ata_sff]
    33      2   0  ffff8800b2d50000  IN   0.0       0      0  [khubd]
    34      2   1  ffff8800b2d58000  IN   0.0       0      0  [md]
    35      2   1  ffff8800b2d59770  IN   0.0       0      0  [devfreq_wq]
    36      2   0  ffff8800b2d51770  IN   0.0       0      0  [kworker/0:1]
    37      2   1  ffff8800b2d5aee0  IN   0.0       0      0  [kworker/1:1]
    38      2   1  ffff8800b2d52ee0  IN   0.0       0      0  [khungtaskd]
    39      2   0  ffff8800b2d5c650  IN   0.0       0      0  [kswapd0]
    40      2   0  ffff8800b2d54650  IN   0.0       0      0  [ksmd]
    41      2   1  ffff8800b2d5ddc0  IN   0.0       0      0  [khugepaged]
    42      2   0  ffff8800b2d55dc0  IN   0.0       0      0  [fsnotify_mark]
    43      2   1  ffff8800aee10000  IN   0.0       0      0  [ecryptfs-kthrea]
    44      2   1  ffff8800aee11770  IN   0.0       0      0  [crypto]
    56      2   1  ffff8800aee39770  IN   0.0       0      0  [kthrotld]
    77      2   0  ffff880036408000  IN   0.0       0      0  [deferwq]
    78      2   0  ffff880036409770  IN   0.0       0      0  [charger_manager]
    79      2   0  ffff88003640aee0  IN   0.0       0      0  [kworker/0:2]
   121      2   0  ffff8800aee24650  IN   0.0       0      0  [scsi_eh_0]
   123      2   1  ffff8800aee20000  IN   0.0       0      0  [scsi_eh_1]
   125      2   0  ffff8800aee2c650  IN   0.0       0      0  [scsi_eh_2]
   126      2   0  ffff8800aee12ee0  IN   0.0       0      0  [kworker/u8:3]
   127      2   0  ffff88003648ddc0  IN   0.0       0      0  [scsi_eh_3]
   176      2   0  ffff88003640c650  IN   0.0       0      0  [jbd2/sda1-8]
   177      2   0  ffff88003640ddc0  IN   0.0       0      0  [ext4-rsv-conver]
   178      2   0  ffff8800aefeddc0  IN   0.0       0      0  [ext4-unrsv-conv]
   215      1   0  ffff8800360b2ee0  IN   0.1   26792   1572  mountall
   339      1   0  ffff8800aefe8000  IN   0.0   17452    896  upstart-udev-br
   348      1   0  ffff8800360b0000  IN   0.1   42524   1580  systemd-udevd
   415      1   0  ffff8800af75ddc0  IN   0.0   30512   1272  dbus-daemon
   418      2   1  ffff8800af175dc0  IN   0.0       0      0  [kpsmoused]
   425      1   1  ffff8800af790000  IN   0.1  247472   1544  rsyslogd
   499      1   0  ffff8800b1b9ddc0  IN   0.1  247472   1544  rs:main Q:Reg
   500      1   1  ffff8800b1c48000  IN   0.1  247472   1544  rsyslogd
   501      1   0  ffff8800b1c39770  IN   0.1  247472   1544  rsyslogd
   524      1   0  ffff88003644aee0  IN   0.1   37056   1704  systemd-logind
   613      1   0  ffff8800af172ee0  IN   0.0   15668    916  upstart-file-br
   861      1   0  ffff8800b23a4650  IN   0.0   15260    628  upstart-socket-
   897      1   1  ffff8800af795dc0  IN   0.0   19244    612  rpcbind
  1211      1   0  ffff880036575dc0  IN   0.0   25672   1368  vsftpd
  1232      2   1  ffff8800b1c4c650  IN   0.0       0      0  [kdmflush]
  1238      2   1  ffff8800b0b84650  IN   0.0       0      0  [bioset]
  1239      2   1  ffff8800b0b80000  IN   0.0       0      0  [kcryptd_io]
  1240      2   1  ffff8800b0b9c650  IN   0.0       0      0  [kcryptd]
  1241      2   1  ffff8800b0b99770  IN   0.0       0      0  [bioset]
  1432      1   1  ffff8800b1c3c650  IN   0.0   15828    960  getty
  1438      1   1  ffff880036449770  IN   0.0   15828    956  getty
  1447      1   1  ffff8800aee3c650  IN   0.0   15828    956  getty
  1448      1   1  ffff8800b1b9aee0  IN   0.0   15828    952  getty
  1452      1   1  ffff8800aefe9770  IN   0.0   15828    952  getty
  1481      1   0  ffff8800b1599770  IN   0.1   61092   2972  sshd
  1484      1   0  ffff8800b159aee0  IN   0.2   17648   4624  dhcpd
  1487      1   1  ffff8800b159c650  IN   0.0    4376    668  acpid
  1499      1   1  ffff8800aee21770  IN   0.0   25804   1100  cron
  1500      1   0  ffff8800af75c650  IN   0.0   19124    164  atd
  1522      1   0  ffff8800b1811770  IN   1.4  484344  43104  mysqld
  1524      1   0  ffff8800b1bec650  IN   0.9  118896  26384  squid3
  1536      1   0  ffff8800af171770  IN   1.4  484344  43104  mysqld
  1537      1   0  ffff8800af174650  IN   1.4  484344  43104  mysqld
  1538      1   0  ffff8800af794650  IN   1.4  484344  43104  mysqld
  1539      1   1  ffff8800af791770  IN   1.4  484344  43104  mysqld
  1540      1   0  ffff8800af75aee0  IN   1.4  484344  43104  mysqld
  1541      1   0  ffff8800af759770  IN   1.4  484344  43104  mysqld
  1542      1   0  ffff8800b23a1770  IN   1.4  484344  43104  mysqld
  1543      1   0  ffff8800b1810000  IN   1.4  484344  43104  mysqld
  1544      1   1  ffff8800b1815dc0  IN   1.4  484344  43104  mysqld
  1545      1   1  ffff8800b1812ee0  IN   1.4  484344  43104  mysqld
  1548   1524   1  ffff8800b1814650  IN   0.0   12672   1064  log_file_daemon
  1549   1524   0  ffff8800b0b9aee0  IN   0.0   12792   1284  pinger
  1559      1   0  ffff8800af758000  IN   1.4  484344  43104  mysqld
  1560      1   1  ffff8800aee14650  IN   1.4  484344  43104  mysqld
  1561      1   0  ffff8800aee15dc0  IN   1.4  484344  43104  mysqld
  1562      1   1  ffff8800b23a0000  IN   1.4  484344  43104  mysqld
  1563      1   1  ffff8800b23a2ee0  IN   0.1  335304   3584  whoopsie
  1573      1   1  ffff8800b1be8000  IN   0.1  335304   3584  gmain
  1575      1   1  ffff8800b0b85dc0  IN   0.1  335304   3584  gdbus
  1578      1   1  ffff8800b0b82ee0  IN   1.4  484344  43104  mysqld
  1581      1   1  ffff88003644c650  IN   1.4  484344  43104  mysqld
  1742      1   1  ffff8800b159ddc0  IN   1.1  255764  32968  named
  1743      1   1  ffff880036574650  IN   1.1  255764  32968  named
  1744      1   1  ffff880036572ee0  IN   1.1  255764  32968  named
  1745      1   0  ffff880036570000  IN   1.1  255764  32968  named
  1746      1   0  ffff8800b1beaee0  IN   1.1  255764  32968  named
  1767      1   0  ffff8800b0b81770  IN   0.0   88740   1256  sensord
  1791      1   0  ffff8800b1b9c650  IN   0.1   47920   4368  snmpd
  1834      1   1  ffff8800360b1770  IN   0.1   27208   1684  nagios3
  1924      1   1  ffff88003644ddc0  IN   0.5  188264  14364  apache2
  1927   1924   0  ffff8800b1be9770  IN   0.2  188336   6284  apache2
  1928   1924   0  ffff8800aee3ddc0  IN   0.2  188336   6280  apache2
  1929   1924   0  ffff8800aee38000  IN   0.2  188336   6236  apache2
  1930   1924   0  ffff8800b1598000  IN   0.2  188336   6216  apache2
  1931   1924   0  ffff8800b23a5dc0  IN   0.2  188336   6280  apache2
  1960      1   1  ffff8800b1b98000  IN   0.1  198324   2216  accel-pppd
  1963      1   0  ffff8800b1f7ddc0  IN   0.1  198324   2216  accel-pppd
  1986      1   0  ffff8800b1ae5dc0  IN   0.1  198324   2216  accel-pppd
  1987      1   0  ffff8800b1fc9770  IN   0.1  198324   2216  accel-pppd
  1990      1   0  ffff8800360b4650  IN   0.1  198324   2216  accel-pppd
  1991      1   1  ffff8800b1f78000  IN   0.1  198324   2216  accel-pppd
  2098      1   1  ffff8800b1ae1770  IN   0.0   15828    952  getty
  2277      2   0  ffff8800b1ae4650  IN   0.0       0      0  [kauditd]
  7418   1924   0  ffff8800b32b0000  IN   0.2  188336   6252  apache2
  7530   1924   1  ffff8800b1c4ddc0  IN   0.2  188336   6236  apache2
  7533      2   1  ffff8800aefeaee0  IN   0.0       0      0  [kworker/u8:0]
  7974      1   1  ffff8800b1f79770  IN   0.1  198324   2216  accel-pppd
  8645   1481   1  ffff8800360b5dc0  IN   0.1  111172   4496  sshd
  8747   8645   0  ffff8800aee25dc0  IN   0.1  111172   2124  sshd
  8748   8747   1  ffff8800aee22ee0  IN   0.1   23124   4336  bash
  8839   8748   0  ffff8800b328c650  IN   0.1   75012   2700  sudo
  8840   8839   1  ffff8800aee29770  IN   0.1   22244   3484  bash
 11668      2   1  ffff8800b1fc8000  IN   0.0       0      0  [kworker/u9:1]
 13743      1   1  ffff8800af235dc0  IN   0.1  198324   2216  accel-pppd
 13761      1   1  ffff8800b0b9ddc0  IN   0.1  198324   2216  accel-pppd
 13762    348   0  ffff8800af230000  IN   0.0   42520   1028  systemd-udevd
 13795    348   0  ffff880036488000  IN   0.0   42520    972  systemd-udevd
crash>

Edited by Animal

Share this post


Link to post
Share on other sites

Весь чипсет виашный у сервера, это плохо :(

Фря была 64бит?

Я попробую по наличию свободного времени поколупать исходники этого ядра, похоже вылетает постоянно на одном участке, что-то связанное с памятью.

 

И систему по возможности желательно проапдейтить, ибо " PANIC:

WARNING: log buf data structure(s) have changed

""" - не совсем то, что там должно быть.

Share this post


Link to post
Share on other sites

Весь чипсет виашный у сервера, это плохо :(

Фря была 64бит?

Я попробую по наличию свободного времени поколупать исходники этого ядра, похоже вылетает постоянно на одном участке, что-то связанное с памятью.

 

И систему по возможности желательно проапдейтить, ибо " PANIC:

WARNING: log buf data structure(s) have changed

""" - не совсем то, что там должно быть.

нет, фря была обычная

серв ребутится.. до сих пор поставить на выходных 32х битную убунту

Edited by Animal

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this