Wind River Support Network

HomeDefectsLIN6-9429
Fixed

LIN6-9429 : fsl-p50xx scp vmcore after kdump test have kernel call trace.

Created: Feb 15, 2015    Updated: Dec 3, 2018
Resolved Date: Feb 26, 2015
Found In Version: 6.0
Fix Version: 6.0.0.18
Severity: Standard
Applicable for: Wind River Linux 6
Component/s: BSP - Async

Description

This issue need used board barcode 19756, 20094 and 20129 can't boot up with standard kernel.

1st time:
root@p5020ds:~# ------------[ cut here ]------------
kernel BUG at /fsl-p50xx/std-kdump_kexec/bitbake_build/tmp/work/fsl_p50xx-wrs-linux/linux-windriver/3.10-r0/linux/net/core/skbuff.c:2605!
Oops: Exception in kernel mode, sig: 5 [#1]
PREEMPT SMP NR_CPUS=2 CoreNet Generic
Modules linked in:
CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.10.62-ltsi-WR6.0.0.0_standard #1
task: c0000000f90c5500 ti: c0000000fffdc000 task.ti: c0000000f9194000
NIP: c0000000028a1348 LR: c0000000028a1160 CTR: 0000000000000010
REGS: c0000000fffdeec0 TRAP: 0700   Not tainted  (3.10.62-ltsi-WR6.0.0.0_standard)
MSR: 0000000080029000 <CE,EE,ME>  CR: 28024422  XER: 20000000
SOFTE: 1

GPR00: c0000000028a1160 c0000000fffdf140 c000000003269248 0000000000000000 
GPR04: 0000000000000001 0000000000000040 0000000000000000 0000000000000001 
GPR08: 0000000000000001 0000000000000001 00000000000002c0 00005c70000005a0 
GPR12: 0000000028022428 c00000000ffff000 0000000025e84aaa 0000000000000000 
GPR16: 00000000ffff7ef1 0000000025e84aaa 0000000000000002 0000000000000000 
GPR20: 0000000000000001 00000000000005a8 0000000000000008 ffffffffffffffff 
GPR24: 0000000000000008 00000000000005a8 00000000000005a8 c0000000f719cf00 
GPR28: 0000000000000002 c0000000f7198200 0000000000000001 c0000000f7198800 
NIP [c0000000028a1348] .skb_shift+0x358/0x510
LR [c0000000028a1160] .skb_shift+0x170/0x510
Call Trace:
[c0000000fffdf140] [c0000000028a1160] .skb_shift+0x170/0x510 (unreliable)
[c0000000fffdf210] [c0000000029122dc] .tcp_sacktag_walk+0x37c/0x5a0
[c0000000fffdf2f0] [c00000000291353c] .tcp_sacktag_write_queue+0x4fc/0xc10
[c0000000fffdf400] [c000000002917ddc] .tcp_ack+0x3ac/0x1000
[c0000000fffdf570] [c000000002919060] .tcp_rcv_established+0x140/0x740
[c0000000fffdf630] [c0000000029241bc] .tcp_v4_do_rcv+0x18c/0x440
[c0000000fffdf6e0] [c000000002927590] .tcp_v4_rcv+0x800/0x860
[c0000000fffdf7c0] [c0000000028f936c] .ip_local_deliver_finish+0x14c/0x330
[c0000000fffdf860] [c0000000028f9698] .ip_rcv_finish+0x148/0x3a0
[c0000000fffdf8f0] [c0000000028adae8] .__netif_receive_skb_core+0x818/0xb40
[c0000000fffdf9e0] [c0000000028afc98] .netif_receive_skb+0x48/0x110
[c0000000fffdfa80] [c0000000026f026c] ._dpa_rx+0x1cc/0x6f0
[c0000000fffdfba0] [c0000000026ee3f4] .priv_rx_default_dqrr+0xc4/0x230
[c0000000fffdfc50] [c000000002851d14] .qman_p_poll_dqrr+0x1d4/0x2e0
[c0000000fffdfd10] [c0000000026ee634] .dpaa_eth_poll+0x34/0x80
[c0000000fffdfda0] [c0000000028b024c] .net_rx_action+0x1cc/0x330
[c0000000fffdfe80] [c00000000207276c] .__do_softirq+0x19c/0x3d0
[c0000000fffdff90] [c000000002017054] .call_do_softirq+0x14/0x24
[c0000000f91978e0] [c000000002005fe8] .do_softirq+0x118/0x150
[c0000000f9197970] [c000000002072c54] .irq_exit+0x124/0x140
[c0000000f91979f0] [c000000002005ac4] .do_IRQ+0x184/0x370
[c0000000f9197aa0] [c00000000201b93c] exc_0x500_common+0xfc/0x100
--- Exception: 501 at .book3e_idle+0x24/0x4c
    LR = .book3e_idle+0x24/0x4c
[c0000000f9197d90] [c00000000200b11c] .arch_cpu_idle+0x3c/0xb0 (unreliable)
[c0000000f9197e00] [c0000000020c7254] .cpu_startup_entry+0x1d4/0x350
[c0000000f9197ed0] [c000000002a2a36c] .start_secondary+0x3ec/0x3f4
[c0000000f9197f90] [c00000000200046c] .start_secondary_prolog+0x10/0x14
Instruction dump:
7d274a14 7f855000 419dffb0 78c60620 98c90000 40910134 815f00c4 e93f00c8 
7d2950ae 7d290034 5529d97e 79290020 <0b090000> a13d007c 7f43d378 61293000 
---[ end trace 29d552ef45cb2e93 ]---

Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 180 seconds..


======================================================
2st time:
root@p5020ds:~# BUG: Bad page state in process swapper/1  pfn:f715f
page:c0000000069e5cc8 count:-1 mapcount:0 mapping:          (null) index:0x0
page flags: 0x4000000000000000()
Modules linked in:
CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.10.62-ltsi-WR6.0.0.0_standard #1
Call Trace:
[c0000000fffd7450] [c000000002009380] .show_stack+0x170/0x290 (unreliable)
[c0000000fffd7540] [c000000002a33f60] .dump_stack+0x28/0x3c
[c0000000fffd75b0] [c00000000216ae24] .bad_page+0x104/0x160
[c0000000fffd7640] [c00000000216b664] .get_page_from_freelist+0x614/0x740
[c0000000fffd77a0] [c00000000216c3d0] .__alloc_pages_nodemask+0x1c0/0xad0
[c0000000fffd7960] [c00000000289968c] .__netdev_alloc_frag+0xec/0x240
[c0000000fffd7a10] [c0000000026ef9c0] ._dpa_bp_add_8_bufs+0xc0/0x300
[c0000000fffd7b10] [c0000000026efda0] .dpaa_eth_refill_bpools+0x60/0xa0
[c0000000fffd7ba0] [c0000000026ee3c8] .priv_rx_default_dqrr+0x98/0x230
[c0000000fffd7c50] [c000000002851d14] .qman_p_poll_dqrr+0x1d4/0x2e0
[c0000000fffd7d10] [c0000000026ee634] .dpaa_eth_poll+0x34/0x80
[c0000000fffd7da0] [c0000000028b024c] .net_rx_action+0x1cc/0x330
[c0000000fffd7e80] [c00000000207276c] .__do_softirq+0x19c/0x3d0
[c0000000fffd7f90] [c000000002017054] .call_do_softirq+0x14/0x24
[c0000000f91978e0] [c000000002005fe8] .do_softirq+0x118/0x150
[c0000000f9197970] [c000000002072c54] .irq_exit+0x124/0x140
[c0000000f91979f0] [c000000002005ac4] .do_IRQ+0x184/0x370
[c0000000f9197aa0] [c00000000201b93c] exc_0x500_common+0xfc/0x100
--- Exception: 501 at .book3e_idle+0x24/0x4c
    LR = .book3e_idle+0x24/0x4c
[c0000000f9197d90] [c00000000200b11c] .arch_cpu_idle+0x3c/0xb0 (unreliable)
[c0000000f9197e00] [c0000000020c7254] .cpu_startup_entry+0x1d4/0x350
[c0000000f9197ed0] [c000000002a2a36c] .start_secondary+0x3ec/0x3f4
[c0000000f9197f90] [c00000000200046c] .start_secondary_prolog+0x10/0x14
Disabling lock debugging due to kernel taint

root@p5020ds:~# root@p5020ds:~# ifconfig
alloc_fd: slot 3 not NULL!
------------[ cut here ]------------
kernel BUG at /fsl-p50xx/std-kdump_kexec/bitbake_build/tmp/work/fsl_p50xx-wrs-linux/linux-windriver/3.10-r0/linux/fs/file.c:574!
Oops: Exception in kernel mode, sig: 5 [#1]
PREEMPT SMP NR_CPUS=2 CoreNet Generic
Modules linked in:
CPU: 1 PID: 730 Comm: ifconfig Tainted: G    B        3.10.62-ltsi-WR6.0.0.0_standard #1
task: c0000000f9b30880 ti: c0000000f9f80000 task.ti: c0000000f9f80000
NIP: c0000000021f6518 LR: c0000000021f64fc CTR: 0000000000000000
REGS: c0000000f9f839e0 TRAP: 0700   Tainted: G    B         (3.10.62-ltsi-WR6.0.0.0_standard)
MSR: 0000000080029000 <CE,EE,ME>  CR: 24244042  XER: 20000000
SOFTE: 1

GPR00: c0000000021f64fc c0000000f9f83c60 c000000003269248 0000000000000001 
GPR04: 0000000000000018 c0000000f9dc9900 0000000000000001 0000000000000000 
GPR08: 0000000200000000 c0000000f9c6d940 0000000000000001 00000003249ed4ca 
GPR12: 0000000024244048 c00000000ffff780 0000000000000000 0000000000000000 
GPR16: 000000000fff18c4 00000000ff88e7e8 00000000ff88e7ec 000000000fff1af0 
GPR20: 000000000fff06d4 000000000000000a 0000000000000000 000000000fff0330 
GPR24: 000000000fff0330 000000001000c6dd c0000000f84465b8 c0000000f9dc9910 
GPR28: c0000000f9dc9900 0000000000000003 c0000000f9f79940 c0000000f9f79900 
NIP [c0000000021f6518] .__fd_install+0x58/0xa0
LR [c0000000021f64fc] .__fd_install+0x3c/0xa0
Call Trace:
[c0000000f9f83c60] [c0000000021f64fc] .__fd_install+0x3c/0xa0 (unreliable)
[c0000000f9f83cf0] [c0000000021cea7c] .do_sys_open+0x1cc/0x270
[c0000000f9f83da0] [c000000002239d50] .compat_SyS_open+0x40/0x60
[c0000000f9f83e30] [c000000002000718] syscall_exit+0x0/0x8c
Instruction dump:
60000000 60000000 3bdf0040 7fc3f378 488277f9 60000000 e93f0008 7ba41f24 
e9490008 7d4a202a 310affff 7d485110 <0b0a0000> 7c2004ac e9290008 7fc3f378 
---[ end trace 0e507c714bd70d4a ]---

note: ifconfig[730] exited with preempt_count 1
BUG: scheduling while atomic: ifconfig/730/0x10000002
Modules linked in:
CPU: 1 PID: 730 Comm: ifconfig Tainted: G    B D      3.10.62-ltsi-WR6.0.0.0_standard #1
Call Trace:
[c0000000f9f82d90] [c000000002009380] .show_stack+0x170/0x290 (unreliable)
[c0000000f9f82e80] [c000000002a33f60] .dump_stack+0x28/0x3c
[c0000000f9f82ef0] [c000000002a2ef84] .__schedule_bug+0x60/0x88
[c0000000f9f82f70] [c000000002a1bc40] .__schedule+0x660/0x7f0
[c0000000f9f831d0] [c0000000020adcf0] .__cond_resched+0x20/0x40
[c0000000f9f83240] [c000000002a1c278] ._cond_resched+0x48/0x50
[c0000000f9f832b0] [c000000002191dc8] .unmap_single_vma+0x328/0x770
[c0000000f9f83400] [c000000002193504] .unmap_vmas+0x74/0xa0
[c0000000f9f83490] [c00000000219d4a8] .exit_mmap+0xd8/0x190
[c0000000f9f835b0] [c000000002063c90] .mmput+0x80/0x140
[c0000000f9f83630] [c00000000206ea0c] .do_exit+0x2bc/0xa70
[c0000000f9f83730] [c000000002013e34] .die+0x304/0x450
[c0000000f9f837d0] [c000000002014194] ._exception+0x1a4/0x1d0
[c0000000f9f83970] [c00000000201bb7c] exc_0x700_common+0xe8/0xec
--- Exception: 700 at .__fd_install+0x58/0xa0
    LR = .__fd_install+0x3c/0xa0
[c0000000f9f83cf0] [c0000000021cea7c] .do_sys_open+0x1cc/0x270
[c0000000f9f83da0] [c000000002239d50] .compat_SyS_open+0x40/0x60
[c0000000f9f83e30] [c000000002000718] syscall_exit+0x0/0x8c
Unable to handle kernel paging request for data at address 0x628fceba00000040
Faulting instruction address: 0xc0000000021cd288
Oops: Kernel access of bad area, sig: 11 [#2]
PREEMPT SMP NR_CPUS=2 CoreNet Generic
Modules linked in:
CPU: 1 PID: 730 Comm: ifconfig Tainted: G    B D W    3.10.62-ltsi-WR6.0.0.0_standard #1
task: c0000000f9b30880 ti: c0000000f9f80000 task.ti: c0000000f9f80000
NIP: c0000000021cd288 LR: c0000000021f608c CTR: c0000000021990a0
REGS: c0000000f9f83270 TRAP: 0300   Tainted: G    B D W     (3.10.62-ltsi-WR6.0.0.0_standard)
MSR: 0000000080029000 <CE,EE,ME>  CR: 28244024  XER: 20000000
SOFTE: 1
DEAR: 628fceba00000040, ESR: 0000000000000000

GPR00: c0000000021f608c c0000000f9f834f0 c000000003269248 628fceba00000000 
GPR04: c0000000f9f79900 0000000000000001 c0000000021992f4 0000000000000000 
GPR08: c0000000f9c6d7c0 c0000000f9ce3808 628fceba00000000 0000000000000014 
GPR12: 0000000028244028 c00000000ffff780 0000000000000000 0000000000000000 
GPR16: 000000000fff18c4 00000000ff88e7e8 00000000ff88e7ec 000000000fff1af0 
GPR20: 000000000fff06d4 000000000000000a c0000000f9b30f30 000000000fff0330 
GPR24: c0000000f9f836a0 0000000000000001 0000000000000000 c0000000f9f79900 
GPR28: c0000000f9c6d940 0000000000000000 c0000000f9f79900 628fceba00000000 
NIP [c0000000021cd288] .filp_close+0x28/0xf0
LR [c0000000021f608c] .put_files_struct+0x10c/0x1b0
Call Trace:
[c0000000f9f834f0] [c0000000021cd308] .filp_close+0xa8/0xf0 (unreliable)
[c0000000f9f83580] [c0000000021f608c] .put_files_struct+0x10c/0x1b0
[c0000000f9f83630] [c00000000206ea48] .do_exit+0x2f8/0xa70
[c0000000f9f83730] [c000000002013e34] .die+0x304/0x450
[c0000000f9f837d0] [c000000002014194] ._exception+0x1a4/0x1d0
[c0000000f9f83970] [c00000000201bb7c] exc_0x700_common+0xe8/0xec
--- Exception: 700 at .__fd_install+0x58/0xa0
    LR = .__fd_install+0x3c/0xa0
[c0000000f9f83cf0] [c0000000021cea7c] .do_sys_open+0x1cc/0x270
[c0000000f9f83da0] [c000000002239d50] .compat_SyS_open+0x40/0x60
[c0000000f9f83e30] [c000000002000718] syscall_exit+0x0/0x8c
Instruction dump:
60000000 60000000 7c0802a6 fba1ffe8 fbc1fff0 fbe1fff8 f8010010 f821ff71 
7c7f1b78 7c9e2378 60000000 60000000 <e93f0040> 2fa90000 41de00a8 e93f0028 
---[ end trace 0e507c714bd70d4b ]---

Fixing recursive fault but reboot is needed!
BUG: scheduling while atomic: ifconfig/730/0x00000002
Modules linked in:
CPU: 1 PID: 730 Comm: ifconfig Tainted: G    B D W    3.10.62-ltsi-WR6.0.0.0_standard #1
Call Trace:
[c0000000f9f82ba0] [c000000002009380] .show_stack+0x170/0x290 (unreliable)
[c0000000f9f82c90] [c000000002a33f60] .dump_stack+0x28/0x3c
[c0000000f9f82d00] [c000000002a2ef84] .__schedule_bug+0x60/0x88
[c0000000f9f82d80] [c000000002a1bc40] .__schedule+0x660/0x7f0
[c0000000f9f82fe0] [c00000000206f19c] .do_exit+0xa4c/0xa70
[c0000000f9f830e0] [c000000002013e34] .die+0x304/0x450
[c0000000f9f83180] [c00000000202d080] .bad_page_fault+0xe0/0x130
[c0000000f9f83200] [c00000000201d1dc] storage_fault_common+0x40/0x44
--- Exception: 300 at .filp_close+0x28/0xf0
    LR = .put_files_struct+0x10c/0x1b0
[c0000000f9f834f0] [c0000000021cd308] .filp_close+0xa8/0xf0 (unreliable)
[c0000000f9f83580] [c0000000021f608c] .put_files_struct+0x10c/0x1b0
[c0000000f9f83630] [c00000000206ea48] .do_exit+0x2f8/0xa70
[c0000000f9f83730] [c000000002013e34] .die+0x304/0x450
[c0000000f9f837d0] [c000000002014194] ._exception+0x1a4/0x1d0
[c0000000f9f83970] [c00000000201bb7c] exc_0x700_common+0xe8/0xec
--- Exception: 700 at .__fd_install+0x58/0xa0
    LR = .__fd_install+0x3c/0xa0
[c0000000f9f83cf0] [c0000000021cea7c] .do_sys_open+0x1cc/0x270
[c0000000f9f83da0] [c000000002239d50] .compat_SyS_open+0x40/0x60
[c0000000f9f83e30] [c000000002000718] syscall_exit+0x0/0x8c

Steps to Reproduce

/wrlinux-6/wrlinux/configure --enable-board=fsl-p50xx --enable-kernel=standard --enable-rootfs=glibc-std --with-template=feature/kexec,feature/kdump --enable-parallel-pkgbuilds=16 --enable-jobs=16 --enable-test=yes --enable-reconfig=yes --with-rcpl-version=0; make fs

do kdump test, then scp vmcore from server.

Other Downloads


Live chat
Online