Wind River Support Network

HomeDefectsLIN5-11599
Fixed

LIN5-11599 : WR Linux 4.0 -- Oops in skb_over_panic when target boots under heavy networking traffic

Created: Aug 3, 2012    Updated: Dec 19, 2017
Resolved Date: Oct 25, 2013
Previous ID: LIN4-3347
Found In Version: 5.0
Fix Version: 5.0.1.9
Severity: Severe
Applicable for: Wind River Linux 5
Component/s: Networking

Description


> ## Booting image at fc500000 ...
>    Image Name:   Linux-2.6.34.6-WR4.0.0.0_standar
>    Image Type:   PowerPC Linux Kernel Image (gzip compressed)
>    Data Size:    1976382 Bytes =  1.9 MB
>    Load Address: 00000000
>    Entry Point:  00000000
>    Verifying Checksum ... OK
>    Uncompressing Kernel Image ... OK
>    Booting using flat device tree at 0xff6e0000 ## Transferring 
> control to Linux (at address 00000000) ...
> Sending MMC wdog enable command OS-Loading
>    Loading Device Tree to 007f9000, end 007fd058 ... Searching Device 
> Tree to S.
> Found Stub Ethernet Mac Addr: Using 00:00:77:B4:56:30 of_flat_tree - 
> Jumping to kernel!!
> SystemFirmwareProgress...booting
> Using Xilinx Virtex machine description Initializing cgroup subsys 
> cpuset Initializing cgroup subsys cpu Linux version 
> 2.6.34.6-WR4.0.0.0_standard  (gcc version 4.4.1
> (2
> Zone PFN ranges:
>   DMA      0x00000000 -> 0x00010000
>   Normal   empty
> Movable zone start PFN for each node
> early_node_map[1] active PFN ranges
>     0: 0x00000000 -> 0x00010000
> MMU: Allocated 1088 bytes of context maps for 255 contexts Built 1 
> zonelists in Zone order, mobility grouping on.  Total pages: 65024 
> Kernel command line: console=ttyUL0,38400 
> mtdparts=physmap-flash.0:5M,2M,49024K0
> PID hash table entries: 1024 (order: 0, 4096 bytes) Dentry cache hash 
> table entries: 32768 (order: 5, 131072 bytes) Inode-cache hash table
> entries: 16384 (order: 4, 65536 bytes) allocated 1572864 bytes of 
> page_cgroup please try 'cgroup_disable=memory,blkio' option if you 
> don't want memory and bls
> Memory: 253976k/262144k available (3876k kernel code, 8168k reserved, 
> 184k
> data)
> Kernel virtual memory layout:
>   * 0xfffdf000..0xfffff000  : fixmap
>   * 0xfdd00000..0xfe000000  : consistent mem
>   * 0xfdd00000..0xfdd00000  : early ioremap
>   * 0xd1000000..0xfdd00000  : vmalloc & ioremap Hierarchical RCU 
> implementation.
> RCU-based detection of stalled CPUs is enabled.
> NR_IRQS:512 nr_irqs:512
> clocksource: timebase mult[d55555] shift[22] registered
> Console: colour dummy device 80x25
> Security Framework initialized
> Mount-cache hash table entries: 512
> Initializing cgroup subsys debug
> Initializing cgroup subsys ns
> Initializing cgroup subsys cpuacct
> Initializing cgroup subsys memory
> Initializing cgroup subsys blkio
> Initializing cgroup subsys devices
> Initializing cgroup subsys net_cls
> Init trace_clock_cyc2ns: precalc_mult = 853, precalc_shift = 8
> NET: Registered protocol family 16
> check_res_of_trace_clock: sched_clock() high resolution
> bio: create slab <bio-0> at 0
> XGpio: /plb@0/gpio@50010000: registered
> XGpio: /plb@0/gpio@40020000: registered
> XGpio: /plb@0/gpio@40024000: registered
> XGpio: /plb@0/gpio@40028000: registered
> XGpio: /plb@0/gpio@4002c000: registered
> XGpio: /plb@0/gpio@b0000000: registered
> XGpio: /plb@0/gpio@50014000: registered
> XGpio: /plb@0/gpio@40000000: registered Switching to clocksource 
> timebase
> NET: Registered protocol family 2
> IP route cache hash table entries: 2048 (order: 1, 8192 bytes) TCP 
> established hash table entries: 8192 (order: 4, 65536 bytes) TCP bind 
> hash table entries: 8192 (order: 3, 32768 bytes)
> TCP: Hash tables configured (established 8192 bind 8192) TCP reno 
> registered UDP hash table entries: 256 (order: 0, 4096 bytes) UDP-Lite 
> hash table entries: 256 (order: 0, 4096 bytes)
> NET: Registered protocol family 1
> RPC: Registered udp transport module.
> RPC: Registered tcp transport module.
> RPC: Registered tcp NFSv4.1 backchannel transport module.
> Registering unionfs 2.5.4 (for 2.6.34-rc0)
> JFFS2 version 2.2. (NAND) .. 2001-2006 Red Hat, Inc.
> ROMFS MTD (C) 2007 Red Hat, Inc.
> msgmni has been set to 496
> alg: No test for stdrng (krng)
> io scheduler noop registered
> io scheduler deadline registered
> io scheduler cfq registered (default)
> LTT : ltt-relay init
> ipmi message handler version 39.2
> ipmi device interface
> IPMI System Interface driver.
> ipmi_si: Unable to find any System Interface(s) IPMI Watchdog: driver 
> initialized Copyright (C) 2004 MontaVista Software - IPMI Powerdown 
> via sys_reboot.
> Serial: 8250/16550 driver, 3 ports, IRQ sharing disabled
> 40600000.serial: ttyUL0 at MMIO 0x40600003 (irq = 16) is a uartlite 
> console [ttyUL0] enabled
> 40620000.serial: ttyUL1 at MMIO 0x40620003 (irq = 17) is a uartlite
> 40640000.serial: ttyUL2 at MMIO 0x40640003 (irq = 18) is a uartlite
> brd: module loaded
> loop: module loaded
> Xilinx SystemACE device driver, major=254 physmap platform flash
> device: 08000000 at f8000000
> physmap-flash.0: Found 1 x16 devices at 0x0 in 16-bit bank Amd/Fujitsu 
> Extended Query Table at 0x0040
> physmap-flash.0: CFI does not contain boot bank location. Assuming top.
> number of CFI chips: 1
> 16 cmdlinepart partitions found on MTD device physmap-flash.0 Creating
> 16 MTD partitions on "physmap-flash.0":
> 0x000000000000-0x000000500000 : "Partition_000"
> 0x000000500000-0x000000700000 : "Partition_001"
> 0x000000700000-0x0000036e0000 : "Partition_002"
> 0x0000036e0000-0x000003700000 : "Partition_003"
> 0x000003700000-0x000003f00000 : "Partition_004"
> 0x000003f00000-0x000003f20000 : "Partition_005"
> 0x000003f20000-0x000003f40000 : "Partition_006"
> 0x000003f40000-0x000004000000 : "Partition_007"
> 0x000004000000-0x000004500000 : "Partition_008"
> 0x000004500000-0x000004700000 : "Partition_009"
> 0x000004700000-0x0000076e0000 : "Partition_010"
> 0x0000076e0000-0x000007700000 : "Partition_011"
> 0x000007700000-0x000007f00000 : "Partition_012"
> 0x000007f00000-0x000007f20000 : "Partition_013"
> 0x000007f20000-0x000007f40000 : "Partition_014"
> 0x000007f40000-0x000008000000 : "Partition_015"
> xilinx-xps-spi 40200000.spi: at 0x40200000 mapped to 0xd10e0000,
> irq=19 Probe eth0
> eth0: Dropping NETIF_F_SG since no checksum feature.
> net eth0: Promiscuous mode disabled.
> Probe eth1
> eth1: Dropping NETIF_F_SG since no checksum feature.
> net eth1: Promiscuous mode disabled.
> Probe eth2
> eth2: Dropping NETIF_F_SG since no checksum feature.
> net eth2: Promiscuous mode disabled.
> skb_over_panic: text:c0225fcc len:16383 put:16383 head:ce2ac000 
> data:ce2ac000
> t>
> ------------[ cut here ]------------
> kernel BUG at
> /iTDM-Z01_0/Bsp/workdir/build/linux/net/core/skbuf!
> Oops: Exception in kernel mode, sig: 5 [#1] Xilinx Virtex last sysfs
> file:
> Modules linked in:
> NIP: c0247d4c LR: c0247d4c CTR: 000181ca
> REGS: cf83ba00 TRAP: 0700   Not tainted  (2.6.34.6-WR4.0.0.0_standard)
> MSR: 00021030 <ME,CE,IR,DR>  CR: 24022022  XER: 20000000 TASK = 
> cf839a80[1] 'swapper' THREAD: cf83a000
> GPR00: c0247d4c cf83bab0 cf839a80 0000007e 00001eff ffffffff c0201de4 
> 00000000
> GPR08: 00000002 c03eeb20 00001e86 00000000 44022022 ffffffff 0fff6700 
> 000000ec
> GPR16: 00000001 c03cd098 c034b864 c03500f4 c03eb850 00003fff 0f192000 
> 00000220
> GPR24: 00029030 c03f71ec 40000000 00000000 fdd05220 cf18dae0 ce7fb200 
> ce2ac000 NIP [c0247d4c] skb_over_panic+0x48/0x5c LR [c0247d4c] 
> skb_over_panic+0x48/0x5c Call Trace:
> [cf83bab0] [c0247d4c] skb_over_panic+0x48/0x5c (unreliable) [cf83bac0] 
> [c0249a6c] skb_put+0x5c/0x60 [cf83bad0] [c0225fcc] 
> ll_temac_rx_irq+0x10c/0x29c [cf83bb10] [c0071d60] 
> handle_IRQ_event+0xb0/0x26c [cf83bb50] [c007472c]
> handle_level_irq+0x88/0x128 [cf83bb60] [c0005164] do_IRQ+0x98/0xb4 
> [cf83bb80] [c000f2ec] ret_from_except+0x0/0x18 [cf83bc40] [c03eb870] 
> 0xc03eb870 [cf83bca0] [c0005078] do_softirq+0x78/0x84 [cf83bcb0] 
> [c003a1c0] irq_exit+0x48/0x58 [cf83bcc0] [c0005168] do_IRQ+0x9c/0xb4 
> [cf83bce0] [c000f2ec] ret_from_except+0x0/0x18 [cf83bda0] [c0072e10] 
> __setup_irq+0x364/0x38c [cf83bdc0] [c0072f4c]
> request_threaded_irq+0x114/0x1d8 [cf83be00] [c03bb1b4] 
> temac_of_probe+0xa94/0xb50 [cf83be50] [c023ebf0]
> of_platform_device_probe+0x58/0x98
> [cf83be70] [c0206c18] driver_probe_device+0xa4/0x190 [cf83be90] 
> [c0206dc0] __driver_attach+0xbc/0xc0 [cf83beb0] [c0206288] 
> bus_for_each_dev+0x70/0xac [cf83bee0] [c0206a40]
> driver_attach+0x24/0x34 [cf83bef0] [c02059d0]
> bus_add_driver+0xe4/0x2e4 [cf83bf20] [c0207130]
> driver_register+0x94/0x164 [cf83bf40] [c023eacc] 
> of_register_driver+0x54/0x70 [cf83bf50] [c03bb294]
> temac_init+0x24/0x34 [cf83bf60] [c0002374] do_one_initcall+0x3c/0x1e8 
> [cf83bf90] [c03a31e8] kernel_init+0xc8/0x1a0 [cf83bff0] [c000ea8c]
> kernel_thread+0x4c/0x68 Instruction dump:
> 2f800000 80e30098 8103009c 81230090 81430094 419e0024 3c60c037
> 90010008
> 7ca42b78 38636b1c 7d655b78 480a9d35 <0fe00000> 48000000 3c80c037 
> 3804bec0 Kernel panic - not syncing: Fatal exception in interrupt Call
> Trace:
> [cf83b860] [c00072ec] show_stack+0x44/0x160 (unreliable) [cf83b890] 
> [c02f1a00] panic+0xf4/0x170 [cf83b8e0] [c000c3e0] die+0x100/0x1b0 
> [cf83b900] [c000c680] _exception+0xac/0x118 [cf83b9f0] [c000f2a0] 
> ret_from_except_full+0x0/0x4c [cf83bab0] [c0247d4c] 
> skb_over_panic+0x48/0x5c [cf83bac0] [c0249a6c] skb_put+0x5c/0x60 
> [cf83bad0] [c0225fcc] ll_temac_rx_irq+0x10c/0x29c [cf83bb10] 
> [c0071d60] handle_IRQ_event+0xb0/0x26c [cf83bb50] [c007472c]
> handle_level_irq+0x88/0x128 [cf83bb60] [c0005164] do_IRQ+0x98/0xb4 
> [cf83bb80] [c000f2ec] ret_from_except+0x0/0x18 [cf83bc40] [c03eb870] 
> 0xc03eb870 [cf83bca0] [c0005078] do_softirq+0x78/0x84 [cf83bcb0] 
> [c003a1c0] irq_exit+0x48/0x58 [cf83bcc0] [c0005168] do_IRQ+0x9c/0xb4 
> [cf83bce0] [c000f2ec] ret_from_except+0x0/0x18 [cf83bda0] [c0072e10] 
> __setup_irq+0x364/0x38c [cf83bdc0] [c0072f4c]
> request_threaded_irq+0x114/0x1d8 [cf83be00] [c03bb1b4] 
> temac_of_probe+0xa94/0xb50 [cf83be50] [c023ebf0]
> of_platform_device_probe+0x58/0x98
> [cf83be70] [c0206c18] driver_probe_device+0xa4/0x190 [cf83be90] 
> [c0206dc0] __driver_attach+0xbc/0xc0 [cf83beb0] [c0206288] 
> bus_for_each_dev+0x70/0xac [cf83bee0] [c0206a40]
> driver_attach+0x24/0x34 [cf83bef0] [c02059d0]
> bus_add_driver+0xe4/0x2e4 [cf83bf20] [c0207130]
> driver_register+0x94/0x164 [cf83bf40] [c023eacc] 
> of_register_driver+0x54/0x70 [cf83bf50] [c03bb294]
> temac_init+0x24/0x34 [cf83bf60] [c0002374] do_one_initcall+0x3c/0x1e8 
> [cf83bf90] [c03a31e8] kernel_init+0xc8/0x1a0 [cf83bff0] [c000ea8c]
> kernel_thread+0x4c/0x68 Rebooting in 180 seconds..

Steps to Reproduce

In that case, there are two targets directly connected with two 1Gbps Ethernet links, with heavy bi-directional traffic on each link.  When one target is rebooted (for outside reasons) the Oops is seen as shown in the "symptoms" field.

Other Downloads


Live chat
Online