Wind River Support Network

HomeDefectsLIN1019-4000
Fixed

LIN1019-4000 : Observing QEMU crash with WRL9

Created: Feb 3, 2020    Updated: Mar 10, 2020
Resolved Date: Feb 25, 2020
Previous ID: LIN1018-5674
Found In Version: 10.19.45.3
Fix Version: 10.19.45.5
Severity: Critical
Applicable for: Wind River Linux LTS 19
Component/s: Userspace

Description

PFA core dump with executable and guest .xml file.

*Coredump* 



GNU gdb (GDB) 8.2.50.20180709-git

Copyright (C) 2018 Free Software Foundation, Inc.

License GPLv3+: GNU GPL version 3 or later <[http://gnu.org/licenses/gpl.html]>

This is free software: you are free to change and redistribute it.

There is NO WARRANTY, to the extent permitted by law.

Type "show copying" and "show warranty" for details.

This GDB was configured as "x86_64-pc-linux-gnu".

Type "show configuration" for configuration details.

For bug reporting instructions, please see:

<[http://www.gnu.org/software/gdb/bugs/]>.

Find the GDB manual and other documentation resources online at:

    <[http://www.gnu.org/software/gdb/documentation/]>.

For help, type "help".

Type "apropos word" to search for commands related to "word"...

warning: core file may not match specified executable file.

[New LWP 4470]

[New LWP 4478]

[New LWP 4480]

[New LWP 4479]

[New LWP 4481]

[New LWP 4482]

[New LWP 4483]

[New LWP 4475]

[New LWP 4474]

[New LWP 4473]

warning: .dynamic section for "/lib64/ld-linux-x86-64.so.2" is not at the expected address (wrong library or version mismatch?)

warning: Could not load shared library symbols for 48 libraries, e.g. /lib64/libz.so.1.

Use the "info sharedlibrary" command to see the complete listing.

Do you need "set solib-search-path" or "set sysroot"?

Core was generated by `/usr/bin/qemu-system-x86_64 -name guest=vjunos,debug-threads=on -S -object secr'.

Program terminated with signal SIGSEGV, Segmentation fault.

#0  0x00005632c6f8f71b in mon_get_cpu () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/monitor.c:1025

1025    /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/monitor.c: No such file or directory.

[Current thread is 1 (LWP 4470)]

(gdb)

(gdb) bt

#0  0x00005632c6f8f71b in mon_get_cpu () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/monitor.c:1025

#1  0x00005632c6f910e9 in monitor_get_cpu_index () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/monitor.c:1039

#2  0x00005632c6f8a789 in qmp_inject_nmi (errp=errp@entry=0x7ffe97ecef00) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/cpus.c:1841

#3  0x00005632c718dd5c in i6300esb_timer_expired (vp=0x5632c9141d10) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/hw/watchdog/wdt_i6300esb.c:203

#4  0x00005632c71e621c in timerlist_run_timers (timer_list=0x5632c7d46490) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/qemu-timer.c:528

#5  0x00005632c71e6420 in qemu_clock_run_timers (type=<optimized out>) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/qemu-timer.c:539

#6  qemu_clock_run_all_timers () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/qemu-timer.c:653

#7  0x00005632c71e52de in main_loop_wait (nonblocking=<optimized out>) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/main-loop.c:532

#8  0x00005632c6f54fb8 in main_loop () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/vl.c:1908

#9  main (argc=<optimized out>, argv=<optimized out>, envp=<optimized out>) at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/vl.c:4607

(gdb) info threads

  Id   Target Id         Frame
 * 1    LWP 4470          0x00005632c6f8f71b in mon_get_cpu () at /usr/src/debug/qemu/2.7.0-r1/qemu-2.7.0/monitor.c:1025

  2    LWP 4478          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  3    LWP 4480          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  4    LWP 4479          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  5    LWP 4481          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  6    LWP 4482          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  7    LWP 4483          0x00007f49fc0863f7 in ioctl () at ../sysdeps/unix/syscall-template.S:84

  8    LWP 4475          0x00007f49fc0854d1 in __GI_ppoll (fds=0x7f49e80008c0, nfds=3, timeout=<optimized out>, timeout@entry=0x0, sigmask=sigmask@entry=0x0) at /usr/src/debug/glibc/2.24-r0/git/sysdeps/unix/sysv/linux/ppoll.c:39

  9    LWP 4474          0x00007f49fc0854d1 in __GI_ppoll (fds=0x7f49f00008c0, nfds=3, timeout=<optimized out>, timeout@entry=0x0, sigmask=sigmask@entry=0x0) at /usr/src/debug/glibc/2.24-r0/git/sysdeps/unix/sysv/linux/ppoll.c:39

  10   LWP 4473          syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38

(gdb)

Cat  /var/log/messages

2019-11-06T12:48:23.386651-08:00 bigdrop1-node kernel: High host-mode time vcpu 0 delay 2039098 us exit reason IO_INSTRUCTION rip 0xeea3f info cfe0000 0

2019-11-06T12:48:25.426631-08:00 bigdrop1-node kernel: High host-mode time vcpu 0 delay 2039537 us exit reason IO_INSTRUCTION rip 0xeea3f info cff0000 0

2019-11-06T12:48:27.224674-08:00 bigdrop1-node refpga_cmd: MQ related information -  mqdes 3, flag 0, msgsize 127, maxmsg 50, curmsgs 0

2019-11-06T12:48:27.224972-08:00 bigdrop1-node refpga_cmd: msg stat -  Tx 1, bad_des 0, bad_length 0, intr 0, tx_timeout 0, q_full 0, unknown 0

2019-11-06T12:48:27.225218-08:00 bigdrop1-node refpga_cmd: librefpga_log_stat: Response stat: Rx 0, errors - Open 0,  MQRemove 0, ID 0, Read 0, Length 0, Wrong type 0

2019-11-06T12:48:48.800339-08:00 bigdrop1-node kernel: igb 0000:01:00.0 eth4: igb: eth4 NIC Link is Down

2019-11-06T12:48:48.800343-08:00 bigdrop1-node kernel: igb 0000:01:00.1 eth3: igb: eth3 NIC Link is Down

2019-11-06T12:48:52.331789-08:00 bigdrop1-node kernel: igb 0000:01:00.0 eth4: igb: eth4 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T12:48:52.396130-08:00 bigdrop1-node kernel: igb 0000:01:00.1 eth3: igb: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T12:50:00.944293-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Down

2019-11-06T12:50:01.887153-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Up, 1000 Mbps Full Duplex, Flow Control: None

2019-11-06T12:50:01.983857-08:00 bigdrop1-node kernel: igb 0000:01:00.1 eth3: igb: eth3 NIC Link is Down

2019-11-06T12:50:02.275645-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Down

2019-11-06T12:50:02.821628-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Up, 1000 Mbps Full Duplex, Flow Control: None

2019-11-06T12:50:02.928632-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Down

2019-11-06T12:50:03.007625-08:00 bigdrop1-node kernel: igb 0000:01:00.0 eth4: igb: eth4 NIC Link is Down

2019-11-06T12:50:03.654344-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: None

2019-11-06T12:50:05.960213-08:00 bigdrop1-node kernel: igb 0000:01:00.1 eth3: igb: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T12:50:06.540094-08:00 bigdrop1-node kernel: igb 0000:01:00.0 eth4: igb: eth4 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T12:50:11.236682-08:00 bigdrop1-node kernel: i40e 0000:05:00.0 eth2: NIC Link is Up, 10 Gbps Full Duplex, Flow Control: None

2019-11-06T12:50:28.584331-08:00 bigdrop1-node refpga_cmd: MQ related information -  mqdes 3, flag 0, msgsize 127, maxmsg 50, curmsgs 0

2019-11-06T12:50:28.584589-08:00 bigdrop1-node refpga_cmd: msg stat -  Tx 1, bad_des 0, bad_length 0, intr 0, tx_timeout 0, q_full 0, unknown 0

2019-11-06T12:50:28.584854-08:00 bigdrop1-node refpga_cmd: librefpga_log_stat: Response stat: Rx 0, errors - Open 0,  MQRemove 0, ID 0, Read 0, Length 0, Wrong type 0

2019-11-06T12:50:42.422274-08:00 bigdrop1-node re_fpga: libhostd_open: mq is ready. mqdes 3, msgsize 1024, maxmsg 512, curmsgs 0.

2019-11-06T12:50:43.079404-08:00 bigdrop1-node re_fpga: libhostd_open: mq is ready. mqdes 3, msgsize 1024, maxmsg 512, curmsgs 0.

2019-11-06T17:23:06.633785-08:00 bigdrop1-node refpga_cmd: MQ related information -  mqdes 3, flag 0, msgsize 127, maxmsg 50, curmsgs 0

2019-11-06T17:23:06.634090-08:00 bigdrop1-node refpga_cmd: msg stat -  Tx 1, bad_des 0, bad_length 0, intr 0, tx_timeout 0, q_full 0, unknown 0

2019-11-06T17:23:06.634348-08:00 bigdrop1-node refpga_cmd: librefpga_log_stat: Response stat: Rx 0, errors - Open 0,  MQRemove 0, ID 0, Read 0, Length 0, Wrong type 0

2019-11-06T17:23:23.384103-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Down

2019-11-06T17:23:23.653350-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered disabled state

2019-11-06T17:23:23.749872-08:00 bigdrop1-node kernel: device tap1 left promiscuous mode

2019-11-06T17:23:23.749879-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered disabled state

2019-11-06T17:23:24.043513-08:00 bigdrop1-node kernel: i40e 0000:05:00.1 eth1: NIC Link is Up, 1000 Mbps Full Duplex, Flow Control: None

2019-11-06T17:23:33.474128-08:00 bigdrop1-node refpga_cmd: MQ related information -  mqdes 0, flag 0, msgsize 127, maxmsg 50, curmsgs 0

2019-11-06T17:23:33.474318-08:00 bigdrop1-node refpga_cmd: msg stat -  Tx 1, bad_des 0, bad_length 0, intr 0, tx_timeout 0, q_full 0, unknown 0

2019-11-06T17:23:33.474458-08:00 bigdrop1-node refpga_cmd: librefpga_log_stat: Response stat: Rx 0, errors - Open 0,  MQRemove 0, ID 0, Read 0, Length 0, Wrong type 0

2019-11-06T17:24:42.117688-08:00 bigdrop1-node liblogging-stdlog:  [origin software="rsyslogd" swVersion="8.22.0" x-pid="2162" x-info="http://www.rsyslog.com"] exiting on signal 15.

2019-11-06T17:24:42.167561-08:00 bigdrop1-node ssh.config.update: /etc/ssh/sshd_config: setting PermitRootLogin without-password

2019-11-06T17:24:42.178067-08:00 bigdrop1-node ssh.config.update: /etc/ssh/root_login: option set to deny

2019-11-06T17:24:42.178845-08:00 bigdrop1-node ssh.config.update: Restarting sshd

2019-11-06T17:24:43.459037-08:00 bigdrop1-node kernel: e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx

2019-11-06T17:24:43.459043-08:00 bigdrop1-node kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

2019-11-06T17:24:43.459044-08:00 bigdrop1-node kernel: IPv6: ADDRCONF(NETDEV_CHANGE): macvlan0: link becomes ready

2019-11-06T17:24:44.258422-08:00 bigdrop1-node re_fpga: libhostd_open: mq is ready. mqdes 3, msgsize 1024, maxmsg 512, curmsgs 0.

2019-11-06T17:24:44.304367-08:00 bigdrop1-node resild: libhostd_open: mq is ready. mqdes 5, msgsize 1024, maxmsg 512, curmsgs 0.

2019-11-06T17:24:44.313990-08:00 bigdrop1-node jsntp: Start jsntpd ...

2019-11-06T17:24:44.315236-08:00 bigdrop1-node jsntp: Start jsntpd rx pthread ...

2019-11-06T17:24:44.329081-08:00 bigdrop1-node re_fpga: libhostd_open: mq is ready. mqdes 3, msgsize 1024, maxmsg 512, curmsgs 0.

2019-11-06T17:24:44.436715-08:00 bigdrop1-node vehostd[3971]: junos-partition-cleanup: disk space use% in /junos is 18

2019-11-06T17:24:44.844997-08:00 bigdrop1-node root: Creating /vm/adminjunos/vjunos-var-config.img with size 58720256 K

2019-11-06T17:24:44.984032-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered blocking state

2019-11-06T17:24:44.984062-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered disabled state

2019-11-06T17:24:44.984062-08:00 bigdrop1-node kernel: device tap1 entered promiscuous mode

2019-11-06T17:24:45.988475-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered blocking state

2019-11-06T17:24:45.988488-08:00 bigdrop1-node kernel: jnpr-int-br: port 1(tap1) entered forwarding state

2019-11-06T17:25:19.289548-08:00 bigdrop1-node kernel: pci-stub 0000:00:1f.3: kvm assign device

2019-11-06T17:25:19.289560-08:00 bigdrop1-node kernel: pci-stub 0000:09:0d.0: enabling device (0101 -> 0103)

2019-11-06T17:25:19.289561-08:00 bigdrop1-node kernel: pci-stub 0000:09:0d.0: kvm assign device

2019-11-06T17:25:19.289561-08:00 bigdrop1-node kernel: pci-stub 0000:09:0e.0: kvm assign device

2019-11-06T17:25:19.291818-08:00 bigdrop1-node kernel: pci-stub 0000:00:14.0: kvm assign device

2019-11-06T17:25:19.291824-08:00 bigdrop1-node kernel: pci-stub 0000:05:0a.0: enabling device (0000 -> 0002)

2019-11-06T17:25:19.404685-08:00 bigdrop1-node kernel: pci-stub 0000:05:0a.0: kvm assign device

2019-11-06T17:25:19.404694-08:00 bigdrop1-node kernel: pci-stub 0000:05:02.0: enabling device (0000 -> 0002)

2019-11-06T17:25:19.518100-08:00 bigdrop1-node kernel: pci-stub 0000:05:02.0: kvm assign device

2019-11-06T17:25:19.518023-08:00 bigdrop1-node qemu-system-x86_64: pci_hgcommdev_init vm0: vm index 0

2019-11-06T17:25:21.068477-08:00 bigdrop1-node refpga_cmd: MQ related information -  mqdes 3, flag 0, msgsize 127, maxmsg 50, curmsgs 0

2019-11-06T17:25:21.068691-08:00 bigdrop1-node refpga_cmd: msg stat -  Tx 1, bad_des 0, bad_length 0, intr 0, tx_timeout 0, q_full 0, unknown 0

2019-11-06T17:25:21.068883-08:00 bigdrop1-node refpga_cmd: librefpga_log_stat: Response stat: Rx 0, errors - Open 0,  MQRemove 0, ID 0, Read 0, Length 0, Wrong type 0

2019-11-06T17:25:21.099995-08:00 bigdrop1-node qemu: [0sec] oom score is adjusted from 747 to 0/-1000

2019-11-06T17:25:57.458445-08:00 bigdrop1-node kernel: igb 0000:01:00.0 eth4: igb: eth4 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T17:25:57.458453-08:00 bigdrop1-node kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth4: link becomes ready

2019-11-06T17:25:57.484266-08:00 bigdrop1-node kernel: igb 0000:01:00.1 eth3: igb: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

2019-11-06T17:25:57.484270-08:00 bigdrop1-node kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready

2019-11-06T17:32:56.176036-08:00 bigdrop1-node kernel: qemu-system-x86[4470]: segfault at a8 ip 00005632c6f8f71b sp 00007ffe97eceed0 error 4 in qemu-system-x86_64[5632c6d67000+6b4000]

 

Steps to Reproduce

Host - WR9.0.0.20_ovp 
 Guest - FreeBSD OS .

Project configration:
 --dl-layers --distros wrlinux-ovp --machines intel-x86-64 --templates feature/initramfs,feature/kdump,feature/kexec,feature/kernel-ovp-kvm,feature/sysklogd,feature/dpdk,feature/package-management --layers wr-kernel wr-ovp

bitbake wrlinux-image-ovp-kvm

Deploy host image to target.

Use FreeBSD guest to run QEMU guest on WRL9 host.
Live chat
Online