Wind River Support Network

HomeDefectsLIN9-2302
Not to be fixed

LIN9-2302 : intel-skylake-avx512-64: kmemleak occurred during running perf_events_cpu case on preempt-rt kernel

Created: Nov 20, 2016    Updated: Feb 22, 2019
Resolved Date: Feb 19, 2019
Found In Version: unknown
Severity: Standard
Applicable for: Wind River Linux 9
Component/s: BSP

Description

 perf_events_cpu (keyword: ) testing
######################################################### 

<< [do_test1] start Default cpu statistics>>
********************
root@128.224.179.153:/opt/wr-test/testcases/bts/perf_events_cpu# perf stat sleep 10

 Performance counter stats for 'sleep 10':

          4.054931      task-clock (msec)         #    0.000 CPUs utilized          
                 8      context-switches          #    0.002 M/sec                  
                 0      cpu-migrations            #    0.000 K/sec                  
                39      page-faults               #    0.010 M/sec                  
             11301      cycles                    #    0.003 GHz                    
            661567      instructions              #   58.54  insn per cycle         
            661567      branches                  #  163.151 M/sec                  
             11301      branch-misses             #    1.71% of all branches        

      10.009316532 seconds time elapsed
<<end Default cpu statistics>>
********************
<<clean subcase>>
********************

<< [do_test2] start Various basic CPU statistics>>
********************
root@128.224.179.153:/opt/wr-test/testcases/bts/perf_events_cpu# perf stat -e cycles,instructions,cache-references,cache-misses,bus-cycles -a sleep 10

 Performance counter stats for 'system wide':

18446744073016442880      cycles                                                      
18446744073705857024      instructions              #    1.00  insn per cycle         
         285347157      cache-references                                            
         160820775      cache-misses              #   56.360 % of all cache refs    
         291636939      bus-cycles                                                  

      10.066638847 seconds time elapsed
<<end Various basic CPU statistics>>
********************
<<clean subcase>>
********************

<< [do_check_call_trace] start check testcase call trace>>
********************
root@128.224.179.153:/opt/wr-test/testcases/bts/perf_events_cpu# dmesg |grep -i -w -E -B10 -A50 'Call Trace|BUG:|WARNING:' ||return 0

<<end check testcase call trace>>
********************
<<clean subcase>>
********************

<< [do_check_kmemleak] start check kmemleak>>
********************
root@128.224.179.153:/opt/wr-test/testcases/bts/perf_events_cpu# cat /sys/kernel/debug/kmemleak |grep -E -B10 -A50 'kmemleak_alloc|kmem_cache_alloc' ||return 0
unreferenced object 0xffff8817de715050 (size 16):
  comm "kworker/0:1", pid 210, jiffies 4294703952 (age 71529.273s)
  hex dump (first 16 bytes):
    21 00 0c 00 12 00 dc 05 23 00 e0 01 00 00 00 00  !.......#.......
  backtrace:
    [<ffffffff81a753a8>] kmemleak_alloc+0x28/0x50
    [<ffffffff8119a8d7>] __kmalloc+0x1d7/0x290
    [<ffffffff817cb8d3>] xhci_mem_init+0x9c3/0xf80
    [<ffffffff817c3d78>] xhci_init+0xa8/0x1a0
    [<ffffffff817c4506>] xhci_gen_setup+0x2c6/0x3d0
    [<ffffffff817d49ff>] xhci_pci_setup+0x3f/0x90
    [<ffffffff8179f375>] usb_add_hcd+0x235/0x770
    [<ffffffff817b0e7f>] usb_hcd_pci_probe+0x1af/0x430
    [<ffffffff817d4a7c>] xhci_pci_probe+0x2c/0x220
    [<ffffffff81457262>] local_pci_probe+0x42/0xa0
    [<ffffffff81073184>] work_for_cpu_fn+0x14/0x20
    [<ffffffff81077070>] process_one_work+0x1d0/0x4d0
    [<ffffffff810775e3>] worker_thread+0x273/0x540
    [<ffffffff8107cef4>] kthread+0xd4/0xf0
    [<ffffffff81a7a28f>] ret_from_fork+0x1f/0x40
    [<ffffffffffffffff>] 0xffffffffffffffff
unreferenced object 0xffff8817dfc2fba8 (size 8):
  comm "kworker/0:1", pid 210, jiffies 4294703952 (age 71529.273s)
  hex dump (first 8 bytes):
    21 01 e0 04 00 00 00 00                          !.......
  backtrace:
    [<ffffffff81a753a8>] kmemleak_alloc+0x28/0x50
    [<ffffffff8119a8d7>] __kmalloc+0x1d7/0x290
    [<ffffffff817cb8d3>] xhci_mem_init+0x9c3/0xf80
    [<ffffffff817c3d78>] xhci_init+0xa8/0x1a0
    [<ffffffff817c4506>] xhci_gen_setup+0x2c6/0x3d0
    [<ffffffff817d49ff>] xhci_pci_setup+0x3f/0x90
    [<ffffffff8179f375>] usb_add_hcd+0x235/0x770
    [<ffffffff817b0e7f>] usb_hcd_pci_probe+0x1af/0x430
    [<ffffffff817d4a7c>] xhci_pci_probe+0x2c/0x220
    [<ffffffff81457262>] local_pci_probe+0x42/0xa0
    [<ffffffff81073184>] work_for_cpu_fn+0x14/0x20
    [<ffffffff81077070>] process_one_work+0x1d0/0x4d0
    [<ffffffff810775e3>] worker_thread+0x273/0x540
    [<ffffffff8107cef4>] kthread+0xd4/0xf0
    [<ffffffff81a7a28f>] ret_from_fork+0x1f/0x40
    [<ffffffffffffffff>] 0xffffffffffffffff
<<end check kmemleak>>
********************
<<clean subcase>>
********************


#########################################################################
perf_events_cpu (keyword: ) test results:
*1 Default cpu statistics(do_test1)                            PASS  
*2 Various basic CPU statistics(do_test2)                      PASS  
*3 check testcase call trace(do_check_call_trace)              PASS  
*4 check kmemleak(do_check_kmemleak)                           FAIL  
ERROR CMD OR INFO IS :
		line:217 "There is kmemleak for this testcase"
Test Summary
Total number : 4
Pass number  : 3
Fail number  : 1
Skip number  : 0
Excution Time: 50 seconds

######################################################### 

Steps to Reproduce

                                                            
#################################################################################################################################### 

Test case Author:  lei.yang
------------------
Project Build Path:
------------------
pek-lpgtest16.wrs.com.wrs.com:/buildarea1/jhu2/wrl9/intel-skylake/build

To Get The Testing Layer:
------------------------
# git clone git://git.wrs.com/git/projects/wassp-repos/testcases/wrlinux
# cd wrlinux;git checkout master

Project Build:
----------------------
    --machines=intel-skylake-avx512-64 --kernel=preempt-rt --distros=wrlinux-std-sato --base-url git://pek-git.wrs.com --dl-layers
    Build Steps:
    . environment-setup-x86_64-wrlinuxsdk-linux
    . oe-init-build-env
    Add BTS layer  
    1.bitbake-layers add-layer <path to wr-testing/bts-dev>
    2.echo 'require templates/feature/bts/template.conf' >> conf/local.conf
    3.bitbake wrlinux-image-glibc-std

Build Configuration:
----------------------------
BB_VERSION        = '1.32.0'
BUILD_SYS         = 'x86_64-linux'
NATIVELSBSTRING   = 'CentOSLinux-7.2.1511'
DISTRO            = 'wrlinux-std-sato'
DISTRO_VERSION    = '9.0.0.0'
MACHINE           = 'intel-skylake-avx512-64'
DEFAULTTUNE       = 'skylake-avx512-64'
TARGET_SYS        = 'x86_64-wrs-linux'
TUNE_FEATURES     = 'm64 haswell haswell-ep skylake mpx avx512'
TARGET_FPU        = ''
lib32:  DEFAULTTUNE       = 'skylake-avx512-32'
lib32:  TARGET_SYS        = 'i686-wrsmllib32-linux'
lib32:  TUNE_FEATURES     = 'm32 haswell haswell-ep skylake mpx avx512'
wr-base           = 'HEAD:2c735d7b8a43f84c1e68d44ff7c90dc52e6dc368'
wr-fixes          = 'HEAD:86020b2b2b961e3bb447b54184e817ac131eb7a9'
wrlinux           = 'HEAD:67765f6534b125121593bd943334a7b48e770078'
intel-skylake     = 'HEAD:04e0a6cb8a4e071df4372299c572dbc258882f9b'
meta              = 'HEAD:2583e6212b08650242ae5d570b2c684e9ced4bf3'
meta-initramfs    
meta-python       
meta-networking   
meta-oe           
meta-perl         
meta-webserver    = 'HEAD:62c6dadb1aa8900f787a664a8c2bfe68734c2a6c'
wr-template       = 'HEAD:d1f165f234f11376a31b99ec2aaef4843d9c6ded'
wr-kernel         = 'HEAD:9066d22ea9d9e274d72f04d2e055ec6404670e2b'
intel-x86         = 'HEAD:04e0a6cb8a4e071df4372299c572dbc258882f9b'
meta-filesystems  = 'HEAD:62c6dadb1aa8900f787a664a8c2bfe68734c2a6c'
meta-realtime     
meta-virtualization = 'HEAD:9066d22ea9d9e274d72f04d2e055ec6404670e2b'
wr-base-dl        = 'HEAD:aa1eab16a8c351551912bc3b20a3d41896036cbc'
oe-core-dl-2.2    = 'HEAD:c4e4e415289e6bee73aebc12a68b0feb7609bd93'
meta-initramfs-dl-2.2 = 'HEAD:1347989107c2f97644b18d862f850fd4dc0e104e'
meta-python-dl-2.2 = 'HEAD:b7397cb44fb80d3a19b6ef92f4a44de7ffddf53c'
meta-networking-dl-2.2 = 'HEAD:39bd9c511d73eaaba0ab150c65058c0ba563f8e0'
meta-oe-dl-2.2    = 'HEAD:d4fa23b0fb27000142f6468c8fb72761fd0b53c6'
meta-perl-dl-2.2  = 'HEAD:4d65c8cf72a198d849104cd3f213b6f3777f7431'
meta-webserver-dl-2.2 = 'HEAD:ec10bc34d57bd4f8f1a8ff4d6fff993d45c754a0'
wr-kernel-dl      = 'HEAD:f9d20574ab2f63288ecdca850573e0d372577e36'
meta-filesystems-dl-2.2 = 'HEAD:ffa26ce28c1a1ddd181aedc6dbc95c2b539f35a4'
local             = 'master:f51d166e869a5fc65db0e13613a524f7b51c8371'
bts-dev           = 'master:bf481b51d81fe4b8b652d21d2630f2a755efd2ce'


Kernel source top 10 commits:
----------------------------
Paul Gortmaker c8b3e7d bfq-iosched: fix compile warning about possibly used uninitialized Wed Nov 16 15:55:59 2016 -0800
Li Zhou ad55401 Revert 'net: sysrq via icmp' Wed Nov 16 13:15:21 2016 -0800
Zhang Xiao 5ee68c8 preempt-rt: workqueue use normal rcu Wed Nov 16 13:15:21 2016 -0800
Qi Hou f9e3a2e tcp: substitute raw spinlock for spinlock in jprobe Wed Nov 16 13:15:20 2016 -0800
Li Zhou 6a61fa3 locking-selftest: change some rwlock tests' expected results for rt kernel Wed Nov 16 13:15:20 2016 -0800
Li Zhou 58c6539 trace: use raw_local_irq_save/restore to avoid trace code loop Wed Nov 16 13:15:19 2016 -0800
Qi Hou fa165cd fix failure to build the preempt_rt kernel of axxiaarm with DEBUG_LOCKING_API_SELFTESTS enabled. Wed Nov 16 13:15:19 2016 -0800
Jianchuan Wang a248aa7 locking_selftest: Save/restore migrate_disable_atomic in locking selftest Wed Nov 16 13:15:18 2016 -0800
Liwei Song 37655ae events/core: make event activation/deactivation RT safe Wed Nov 16 13:15:18 2016 -0800
He Zhe 4c95017 kdb: disable kdb_summary command in preempt context Wed Nov 16 13:15:17 2016 -0800

Kernel config enabled by the testing layer:
------------------------------------------
CONFIG_DEBUG_KMEMLEAK=y
CONFIG_DEBUG_KMEMLEAK_EARLY_LOG_SIZE=5000
CONFIG_IOSCHED_BFQ=y
CONFIG_DMATEST=m
CONFIG_USB_SERIAL_PL2303=y
CONFIG_CMA_DEBUG=y
CONFIG_UIO_PCI_GENERIC=m
CONFIG_USB_USBNET=y
CONFIG_USB_NET_DM9601=y
CONFIG_IOSCHED_BFQ=y

Kernel Boot Parameter:
---------------------
root@128.224.179.153:/opt/wr-test/testcases/bts/perf_events_cpu# cat /proc/cmdline
kernel console=ttyS0,115200 root=/dev/nfs nfsroot=128.224.165.20:/export/pxeboot/vlm-boards/24854/rootfs rw ip=dhcp selinux=0 enforcing=0 intel_iommu=off

To reproduce it:
---------------
# /opt/wr-test/testcases/bts/perf_events_cpu/runtest.sh
=============
Extra Info:
=============
Live chat
Online