Kernel panic in 5.9.14 20.11.10


Recommended Posts

I thought I'd rebuild the NAS with the latest image in the hope that it would be more stable. Unfortunately my hopes were in vain. I was in the middle of doing an rsync and it crashed with a kernel panic. Had a look on the forum and implemented the two suggestions of limiting the cpu to 1200MHz and tweaking the voltages. CPU @ 50c as reported in the login header. Anyway after updating the setting I reboot it and it crashed immediately ! The same SMP issue that seems to have been plaguing this board since release :(

 

Quote

[  231.154881] reboot: Restarting system
DDR Version 1.24 20191016
In
soft reset
SRX
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 323
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 82367
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xe5674
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.10-armbian (Jan 05 2021 - 00:07:57 +0100)

SoC: Rockchip rk3399
Reset cause: RST
DRAM:  3.9 GiB
PMIC:  RK808
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
starting USB...
Bus usb@fe380000: USB EHCI 1.00
Bus dwc3: usb maximum-speed not found
Register 2000140 NbrPorts 2
Starting the controller
USB XHCI 1.10
scanning bus usb@fe380000 for devices... 1 USB Device(s) found
scanning bus dwc3 for devices... cannot reset port 4!?
4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3279 bytes read in 5 ms (639.6 KiB/s)
## Executing script at 00500000
dev: vdd_log @ vdd-log
dev: vdd_center @ DCDC_REG1
Boot script loaded from mmc 1
166 bytes read in 4 ms (40 KiB/s)
16185666 bytes read in 695 ms (22.2 MiB/s)
27507200 bytes read in 1172 ms (22.4 MiB/s)
81968 bytes read in 12 ms (6.5 MiB/s)
2698 bytes read in 8 ms (329.1 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
Moving Image from 0x2080000 to 0x2200000, end=3cd0000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    16185602 Bytes = 15.4 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f4f80000, end f5eef902 ... OK
   Loading Device Tree to 00000000f4f03000, end 00000000f4f7ffff ... OK

Starting kernel ...

[   23.337713] Internal error: Oops: 96000021 [#1] PREEMPT SMP
[   23.338213] Modules linked in: r8152 snd_soc_hdmi_codec snd_soc_rockchip_i2s snd_soc_core snd_pcm_dmaengine leds_pwm snd_pcm pwm_fan gpio_charger snd_timer snd rockchip_vdec(C) panfrost hantro_vpu(C) soundcore rockchip_rga gpu_sched rockchipdrm v4l2_h264 fusb302 videobuf2_dma_contig videobuf2_dma_sg dw_mipi_dsi v4l2_mem2mem videobuf2_vmalloc tcpm dw_hdmi videobuf2_memops analogix_dp typec drm_kms_helper videobuf2_v4l2 videobuf2_common cec videodev rc_core mc drm sg drm_panel_orientation_quirks gpio_beeper cpufreq_dt zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) nfsd auth_rpcgss nfs_acl zcommon(POE) lockd znvpair(POE) zavl(POE) grace icp(POE) spl(OE) ledtrig_netdev sunrpc lm75 ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md_mod realtek dwmac_rk stmmac_platform stmmac mdio_xpcs adc_keys
[   23.345003] CPU: 4 PID: 0 Comm: swapper/4 Tainted: P         C OE     5.9.14-rockchip64 #20.11.4
[   23.345778] Hardware name: Helios64 (DT)
[   23.346130] pstate: 80000085 (Nzcv daIf -PAN -UAO BTYPE=--)
[   23.346650] pc : flush_smp_call_function_queue+0x40/0x250
[   23.346658] lr : flush_smp_call_function_queue+0x28/0x250
[   23.347617] sp : ffff800011afbf20
[   23.347620] x29: ffff800011afbf20 x28: ffff0000f6ead700
[   23.348397] x27: 0000000000000001 x26: ffff800011522db0
[   23.348402] x25: 0000000000000004 x24: 0000000000000000
[   23.349350] x23: ffff800011bc3df0 x22: 0000000000000001
[   23.349358] x21: ffff8000e6283000 x20: ffff800011525a40
[   23.350300] x19: ffff800011522db0 x18: 0000000000000000
[   23.350306] x17: 0000000000000000 x16: 0000000000000000
[   23.351246] x15: 0000000000000000 x14: 00000000000000ef
[   23.351251] x13: 00000000000001b5 x12: 0000000000000002
[   23.351255] x11: 0000000000000001 x10: 0000000000000a30
[   23.352666] x9 : ffff800011bc3e80 x8 : ffff0000f6eae190
[   23.352672] x7 : 00000000ffffffff x6 : 000000003d5e8871
[   23.353615] x5 : 00ffffffffffffff x4 : ffff8000e6283000
[   23.353622] x3 : ca72b5330aec0004 x2 : ffff800011839988
[   23.354564] x1 : 0000000000000000 x0 : 0000000000000004
[   23.354571] Call trace:
[   23.355269]  flush_smp_call_function_queue+0x40/0x250
[   23.355277]  generic_smp_call_function_single_interrupt+0x14/0x20
[   23.356265]  handle_IPI+0x10c/0x3c8
[   23.356274]  gic_handle_irq+0x168/0x170
[   23.356927]  el1_irq+0xb8/0x180
[   23.356933]  arch_cpu_idle+0x14/0x20
[   23.356939]  do_idle+0x1fc/0x270
[   23.356946]  cpu_startup_entry+0x28/0x60
[   23.358179]  secondary_start_kernel+0x16c/0x180
[   23.358189] Code: d2800001 f8605855 8b150283 f9800071 (c85f7c60)
[   23.359142] ---[ end trace d7f9c88f93daf07b ]---
[   23.359147] Kernel panic - not syncing: Fatal exception in interrupt
[   23.360124] SMP: stopping secondary CPUs
[   23.360484] Kernel Offset: disabled
[   23.360489] CPU features: 0x0240022,2000200c
[   23.360491] Memory Limit: none
[   23.361461] Rebooting in 90 seconds..

 

Link to post
Share on other sites
Donate and support the project!

Hi,

I don't own this device (yet), but I'm considering getting one from the next batch.

So I did a little research into its mainlining status. The board should benefit from the RK3399 being a popular SoC for SBCs.

The mainline kernel contains a device tree file that was added by this commit back in October.

The dts file contains this comment:

/*
 * The system doesn't run stable with cpu freq enabled, so disallow the lower
 * frequencies until this problem is properly understood and resolved.
 */

After the comment, all CPU frequencies except the respective highest one on each cluster are disabled.

I'm not sure whether the current Armbian kernel also does this (it does disable additional higher overclocked frequencies which aren't present in the mainline kernel).

 

Unfortunately, there is no reason given for the choice of the highest frequencies.

But I'd give them a try. That would be 1416MHz for the A53 cluster and 1800 MHz for the A72 cluster.

Link to post
Share on other sites

@edwinistrator we did recommend the Debian maintainer to try the following tweak at that time,

Quote

Hi Uwe,

 

Can you try to add the following in /etc/sysfs.conf

 

devices/system/cpu/cpufreq/policy0/scaling_min_freq = 1416000
devices/system/cpu/cpufreq/policy4/scaling_min_freq = 1800000
devices/system/cpu/cpufreq/policy0/scaling_max_freq = 1416000
devices/system/cpu/cpufreq/policy4/scaling_max_freq = 1800000

 

Then reboot your system.

and according to Uwe, it does improve the stability.

 

On 2/6/2021 at 5:17 AM, edwinistrator said:

I'm not sure whether the current Armbian kernel also does this

currently we still use the lower freq but we are considering to also disable those lower freq and maybe also disable DVFS (just use one fixed clock speed), since we received many instability reported and some has good outcome when cpu clock limited to 1200 MHz.

 

Link to post
Share on other sites
Quote

DDR Version 1.24 20191016
In
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x82
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 254
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 79784
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xe5674
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.10-armbian (Jan 05 2021 - 00:07:57 +0100)

SoC: Rockchip rk3399
Reset cause: POR
DRAM:  3.9 GiB
PMIC:  RK808
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
starting USB...
Bus usb@fe380000: USB EHCI 1.00
Bus dwc3: usb maximum-speed not found
Register 2000140 NbrPorts 2
Starting the controller
USB XHCI 1.10
scanning bus usb@fe380000 for devices... 1 USB Device(s) found
scanning bus dwc3 for devices... cannot reset port 4!?
4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3279 bytes read in 5 ms (639.6 KiB/s)
## Executing script at 00500000
dev: vdd_log @ vdd-log
dev: vdd_center @ DCDC_REG1
Boot script loaded from mmc 1
166 bytes read in 4 ms (40 KiB/s)
16181568 bytes read in 696 ms (22.2 MiB/s)
27507200 bytes read in 1168 ms (22.5 MiB/s)
81968 bytes read in 13 ms (6 MiB/s)
2698 bytes read in 8 ms (329.1 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
Moving Image from 0x2080000 to 0x2200000, end=3cd0000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    16181504 Bytes = 15.4 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f4f81000, end f5eef900 ... OK
   Loading Device Tree to 00000000f4f04000, end 00000000f4f80fff ... OK

Starting kernel ...

[   24.738473] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: sched_ttwu_pending+0x160/0x160
[   24.739419] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P         C OE     5.9.14-rockchip64 #20.11.4
[   24.740194] Hardware name: Helios64 (DT)
[   24.740546] Call trace:
[   24.740772]  dump_backtrace+0x0/0x200
[   24.741103]  show_stack+0x18/0x28
[   24.741406]  dump_stack+0xc0/0x11c
[   24.741714]  panic+0x164/0x364
[   24.741992]  __stack_chk_fail+0x3c/0x40
[   24.742336]  send_call_function_single_ipi+0x0/0x20
[   24.742775]  flush_smp_call_function_queue+0x114/0x250
[   24.743234]  generic_smp_call_function_single_interrupt+0x14/0x20
[   24.743779]  handle_IPI+0x10c/0x3c8
[   24.744096]  gic_handle_irq+0x168/0x170
[   24.744440]  el1_irq+0xb8/0x180
[   24.744724]  arch_cpu_idle+0x14/0x20
[   24.745046]  do_idle+0x1fc/0x270
[   24.745337]  cpu_startup_entry+0x24/0x60
[   24.745690]  secondary_start_kernel+0x16c/0x180
[   24.746099] SMP: stopping secondary CPUs
[   24.746456] Kernel Offset: disabled
[   24.746770] CPU features: 0x0240022,2000200c
[   24.747149] Memory Limit: none
[   24.747435] Rebooting in 90 seconds..

 

Link to post
Share on other sites
Quote

DDR Version 1.24 20191016
In
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x82
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 254
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 79784
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xe5674
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.10-armbian (Jan 05 2021 - 00:07:57 +0100)

SoC: Rockchip rk3399
Reset cause: POR
DRAM:  3.9 GiB
PMIC:  RK808
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
starting USB...
Bus usb@fe380000: USB EHCI 1.00
Bus dwc3: usb maximum-speed not found
Register 2000140 NbrPorts 2
Starting the controller
USB XHCI 1.10
scanning bus usb@fe380000 for devices... 1 USB Device(s) found
scanning bus dwc3 for devices... cannot reset port 4!?
4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3279 bytes read in 5 ms (639.6 KiB/s)
## Executing script at 00500000
dev: vdd_log @ vdd-log
dev: vdd_center @ DCDC_REG1
Boot script loaded from mmc 1
166 bytes read in 4 ms (40 KiB/s)
16181568 bytes read in 696 ms (22.2 MiB/s)
27507200 bytes read in 1168 ms (22.5 MiB/s)
81968 bytes read in 13 ms (6 MiB/s)
2698 bytes read in 8 ms (329.1 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
Moving Image from 0x2080000 to 0x2200000, end=3cd0000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    16181504 Bytes = 15.4 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f4f81000, end f5eef900 ... OK
   Loading Device Tree to 00000000f4f04000, end 00000000f4f80fff ... OK

Starting kernel ...

[   24.738473] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: sched_ttwu_pending+0x160/0x160
[   24.739419] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P         C OE     5.9.14-rockchip64 #20.11.4
[   24.740194] Hardware name: Helios64 (DT)
[   24.740546] Call trace:
[   24.740772]  dump_backtrace+0x0/0x200
[   24.741103]  show_stack+0x18/0x28
[   24.741406]  dump_stack+0xc0/0x11c
[   24.741714]  panic+0x164/0x364
[   24.741992]  __stack_chk_fail+0x3c/0x40
[   24.742336]  send_call_function_single_ipi+0x0/0x20
[   24.742775]  flush_smp_call_function_queue+0x114/0x250
[   24.743234]  generic_smp_call_function_single_interrupt+0x14/0x20
[   24.743779]  handle_IPI+0x10c/0x3c8
[   24.744096]  gic_handle_irq+0x168/0x170
[   24.744440]  el1_irq+0xb8/0x180
[   24.744724]  arch_cpu_idle+0x14/0x20
[   24.745046]  do_idle+0x1fc/0x270
[   24.745337]  cpu_startup_entry+0x24/0x60
[   24.745690]  secondary_start_kernel+0x16c/0x180
[   24.746099] SMP: stopping secondary CPUs
[   24.746456] Kernel Offset: disabled
[   24.746770] CPU features: 0x0240022,2000200c
[   24.747149] Memory Limit: none
[   24.747435] Rebooting in 90 seconds..
DDR Version 1.24 20191016
In
soft reset
SRX
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x82
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 322
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 80909
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xe5674
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.10-armbian (Jan 05 2021 - 00:07:57 +0100)

SoC: Rockchip rk3399
Reset cause: RST
DRAM:  3.9 GiB
PMIC:  RK808
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
starting USB...
Bus usb@fe380000: USB EHCI 1.00
Bus dwc3: usb maximum-speed not found
Register 2000140 NbrPorts 2
Starting the controller
USB XHCI 1.10
scanning bus usb@fe380000 for devices... 1 USB Device(s) found
scanning bus dwc3 for devices... cannot reset port 4!?
4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3279 bytes read in 5 ms (639.6 KiB/s)
## Executing script at 00500000
dev: vdd_log @ vdd-log
dev: vdd_center @ DCDC_REG1
Boot script loaded from mmc 1
166 bytes read in 4 ms (40 KiB/s)
16181568 bytes read in 691 ms (22.3 MiB/s)
27507200 bytes read in 1168 ms (22.5 MiB/s)
81968 bytes read in 13 ms (6 MiB/s)
2698 bytes read in 8 ms (329.1 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
Moving Image from 0x2080000 to 0x2200000, end=3cd0000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    16181504 Bytes = 15.4 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f4f81000, end f5eef900 ... OK
   Loading Device Tree to 00000000f4f04000, end 00000000f4f80fff ... OK

Starting kernel ...

[   40.035068] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: sched_ttwu_pending+0x160/0x160
[   40.036021] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P         C OE     5.9.14-rockchip64 #20.11.4
[   40.036797] Hardware name: Helios64 (DT)
[   40.037148] Call trace:
[   40.037375]  dump_backtrace+0x0/0x200
[   40.037705]  show_stack+0x18/0x28
[   40.038006]  dump_stack+0xc0/0x11c
[   40.038314]  panic+0x164/0x364
[   40.038591]  __stack_chk_fail+0x3c/0x40
[   40.038935]  send_call_function_single_ipi+0x0/0x20
[   40.039372]  flush_smp_call_function_queue+0x114/0x250
[   40.039832]  generic_smp_call_function_single_interrupt+0x14/0x20
[   40.040377]  handle_IPI+0x10c/0x3c8
[   40.040695]  gic_handle_irq+0x168/0x170
[   40.041039]  el1_irq+0xb8/0x180
[   40.041324]  arch_cpu_idle+0x14/0x20
[   40.041646]  do_idle+0x1fc/0x270
[   40.041937]  cpu_startup_entry+0x24/0x60
[   40.042288]  secondary_start_kernel+0x16c/0x180
[   40.042698] SMP: stopping secondary CPUs
[   40.043054] Kernel Offset: disabled
[   40.043365] CPU features: 0x0240022,2000200c
[   40.043746] Memory Limit: none
[   40.044033] Rebooting in 90 seconds..
DDR Version 1.24 20191016
In
soft reset
SRX
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x2
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 324
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 80419
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xe5674
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.10-armbian (Jan 05 2021 - 00:07:57 +0100)

SoC: Rockchip rk3399
Reset cause: RST
DRAM:  3.9 GiB
PMIC:  RK808
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
starting USB...
Bus usb@fe380000: USB EHCI 1.00
Bus dwc3: usb maximum-speed not found
Register 2000140 NbrPorts 2
Starting the controller
USB XHCI 1.10
scanning bus usb@fe380000 for devices... 1 USB Device(s) found
scanning bus dwc3 for devices... cannot reset port 4!?
4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3279 bytes read in 6 ms (533.2 KiB/s)
## Executing script at 00500000
dev: vdd_log @ vdd-log
dev: vdd_center @ DCDC_REG1
Boot script loaded from mmc 1
166 bytes read in 4 ms (40 KiB/s)
16181568 bytes read in 697 ms (22.1 MiB/s)
27507200 bytes read in 1174 ms (22.3 MiB/s)
81968 bytes read in 13 ms (6 MiB/s)
2698 bytes read in 8 ms (329.1 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
Moving Image from 0x2080000 to 0x2200000, end=3cd0000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    16181504 Bytes = 15.4 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f4f81000, end f5eef900 ... OK
   Loading Device Tree to 00000000f4f04000, end 00000000f4f80fff ... OK

Starting kernel ...

[   38.759473] Internal error: Oops: 9600004e [#1] PREEMPT SMP
[   38.759976] Modules linked in: snd_soc_hdmi_codec r8152 fusb302 pwm_fan hantro_vpu(C) leds_pwm rockchip_vdec(C) snd_soc_rockchip_i2s gpio_charger v4l2_h264 panfrost tcpm snd_soc_core rockchip_rga videobuf2_dma_contig snd_pcm_dmaengine typec v4l2_mem2mem gpu_sched snd_pcm videobuf2_dma_sg videobuf2_vmalloc videobuf2_memops snd_timer videobuf2_v4l2 snd videobuf2_common soundcore videodev sg mc rockchipdrm dw_mipi_dsi dw_hdmi analogix_dp drm_kms_helper cec rc_core drm drm_panel_orientation_quirks gpio_beeper cpufreq_dt zfs(POE) zunicode(POE) zzstd(OE) nfsd zlua(OE) auth_rpcgss zcommon(POE) nfs_acl znvpair(POE) zavl(POE) lockd icp(POE) grace spl(OE) ledtrig_netdev lm75 sunrpc ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md_mod realtek dwmac_rk stmmac_platform stmmac mdio_xpcs adc_keys
[   38.766762] CPU: 5 PID: 0 Comm: swapper/5 Tainted: P         C OE     5.9.14-rockchip64 #20.11.4
[   38.767536] Hardware name: Helios64 (DT)
[   38.767890] pstate: 20000085 (nzCv daIf -PAN -UAO BTYPE=--)
[   38.768392] pc : __update_load_avg_se+0x44/0x310
[   38.768808] lr : update_load_avg+0x4e4/0x5f0
[   38.769186] sp : ffff800011b03d40
[   38.769483] x29: ffff800011b03d40 x28: ffff0000f6eae580
[   38.769956] x27: 0000000000000001 x26: ffff800011522db0
[   38.770428] x25: 0000000000000005 x24: ffff0000f6fa00c0
[   38.770900] x23: ffff0000f77c7c40 x22: 0000000000000005
[   38.771372] x21: 0000000903da1aad x20: ffff0000f6fa00c0
[   38.771844] x19: ffff0000f77c7cc0 x18: 0000000000000004
[   38.772315] x17: 0000000000000001 x16: 0000000000000019
[   38.772786] x15: ffff80001185a098 x14: ffffffffffffffff
[   38.773257] x13: 000000000000021e x12: 000000000000010f
[   38.773729] x11: 0000000000000001 x10: 0000000000000a30
[   38.774200] x9 : 0000000000000000 x8 : 0000000000000000
[   38.774672] x7 : 0000000000000000 x6 : ffff0000f6fa0180
[   38.775143] x5 : 0000000000000060 x4 : 0000000903d89800
[   38.775614] x3 : 00000000000182ad x2 : ffff0000f6fa00c0
[   38.776085] x1 : ffff0000f77c7cc0 x0 : 0000000903da1aad
[   38.776557] Call trace:
[   38.776781]  __update_load_avg_se+0x44/0x310
[   38.777163]  update_load_avg+0x4e4/0x5f0
[   38.777515]  enqueue_entity+0x68/0x228
[   38.777851]  enqueue_task_fair+0x94/0x450
[   38.778210]  ttwu_do_activate+0x88/0x150
[   38.778561]  sched_ttwu_pending+0xbc/0x160
[   38.778931]  flush_smp_call_function_queue+0x114/0x250
[   38.779390]  generic_smp_call_function_single_interrupt+0x14/0x20
[   38.779932]  handle_IPI+0x10c/0x3c8
[   38.780248]  gic_handle_irq+0x168/0x170
[   38.780592]  el1_irq+0xb8/0x180
[   38.780876]  arch_cpu_idle+0x14/0x20
[   38.781198]  do_idle+0x1fc/0x270
[   38.781488]  cpu_startup_entry+0x24/0x60
[   38.781841]  secondary_start_kernel+0x16c/0x180
[   38.782251] Code: eb040003 540008e4 d34afc65 b40007e5 (a90153f3)
[   38.782801] ---[ end trace 750eb2db6f8efac2 ]---
[   38.783213] Kernel panic - not syncing: Fatal exception in interrupt
[   38.783776] SMP: stopping secondary CPUs
[   38.784134] Kernel Offset: disabled
[   38.784447] CPU features: 0x0240022,2000200c
[   38.784826] Memory Limit: none
[   38.785113] Rebooting in 90 seconds..

 

Link to post
Share on other sites