RlndVt

I'm not using the 2.5Gbps port fwiw, but I did have a crash a few days ago: [830618.309898] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: return_address+0x78/0x78 [830618.310813] CPU: 5 PID: 67 Comm: kswapd0 Tainted: G C 6.6.0-edge-rockchip64 #1 [830618.311578] Hardware name: Helios64 (DT) [830618.311933] Call trace: [830618.312159] dump_backtrace+0x98/0x118 [830618.312502] show_stack+0x18/0x24 [830618.312805] dump_stack_lvl+0x48/0x60 [830618.313141] dump_stack+0x18/0x24 [830618.313443] panic+0x31c/0x388 [830618.313723] __ktime_get_real_seconds+0x0/0xc [830618.314121] c_start+0x0/0x10 [830618.314394] preempt_count_add+0xfc/0x130 [830618.314759] _raw_spin_lock+0x1c/0x7c [830618.315095] test_range_bit+0x40/0x1e4 [830618.315438] try_release_extent_mapping+0x198/0x240 [830618.315877] btrfs_release_folio+0x48/0xcc [830618.316249] filemap_release_folio+0x78/0xbc [830618.316637] shrink_folio_list+0xab4/0xd64 [830618.317009] evict_folios+0x230/0x5c8 [830618.317342] try_to_shrink_lruvec+0x1b0/0x2a8 [830618.317736] shrink_one+0x15c/0x234 [830618.318054] shrink_node+0x988/0xd8c [830618.318381] balance_pgdat+0x388/0x868 [830618.318723] kswapd+0x24c/0x538 [830618.319014] kthread+0xfc/0x108 [830618.319302] ret_from_fork+0x10/0x20 [830618.319630] SMP: stopping secondary CPUs [830618.319990] Kernel Offset: disabled [830618.320307] CPU features: 0x1,00000208,24020000,1000421b [830618.320783] Memory Limit: none [830618.321068] ---[ end Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: return_address+0x78/0x78 ]--- Going to revert to buster. (5.15.) Buster has been 99% stable for me. Might consider attempting bullseye.

Thanks, I've installed 6.1.58; but got the same kernel problem as previously on my second boot. (First and third were okay.) I'm going to try the 6.6.0 version now. (E: 6.6.0 had two kernel crashes but booted on the third.) Could you share how you patched 6.1.xx versions?

FWIW 23.02.2/5.15.93 crashes on shutdown. [ OK ] Reached target reboot.target - System Reboot. [10787.888857] watchdog: watchdog0: watchdog did not stop! [10788.208644] xhci-hcd xhci-hcd.3.auto: Host halt failed, -110 [10788.209246] ------------[ cut here ]------------ [10788.209658] WARNING: CPU: 1 PID: 1 at drivers/gpu/drm/drm_modeset_lock.c:266 drm_modeset_lock+0xe4/0x108 [10788.210510] Modules linked in: rfkill ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables binfmt_misc ip6t_rt ipt_REJECT leds_pwm gpio_charger nf_reject_ipv4 xt_LOG pwm_fan panfrost snd_soc_hdmi_codec snd_soc_rockchip_i2s gpu_sched nf_log_syslog snd_soc_rockchip_pcm xt_multiport snd_soc_core hantro_vpu(C) rockchip_vdec(C) rockchip_rga xt_comment rockchip_iep v4l2_h264 snd_pcm_dmaengine videobuf2_dma_contig videobuf2_dma_sg videobuf2_vmalloc v4l2_mem2mem nft_limit snd_pcm videobuf2_memops videobuf2_v4l2 snd_timer xt_limit videobuf2_common xt_addrtype snd lz4hc videodev lz4 mc soundcore xt_tcpudp xt_conntrack nf_conntrack gpio_beeper cpufreq_dt nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nft_counter sg nf_tables nfnetlink zram nfsd auth_rpcgss nfs_acl lockd grace ledtrig_netdev lm75 sunrpc dm_mod ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md_mod r8152 realtek cdc_ncm cdc_ether usbnet fusb302 tcpm dwmac_rk typec [10788.210772] stmmac_platform stmmac pcs_xpcs adc_keys [10788.218830] CPU: 1 PID: 1 Comm: systemd-shutdow Tainted: G C 5.15.93-rockchip64 #23.02.2 [10788.219659] Hardware name: Helios64 (DT) [10788.220009] pstate: a0000005 (NzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [10788.220626] pc : drm_modeset_lock+0xe4/0x108 [10788.221010] lr : drm_modeset_lock+0x40/0x108 [10788.221393] sp : ffff800009e1bb50 [10788.221689] x29: ffff800009e1bb50 x28: ffff000000680000 x27: 0000000000000000 [10788.222326] x26: ffff000000fce490 x25: ffff8000094bfc80 x24: 0000000000000008 [10788.222962] x23: ffff800009d38050 x22: ffff000008bcf000 x21: ffff8000095504a8 [10788.223599] x20: ffff000008bcf188 x19: ffff800009e1bbe0 x18: 0000000000000010 [10788.224236] x17: 0000000000000000 x16: 0000000000000000 x15: 000000000000035d [10788.224872] x14: ffff800009e1b800 x13: 00000000ffffffea x12: ffff800009b2fe58 [10788.225509] x11: 0000000000000003 x10: ffff800009b17e18 x9 : ffff800009e1bb88 [10788.226145] x8 : ffff800009e1bbb0 x7 : ffff800009e1bbb0 x6 : 0000000000000001 [10788.226781] x5 : 0000000000000000 x4 : ffff800009e1bbe0 x3 : ffff000008bcf188 [10788.227418] x2 : 0000000000000000 x1 : ffff000008bcf1b0 x0 : 0000000000000000 [10788.228055] Call trace: [10788.228276] drm_modeset_lock+0xe4/0x108 [10788.228629] drm_modeset_lock_all_ctx+0x28/0xf8 [10788.229037] drm_atomic_helper_shutdown+0x74/0x130 [10788.229468] rockchip_drm_platform_shutdown+0x18/0x28 [10788.229921] platform_shutdown+0x24/0x38 [10788.230275] device_shutdown+0x148/0x240 [10788.230629] kernel_restart_prepare+0x38/0x48 [10788.231023] kernel_restart+0x18/0x68 [10788.231353] __do_sys_reboot+0x220/0x248 [10788.231706] __arm64_sys_reboot+0x24/0x30 [10788.232067] invoke_syscall+0x44/0x108 [10788.232407] el0_svc_common.constprop.3+0x94/0xf8 [10788.232828] do_el0_svc+0x24/0x98 [10788.233127] el0_svc+0x20/0x50 [10788.233406] el0t_64_sync_handler+0x90/0xb8 [10788.233780] el0t_64_sync+0x180/0x184 [10788.234110] ---[ end trace 744dd2aea6b1d549 ]--- [10788.234544] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000018 [10788.235352] Mem abort info: [10788.235618] ESR = 0x0000000096000004 [10788.235950] EC = 0x25: DABT (current EL), IL = 32 bits [10788.236417] SET = 0, FnV = 0 [10788.236687] EA = 0, S1PTW = 0 [10788.236964] FSC = 0x04: level 0 translation fault [10788.237391] Data abort info: [10788.237645] ISV = 0, ISS = 0x00000004 [10788.237981] CM = 0, WnR = 0 [10788.238244] user pgtable: 4k pages, 48-bit VAs, pgdp=00000000096eb000 [10788.238809] [0000000000000018] pgd=0000000000000000, p4d=0000000000000000 [10788.239408] Internal error: Oops: 96000004 [#1] PREEMPT SMP [10788.239898] Modules linked in: rfkill ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables binfmt_misc ip6t_rt ipt_REJECT leds_pwm gpio_charger nf_reject_ipv4 xt_LOG pwm_fan panfrost snd_soc_hdmi_codec snd_soc_rockchip_i2s gpu_sched nf_log_syslog snd_soc_rockchip_pcm xt_multiport snd_soc_core hantro_vpu(C) rockchip_vdec(C) rockchip_rga xt_comment rockchip_iep v4l2_h264 snd_pcm_dmaengine videobuf2_dma_contig videobuf2_dma_sg videobuf2_vmalloc v4l2_mem2mem nft_limit snd_pcm videobuf2_memops videobuf2_v4l2 snd_timer xt_limit videobuf2_common xt_addrtype snd lz4hc videodev lz4 mc soundcore xt_tcpudp xt_conntrack nf_conntrack gpio_beeper cpufreq_dt nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nft_counter sg nf_tables nfnetlink zram nfsd auth_rpcgss nfs_acl lockd grace ledtrig_netdev lm75 sunrpc dm_mod ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md_mod r8152 realtek cdc_ncm cdc_ether usbnet fusb302 tcpm dwmac_rk typec [10788.240040] stmmac_platform stmmac pcs_xpcs adc_keys [10788.248043] CPU: 4 PID: 1 Comm: systemd-shutdow Tainted: G WC 5.15.93-rockchip64 #23.02.2 [10788.248864] Hardware name: Helios64 (DT) [10788.249209] pstate: a0000005 (NzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [10788.249819] pc : ww_mutex_lock+0x54/0x88 [10788.250170] lr : drm_modeset_lock+0x40/0x108 [10788.250549] sp : ffff800009e1bb40 [10788.250841] x29: ffff800009e1bb40 x28: ffff000000680000 x27: 0000000000000000 [10788.251470] x26: ffff000000fce490 x25: ffff8000094bfc80 x24: 0000000000000008 [10788.252098] x23: 0000000000000000 x22: ffff000008bcf000 x21: ffff000008bcf2d8 [10788.252724] x20: 0000000000000018 x19: ffff800009e1bbe0 x18: 0000000000000010 [10788.253351] x17: 0000000000000000 x16: 0000000000000000 x15: 000000000000035d [10788.253979] x14: ffff800009e1b800 x13: 00000000ffffffea x12: ffff800009b2fe58 [10788.254607] x11: 0000000000000003 x10: ffff800009b17e18 x9 : ffff800009e1bb88 [10788.255234] x8 : ffff800009e1bbb0 x7 : ffff800009e1bbb0 x6 : 0000000000000001 [10788.255862] x5 : 0000000000000000 x4 : ffff800009e1bbe0 x3 : 0000000000000018 [10788.256489] x2 : ffff000000680000 x1 : 0000000000000000 x0 : 0000000000000018 [10788.257117] Call trace: [10788.257334] ww_mutex_lock+0x54/0x88 [10788.257651] drm_modeset_lock+0x40/0x108 [10788.257999] drm_modeset_lock_all_ctx+0x64/0xf8 [10788.258399] drm_atomic_helper_shutdown+0x74/0x130 [10788.258823] rockchip_drm_platform_shutdown+0x18/0x28 [10788.259269] platform_shutdown+0x24/0x38 [10788.259616] device_shutdown+0x148/0x240 [10788.259963] kernel_restart_prepare+0x38/0x48 [10788.260349] kernel_restart+0x18/0x68 [10788.260673] __do_sys_reboot+0x220/0x248 [10788.261021] __arm64_sys_reboot+0x24/0x30 [10788.261375] invoke_syscall+0x44/0x108 [10788.261708] el0_svc_common.constprop.3+0x94/0xf8 [10788.262123] do_el0_svc+0x24/0x98 [10788.262418] el0_svc+0x20/0x50 [10788.262689] el0t_64_sync_handler+0x90/0xb8 [10788.263058] el0t_64_sync+0x180/0x184 [10788.263384] Code: d50323bf d65f03c0 d2800001 f9800071 (c85ffc60) [10788.263920] ---[ end trace 744dd2aea6b1d54a ]--- [10788.264346] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b [10788.265021] Kernel Offset: disabled [10788.265329] CPU features: 0x800820b1,20000846 [10788.265713] Memory Limit: none [10788.265988] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b ]--- U-Boot TPL 2022.07-armbian (Aug 22 2023 - 15:26:42) Channel 0: LPDDR4, 50MHz BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB Channel 1: LPDDR4, 50MHz BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB 256B stride lpddr4_set_rate: change freq to 400000000 mhz 0, 1 lpddr4_set_rate: change freq to 800000000 mhz 1, 0 Trying to boot from BOOTROM Returning to boot ROM... U-Boot SPL 2022.07-armbian (Aug 22 2023 - 15:26:42 +0000) Trying to boot from MMC1 mmc_load_image_raw_sector: mmc block read error Trying to boot from SPI Trying to boot from MMC1 mmc_load_image_raw_sector: mmc block read error Trying to boot from MMC2 mmc_load_image_raw_sector: mmc block read error SPL: failed to boot from all boot devices ### ERROR ### Please RESET the board ###

I reverted linux-image-current-rockchip64 to 23.02.2 (5.15.93-rockchip64) and my system booted. For me some extra confirmation that the problem lies in the kernel version. I did see the same kaslrseed message which I'm ignoring for now. $ apt-cache policy linux-image-current-rockchip64 linux-image-current-rockchip64: Installed: 23.02.2 Candidate: 23.8.1 Version table: 23.8.1 500 500 http://apt.armbian.com bookworm/main arm64 Packages *** 23.02.2 500 500 http://apt.armbian.com bookworm/main arm64 Packages 100 /var/lib/dpkg/status @ebin-dev, could you explain how you built the newer kernel versions? Or point me to a resource that can help me along? I'm hesitant about flashing 6.1.36 as I would like to avoid reconfiguring the install. EDIT: Building the required packages is apparently trivial: `git clone https://github.com/armbian/build` and a `./compile.sh`. The result does however still seem to be missing the required patches. I'm now looking into how to get the right patches into the right place, would love some help.

Did you manually build 6.1.60? I don't see it available through the package manager. I'll try the custom u-boot build. I'm booting from an SD-card. FWIW, as I mention I installed armbian-firmware-full which includes 'rtl8156a-2.fw'. The md5sum matches from git.kernel.org. Glad to hear I'm not alone :). I'll try that soon. I'm guessing that will work because I had been running Armbian 23 for a month till a 'recent' update/broke my system. That is most likely a bug in that version of u-boot. The solution is to flash another bootloader as shown earlier in this thread. Is apparently a intentional change. (I'm assuming that) The error message is the 'gracefully skips' mentioned in the PR. https://github.com/armbian/build/pull/4352

Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... Scanning for Btrfs filesystems registered: /dev/sdd registered: /dev/sdb registered: /dev/sde registered: /dev/sdc registered: /dev/sda done. Begin: Will now check root file system ... fsck from util-linux 2.38.1 [/sbin/fsck.ext4 (1) -- /dev/mmcblk0p1] fsck.ext4 -a -C0 /dev/mmcblk0p1 armbi_root: clean, 56356/1891776 files, 967727/7708672 blocks done. done. Begin: Running /scripts/local-bottom ... /scripts/local-bottom/mdadm: 2: /scripts/local-bottom/mdadm: rm: not found done. Begin: Running /scripts/init-bottom ... done. Welcome to Armbian 23.8.3 bookworm! [...] Starting networking.service - Raise network interfaces... [ 16.458082] Internal error: Oops - Undefined instruction: 0000000002000000 [#1] PREEMPT SMP [ 16.458852] Modules linked in: ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt ipt_REJECT nf_reject_ipv4 xt_LOG nf_log_syslog xt_multiport xt_comment lz4hc nft_limit lz4 leds_pwm gpio_charger pwm_fan rockchip_vdec(C) hantro_vpu panfrost snd_soc_hdmi_codec snd_soc_rockchip_i2s v4l2_vp9 videobuf2_dma_contig v4l2_h264 rockchip_rga gpu_sched xt_limit drm_shmem_helper rockchip_rng snd_soc_core xt_addrtype videobuf2_dma_sg v4l2_mem2mem rng_core snd_compress videobuf2_memops snd_pcm_dmaengine xt_tcpudp videobuf2_v4l2 snd_pcm binfmt_misc videobuf2_common xt_conntrack videodev nf_conntrack snd_timer nf_defrag_ipv6 mc snd nf_defrag_ipv4 nft_compat soundcore nf_tables nfnetlink zram gpio_beeper cpufreq_dt sg ledtrig_netdev lm75 nfsd auth_rpcgss nfs_acl lockd grace dm_mod sunrpc ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md_mod realtek fusb302 tcpm dwmac_rk stmmac_platform stmmac typec pcs_xpcs adc_keys [ 16.466751] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G C 6.1.50-current-rockchip64 #3 [ 16.467567] Hardware name: Helios64 (DT) [ 16.467920] pstate: 200000c5 (nzCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 16.468542] pc : __this_cpu_preempt_check+0x24/0x40 [ 16.468996] lr : ct_nmi_exit+0x80/0x280 [ 16.469348] sp : ffff800009ef3be0 [ 16.469647] x29: ffff800009ef3be0 x28: ffff000000762d00 x27: 0000000000000000 [ 16.470292] x26: ffff000000762d00 x25: 0000000000000000 x24: 0000000000000000 [ 16.470934] x23: ffff0000f779e8f0 x22: ffff800009a3dc70 x21: ffff8000094ea818 [ 16.471575] x20: ffff800009766900 x19: ffff8000097668f0 x18: 0000000000000000 [ 16.472215] x17: ffff8000ee038000 x16: ffff800009d20000 x15: 0000000000000000 [ 16.472857] x14: 0000000000000000 x13: 0000000000000303 x12: 0000000000000000 [ 16.473501] x11: 0000000000000000 x10: 0000000000000000 x9 : ffff0000f77a1f80 [ 16.474142] x8 : 0000000000000005 x7 : ffff0000f77a28f8 x6 : 00000000ffffffff [ 16.474781] x5 : ffff80000959a7e0 x4 : 0000000000000001 x3 : ffff800009757008 [ 16.475422] x2 : ffff000000762d00 x1 : ffff8000094ea818 x0 : 0000000000000005 [ 16.476063] Call trace: [ 16.476286] __this_cpu_preempt_check+0x24/0x40 [ 16.476700] ct_irq_exit+0x10/0x80 [ 16.477014] exit_to_kernel_mode.isra.0+0x20/0x2c [ 16.477440] el1_interrupt+0x58/0x6c [ 16.477766] el1h_64_irq_handler+0x18/0x2c [ 16.478139] el1h_64_irq+0x64/0x68 [ 16.478450] arch_cpu_idle+0x18/0x2c [ 16.478778] default_idle_call+0x38/0x17c [ 16.479143] do_idle+0x23c/0x2b0 [ 16.479442] cpu_startup_entry+0x24/0x30 [ 16.479800] secondary_start_kernel+0x124/0x150 [ 16.480221] __secondary_switched+0xb0/0xb4 [ 16.480627] Code: 9115e040 97ffffa6 a8c17bfd d50323bf (d65f03c0) [ 16.481180] ---[ end trace 0000000000000000 ]--- [ 16.481594] Kernel panic - not syncing: Attempted to kill the idle task! [ 16.482189] SMP: stopping secondary CPUs [ 16.482555] Kernel Offset: disabled [ 16.482869] CPU features: 0x40000,20824084,0000421b [ 16.483308] Memory Limit: none [ 16.483592] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]--- No luck, see kernel panic above. The missing command can be seen below; `Unknown command 'kaslrseed' - try 'help'`: U-Boot 2022.07-armbian (Aug 22 2023 - 15:26:42 +0000) SoC: Rockchip rk3399 Reset cause: POR DRAM: 3.9 GiB PMIC: RK808 Core: 339 devices, 31 uclasses, devicetree: separate SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB MMC: mmc@fe320000: 1, mmc@fe330000: 0 Loading Environment from MMC... *** Warning - bad CRC, using default environment In: serial Out: serial Err: serial Model: Helios64 Revision: 1.2 - 4GB non ECC Net: dw_dm_mdio_init: mdio node is missing, registering legacy mdio busNo ethernet found. scanning bus for devices... Hit any key to stop autoboot: 0 switch to partitions #0, OK mmc1 is current device Scanning mmc 1:1... Found U-Boot script /boot/boot.scr 3252 bytes read in 5 ms (634.8 KiB/s) ## Executing script at 00500000 Boot script loaded from mmc 1 166 bytes read in 4 ms (40 KiB/s) 24417797 bytes read in 1036 ms (22.5 MiB/s) 29792768 bytes read in 1264 ms (22.5 MiB/s) 86670 bytes read in 12 ms (6.9 MiB/s) 2698 bytes read in 8 ms (329.1 KiB/s) Applying kernel provided DT fixup script (rockchip-fixup.scr) ## Executing script at 09000000 Unknown command 'kaslrseed' - try 'help' Moving Image from 0x2080000 to 0x2200000, end=3f00000 ## Loading init Ramdisk from Legacy Image at 06000000 ... Image Name: uInitrd Image Type: AArch64 Linux RAMDisk Image (gzip compressed) Data Size: 24417733 Bytes = 23.3 MiB Load Address: 00000000 Entry Point: 00000000 Verifying Checksum ... OK ## Flattened Device Tree blob at 01f00000 Booting using the fdt blob at 0x1f00000 Loading Ramdisk to f4794000, end f5edd5c5 ... OK Loading Device Tree to 00000000f4716000, end 00000000f4793fff ... OK Starting kernel ...

Thanks. I went for armbian-firmware-full (and ran update-initramfs) using chroot. I'll have to see if my system boots tomorrow. I've noticed that the 'uboot' in armbian 23 throws an error about the unknown command `rm` IIRC. The 'uboot' used for armbian 22 does not show this message. Does anyone else recognise this? If the rebuilt 'uboot' throws that error again tomorrow I'll share the exact message here.

Adding non-free-firmware to apt-sources? Do you mean from here: https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git/tree/rtl_nic ? I don't see any mention of `8152` in the list.

FWIW, unknowingly of these issues, I've been updating my helios64 on armbian (23.8.1) peacefully in the background for the past month. I attempted viewing htop and was greeted with a kernel issue. Assuming it was related to the month uptime I went for a reboot. Since then the system crashes (kernel panic) after the network service has started. It seems to be related to the r8152 driver. Is it useful if I post the kernel dump message? I've reverted to my older armbian sd-card. (22.02.1) Do you mean that I have to manually 'install' the firmware files by copying them to that folder?