robnielsen Posted October 22 Posted October 22 Armbianmonitor: https://paste.armbian.com/omabipapim How can I recover from this? I haven't rebooted: _ _ _ /_\ _ _ _ __ | |__(_)__ _ _ _ / _ \| '_| ' \| '_ \ / _` | ' \ /_/ \_\_| |_|_|_|_.__/_\__,_|_||_| v24.8.4 for Orange Pi 5 running Armbian Linux 6.10.6-current-rockchip-rk3588 Packages: Debian stable (bookworm) IP addresses: (LAN) 192.168.1.2 10.8.0.1 (WAN) xxx.xxx.xxx.xxx Performance: Load: 1% Up time: 21 days 23:00 Memory usage: 10% of 15.35G CPU temp: 41°C Usage of /: 21% of 233G Tips: Support our work and become a sponsor https://github.com/sponsors/armbian Commands: System config : sudo armbian-config System monitor : htop Last login: Tue Oct 15 13:16:59 2024 from 192.168.1.28 rob@orangepi5:~$ sudo apt update [sudo] password for rob: Hit:1 http://deb.debian.org/debian bookworm InRelease Get:2 http://security.debian.org bookworm-security InRelease [48.0 kB] Get:3 http://deb.debian.org/debian bookworm-updates InRelease [55.4 kB] Get:5 http://deb.debian.org/debian bookworm-backports InRelease [59.0 kB] Get:6 https://packages.adoptium.net/artifactory/deb bookworm InRelease [7,517 B] Get:4 http://mirrors.jevincanders.net/armbian/apt bookworm InRelease [53.3 kB] Get:7 http://security.debian.org bookworm-security/main arm64 Packages [186 kB] Get:8 http://security.debian.org bookworm-security/main armhf Packages [186 kB] Get:9 http://deb.debian.org/debian bookworm-backports/main arm64 Packages.diff/Index [63.3 kB] Get:10 http://deb.debian.org/debian bookworm-backports/main armhf Packages.diff/Index [63.3 kB] Get:11 http://deb.debian.org/debian bookworm-backports/main arm64 Contents (deb).diff/Index [63.6 kB] Get:12 http://deb.debian.org/debian bookworm-backports/main all Contents (deb).diff/Index [63.6 kB] Get:13 http://deb.debian.org/debian bookworm-backports/main armhf Contents (deb).diff/Index [63.6 kB] Get:14 http://deb.debian.org/debian bookworm-backports/main arm64 Packages T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [11.0 kB] Get:14 http://deb.debian.org/debian bookworm-backports/main arm64 Packages T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [11.0 kB] Get:15 http://mirrors.jevincanders.net/armbian/apt bookworm/main all Packages [13.5 kB] Get:16 http://mirrors.jevincanders.net/armbian/apt bookworm/main armhf Packages [345 kB] Get:17 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 Packages [935 kB] Get:18 http://deb.debian.org/debian bookworm-backports/main armhf Packages T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [10.9 kB] Get:18 http://deb.debian.org/debian bookworm-backports/main armhf Packages T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [10.9 kB] Get:19 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 Contents (deb) [14.9 MB] Get:20 http://deb.debian.org/debian bookworm-backports/main arm64 Contents (deb) T-2024-10-19-0204.47-F-2024-10-15-2009.57.pdiff [265 B] Get:20 http://deb.debian.org/debian bookworm-backports/main arm64 Contents (deb) T-2024-10-19-0204.47-F-2024-10-15-2009.57.pdiff [265 B] Get:21 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-utils arm64 Packages [22.6 kB] Get:22 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-utils armhf Packages [52.5 kB] Get:23 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-utils arm64 Contents (deb) [28.4 kB] Get:24 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-utils armhf Contents (deb) [24.7 kB] Get:25 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop armhf Packages [10.2 kB] Get:26 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop all Packages [5,802 B] Get:27 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop arm64 Packages [9,992 B] Get:28 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop armhf Contents (deb) [29.4 kB] Get:29 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop all Contents (deb) [1,309 B] Get:30 http://mirrors.jevincanders.net/armbian/apt bookworm/bookworm-desktop arm64 Contents (deb) [29.4 kB] Get:31 http://deb.debian.org/debian bookworm-backports/main all Contents (deb) T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [5,774 B] Get:31 http://deb.debian.org/debian bookworm-backports/main all Contents (deb) T-2024-10-21-1409.06-F-2024-10-15-2009.57.pdiff [5,774 B] Get:32 http://deb.debian.org/debian bookworm-backports/main armhf Contents (deb) T-2024-10-19-0204.47-F-2024-10-15-2009.57.pdiff [263 B] Get:32 http://deb.debian.org/debian bookworm-backports/main armhf Contents (deb) T-2024-10-19-0204.47-F-2024-10-15-2009.57.pdiff [263 B] Fetched 17.3 MB in 7s (2,576 kB/s) Reading package lists... Done Building dependency tree... Done Reading state information... Done 6 packages can be upgraded. Run 'apt list --upgradable' to see them. rob@orangepi5:~$ sudo apt upgrade Reading package lists... Done Building dependency tree... Done Reading state information... Done Calculating upgrade... Done The following packages will be upgraded: armbian-config armbian-firmware armbian-plymouth-theme armbian-zsh linux-dtb-vendor-rk35xx linux-image-vendor-rk35xx 6 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Need to get 138 MB of archives. After this operation, 15.9 MB of additional disk space will be used. Do you want to continue? [Y/n] y Get:1 http://armbian.tnahosting.net/apt bookworm/main arm64 armbian-config all 24.8.4 [136 kB] Get:6 http://armbian.chi.auroradev.org/apt bookworm/main arm64 linux-image-vendor-rk35xx arm64 24.8.4 [32.6 MB] Get:2 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 armbian-firmware all 24.8.4 [91.6 MB] Get:3 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 armbian-plymouth-theme all 24.8.4 [108 kB] Get:4 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 armbian-zsh all 24.8.4 [11.8 MB] Get:5 http://mirrors.jevincanders.net/armbian/apt bookworm/main arm64 linux-dtb-vendor-rk35xx arm64 24.8.4 [2,135 kB] Fetched 138 MB in 3s (44.6 MB/s) (Reading database ... 109457 files and directories currently installed.) Preparing to unpack .../0-armbian-config_24.8.4_all.deb ... Unpacking armbian-config (24.8.4) over (24.8.3) ... Preparing to unpack .../1-armbian-firmware_24.8.4_all.deb ... Unpacking armbian-firmware (24.8.4) over (24.8.3) ... Preparing to unpack .../2-armbian-plymouth-theme_24.8.4_all.deb ... Unpacking armbian-plymouth-theme (24.8.4) over (24.8.3) ... Preparing to unpack .../3-armbian-zsh_24.8.4_all.deb ... Unpacking armbian-zsh (24.8.4) over (24.8.3) ... Preparing to unpack .../4-linux-dtb-vendor-rk35xx_24.8.4_arm64.deb ... Armbian 'linux-dtb-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'preinst' starting. Armbian 'linux-dtb-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'preinst' finishing. Unpacking linux-dtb-vendor-rk35xx (24.8.4) over (24.8.2) ... Preparing to unpack .../5-linux-image-vendor-rk35xx_24.8.4_arm64.deb ... Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'prerm' starting. Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'prerm' finishing. Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'preinst' starting. Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'preinst' finishing. Unpacking linux-image-vendor-rk35xx (24.8.4) over (24.8.2) ... Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postrm' starting. Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postrm' finishing. Setting up linux-dtb-vendor-rk35xx (24.8.4) ... Armbian 'linux-dtb-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postinst' starting. Armbian: DTB: FAT32: moving /boot/dtb-6.1.75-vendor-rk35xx to /boot/dtb ... renamed 'dtb-6.1.75-vendor-rk35xx' -> 'dtb' Armbian 'linux-dtb-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postinst' finishing. Setting up linux-image-vendor-rk35xx (24.8.4) ... Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postinst' starting. dkms: autoinstall for kernel 6.1.75-vendor-rk35xx was skipped since the kernel headers for this kernel do not seem to be installed. update-initramfs: Generating /boot/initrd.img-6.1.75-vendor-rk35xx update-initramfs: Armbian: Converting to u-boot format: /boot/uInitrd-6.1.75-vendor-rk35xx Image Name: uInitrd Created: Tue Oct 22 06:34:02 2024 Image Type: AArch64 Linux RAMDisk Image (gzip compressed) Data Size: 16110316 Bytes = 15732.73 KiB = 15.36 MiB Load Address: 00000000 Entry Point: 00000000 update-initramfs: Armbian: Symlinking /boot/uInitrd-6.1.75-vendor-rk35xx to /boot/uInitrd ln: failed to create symbolic link '/boot/uInitrd': Operation not permitted update-initramfs: Symlink failed, moving /boot/uInitrd-6.1.75-vendor-rk35xx to /boot/uInitrd renamed '/boot/uInitrd-6.1.75-vendor-rk35xx' -> '/boot/uInitrd' update-initramfs: Armbian: done. Free space after deleting the package linux-image-vendor-rk35xx in /boot: 78.5M Armbian: FAT32 /boot: move last-installed kernel to 'Image'... renamed '/boot/vmlinuz-6.1.75-vendor-rk35xx' -> '/boot/Image' Armbian 'linux-image-vendor-rk35xx' for '6.1.75-vendor-rk35xx': 'postinst' finishing. Setting up armbian-zsh (24.8.4) ... Setting up armbian-config (24.8.4) ... Setting up armbian-firmware (24.8.4) ... Setting up armbian-plymouth-theme (24.8.4) ... update-initramfs: deferring update (trigger activated) Processing triggers for initramfs-tools (0.142+deb12u1) ... ln: failed to create hard link '/boot/initrd.img-6.10.6-current-rockchip-rk3588.dpkg-bak' => '/boot/initrd.img-6.10.6-current-rockchip-rk3588': Operation not permitted update-initramfs: Generating /boot/initrd.img-6.10.6-current-rockchip-rk3588 grep: /boot/config-6.10.6-current-rockchip-rk3588: No such file or directory E: gzip compression (CONFIG_RD_GZIP) not supported by kernel update-initramfs: failed for /boot/initrd.img-6.10.6-current-rockchip-rk3588 with 1. dpkg: error processing package initramfs-tools (--configure): installed initramfs-tools package post-installation script subprocess returned error exit status 1 Errors were encountered while processing: initramfs-tools E: Sub-process /usr/bin/dpkg returned an error code (1) rob@orangepi5:~$ ls -l /boot total 104816 -rwxr-xr-x 1 root root 213 Sep 30 07:31 armbianEnv.txt -rwxr-xr-x 1 root root 38518 Feb 18 2023 boot.bmp -rwxr-xr-x 1 root root 3404 Feb 18 2023 boot.cmd -rwxr-xr-x 1 root root 3476 Feb 18 2023 boot.scr -rwxr-xr-x 1 root root 244731 Oct 18 04:11 config-6.1.75-vendor-rk35xx drwxr-xr-x 3 root root 4096 Oct 22 06:33 dtb -rwxr-xr-x 1 root root 39152128 Oct 18 04:11 Image -rwxr-xr-x 1 root root 28272711 Sep 30 07:29 initrd.img-6.10.6-current-rockchip-rk3588 -rwxr-xr-x 1 root root 16110316 Oct 22 06:34 initrd.img-6.1.75-vendor-rk35xx -rwxr-xr-x 1 root root 7371703 Oct 18 04:11 System.map-6.1.75-vendor-rk35xx -rwxr-xr-x 1 root root 16110380 Oct 22 06:34 uInitrd rob@orangepi5:~$ 0 Quote
Solution robnielsen Posted October 24 Author Solution Posted October 24 I was able to recover. Here's what I did: copied /boot/config-6.1.75-vendor-rk35xx to /boot/config-6.10.6-current-rockchip-rk3588 and was able to get apt upgrade to complete successfully. ran sudo apt list --installed | egrep "linux-dtb|linux-image" used apt remove to removed the packages listed except for linux-dtb-current-rockchip-rk3588 linux-image-current-rockchip-rk3588 ran sudo apt install --reinstall linux-dtb-current-rockchip-rk3588 linux-image-current-rockchip-rk3588 to reinstall both packages froze Armbian kernel upgrades in armbian-config rebooted 0 Quote
ScottP Posted November 6 Posted November 6 I installed this kernel on a Rock 5B. Although the above fixed the issue for the original poster the failure of configure stage is not addressed. I think there is something wrong with this kernel. On my Home Assistant server some containers were failing to start and the errors pointed towards some resource/limits issue even for processes running as root. The errors were something like - fork failed, resource temporarily not available. I think update-initramfs ran into this issue producing the errors in the post. I don't have any logs since it has hard to do anything at this point, commands failing when trying to diagnose. I rolled back to 5.10 manually to get my server up and running. I think the maximum number of processes was being limited artificially low despite nothing being in /etc/security/limits* - I did see for not root users this limited to around 2k processes via ulimit -u - cant remember the exact number. If anyone is running this kernel you can check the limits for various processes - user and root alike by looking at /proc/<PID>/limits On my rolled back 5.10 legacy kernel this is 61790 0 Quote
q-bert Posted November 16 Posted November 16 I upgraded to 6.1.75-vendor-rk35xx and now my m2 ssd is not recognized anymore and the system is unresponsive and unstable. Once I remove the ssd, I am able to use it again. I tried to revert to a previous kernel using armbian-config but that didn't work. How can I revert back to 6.1.43? 0 Quote
q-bert Posted November 16 Posted November 16 I upgraded to 6.1.75-vendor-rk35xx and now my m2 ssd is not recognized anymore and the system is unresponsive and unstable. Once I remove the ssd, I am able to use it again. I tried to revert to a previous kernel using armbian-config but that didn't work. Here's how I reverted back to an older kernel: sudo apt install linux-dtb-vendor-rk35xx=24.5.2 linux-image-vendor-rk35xx=24.5.2 sudo reboot The system is stable again, including pci ssd. 0 Quote
robnielsen Posted November 16 Author Posted November 16 (edited) 3 hours ago, q-bert said: The system is stable again, including pci ssd. Mine is stable with 24.8.2 (6.10.6-current-rockchip-rk3588) Edited November 16 by robnielsen 0 Quote
ScottP Posted November 16 Posted November 16 The other issue with the vendor kernels is that the DTB seems to contain every rockchip dtb known - hundreds of them not just rk35xx - the default 256MB boot partition fills up as there is no room to have two kernel/overlay versions 0 Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.