Jean-Marc Posted March 7, 2020 Share Posted March 7, 2020 Hello, Sometimes, i have following errors on main syslog-ng server : Spoiler 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,996,16878692493,-;mmc0: Card stuck in programming state! mmc_do_erase 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,997,16878692530,-;blk_update_request: I/O error, dev mmcblk0, sector 10335392 op 0x3:(DISCARD) flags 0x0 phys_seg 1 prio class 0 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,998,16878692736,-;mmc_erase: group start error -110, status 0x0 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,999,16878692755,-;blk_update_request: I/O error, dev mmcblk0, sector 10466560 op 0x3:(DISCARD) flags 0x0 phys_seg 1 prio class 0 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,1000,16878692885,-;sunxi-mmc 1c0f000.mmc: data error, sending stop command 2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service SUBSYSTEM=platform 2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service DEVICE=+platform:1c0f000.mmc 2020-03-07T12:59:50+01:00 s_dev_kernel_kmsg@srv-orangepir1-140-user kernel: 3,1001,16878692905,-;sunxi-mmc 1c0f000.mmc: send stop command failed 2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service SUBSYSTEM=platform 2020-03-07T12:59:50+01:00 srv-orangepir1-140-service/srv-orangepir1-140-service DEVICE=+platform:1c0f000.mmc After this error, not possible to connect via ssh on target .. When trying to connect on local tty, then following error in loop... Port /dev/tty-target-srv-orangepir1-140-position-1.2.4.4.3 Press CTRL-A Z for help on special keys êRead-error on swap-device (179:0:918360) [18207.712698] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000007 [18207.720401] CPU: 1 PID: 1 Comm: init Not tainted 5.5.0-sunxi #trunk.034 [18207.727030] Hardware name: Allwinner sun8i Family [18207.731774] [<c010db0d>] (unwind_backtrace) from [<c010a139>] (show_stack+0x11/0x14) [18207.739997] [<c010a139>] (show_stack) from [<c0962e6b>] (dump_stack+0x6f/0x7c) [18207.747329] [<c0962e6b>] (dump_stack) from [<c011b99d>] (panic+0xcd/0x24c) [18207.754210] [<c011b99d>] (panic) from [<c011fc39>] (do_exit+0x86d/0x884) [18207.760914] [<c011fc39>] (do_exit) from [<c011fcab>] (do_group_exit+0x2f/0x84) [18207.768142] [<c011fcab>] (do_group_exit) from [<c01288e7>] (get_signal+0x127/0x740) [18207.775804] [<c01288e7>] (get_signal) from [<c0109a5f>] (do_work_pending+0xc3/0x42c) [18207.783552] [<c0109a5f>] (do_work_pending) from [<c0101077>] (slow_work_pending+0x9/0x16) [18207.791729] Exception stack(0xcf8f9fb0 to 0xcf8f9ff8) [18207.796783] 9fa0: 00d3f8a4 004d833c b6e94000 0000015c [18207.804964] 9fc0: 00d3f8a4 bec257ec 004d8324 004e921c 00d3f880 004e9000 00d3f8a4 0000004e [18207.813143] 9fe0: 004e918c bec256b0 b6df990d b6df91f6 00010030 ffffffff [18207.819766] CPU3: stopping [18207.822484] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 5.5.0-sunxi #trunk.034 [18207.829530] Hardware name: Allwinner sun8i Family [18207.834243] [<c010db0d>] (unwind_backtrace) from [<c010a139>] (show_stack+0x11/0x14) [18207.841992] [<c010a139>] (show_stack) from [<c0962e6b>] (dump_stack+0x6f/0x7c) [18207.849221] [<c0962e6b>] (dump_stack) from [<c010ca33>] (handle_IPI+0x293/0x2bc) [18207.856626] [<c010ca33>] (handle_IPI) from [<c05e3345>] (gic_handle_irq+0x69/0x6c) [18207.864203] [<c05e3345>] (gic_handle_irq) from [<c0101ae5>] (__irq_svc+0x65/0x94) [18207.871685] Exception stack(0xcf923f58 to 0xcf923fa0) [18207.876737] 3f40: 00000000 00a95dd8 [18207.884918] 3f60: cfd71fb4 c0116341 ffffe000 c0f04f68 c0f04fb0 00000008 c0f04f48 00000000 [18207.893099] 3f80: c0ec88f0 00000000 c0f03d00 cf923fa8 c01079bf c01079c0 400f0033 ffffffff [18207.901282] [<c0101ae5>] (__irq_svc) from [<c01079c0>] (arch_cpu_idle+0x28/0x2c) [18207.908687] [<c01079c0>] (arch_cpu_idle) from [<c014033f>] (do_idle+0x16b/0x1e8) U-Boot SPL 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200) As a result, the only solution to this issue is the physical on/off on target (remove then insert power cable (!)) Configuration is ... (after reboot) root@srv-orangepir1-140:~# uname -a Linux srv-orangepir1-140 5.5.0-sunxi #trunk.034 SMP Mon Feb 3 08:38:40 CET 2020 armv7l GNU/Linux root@srv-orangepir1-140:~# cat /etc/debian_version 10.3 root@srv-orangepir1-140:~# grep -iR ^Deb /etc/apt /etc/apt/sources.list.d/debian_apt_v_10_buster_backports.list:deb http://ftp.fr.debian.org/debian buster-backports main contrib non-free /etc/apt/sources.list.d/debian_apt_v_10_buster_previous.list:deb http://ftp.debian.org/debian/ stretch main contrib non-free /etc/apt/sources.list.d/debian_apt_v_10_buster_update_security.list:deb http://security.debian.org buster/updates main contrib non-free /etc/apt/sources.list.d/armbian_apt_v_10_buster.list:deb http://apt.armbian.com buster main buster-utils buster-desktop /etc/apt/sources.list.d/debian_apt_v_10_buster_current.list:deb http://ftp.debian.org/debian/ buster main contrib non-free /etc/apt/sources.list.d/debian_apt_v_10_buster_updates.list:deb http://ftp.fr.debian.org/debian buster-updates main contrib non-free root@srv-orangepir1-140:~# grep -iR ^P /etc/apt/preferences.d/ /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster/updates /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 920 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster-update /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 910 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 900 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=buster-backports /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=stretch /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: 400 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=testing /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Package: * /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin: release o=Debian,l=Debian,n=unstable /etc/apt/preferences.d/preferences_debian_v_10_buster.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Package: elogind /etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Pin: release * /etc/apt/preferences.d/preferences_debian_v_10_buster_no_elogind.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Package: dhcpcd5 /etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Pin: release * /etc/apt/preferences.d/preferences_debian_v_10_buster_no_dhcpcd5.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Package: systemd /etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Pin: release * /etc/apt/preferences.d/preferences_debian_v_10_buster_no_systemd.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_armbian_buster.pref:Package: hostapd /etc/apt/preferences.d/preferences_armbian_buster.pref:Pin: origin "apt.armbian.com" /etc/apt/preferences.d/preferences_armbian_buster.pref:Pin-Priority: -1 /etc/apt/preferences.d/preferences_armbian_buster.pref:Package: * /etc/apt/preferences.d/preferences_armbian_buster.pref:Pin: origin "apt.armbian.com" /etc/apt/preferences.d/preferences_armbian_buster.pref:Pin-Priority: 500 root@srv-orangepir1-140:~# root@srv-orangepir1-140:~# dpkg -l |grep linux-image ii linux-image-dev-sunxi 20.05.0-trunk.034 armhf Linux kernel, version 5.5.0-sunxi ii linux-image-next-sunxi 5.92 armhf Linux kernel, version 4.19.62-sunxi root@srv-orangepir1-140:~# Link to comment Share on other sites More sharing options...
Werner Posted March 7, 2020 Share Posted March 7, 2020 Dev branch / images built from trunk are unsupported. Try with a supported image and check if the issue persists. Link to comment Share on other sites More sharing options...
Jean-Marc Posted March 7, 2020 Author Share Posted March 7, 2020 Ok, thank for your reply. As a result, i have installed 4.19.62-sunxi kernel, and the target booting process is OK. But the bad news is that behavior is the same ..... root@srv-orangepir1-140:~# [10693.955976] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 Spoiler [10693.966714] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10693.977622] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10693.988024] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10693.998574] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10694.008896] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10694.019195] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10694.029590] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10694.040134] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10694.050567] EXT4-fs error (device dm-26): ext4_find_entry:1455: inode #12: comm apt: reading directory lblock 0 [10695.634222] EXT4-fs error (device mmcblk0p1): ext4_journal_check_start:61: Detected aborted journal [10695.643330] EXT4-fs (mmcblk0p1): Remounting filesystem read-only [10695.650153] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.703714] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #133342: comm monit: reading directory lblock 0 [10696.715499] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.726225] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.736882] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.747567] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.758211] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm monit: reading directory lblock 0 [10696.768912] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #133378: comm monit: reading directory lblock 0 [10696.782358] EXT4-fs error (device mmcblk0p1): ext4_wait_block_bitmap:511: comm monit: Cannot read block bitmap - block_group = 20, block_bitmap = 524292 [10696.796062] EXT4-fs error (device mmcblk0p1): ext4_discard_preallocations:4065: comm monit: Error -5 loading buddy information for 20 [10712.057406] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0 [10712.068115] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0 [10712.081635] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #35043: comm cron: reading directory lblock 0 [10712.092836] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0 [10712.103450] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0 [10712.114061] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #2: comm cron: reading directory lblock 0 [10712.124644] EXT4-fs error (device mmcblk0p1): ext4_find_entry:1455: inode #35043: comm cron: reading directory lblock 0 [10757.865768] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000007 [10757.865768] [10757.875296] CPU: 3 PID: 1 Comm: init Tainted: G W 4.19.62-sunxi #5.92 [10757.883251] Hardware name: Allwinner sun8i Family [10757.887989] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14) [10757.895748] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78) [10757.902983] [<c08fc121>] (dump_stack) from [<c011b3f5>] (panic+0xb9/0x1cc) [10757.909867] [<c011b3f5>] (panic) from [<c011f289>] (complete_and_exit+0x1/0x18) [10757.917183] [<c011f289>] (complete_and_exit) from [<cf8e5e54>] (0xcf8e5e54) [10757.924153] CPU1: stopping [10757.926872] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W 4.19.62-sunxi #5.92 [10757.935047] Hardware name: Allwinner sun8i Family [10757.939760] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14) [10757.947510] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78) [10757.954739] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0) [10757.962146] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68) [10757.969725] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94) [10757.977208] Exception stack(0xcf91df60 to 0xcf91dfa8) [10757.982265] df60: 00000000 003d69e4 cfd48438 c0116441 ffffe000 c0e04d70 c0e04db8 00000002 [10757.990446] df80: 00000000 c0e04d48 c0dba870 00000000 c0e03d00 cf91dfb0 c01078f3 c01078f4 [10757.998622] dfa0: 40010133 ffffffff [10758.002120] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c) [10758.009526] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8) [10758.016928] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c) [10758.024502] [<c013ebed>] (cpu_startup_entry) from [<401024b1>] (0x401024b1) [10758.031464] CPU2: stopping [10758.034180] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G W 4.19.62-sunxi #5.92 [10758.042355] Hardware name: Allwinner sun8i Family [10758.047068] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14) [10758.054817] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78) [10758.062045] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0) [10758.069449] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68) [10758.077024] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94) [10758.084507] Exception stack(0xcf91ff60 to 0xcf91ffa8) [10758.089563] ff60: 00000000 00479ea4 cfd5a438 c0116441 ffffe000 c0e04d70 c0e04db8 00000004 [10758.097744] ff80: 00000000 c0e04d48 c0dba870 00000000 c0e03d00 cf91ffb0 c01078f3 c01078f4 [10758.105920] ffa0: 400f0133 ffffffff [10758.109416] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c) [10758.116818] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8) [10758.124220] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c) [10758.131794] [<c013ebed>] (cpu_startup_entry) from [<401024b1>] (0x401024b1) [10758.138753] CPU0: stopping [10758.141469] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G W 4.19.62-sunxi #5.92 [10758.149644] Hardware name: Allwinner sun8i Family [10758.154356] [<c010d74d>] (unwind_backtrace) from [<c010a2f1>] (show_stack+0x11/0x14) [10758.162105] [<c010a2f1>] (show_stack) from [<c08fc121>] (dump_stack+0x69/0x78) [10758.169334] [<c08fc121>] (dump_stack) from [<c010c7fb>] (handle_IPI+0x2a7/0x2c0) [10758.176737] [<c010c7fb>] (handle_IPI) from [<c05c9c7f>] (gic_handle_irq+0x67/0x68) [10758.184312] [<c05c9c7f>] (gic_handle_irq) from [<c0101a65>] (__irq_svc+0x65/0x94) [10758.191795] Exception stack(0xc0e01f18 to 0xc0e01f60) [10758.196846] 1f00: 00000000 01d3b36c [10758.205027] 1f20: cfd36438 c0116441 ffffe000 c0e04d70 c0e04db8 00000001 00000000 c0e04d48 [10758.213208] 1f40: c0dba870 00000000 00000001 c0e01f68 c01078f3 c01078f4 40070033 ffffffff [10758.221390] [<c0101a65>] (__irq_svc) from [<c01078f4>] (arch_cpu_idle+0x28/0x2c) [10758.228792] [<c01078f4>] (arch_cpu_idle) from [<c013e96b>] (do_idle+0x14b/0x1d8) [10758.236194] [<c013e96b>] (do_idle) from [<c013ebed>] (cpu_startup_entry+0x19/0x1c) [10758.243772] [<c013ebed>] (cpu_startup_entry) from [<c0d00bad>] (start_kernel+0x3a7/0x3c6) [10758.251958] Rebooting in 10 seconds.. U-Boot SPL 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200) DRAM: 256 MiB Trying to boot from MMC1 U-Boot 2019.04-armbian (Jul 06 2019 - 00:26:54 +0200) Allwinner Technology CPU: Allwinner H3 (SUN8I 1680) Model: Xunlong Orange Pi R1 DRAM: 256 MiB MMC: mmc@1c0f000: 0, mmc@1c10000: 1 Loading Environment from EXT4... ** File not found /boot/boot.env ** ** Unable to read "/boot/boot.env" from mmc0:1 ** In: serial Out: serial Err: serial Net: phy interface0 eth0: ethernet@1c30000 starting USB... USB0: USB EHCI 1.00 USB1: USB OHCI 1.0 USB2: USB EHCI 1.00 USB3: USB EHCI 1.00 USB4: USB OHCI 1.0 scanning bus 0 for devices... 1 USB Device(s) found scanning bus 1 for devices... 1 USB Device(s) found scanning bus 2 for devices... 1 USB Device(s) found scanning bus 3 for devices... My SDCARD is a class 10 , and no issue on other embedded boards, Link to comment Share on other sites More sharing options...
Werner Posted March 8, 2020 Share Posted March 8, 2020 4.19.62 is quite old and not supported either. Grab a supported image from here: https://www.armbian.com/orange-pi-r1/ Support forums for H2+ devices is here: https://forum.armbian.com/forum/13-allwinner-h2-h3/ Dont forget to add armbianmonitor -u Use spoiler/code BB-code to increase readability. Link to comment Share on other sites More sharing options...
Igor Posted March 8, 2020 Share Posted March 8, 2020 11 hours ago, Jean-Marc said: But the bad news is that behavior is the same Is this the only HW / SD card combination you have? On a quick scan it looks like a problem with hardware. We need (someone) to recreate and full logs with armbianmonitor to proceed. Link to comment Share on other sites More sharing options...
Recommended Posts