ZeroPi Armbian USBIP Host Kernel Exception since latest updates

[apollon77]

Armbianmonitor:

http://ix.io/3BEA

Hi,

 

I use three ZeroPi hosts as USBIP hosts top just offer USB devices.

 

The kernel till last update on one device was

 

Linux usb2 5.10.43-sunxi #21.05.6 SMP Mon Jun 21 15:07:45 UTC 2021 armv7l GNU/Linux

 

and the new kernel on the once device that makes issues now is

 

Linux usb3 5.10.60-sunxi #21.08.2 SMP Tue Sep 14 16:28:44 UTC 2021 armv7l GNU/Linux

 

The issues are that one of the USB devices become unavailable after some hours and I see this in the  syslog:

 

Spoiler

Oct 13 18:36:39 usb3 kernel: [43038.026466] usbip-host 4-1.1: failed to unlink 1/1 urb of seqnum 354788, ret -43
Oct 13 18:36:39 usb3 kernel: [43038.026497] 8<--- cut here ---
Oct 13 18:36:39 usb3 kernel: [43038.026504] Unable to handle kernel NULL pointer dereference at virtual address 00000028
Oct 13 18:36:39 usb3 kernel: [43038.026520] pgd = ad869166
Oct 13 18:36:39 usb3 kernel: [43038.026525] [00000028] *pgd=00000000
Oct 13 18:36:39 usb3 kernel: [43038.026546] Internal error: Oops: 5 [#1] SMP THUMB2
Oct 13 18:36:39 usb3 kernel: [43038.031434] Modules linked in: dm_mod rfkill pl2303 cp210x sun4i_gpadc_iio usbserial industrialio sun8i_thermal sunxi_cedrus(C) v4l2_mem2mem videobuf2_dma_contig videobuf2_memops videobuf2_v4l2 videobuf2_common evdev uio_pdrv_genirq uio cpufreq_dt zram usbip_host usbip_core ip_tables x_tables autofs4 sunxi phy_generic gpio_keys realtek
Oct 13 18:36:39 usb3 kernel: [43038.061198] CPU: 0 PID: 1794 Comm: stub_rx Tainted: G         C        5.10.60-sunxi #21.08.2
Oct 13 18:36:39 usb3 kernel: [43038.069710] Hardware name: Allwinner sun8i Family
Oct 13 18:36:39 usb3 kernel: [43038.074425] PC is at stub_rx_loop+0x332/0x8fc [usbip_host]
Oct 13 18:36:39 usb3 kernel: [43038.079908] LR is at stub_rx_loop+0x325/0x8fc [usbip_host]
Oct 13 18:36:39 usb3 kernel: [43038.085386] pc : [<bf8441e2>]    lr : [<bf8441d5>]    psr: 200f0033
Oct 13 18:36:39 usb3 kernel: [43038.091644] sp : c2b43ef0  ip : 3fffefff  fp : c3430784
Oct 13 18:36:39 usb3 kernel: [43038.096860] r10: bf840bc0  r9 : 00000000  r8 : 00000001
Oct 13 18:36:39 usb3 kernel: [43038.102077] r7 : 00000004  r6 : bf846730  r5 : c2b4a300  r4 : 00000002
Oct 13 18:36:39 usb3 kernel: [43038.108595] r3 : 00000000  r2 : 00000002  r1 : bf846730  r0 : ffffffea
Oct 13 18:36:39 usb3 kernel: [43038.115115] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA Thumb  Segment none
Oct 13 18:36:39 usb3 kernel: [43038.122413] Control: 50c5387d  Table: 4268806a  DAC: 00000051
Oct 13 18:36:39 usb3 kernel: [43038.128154] Process stub_rx (pid: 1794, stack limit = 0xb5106123)
Oct 13 18:36:39 usb3 kernel: [43038.134241] Stack: (0xc2b43ef0 to 0xc2b44000)
Oct 13 18:36:39 usb3 kernel: [43038.138594] 3ee0:                                     000569e4 ffffffd5 c2b986c0 c9c06800
Oct 13 18:36:39 usb3 kernel: [43038.146764] 3f00: 00000001 00000000 80000300 00000000 bf8466f0 bf8482b8 c0f04fc8 c3430784
Oct 13 18:36:39 usb3 kernel: [43038.154933] 3f20: bf84696c bf84690c dff76a40 00000002 000569e4 00040003 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.163101] 3f40: 000569df 00000000 00000000 00000000 00000000 00000000 00000000 c7cf741f
Oct 13 18:36:39 usb3 kernel: [43038.171269] 3f60: c3430784 c9bad000 c2b49840 00000000 c2b42000 bf843eb1 c3430784 c3083e1c
Oct 13 18:36:39 usb3 kernel: [43038.179438] 3f80: c9bad024 c01345bd 0000021b c2b49840 c01344b5 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.187607] 3fa0: 00000000 00000000 00000000 c0100159 00000000 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.195777] 3fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.203945] 3fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.212157] [<bf8441e2>] (stub_rx_loop [usbip_host]) from [<c01345bd>] (kthread+0x109/0x10c)
Oct 13 18:36:39 usb3 kernel: [43038.220601] [<c01345bd>] (kthread) from [<c0100159>] (ret_from_fork+0x11/0x38)
Oct 13 18:36:39 usb3 kernel: [43038.227812] Exception stack(0xc2b43fb0 to 0xc2b43ff8)
Oct 13 18:36:39 usb3 kernel: [43038.232861] 3fa0:                                     00000000 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.241027] 3fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Oct 13 18:36:39 usb3 kernel: [43038.249194] 3fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Oct 13 18:36:39 usb3 kernel: [43038.255809] Code: 692b 4622 4631 59db (6a9f) 9001
Oct 13 18:36:39 usb3 kernel: [43038.260849] ---[ end trace caa9dd5554754acb ]---

 

Second exception is e.g.

 

Spoiler

Oct 13 00:03:23 usb3 kernel: [59912.189086] usbip-host 4-1.1: failed to unlink 1/1 urb of seqnum 495692, ret -43
Oct 13 00:03:23 usb3 kernel: [59912.189122] 8<--- cut here ---
Oct 13 00:03:23 usb3 kernel: [59912.189139] Unable to handle kernel NULL pointer dereference at virtual address 00000028
Oct 13 00:03:23 usb3 kernel: [59912.189161] pgd = e66d4fcf
Oct 13 00:03:23 usb3 kernel: [59912.189175] [00000028] *pgd=00000000
Oct 13 00:03:23 usb3 kernel: [59912.189210] Internal error: Oops: 5 [#1] SMP THUMB2
Oct 13 00:03:23 usb3 kernel: [59912.194111] Modules linked in: dm_mod rfkill sun4i_gpadc_iio pl2303 cp210x industrialio usbserial sun8i_thermal sunxi_cedrus(C) v4l2_mem2mem videobuf2_dma_contig videobuf2_memops videobuf2_v4l2 videobuf2_common evdev uio_pdrv_genirq uio cpufreq_dt zram usbip_host usbip_core ip_tables x_tables autofs4 sunxi phy_generic gpio_keys realtek
Oct 13 00:03:23 usb3 kernel: [59912.224037] CPU: 0 PID: 1693 Comm: stub_rx Tainted: G         C        5.10.60-sunxi #21.08.2
Oct 13 00:03:23 usb3 kernel: [59912.232560] Hardware name: Allwinner sun8i Family
Oct 13 00:03:23 usb3 kernel: [59912.237297] PC is at stub_rx_loop+0x332/0x8fc [usbip_host]
Oct 13 00:03:23 usb3 kernel: [59912.242798] LR is at stub_rx_loop+0x325/0x8fc [usbip_host]
Oct 13 00:03:23 usb3 kernel: [59912.248289] pc : [<bf8431e2>]    lr : [<bf8431d5>]    psr: 20070033
Oct 13 00:03:23 usb3 kernel: [59912.254560] sp : ca1bdef0  ip : 3ffff0c7  fp : c9bdd6c4
Oct 13 00:03:23 usb3 kernel: [59912.259790] r10: bf839bc0  r9 : 00000000  r8 : 00000001
Oct 13 00:03:23 usb3 kernel: [59912.265021] r7 : 00000004  r6 : bf845730  r5 : c4046d80  r4 : 00000002
Oct 13 00:03:23 usb3 kernel: [59912.271552] r3 : 00000000  r2 : 00000002  r1 : bf845730  r0 : ffffffea
Oct 13 00:03:23 usb3 kernel: [59912.278087] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA Thumb  Segment none
Oct 13 00:03:23 usb3 kernel: [59912.285399] Control: 50c5387d  Table: 42afc06a  DAC: 00000051
Oct 13 00:03:23 usb3 kernel: [59912.291153] Process stub_rx (pid: 1693, stack limit = 0xf6019ed1)
Oct 13 00:03:23 usb3 kernel: [59912.297245] Stack: (0xca1bdef0 to 0xca1be000)
Oct 13 00:03:23 usb3 kernel: [59912.301599] dee0:                                     0007904c ffffffd5 c9996c00 c9c12400
Oct 13 00:03:23 usb3 kernel: [59912.309767] df00: 00000001 00000000 80000300 00000000 bf8456f0 bf8472b8 c0f04fc8 c9bdd6c4
Oct 13 00:03:23 usb3 kernel: [59912.317934] df20: bf84596c bf84590c dff76a40 00000002 0007904c 00040003 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.326101] df40: 00079047 00000000 00000000 00000000 00000000 00000000 00000000 c7cf741f
Oct 13 00:03:23 usb3 kernel: [59912.334268] df60: c9bdd6c4 c22760c0 ca247280 00000000 ca1bc000 bf842eb1 c9bdd6c4 c2b3fe1c
Oct 13 00:03:23 usb3 kernel: [59912.342436] df80: c22760e4 c01345bd 00000178 ca247280 c01344b5 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.350602] dfa0: 00000000 00000000 00000000 c0100159 00000000 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.358769] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.366935] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.375132] [<bf8431e2>] (stub_rx_loop [usbip_host]) from [<c01345bd>] (kthread+0x109/0x10c)
Oct 13 00:03:23 usb3 kernel: [59912.383567] [<c01345bd>] (kthread) from [<c0100159>] (ret_from_fork+0x11/0x38)
Oct 13 00:03:23 usb3 kernel: [59912.390777] Exception stack(0xca1bdfb0 to 0xca1bdff8)
Oct 13 00:03:23 usb3 kernel: [59912.395822] dfa0:                                     00000000 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.403988] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Oct 13 00:03:23 usb3 kernel: [59912.412154] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000
Oct 13 00:03:23 usb3 kernel: [59912.418763] Code: 692b 4622 4631 59db (6a9f) 9001
Oct 13 00:03:23 usb3 kernel: [59912.423668] ---[ end trace 9cf7f92320a994d4 ]---

 

I tried to google for such errors but were unsucessful to find anything. Maybe i used wrong keywords.

 

If there were Kernels in betweenn I could also try to go backward to find the pot affecting version or such ... I just need to know how.

 

Thank you for your support,

 

Ingo

[apollon77]

I checked the different packages and it should be basically

 

armbian-bsp-cli-zeropi/buster,now 21.08.2 armhf [installed]
armbian-firmware/buster,now 21.08.2 all [installed]

 

vs 21.0.3

 

SHould I try to revert these two packages using apt install? (or is armbian-firmware enough?

[apollon77]

Ok, I check deeper ... so beside armbian firmware which was updated as I told also kernel is much newer ...

 

> Welcome to Armbian 21.08.3 Buster with Linux 5.10.60-sunxi

 

on the system where it makes issues

 

> Welcome to Armbian 21.08.2 Buster with Linux 5.10.43-sunxi

 

on the systems where it works

 

I now downgradded armbian firmware to 21.08.2 and will see if it gets better. Next would be downgrading kernel too

[apollon77]

Ok, Arnbian Firmware was not the reason, happened again .., I now downgraded kernel to the version it was before ... lets see how this goes

[apollon77]

It seems that the kernel downgrade did the trick so far