Helios64 Support


gprovost
 Share

24 24

Recommended Posts

5 hours ago, aprayoga said:

There is a change to rename device tree to follow mainline device tree naming.

from /boot/rockchip/rk3399-helios64.dtb to /boot/rockchip/rk3399-kobol-helios64.dtb

 

Did you use fresh image of 20.08.8 then transfer to eMMC via nand-sata-install?


Right and there the option "2 Boot from eMMC - system on eMMC".
The only thing I haven't done this time is to set the jumper P11.
Is it possible to do something with the file /boot/armbianEnv.txt and changing the variable "rootdev"?
Because in the /boot/boot.scr the default value for "rootdev" -> "/dev/mmcblk0p1" is used and this is the partition of the microSD.

Link to post
Share on other sites

Armbian is a community driven open source project. Do you like to contribute your code?

3 minutes ago, TDCroPower said:

The only thing I haven't done this time is to set the jumper P11.

 

I think you need to read again carefully our wiki page on jumper to understand the boot order system, if you have nothing on SPI Flash (which should be the case) then you don't need to set jumper 11 to boot on eMMC.

The jumpers (P10 and P11) are used to skip boot device by disabling the device. The Soc will always look for bootcode as follow :

1. SPI Flash (unless it's disable by P11)

2. eMMC Flash (unless it's disable by P10)

3. micro-SD Card

 

The issue with eMMC is that U-Boot wasn't supporting the UHS mode therefore unable to access the rootfs on eMMC, it's being fixed by @aprayoga. He's also preparing some wiki instruction around eMMC.

I see you asked many questions on many pages of our wiki around this topic... So a bit of patience ;-) otherwise all those questions might be more confusing than anything for other users. ;-) .

 

 

Link to post
Share on other sites

Thanks for the answer.
As shown in my previous posts I somehow managed to get the eMMC partition loaded and in some places this was displayed correctly.
The only problem was that the microSD had to stay connected, which surprised me a bit.

 

I'm happy to share my feedback with everyone so that we can all benefit from it.
If I annoy you with this I am sorry.

Link to post
Share on other sites

5 hours ago, lyuyhn said:

To fellow zfs users, I just saw that the 0.8.5 release is out with many compatibility patches, we should wait until this version lands in the repos to use it on the Helios64 ;)

Just tried building 0.8.5 on the Buster current image.  Unfortunately is still fails with the "__stack_chk_guard" errors.

This topic and this GitHub issue (by the same author) have more info about the possible cause for this.

 

----------------------

 

@aprayoga I will try to reproduce the crash on legacy again and post the results.

Link to post
Share on other sites

@TDCroPower

I could not reproduce your setup.
First I tried with fresh Armbian 20.08.8 then transfer to eMMC using nand-sata-install.

System can boot if sd card inserted.

 

I clean up the eMMC. then run next test.
I tried boot from fresh Armbian 20.08.4 then transfer to eMMC using nand-sata-install.
System can boot if sd card inserted.

Then boot from fresh Armbian 20.08.8 without cleaning the eMMC, then transfer to eMMC using nand-sata-install.

System can boot if sd card inserted.

 

Initially I though maybe previous u-boot on eMMC looking for old device tree name therefore your system failed to boot. But it does not seem the case.

 

4 hours ago, TDCroPower said:

Is it possible to do something with the file /boot/armbianEnv.txt and changing the variable "rootdev"?
Because in the /boot/boot.scr the default value for "rootdev" -> "/dev/mmcblk0p1" is used and this is the partition of the microSD.

You could try to set "rootdev=/dev/mmcblk1p1" in /boot/armbianEnv.txt as a workaround.

But keep in mind that all of the actual boot files are still on sdcard and not accessible under /boot/

Link to post
Share on other sites

@aprayoga 

Oh sorry I think there is an understanding problem.
The system can always boot from the microSD!
When i install everything on the eMMC with nand-sata-install and reboot it has booted from the eMMC... the microSD stays plugged in!
If I shut down the system, removed the microSD and rebooted it did not boot anymore.
When I plugged in the microSD and booted it again it showed me that it has mounted from the eMMC.

See my post early Topic 2
 

Link to post
Share on other sites

@TDCroPower

I have to wonder if you have a uboot (&equally important, idbloader) on your emmc

If you run fdisk on emmc is there room,,1st part start at 32768 (or >)?

What the boot rom is looking for is idblaoder, well, a raw read for the signature bytes

3B 8C DC FC  BE 9F 9D 51  (so far, all idbloaders are same here)

I guess it is assumed that if idbloader is there (on that media), then so will uboot

So, something like..... dd if=/dev/emmc of=test skip=64 count=1

then,,,,, hexedit test

Link to post
Share on other sites

Just a few more questions (i am on kernel 5.8):

 

- is there a way to see if the battery is used? i'd like to write a service which shuts down the unit on powerloss

- i get log messages about tx disconnect for r8152. followed by usb errors. iperf shows my transferrate correctly at 2.5gbits but file transfers hover around 80-150mb/s which is a bit slow

 

 usb 2-1.4: reset SuperSpeed Gen 1 USB device number 3 using xhci-hcd 
 r8152 2-1.4:1.0 eth1: Tx status -2 
 xhci-hcd xhci-hcd.0.auto: bad transfer trb length 16744300 in event trb 
 r8152 2-1.4:1.0 eth1: Tx status -2 
 xhci-hcd xhci-hcd.0.auto: bad transfer trb length 16744300 in event trb 
 r8152 2-1.4:1.0 eth1: Tx status -2 
 xhci-hcd xhci-hcd.0.auto: bad transfer trb length 16744300 in event trb 
 r8152 2-1.4:1.0 eth1: Tx status -2 
 xhci-hcd xhci-hcd.0.auto: bad transfer trb length 16744300 in event trb 
 r8152 2-1.4:1.0 eth1: Tx timeout 

 

i just want to know the reasoning behind this two:

- why does armbian use zram for logs? AFAIK zram is not swappable (instead of tmpfs).

- why is zram used for swap instead of zswap? i have always used zswap on my desktop

 

helio64 sets 2gb as swap through zram. sounds like a good value. i have added 4x2gb swap partitions with a lower priority. is this a good idea with the way armbian handles ram (eg swappiness=100)?

Link to post
Share on other sites

On 10/5/2020 at 1:37 PM, TDCroPower said:

Topic 4 -> USB-C Connector

 

It is not possible to connect the included USB-C cable to the USB port when the backpanel is on.
The panel produces a too wide distance, so the connector does not fit 100%.
So I have removed the board from the case and work without the case until the system is ready.
You might want to recommend this before assembling the system, there are just too many mistakes/unclearties when you have assembled everything.

 

After some trial and error with the same issue on the USB-C port, I discovered that the USB3 ports were not going into the back panel 100% flush.  Once I sorted this out the back panel aligned properly.

 

If you're just having issues with the USB port then consider yourself lucky, on my case the two halves making up the body were not even in alignment :(

 

On 10/6/2020 at 6:50 AM, Igor said:

 

*** ZFS Version: zfs-0.8.3-1ubuntu12.4
*** Compatible Kernels: 2.6.32 - 5.4

For 5.8.y you need at least 0.8.4 from sourceshttps://github.com/openzfs/zfs/issues

 

DKMS on Debian / Ubuntu is simply too old. Install attached .deb package (i tested this on Ubuntu Focal) and it will work:
 

  Reveal hidden contents




sudo armbian-config main=Software selection=Headers_install
dpkg -i zfs-dkms_0.8.4-1ubuntu11_all.deb 
(Reading database ... 66592 files and directories currently installed.)
Preparing to unpack zfs-dkms_0.8.4-1ubuntu11_all.deb ...

------------------------------
Deleting module version: 0.8.3
completely from the DKMS tree.
------------------------------
Done.
Unpacking zfs-dkms (0.8.4-1ubuntu11) over (0.8.3-1ubuntu12.4) ...
Setting up zfs-dkms (0.8.4-1ubuntu11) ...
Loading new zfs-0.8.4 DKMS files...
Building for 5.8.13-rockchip64
Building initial module for 5.8.13-rockchip64
Done.

zavl.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

znvpair.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

zunicode.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

zcommon.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

zfs.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

icp.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

zlua.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

spl.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/5.8.13-rockchip64/updates/dkms/

depmod.....

DKMS: install completed.
Processing triggers for initramfs-tools (0.136ubuntu6.3) ...
update-initramfs: Generating /boot/initrd.img-5.8.13-rockchip64
update-initramfs: Converting to u-boot format

modprobe zfs
[319920.214635] ZFS: Loaded module v0.8.4-1ubuntu11, ZFS pool version 5000, ZFS filesystem version 5

 

 

zfs-dkms_0.8.4-1ubuntu11_all.deb 1.81 MB · 5 downloads

 

I'm so glad someone posted about this, I've been playing around for a day or so trying to get this to work with no luck.  Thanks!

Edited by rjgould
Link to post
Share on other sites

Spoiler

 

15 hours ago, aprayoga said:

So with Armbian 20.08.8 LEGACY,  the system still crashed? Let us know if you managed to get the log and a way to reproduce the crash.

I managed to catch the error this time, although I suspect because I caught it almost immediately after it happened, the system did not have a chance to become completely unresponsive.

As you will see in the log below, the disk in the 5th bay (sde) became "disconnected" after the error, which makes me wonder if a software fault caused the disk to "soft-disconnect" or if the disks' hardware is failing after hours of intense activity and triggered the error (in which case I'm just wasting everyone's time). After a forced reboot the disk appears to be working fine and resilvered in seconds, so I'm really not sure.

 

Please see below:

 

 Steps to reproduce:


- Flashed Armbian_20.08.8_Helios64_buster_legacy_4.4.213.img.xz and went through initial setup.
- sudo apt-get update && sudo apt-get dist-upgrade -y
- sudo apt-get install linux-headers-legacy-rk3399
- sudo apt-get install zfs-dkms -t buster-backports
- installed OMV through armbian-config
- logged in to OMV web interface and enabled the omv-extras repo
- still in OMV, went to Plugins and installed openmediavault-zfs (regular, not armhf)
- enabled SMART monitoring for all disks (not sure if relevant)
- From the newly-added "ZFS" section in OMV, imported my ZFS pool (4x4TB RAID-Z2).
- Created some shared folders and shared them via NFS and Samba
- Started a scrub on the ZFS pool, this puts some medium/high load on the CPU and disks.
- Have two clients (Proxmox) accesssing a couple of VM disks via NFS.

 

 

Error log  after approx. 6 hours (from serial terminal):


[13483.617705] Internal error: Oops: 96000004 [#1] SMP
[13483.619387] Modules linked in: zfs(PO) zunicode(PO) zlua(PO) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) softdog r8152 af_packet snd_soc_rockchip_hdmi_dp midgard_kbase sg cdn_dp uio_pdrv_g
enirq gpio_beeper uio nfsd auth_rpcgss nfs_acl lockd lm75 grace sunrpc ip_tables x_tables raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md
_mod
[13483.627827] CPU: 5 PID: 203 Comm: irq/259-ahci4 Tainted: P           O    4.4.213-rk3399 #3
[13483.629885] Hardware name: Helios64 (DT)
[13483.631530] task: ffffffc0e1612a00 task.stack: ffffffc0e17f0000
[13483.633360] PC is at irq_thread_fn+0x44/0x74
[13483.635044] LR is at irq_thread_fn+0x30/0x74
[13483.636698] pc : [<ffffff8008113e68>] lr : [<ffffff8008113e54>] pstate: 60000145
[13483.638635] sp : ffffffc0e17f3d50
[13483.640208] x29: ffffffc0e17f3d50 x28: 0000000000000001 
[13483.641982] x27: ffffffc0e1612a00 x26: 0000000000000001 
[13483.643735] x25: ffffffc0e1612a00 x24: ffffffc0ed84e440 
[13483.645474] x23: ffffff8009409201 x22: ffffff8008113fd0 
[13483.647188] x21: 0000000000000001 x20: ffffffc0ed84e400 
[13483.648889] x19: ffffe2c0eadc1200 x18: 0000000030d00800 
[13483.650573] x17: 00000000b995214c x16: 0000000000000050 
[13483.652244] x15: 000000000000000e x14: 0000000000000007 
[13483.653916] x13: 0000000000000001 x12: 0000000000000028 
[13483.655568] x11: 0101010101010101 x10: 7f7f7f7f7f7f7f7f 
[13483.657222] x9 : 656824ff6462716e x8 : 7f7f7fffffffffff 
[13483.658867] x7 : 6567fffefefefefe x6 : 00000040eec83000 
[13483.660510] x5 : ffffff800867ea2c x4 : 0000000000000001 
[13483.662146] x3 : ffffffbdc1891410 x2 : ffffe2c0eadc1294 
[13483.663795] x1 : ffffffc0e1612a00 x0 : 0000000000000001 
[13483.665445] 
[13483.665445] PC: 0xffffff8008113de8:
[13483.668159] 3de8  37800080 36880060 aa1303e0 94000aea aa1603e0 942a6c05 f9401e60 f9403c01
[13483.670116] 3e08  b4000061 aa1503e0 d63f0020 a94153f3 a9425bf5 a8c37bfd d65f03c0 a9bd7bfd
[13483.672079] 3e28  910003fd a90153f3 f90013f5 aa0103f4 aa0003f3 aa1e03e0 d503201f b9403a80
[13483.674046] 3e48  f9400681 f9401282 d63f0040 2a0003f5 7100041f 540000e1 91025262 f9800051
[13483.676011] 3e68  885f7c40 11000400 88017c40 35ffffa1 aa1403e1 aa1303e0 97ffffae 2a1503e0
[13483.678002] 3e88  a94153f3 f94013f5 a8c37bfd d65f03c0 a9bd7bfd 910003fd a90153f3 f90013f5
[13483.680014] 3ea8  aa0103f4 aa0003f3 aa1e03e0 d503201f d5384101 b9401020 11080000 b9001020
[13483.682056] 3ec8  b9403a80 f9400681 f9401282 d63f0040 2a0003f5 7100041f 540000e1 91025262
[13483.684116] 
[13483.684116] LR: 0xffffff8008113dd4:
[13483.687088] 3dd4  f9406e62 8a200040 f9006e60 b50000c0 b9400020 37800080 36880060 aa1303e0
[13483.689173] 3df4  94000aea aa1603e0 942a6c05 f9401e60 f9403c01 b4000061 aa1503e0 d63f0020
[13483.691253] 3e14  a94153f3 a9425bf5 a8c37bfd d65f03c0 a9bd7bfd 910003fd a90153f3 f90013f5
[13483.693334] 3e34  aa0103f4 aa0003f3 aa1e03e0 d503201f b9403a80 f9400681 f9401282 d63f0040
[13483.695424] 3e54  2a0003f5 7100041f 540000e1 91025262 f9800051 885f7c40 11000400 88017c40
[13483.697554] 3e74  35ffffa1 aa1403e1 aa1303e0 97ffffae 2a1503e0 a94153f3 f94013f5 a8c37bfd
[13483.699665] 3e94  d65f03c0 a9bd7bfd 910003fd a90153f3 f90013f5 aa0103f4 aa0003f3 aa1e03e0
[13483.701788] 3eb4  d503201f d5384101 b9401020 11080000 b9001020 b9403a80 f9400681 f9401282
[13483.703917] 
[13483.703917] SP: 0xffffffc0e17f3cd0:
[13483.706981] 3cd0  08113fd0 ffffff80 09409201 ffffff80 ed84e440 ffffffc0 e1612a00 ffffffc0
[13483.709064] 3cf0  00000001 00000000 e1612a00 ffffffc0 00000001 00000000 e17f3d50 ffffffc0
[13483.711114] 3d10  08113e54 ffffff80 e17f3d50 ffffffc0 08113e68 ffffff80 60000145 00000000
[13483.713134] 3d30  eadc1200 ffffe2c0 ed84e400 ffffffc0 ffffffff ffffffff 08113fd0 ffffff80
[13483.715127] 3d50  e17f3d80 ffffffc0 081141a8 ffffff80 eadc1200 ffffe2c0 08113e24 ffffff80
[13483.717124] 3d70  ed84e400 ffffffc0 08114128 ffffff80 e17f3e00 ffffffc0 080d6d80 ffffff80
[13483.719118] 3d90  ed858280 ffffffc0 e1612a00 ffffffc0 08e216d2 ffffff80 ed84e400 ffffffc0
[13483.721093] 3db0  08114070 ffffff80 00000000 00000000 00000000 00000000 00000000 00000000
[13483.723082] 
[13483.723082] X1: 0xffffffc0e1612980:
[13483.725898] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.727901] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.729921] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.731907] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13483.733899] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13483.735883] 2a20  e17f0000 ffffffc0 00000003 00208040 00000000 00000000 00000000 00000000
[13483.737875] 2a40  00000001 00000005 0000007e 00000000 00324a49 00000001 e1b10000 ffffffc0
[13483.739857] 2a60  00000005 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13483.741870] 
[13483.741870] X3: 0xffffffbdc1891390:
[13483.744738] 1390  00000000 00000000 ffffffff 00000001 00000100 dead0000 00000200 dead0000
[13483.746778] 13b0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.748830] 13d0  00000000 00000000 ffffffff 00000001 00000100 dead0000 00000200 dead0000
[13483.750868] 13f0  00000000 00000000 00000000 00000000 00004080 00000000 00000000 00000000
[13483.752919] 1410  62451380 ffffffc0 8015000d 00000001 c0fd7400 ffffffbd 00000007 00000007
[13483.754964] 1430  edda7500 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[13483.757019] 1450  00000001 00000000 ffffffff 00000000 c1891401 ffffffbd 00000001 00000001
[13483.759087] 1470  00000000 00000000 00000000 00000000 00010028 00000000 dd7bc708 ffffffc0
[13483.761155] 
[13483.761155] X5: 0xffffff800867e9ac:
[13483.764040] e9ac  7900fa74 7900fe60 17fffff4 7940fe60 11000400 12003c00 7900fe60 7100281f
[13483.766075] e9cc  54fffdc9 34000061 7900f261 d5033e9f 7940f260 17ffffea a9be7bfd 910003fd
[13483.768104] e9ec  a90153f3 aa0103f3 aa0003f4 aa1e03e0 d503201f f9407e61 b4000081 d0007c40
[13483.770135] ea0c  f9428000 97ed96c5 f9400680 f9408a61 97ed96c2 f9400280 aa1303e1 97ed96bf
[13483.772161] ea2c  a94153f3 a8c27bfd d65f03c0 a9bd7bfd 910003fd a90153f3 f90013f5 aa0003f3
[13483.774187] ea4c  b00067f4 aa1e03e0 9131e294 d503201f 9101e280 f9408675 9414ba34 f9408660
[13483.776210] ea6c  b9413801 340000a1 f940a013 b9401260 35000100 d4210000 39482261 91006280
[13483.778266] ea8c  91012293 f27e003f 9a930013 17fffff8 51000400 b9001260 35000140 f9400260
[13483.780315] 
[13483.780315] X20: 0xffffffc0ed84e380:
[13483.783241] e380  0000000c 00000000 e1612fa8 ffffffc0 00000000 00000000 00000000 00000000
[13483.785290] e3a0  e1612588 ffffffc0 080d4414 ffffff80 000000cb 00000000 092fdf88 ffffff80
[13483.787306] e3c0  00000000 00000000 f7ed1718 ffffffc0 ed84e3d0 ffffffc0 ed84e3d0 ffffffc0
[13483.789351] e3e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.791360] e400  086b5924 ffffff80 e1608000 ffffffc0 00000000 00000000 00000000 00000000
[13483.793372] e420  086b8974 ffffff80 e1612a00 ffffffc0 00000000 00000000 00000103 00000000
[13483.795337] e440  00000001 00000000 00000000 00000000 ed8580a8 ffffffc0 ed85a540 ffffffc0
[13483.797327] e460  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.799292] 
[13483.799292] X22: 0xffffff8008113f50:
[13483.802078] 3f50  f9400e60 f90017e0 aa1403e0 942a6bad d5384100 9100a3e1 97ff3a9e a94153f3
[13483.804053] 3f70  a8c37bfd d65f03c0 a9be7bfd 910003fd f9000bf3 aa0003f3 aa1e03e0 d503201f
[13483.806048] 3f90  91038262 f9800051 885f7c40 51000400 8801fc40 35ffffa1 d5033bbf 350000c0
[13483.808054] 3fb0  9103a260 d2800003 52800022 52800061 97ffa91f f9400bf3 a8c27bfd d65f03c0
[13483.810073] 3fd0  a9be7bfd 910003fd a90153f3 aa1e03e0 d503201f d5384114 b9402e80 37100160
[13483.812094] 3ff0  d00097a0 91080400 39400401 35000081 d4210000 52800021 39000401 a94153f3
[13483.814110] 4010  a8c27bfd d65f03c0 aa1403e0 97ff0d20 aa0003f3 b9454a82 911c6281 d0006880
[13483.816154] 4030  913ef400 b9403a63 94020060 b9403a60 97fff98f aa0003f4 91010261 52800000
[13483.818192] 
[13483.818192] X23: 0xffffff8009409181:
[13483.821156] 9180  09223c58 ffffff80 00000000 00000000 ed93fdb0 ffffffc0 ed93fdb0 ffffffc0
[13483.823255] 91a0  081787a0 ffffff80 00000000 00000000 00000000 00000000 00000000 00000000
[13483.825382] 91c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.827473] 91e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.829568] 9200  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.831632] 9220  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.833680] 9240  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.835700] 9260  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.837699] 9280  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.839683] 
[13483.839683] X24: 0xffffffc0ed84e3c0:
[13483.842519] e3c0  00000000 00000000 f7ed1718 ffffffc0 ed84e3d0 ffffffc0 ed84e3d0 ffffffc0
[13483.844531] e3e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.846546] e400  086b5924 ffffff80 e1608000 ffffffc0 00000000 00000000 00000000 00000000
[13483.848552] e420  086b8974 ffffff80 e1612a00 ffffffc0 00000000 00000000 00000103 00000000
[13483.850546] e440  00000001 00000000 00000000 00000000 ed8580a8 ffffffc0 ed85a540 ffffffc0
[13483.852534] e460  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.854528] e480  0a400000 ffffff80 0a501000 ffffff80 00000004 00000000 eaf04d99 ffffffc0
[13483.856510] e4a0  eae07f98 ffffffc0 eb95ed18 ffffffc0 a2634d30 ffffffc0 eaf04030 ffffffc0
[13483.858484] 
[13483.858484] X25: 0xffffffc0e1612980:
[13483.861247] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.863204] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.865140] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.867055] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13483.868958] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13483.870827] 2a20  e17f0000 ffffffc0 00000003 00208040 00000000 00000000 00000000 00000000
[13483.872696] 2a40  00000001 00000005 0000007e 00000000 00324a49 00000001 e1b10000 ffffffc0
[13483.874557] 2a60  00000005 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13483.876404] 
[13483.876404] X27: 0xffffffc0e1612980:
[13483.878960] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.880835] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.882702] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13483.884538] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13483.886378] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13483.888197] 2a20  e17f0000 ffffffc0 00000003 00208040 00000000 00000000 00000000 00000000
[13483.890017] 2a40  00000001 00000005 0000007e 00000000 00324a49 00000001 e1b10000 ffffffc0
[13483.891823] 2a60  00000005 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13483.893636] 
[13483.893636] X29: 0xffffffc0e17f3cd0:
[13483.896040] 3cd0  08113fd0 ffffff80 09409201 ffffff80 ed84e440 ffffffc0 e1612a00 ffffffc0
[13483.897831] 3cf0  00000001 00000000 e1612a00 ffffffc0 00000001 00000000 e17f3d50 ffffffc0
[13483.899604] 3d10  08113e54 ffffff80 e17f3d50 ffffffc0 08113e68 ffffff80 60000145 00000000
[13483.901394] 3d30  eadc1200 ffffe2c0 ed84e400 ffffffc0 ffffffff ffffffff 08113fd0 ffffff80
[13483.903162] 3d50  e17f3d80 ffffffc0 081141a8 ffffff80 eadc1200 ffffe2c0 08113e24 ffffff80
[13483.904923] 3d70  ed84e400 ffffffc0 08114128 ffffff80 e17f3e00 ffffffc0 080d6d80 ffffff80
[13483.906675] 3d90  ed858280 ffffffc0 e1612a00 ffffffc0 08e216d2 ffffff80 ed84e400 ffffffc0
[13483.908411] 3db0  08114070 ffffff80 00000000 00000000 00000000 00000000 00000000 00000000
[13483.910140] 
[13483.911218] Process irq/259-ahci4 (pid: 203, stack limit = 0xffffffc0e17f0000)
[13483.912847] Stack: (0xffffffc0e17f3d50 to 0xffffffc0e17f4000)
[13483.914375] 3d40:                                   ffffffc0e17f3d80 ffffff80081141a8
[13483.916130] 3d60: ffffe2c0eadc1200 ffffff8008113e24 ffffffc0ed84e400 ffffff8008114128
[13483.917912] 3d80: ffffffc0e17f3e00 ffffff80080d6d80 ffffffc0ed858280 ffffffc0e1612a00
[13483.919697] 3da0: ffffff8008e216d2 ffffffc0ed84e400 ffffff8008114070 0000000000000000
[13483.921510] 3dc0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.923305] 3de0: ffffffc0ed858280 ffffffc0e1612a00 0000000000000000 ffffff8008113fd0
[13483.925110] 3e00: 0000000000000000 ffffff8008082ef0 ffffff80080d6ca0 ffffffc0ed858280
[13483.926905] 3e20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.928696] 3e40: ffffffc0e17f3e60 0000000000000000 ffffffc0ee71c600 ffffffc0ed84e400
[13483.930514] 3e60: ffffffc000000000 dead4ead00000000 ffffffc0ffffffff ffffffffffffffff
[13483.932333] 3e80: ffffffc0e17f3e80 ffffffc0e17f3e80 0000000000000000 dead4ead00000000
[13483.934153] 3ea0: 00000000ffffffff ffffffffffffffff ffffffc0e17f3eb0 ffffffc0e17f3eb0
[13483.935970] 3ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.937801] 3ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.939617] 3f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.941400] 3f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.943172] 3f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.944912] 3f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.946651] 3f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.948394] 3fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.950125] 3fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[13483.951843] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13483.953555] Call trace:
[13483.954772] Exception stack(0xffffffc0e17f3b80 to 0xffffffc0e17f3cb0)
[13483.956364] 3b80: ffffe2c0eadc1200 0000008000000000 ffffffc0e17f3d50 ffffff8008113e68
[13483.958081] 3ba0: ffffffc062451380 0000000000001d4c ffffffc062451080 0000000000000005
[13483.959808] 3bc0: ffffffc0e17f3bf0 ffffff80084c2ed0 ffffffc0e17f3c10 ffffff80092b3000
[13483.961522] 3be0: ffffff80092e6100 0000000000000004 ffffffc0e17f3c20 ffffff8008081160
[13483.963249] 3c00: ffffffc0e17f3c20 ffffff8008081064 0000000000000000 ffffff800808100c
[13483.964997] 3c20: 0000000000000001 ffffffc0e1612a00 ffffe2c0eadc1294 ffffffbdc1891410
[13483.966763] 3c40: 0000000000000001 ffffff800867ea2c 00000040eec83000 6567fffefefefefe
[13483.968527] 3c60: 7f7f7fffffffffff 656824ff6462716e 7f7f7f7f7f7f7f7f 0101010101010101
[13483.970309] 3c80: 0000000000000028 0000000000000001 0000000000000007 000000000000000e
[13483.972097] 3ca0: 0000000000000050 00000000b995214c
[13483.973621] [<ffffff8008113e68>] irq_thread_fn+0x44/0x74
[13483.975183] [<ffffff80081141a8>] irq_thread+0x138/0x1a0
[13483.976737] [<ffffff80080d6d80>] kthread+0xe0/0xf0
[13483.978256] [<ffffff8008082ef0>] ret_from_fork+0x10/0x20
[13483.979789] Code: 7100041f 540000e1 91025262 f9800051 (885f7c40) 
[13483.981388] ---[ end trace 14e9e3e474676f58 ]---
[13483.984979] Unable to handle kernel paging request at virtual address ffffffffffffffc8
[13483.986806] pgd = ffffffc0e1721000
[13483.988191] [ffffffffffffffc8] *pgd=00000000ebcb8003, *pud=00000000ebcb8003, *pmd=0000000000000000
[13483.990180] Internal error: Oops: 96000005 [#2] SMP
[13483.991735] Modules linked in: zfs(PO) zunicode(PO) zlua(PO) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) softdog r8152 af_packet snd_soc_rockchip_hdmi_dp midgard_kbase sg cdn_dp uio_pdrv_g
enirq gpio_beeper uio nfsd auth_rpcgss nfs_acl lockd lm75 grace sunrpc ip_tables x_tables raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx raid1 raid0 multipath linear md
_mod
[13483.999941] CPU: 4 PID: 203 Comm: irq/259-ahci4 Tainted: P      D    O    4.4.213-rk3399 #3
[13484.001913] Hardware name: Helios64 (DT)
[13484.003495] task: ffffffc0e1612a00 task.stack: ffffffc0e17f0000
[13484.005270] PC is at kthread_data+0x24/0x2c
[13484.006888] LR is at irq_thread_dtor+0x50/0xa0
[13484.008517] pc : [<ffffff80080d74c0>] lr : [<ffffff8008114020>] pstate: 60000145
[13484.010427] sp : ffffffc0e17f3a00
[13484.011995] x29: ffffffc0e17f3a00 x28: ffffffc0e1612a00 
[13484.013766] x27: ffffffc0e1612a00 x26: 0000000000000001 
[13484.015514] x25: 0000000000000000 x24: ffffff80092e60c0 
[13484.017253] x23: ffffff8008e1ca7e x22: ffffffc0e1613200 
[13484.018975] x21: ffffff80094438a0 x20: ffffffc0e1612a00 
[13484.020686] x19: ffffffc0e1612a00 x18: 0000000030d00800 
[13484.022405] x17: 0000000000000000 x16: 0000000000000000 
[13484.024131] x15: 0000000000000000 x14: ffffffc0ee6db800 
[13484.025868] x13: 00000040eec6f000 x12: 0000000034d5d91d 
[13484.027616] x11: 0000000000000000 x10: 0000000000000a30 
[13484.029370] x9 : ffffffc0e17f3970 x8 : ffffffc0e1613490 
[13484.031151] x7 : 0000000000000004 x6 : 0000000000668ae2 
[13484.032935] x5 : 0000004b6e4f92ab x4 : 0000000000000000 
[13484.034723] x3 : ffffffc0e16131b8 x2 : ffffffc0e1613200 
[13484.036530] x1 : ffffff8008113fd0 x0 : 0000000000000000 
[13484.038313] 
[13484.038313] PC: 0xffffff80080d7440:
[13484.041302] 7440  f85b8000 53030c14 721d001f 540000e0 52800014 2a1403e0 a94153f3 f94013f5
[13484.043397] 7460  a8c37bfd d65f03c0 52800040 aa1503e1 941021c0 d5384100 eb00027f 54fffea0
[13484.045500] 7480  aa1303e0 94003111 910062a0 942b5492 17fffff1 128004b4 17ffffef a9be7bfd
[13484.047617] 74a0  910003fd f9000bf3 aa0003f3 aa1e03e0 d503201f f9430a60 f9400bf3 a8c27bfd
[13484.049733] 74c0  f85c8000 d65f03c0 a9bd7bfd 910003fd f9000bf3 aa0003f3 aa1e03e0 d503201f
[13484.051831] 74e0  9100a3e0 d2800102 f90017ff f9430a61 d100e021 940308b2 f9400bf3 f94017e0
[13484.053944] 7500  a8c37bfd d65f03c0 a9bf7bfd 910003fd aa1e03e0 d503201f 12800000 a8c17bfd
[13484.056045] 7520  d65f03c0 a9be7bfd 910003fd a90153f3 aa0003f3 aa0103f4 aa1e03e0 d503201f
[13484.058156] 
[13484.058156] LR: 0xffffff8008113fa0:
[13484.061204] 3fa0  8801fc40 35ffffa1 d5033bbf 350000c0 9103a260 d2800003 52800022 52800061
[13484.063345] 3fc0  97ffa91f f9400bf3 a8c27bfd d65f03c0 a9be7bfd 910003fd a90153f3 aa1e03e0
[13484.065506] 3fe0  d503201f d5384114 b9402e80 37100160 d00097a0 91080400 39400401 35000081
[13484.067674] 4000  d4210000 52800021 39000401 a94153f3 a8c27bfd d65f03c0 aa1403e0 97ff0d20
[13484.069845] 4020  aa0003f3 b9454a82 911c6281 d0006880 913ef400 b9403a63 94020060 b9403a60
[13484.072024] 4040  97fff98f aa0003f4 91010261 52800000 940f2ee4 34000060 aa1403e0 97ffffc7
[13484.074201] 4060  aa1303e1 aa1403e0 97ffff34 17ffffe8 a9b87bfd 910003fd a90153f3 a9025bf5
[13484.076378] 4080  a90363f7 a9046bf9 a90573fb aa0003f5 aa1e03e0 d503201f b9403aa0 97fff978
[13484.078549] 
[13484.078549] SP: 0xffffffc0e17f3980:
[13484.081667] 3980  e1613200 ffffffc0 08e1ca7e ffffff80 092e60c0 ffffff80 00000000 00000000
[13484.083767] 39a0  00000001 00000000 e1612a00 ffffffc0 e1612a00 ffffffc0 e17f3a00 ffffffc0
[13484.085845] 39c0  08114020 ffffff80 e17f3a00 ffffffc0 080d74c0 ffffff80 60000145 00000000
[13484.087882] 39e0  e17f3a00 ffffffc0 08114020 ffffff80 00000000 00000080 080d7b50 ffffff80
[13484.089912] 3a00  e17f3a20 ffffffc0 080d4fa0 ffffff80 e1612a00 ffffffc0 00000000 00000000
[13484.091927] 3a20  e17f3a50 ffffffc0 080bd3e0 ffffff80 e1612a00 ffffffc0 00000000 00000000
[13484.093925] 3a40  e1613000 ffffffc0 e1613200 ffffffc0 e17f3ad0 ffffffc0 08088430 ffffff80
[13484.095911] 3a60  e17f3c20 ffffffc0 e1612a00 ffffffc0 00000001 00000000 092f2e30 ffffff80
[13484.097910] 
[13484.097910] X1: 0xffffff8008113f50:
[13484.100691] 3f50  f9400e60 f90017e0 aa1403e0 942a6bad d5384100 9100a3e1 97ff3a9e a94153f3
[13484.102683] 3f70  a8c37bfd d65f03c0 a9be7bfd 910003fd f9000bf3 aa0003f3 aa1e03e0 d503201f
[13484.104695] 3f90  91038262 f9800051 885f7c40 51000400 8801fc40 35ffffa1 d5033bbf 350000c0
[13484.106727] 3fb0  9103a260 d2800003 52800022 52800061 97ffa91f f9400bf3 a8c27bfd d65f03c0
[13484.108776] 3fd0  a9be7bfd 910003fd a90153f3 aa1e03e0 d503201f d5384114 b9402e80 37100160
[13484.110853] 3ff0  d00097a0 91080400 39400401 35000081 d4210000 52800021 39000401 a94153f3
[13484.112960] 4010  a8c27bfd d65f03c0 aa1403e0 97ff0d20 aa0003f3 b9454a82 911c6281 d0006880
[13484.115081] 4030  913ef400 b9403a63 94020060 b9403a60 97fff98f aa0003f4 91010261 52800000
[13484.117219] 
[13484.117219] X2: 0xffffffc0e1613180:
[13484.120334] 3180  00000000 00000000 00000000 00000000 e1613190 ffffffc0 e1613190 ffffffc0
[13484.122505] 31a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.124677] 31c0  00000000 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.126845] 31e0  00000000 00000000 2fa82fa8 dead4ead ffffffff 00000000 ffffffff ffffffff
[13484.129033] 3200  31823182 dead4ead ffffffff 00000000 ffffffff ffffffff 00000000 00000000
[13484.131212] 3220  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.133407] 3240  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.135585] 3260  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.137736] 
[13484.137736] X3: 0xffffffc0e1613138:
[13484.140844] 3138  e1613138 ffffffc0 e1613138 ffffffc0 00000000 00000000 00000000 00000000
[13484.142994] 3158  00000000 00000000 00000000 00000000 ed86b600 ffffffc0 ed866600 ffffffc0
[13484.145134] 3178  00000000 00000000 00000000 00000000 00000000 00000000 e1613190 ffffffc0
[13484.147231] 3198  e1613190 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[13484.149343] 31b8  00000000 00000000 00000000 00000000 ffffffff ffffffff 00000000 00000000
[13484.151417] 31d8  00000000 00000000 00000000 00000000 2fa82fa8 dead4ead ffffffff 00000000
[13484.153488] 31f8  ffffffff ffffffff 31823182 dead4ead ffffffff 00000000 ffffffff ffffffff
[13484.155574] 3218  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.157650] 
[13484.157650] X8: 0xffffffc0e1613410:
[13484.160604] 3410  00000000 00000000 00000000 00000000 00000000 00000001 00000000 00000000
[13484.162651] 3430  ee76f000 ffffffc0 e1612a00 ffffffc0 ee76f000 ffffffc0 092b3000 ffffff80
[13484.164691] 3450  eb6230c0 ffffffc0 08bce9c0 ffffff80 f7f3f200 ffffffc0 00000001 00000000
[13484.166724] 3470  08bce000 ffffff80 e1613090 ffffffc0 e17f3970 ffffffc0 e17f3970 ffffffc0
[13484.168748] 3490  08084f9c ffffff80 00000000 00000000 00000000 00000000 00000000 00000000
[13484.170777] 34b0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.172780] 34d0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.174771] 34f0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.176729] 
[13484.176729] X9: 0xffffffc0e17f38f0:
[13484.179499] 38f0  00000000 00000000 6e4f92ab 0000004b 00668ae2 00000000 00000004 00000000
[13484.181472] 3910  e1613490 ffffffc0 e17f3970 ffffffc0 00000a30 00000000 00000000 00000000
[13484.183440] 3930  34d5d91d 00000000 eec6f000 00000040 ee6db800 ffffffc0 00000000 00000000
[13484.185434] 3950  00000000 00000000 00000000 00000000 30d00800 00000000 e1612a00 ffffffc0
[13484.187430] 3970  e1612a00 ffffffc0 094438a0 ffffff80 e1613200 ffffffc0 08e1ca7e ffffff80
[13484.189431] 3990  092e60c0 ffffff80 00000000 00000000 00000001 00000000 e1612a00 ffffffc0
[13484.191409] 39b0  e1612a00 ffffffc0 e17f3a00 ffffffc0 08114020 ffffff80 e17f3a00 ffffffc0
[13484.193413] 39d0  080d74c0 ffffff80 60000145 00000000 e17f3a00 ffffffc0 08114020 ffffff80
[13484.195414] 
[13484.195414] X14: 0xffffffc0ee6db780:
[13484.198217] b780  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.200191] b7a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.202144] b7c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.204060] b7e0  00000000 00000000 00000000 00000000 08be2d58 ffffff80 024200ca 00000000
[13484.205959] b800  00000010 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.207845] b820  ee6f0000 ffffffc0 00000002 00200040 00000000 00000000 00000000 00000000
[13484.209725] b840  00000000 00000004 00000030 00000000 00324a96 00000001 ead73800 ffffffc0
[13484.211604] b860  00000004 00000001 00000078 00000078 00000078 00000000 08bce6e0 ffffff80
[13484.213469] 
[13484.213469] X19: 0xffffffc0e1612980:
[13484.216058] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.217955] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.219818] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.221673] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13484.223529] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.225410] 2a20  e17f0000 ffffffc0 00000003 00208044 00000000 00000000 00000000 00000000
[13484.227255] 2a40  00000001 00000004 00000080 00000000 00324a49 00000001 e17c3800 ffffffc0
[13484.229126] 2a60  00000004 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13484.230971] 
[13484.230971] X20: 0xffffffc0e1612980:
[13484.233509] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.235374] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.237240] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.239084] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13484.240905] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.242725] 2a20  e17f0000 ffffffc0 00000003 00208044 00000000 00000000 00000000 00000000
[13484.244508] 2a40  00000001 00000004 00000080 00000000 00324a49 00000001 e17c3800 ffffffc0
[13484.246318] 2a60  00000004 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13484.248097] 
[13484.248097] X21: 0xffffff8009443820:
[13484.250532] 3820  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.252337] 3840  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.254114] 3860  00000000 00000000 00000000 00000000 ee580f40 ffffffc0 ee580fc0 ffffffc0
[13484.255895] 3880  ee580f00 ffffffc0 ee580f80 ffffffc0 00000000 00000000 f7ec9f00 ffffffc0
[13484.257717] 38a0  00000000 00000000 00000000 00000000 ededa500 ffffffc0 00000001 00000000
[13484.259551] 38c0  ee5f0e00 ffffffc0 ee403600 ffffffc0 edda6080 ffffffc0 00000000 00000000
[13484.261388] 38e0  ee401c00 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[13484.263222] 3900  ee4f7600 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[13484.265039] 
[13484.265039] X22: 0xffffffc0e1613180:
[13484.267469] 3180  00000000 00000000 00000000 00000000 e1613190 ffffffc0 e1613190 ffffffc0
[13484.269299] 31a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.271095] 31c0  00000000 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.272891] 31e0  00000000 00000000 2fa82fa8 dead4ead ffffffff 00000000 ffffffff ffffffff
[13484.274676] 3200  31823182 dead4ead ffffffff 00000000 ffffffff ffffffff 00000000 00000000
[13484.276473] 3220  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.278260] 3240  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.280033] 3260  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.281790] 
[13484.281790] X23: 0xffffff8008e1c9fe:
[13484.284179] c9fc  206b7374 7025203d 43000a29 206c6c61 63617274 000a3a65 65637845 6f697470
[13484.285986] ca1c  7473206e 006b6361 6e493001 6e726574 65206c61 726f7272 7325203a 7825203a
[13484.287798] ca3c  25235b20 53205d64 000a504d 72503001 7365636f 2e252073 2820732a 3a646970
[13484.289641] ca5c  2c642520 61747320 6c206b63 74696d69 30203d20 29702578 7453000a 3a6b6361
[13484.291492] ca7c  30010020 74614600 65206c61 70656378 6e6f6974 206e6920 65746e69 70757272
[13484.293366] ca9c  61460074 206c6174 65637865 6f697470 6f4f006e 2d207370 47554220 25360100
[13484.295217] cabc  64255b73 75203a5d 6665646e 64656e69 736e6920 63757274 6e6f6974 6370203a
[13484.297108] cadc  0a70253d 00360100 73706f4f 75202d20 6665646e 64656e69 736e6920 63757274
[13484.298982] cafc  6e6f6974 25360100 64255b73 73203a5d 61637379 25206c6c 01000a64 64614232
[13484.300891] 
[13484.300891] X24: 0xffffff80092e6040:
[13484.303589] 6040  f547a000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.305562] 6060  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.307494] 6080  00000000 dead4ead ffffffff 00000000 ffffffff ffffffff 00000000 00000000
[13484.309438] 60a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.311372] 60c0  00000000 deaf1eed ffffffff 00000000 ffffffff ffffffff 00000000 00000000
[13484.313311] 60e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.315236] 6100  080bec20 ffffff80 081249c8 ffffff80 08a14824 ffffff80 08a17fe8 ffffff80
[13484.317170] 6120  084c2e48 ffffff80 084c3528 ffffff80 080bed14 ffffff80 080f777c ffffff80
[13484.319096] 
[13484.319096] X27: 0xffffffc0e1612980:
[13484.321870] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.323851] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.325829] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.327774] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13484.329713] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.331633] 2a20  e17f0000 ffffffc0 00000003 00208044 00000000 00000000 00000000 00000000
[13484.333579] 2a40  00000001 00000004 00000080 00000000 00324a49 00000001 e17c3800 ffffffc0
[13484.335492] 2a60  00000004 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13484.337442] 
[13484.337442] X28: 0xffffffc0e1612980:
[13484.340141] 2980  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.342086] 29a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.344004] 29c0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[13484.345912] 29e0  00000000 00000000 00000000 00000000 00000000 00000000 e1612a00 ffffffc0
[13484.347821] 2a00  00000012 00000000 ffffffff ffffffff 00000000 00000000 00000000 00000000
[13484.349725] 2a20  e17f0000 ffffffc0 00000003 00208044 00000000 00000000 00000000 00000000
[13484.351612] 2a40  00000001 00000004 00000080 00000000 00324a49 00000001 e17c3800 ffffffc0
[13484.353511] 2a60  00000004 00000001 00000031 00000078 00000031 00000032 08bce9c0 ffffff80
[13484.355391] 
[13484.355391] X29: 0xffffffc0e17f3980:
[13484.358041] 3980  e1613200 ffffffc0 08e1ca7e ffffff80 092e60c0 ffffff80 00000000 00000000
[13484.359940] 39a0  00000001 00000000 e1612a00 ffffffc0 e1612a00 ffffffc0 e17f3a00 ffffffc0
[13484.361854] 39c0  08114020 ffffff80 e17f3a00 ffffffc0 080d74c0 ffffff80 60000145 00000000
[13484.363782] 39e0  e17f3a00 ffffffc0 08114020 ffffff80 00000000 00000080 080d7b50 ffffff80
[13484.365741] 3a00  e17f3a20 ffffffc0 080d4fa0 ffffff80 e1612a00 ffffffc0 00000000 00000000
[13484.367681] 3a20  e17f3a50 ffffffc0 080bd3e0 ffffff80 e1612a00 ffffffc0 00000000 00000000
[13484.369630] 3a40  e1613000 ffffffc0 e1613200 ffffffc0 e17f3ad0 ffffffc0 08088430 ffffff80
[13484.371535] 3a60  e17f3c20 ffffffc0 e1612a00 ffffffc0 00000001 00000000 092f2e30 ffffff80
[13484.373441] 
[13484.374654] Process irq/259-ahci4 (pid: 203, stack limit = 0xffffffc0e17f0000)
[13484.376398] Stack: (0xffffffc0e17f3a00 to 0xffffffc0e17f4000)
[13484.378028] 3a00: ffffffc0e17f3a20 ffffff80080d4fa0 ffffffc0e1612a00 0000000000000000
[13484.379836] 3a20: ffffffc0e17f3a50 ffffff80080bd3e0 ffffffc0e1612a00 0000000000000000
[13484.381619] 3a40: ffffffc0e1613000 ffffffc0e1613200 ffffffc0e17f3ad0 ffffff8008088430
[13484.383389] 3a60: ffffffc0e17f3c20 ffffffc0e1612a00 0000000000000001 ffffff80092f2e30
[13484.385134] 3a80: ffffff8008e1ca7e 0000000000000140 ffffffc0e1612a00 0000000000000001
[13484.386869] 3aa0: ffffffc0e1612a00 ffffffc0e1612a00 ffffffc0e17f3ad0 ffffff800808841c
[13484.388617] 3ac0: ffffffc0e17f3c20 ffffffc0e1612a00 ffffffc0e17f3b10 ffffff8008093544
[13484.390372] 3ae0: ffffe2c0eadc1294 ffffffc0e17f3c20 0000000096000004 ffffffc0eb6230c0
[13484.392112] 3b00: 0000000060000145 0000000000000025 ffffffc0e17f3b40 ffffff8008093968
[13484.393886] 3b20: ffffffc0e17f3c20 ffffe2c0eadc1294 0000000096000004 ffffffc0eb6230c0
[13484.395649] 3b40: ffffffc0e17f3b70 ffffff8008080b08 0000000096000004 ffffe2c0eadc1294
[13484.397429] 3b60: ffffffc0e17f3c20 ffffff8008bc7070 ffffffc0e17f3d50 ffffff80080825cc
[13484.399202] 3b80: ffffe2c0eadc1200 0000008000000000 ffffffc0e17f3d50 ffffff8008113e68
[13484.400967] 3ba0: ffffffc062451380 0000000000001d4c ffffffc062451080 0000000000000005
[13484.402730] 3bc0: ffffffc0e17f3bf0 ffffff80084c2ed0 ffffffc0e17f3c10 ffffff80092b3000
[13484.404484] 3be0: ffffff80092e6100 0000000000000004 ffffffc0e17f3c20 ffffff8008081160
[13484.406256] 3c00: ffffffc0e17f3c20 ffffff8008081064 0000000000000000 ffffff800808100c
[13484.408000] 3c20: 0000000000000001 ffffffc0e1612a00 ffffe2c0eadc1294 ffffffbdc1891410
[13484.409788] 3c40: 0000000000000001 ffffff800867ea2c 00000040eec83000 6567fffefefefefe
[13484.411571] 3c60: 7f7f7fffffffffff 656824ff6462716e 7f7f7f7f7f7f7f7f 0101010101010101
[13484.413384] 3c80: 0000000000000028 0000000000000001 0000000000000007 000000000000000e
[13484.415211] 3ca0: 0000000000000050 00000000b995214c 0000000030d00800 ffffe2c0eadc1200
[13484.417037] 3cc0: ffffffc0ed84e400 0000000000000001 ffffff8008113fd0 ffffff8009409201
[13484.418854] 3ce0: ffffffc0ed84e440 ffffffc0e1612a00 0000000000000001 ffffffc0e1612a00
[13484.420684] 3d00: 0000000000000001 ffffffc0e17f3d50 ffffff8008113e54 ffffffc0e17f3d50
[13484.422517] 3d20: ffffff8008113e68 0000000060000145 ffffe2c0eadc1200 ffffffc0ed84e400
[13484.424347] 3d40: ffffffffffffffff ffffff8008113fd0 ffffffc0e17f3d80 ffffff80081141a8
[13484.426181] 3d60: ffffe2c0eadc1200 ffffff8008113e24 ffffffc0ed84e400 ffffff8008114128
[13484.428012] 3d80: ffffffc0e17f3e00 ffffff80080d6d80 ffffffc0ed858280 ffffffc0e1612a00
[13484.429871] 3da0: ffffff8008e216d2 ffffffc0ed84e400 ffffff8008114070 0000000000000000
[13484.431730] 3dc0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.433601] 3de0: ffffffc0ed858280 ffffffc0e1612a00 0000000000000000 ffffff8008113fd0
[13484.435468] 3e00: 0000000000000000 ffffff8008082ef0 ffffff80080d6ca0 ffffffc0ed858280
[13484.437342] 3e20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.439220] 3e40: ffffffc0e17f3e60 0000000000000000 ffffffc0ee71c600 ffffffc0ed84e400
[13484.441081] 3e60: ffffffc000000000 dead4ead00000000 ffffffc0ffffffff ffffffffffffffff
[13484.442954] 3e80: ffffffc0e17f3e80 ffffffc0e17f3e80 0000000000000001 dead4ead00010001
[13484.444822] 3ea0: 00000000ffffffff ffffffffffffffff ffffffc0e17f3eb0 ffffffc0e17f3eb0
[13484.446698] 3ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.448571] 3ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.450445] 3f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.452279] 3f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.454141] 3f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.455964] 3f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.457776] 3f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.459550] 3fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.461296] 3fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[13484.463020] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[13484.464703] Call trace:
[13484.465921] Exception stack(0xffffffc0e17f3830 to 0xffffffc0e17f3960)
[13484.467513] 3820:                                   ffffffc0e1612a00 0000008000000000
[13484.469248] 3840: ffffffc0e17f3a00 ffffff80080d74c0 0000000000000000 ffffffc0e17f3a70
[13484.470983] 3860: ffffffc0edf40000 ffffffc0e17f38b0 ffffffc0e17f38a0 ffffff8008baec70
[13484.472722] 3880: ffffffc0e17f38a0 ffffff8008baee00 00000000000001c0 000000000001d7de
[13484.474478] 38a0: ffffffc0e17f3910 ffffff80080fb598 ffffffc0f7f3f3d0 ffffffc0e1612ca8
[13484.476226] 38c0: 0000000000003221 ffffffc0f7f3f200 0000000000000000 ffffff8008113fd0
[13484.477981] 38e0: ffffffc0e1613200 ffffffc0e16131b8 0000000000000000 0000004b6e4f92ab
[13484.479717] 3900: 0000000000668ae2 0000000000000004 ffffffc0e1613490 ffffffc0e17f3970
[13484.481483] 3920: 0000000000000a30 0000000000000000 0000000034d5d91d 00000040eec6f000
[13484.483240] 3940: ffffffc0ee6db800 0000000000000000 0000000000000000 0000000000000000
[13484.485003] [<ffffff80080d74c0>] kthread_data+0x24/0x2c
[13484.486527] [<ffffff80080d4fa0>] task_work_run+0xa8/0xcc
[13484.488055] [<ffffff80080bd3e0>] do_exit+0x420/0x8d8
[13484.489545] [<ffffff8008088430>] die+0x1a4/0x1b8
[13484.490991] [<ffffff8008093544>] __do_kernel_fault.part.0+0x78/0x88
[13484.492584] [<ffffff8008093968>] do_translation_fault+0xb8/0xc8
[13484.494143] [<ffffff8008080b08>] do_mem_abort+0x54/0xac
[13484.495622] Exception stack(0xffffffc0e17f3b80 to 0xffffffc0e17f3cb0)
[13484.497210] 3b80: ffffe2c0eadc1200 0000008000000000 ffffffc0e17f3d50 ffffff8008113e68
[13484.498949] 3ba0: ffffffc062451380 0000000000001d4c ffffffc062451080 0000000000000005
[13484.500681] 3bc0: ffffffc0e17f3bf0 ffffff80084c2ed0 ffffffc0e17f3c10 ffffff80092b3000
[13484.502423] 3be0: ffffff80092e6100 0000000000000004 ffffffc0e17f3c20 ffffff8008081160
[13484.504148] 3c00: ffffffc0e17f3c20 ffffff8008081064 0000000000000000 ffffff800808100c
[13484.505891] 3c20: 0000000000000001 ffffffc0e1612a00 ffffe2c0eadc1294 ffffffbdc1891410
[13484.507619] 3c40: 0000000000000001 ffffff800867ea2c 00000040eec83000 6567fffefefefefe
[13484.509357] 3c60: 7f7f7fffffffffff 656824ff6462716e 7f7f7f7f7f7f7f7f 0101010101010101
[13484.511105] 3c80: 0000000000000028 0000000000000001 0000000000000007 000000000000000e
[13484.512870] 3ca0: 0000000000000050 00000000b995214c
[13484.514353] [<ffffff80080825cc>] el1_da+0x24/0x84
[13484.515810] [<ffffff80081141a8>] irq_thread+0x138/0x1a0
[13484.517312] [<ffffff80080d6d80>] kthread+0xe0/0xf0
[13484.518766] [<ffffff8008082ef0>] ret_from_fork+0x10/0x20
[13484.520256] Code: d503201f f9430a60 f9400bf3 a8c27bfd (f85c8000) 
[13484.521839] ---[ end trace 14e9e3e474676f59 ]---
[13484.525820] Fixing recursive fault but reboot is needed!

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.617705] Internal error: Oops: 96000004 [#1] SMP

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.911218] Process irq/259-ahci4 (pid: 203, stack limit = 0xffffffc0e17f0000)

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.912847] Stack: (0xffffffc0e17f3d50 to 0xffffffc0e17f4000)

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.914375] 3d40:                                   ffffffc0e17f3d80 ffffff80081141a8

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.916130] 3d60: ffffe2c0eadc1200 ffffff8008113e24 ffffffc0ed84e400 ffffff8008114128

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.917912] 3d80: ffffffc0e17f3e00 ffffff80080d6d80 ffffffc0ed858280 ffffffc0e1612a00

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.919697] 3da0: ffffff8008e216d2 ffffffc0ed84e400 ffffff8008114070 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.921510] 3dc0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.923305] 3de0: ffffffc0ed858280 ffffffc0e1612a00 0000000000000000 ffffff8008113fd0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.925110] 3e00: 0000000000000000 ffffff8008082ef0 ffffff80080d6ca0 ffffffc0ed858280

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.926905] 3e20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.928696] 3e40: ffffffc0e17f3e60 0000000000000000 ffffffc0ee71c600 ffffffc0ed84e400

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.930514] 3e60: ffffffc000000000 dead4ead00000000 ffffffc0ffffffff ffffffffffffffff

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.932333] 3e80: ffffffc0e17f3e80 ffffffc0e17f3e80 0000000000000000 dead4ead00000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.934153] 3ea0: 00000000ffffffff ffffffffffffffff ffffffc0e17f3eb0 ffffffc0e17f3eb0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.935970] 3ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.937801] 3ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.939617] 3f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.941400] 3f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.943172] 3f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.944912] 3f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.946651] 3f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.948394] 3fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.950125] 3fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.951843] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.979789] Code: 7100041f 540000e1 91025262 f9800051 (885f7c40) 

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13483.990180] Internal error: Oops: 96000005 [#2] SMP

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.374654] Process irq/259-ahci4 (pid: 203, stack limit = 0xffffffc0e17f0000)

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.376398] Stack: (0xffffffc0e17f3a00 to 0xffffffc0e17f4000)

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.378028] 3a00: ffffffc0e17f3a20 ffffff80080d4fa0 ffffffc0e1612a00 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.379836] 3a20: ffffffc0e17f3a50 ffffff80080bd3e0 ffffffc0e1612a00 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.381619] 3a40: ffffffc0e1613000 ffffffc0e1613200 ffffffc0e17f3ad0 ffffff8008088430

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.383389] 3a60: ffffffc0e17f3c20 ffffffc0e1612a00 0000000000000001 ffffff80092f2e30

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.385134] 3a80: ffffff8008e1ca7e 0000000000000140 ffffffc0e1612a00 0000000000000001

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.386869] 3aa0: ffffffc0e1612a00 ffffffc0e1612a00 ffffffc0e17f3ad0 ffffff800808841c

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.388617] 3ac0: ffffffc0e17f3c20 ffffffc0e1612a00 ffffffc0e17f3b10 ffffff8008093544

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.390372] 3ae0: ffffe2c0eadc1294 ffffffc0e17f3c20 0000000096000004 ffffffc0eb6230c0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.392112] 3b00: 0000000060000145 0000000000000025 ffffffc0e17f3b40 ffffff8008093968

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.393886] 3b20: ffffffc0e17f3c20 ffffe2c0eadc1294 0000000096000004 ffffffc0eb6230c0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.395649] 3b40: ffffffc0e17f3b70 ffffff8008080b08 0000000096000004 ffffe2c0eadc1294

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.397429] 3b60: ffffffc0e17f3c20 ffffff8008bc7070 ffffffc0e17f3d50 ffffff80080825cc

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.399202] 3b80: ffffe2c0eadc1200 0000008000000000 ffffffc0e17f3d50 ffffff8008113e68

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.400967] 3ba0: ffffffc062451380 0000000000001d4c ffffffc062451080 0000000000000005

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.402730] 3bc0: ffffffc0e17f3bf0 ffffff80084c2ed0 ffffffc0e17f3c10 ffffff80092b3000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.404484] 3be0: ffffff80092e6100 0000000000000004 ffffffc0e17f3c20 ffffff8008081160

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.406256] 3c00: ffffffc0e17f3c20 ffffff8008081064 0000000000000000 ffffff800808100c

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.408000] 3c20: 0000000000000001 ffffffc0e1612a00 ffffe2c0eadc1294 ffffffbdc1891410

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.409788] 3c40: 0000000000000001 ffffff800867ea2c 00000040eec83000 6567fffefefefefe

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.411571] 3c60: 7f7f7fffffffffff 656824ff6462716e 7f7f7f7f7f7f7f7f 0101010101010101

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.413384] 3c80: 0000000000000028 0000000000000001 0000000000000007 000000000000000e

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.415211] 3ca0: 0000000000000050 00000000b995214c 0000000030d00800 ffffe2c0eadc1200

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.417037] 3cc0: ffffffc0ed84e400 0000000000000001 ffffff8008113fd0 ffffff8009409201

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.418854] 3ce0: ffffffc0ed84e440 ffffffc0e1612a00 0000000000000001 ffffffc0e1612a00

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.420684] 3d00: 0000000000000001 ffffffc0e17f3d50 ffffff8008113e54 ffffffc0e17f3d50

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.422517] 3d20: ffffff8008113e68 0000000060000145 ffffe2c0eadc1200 ffffffc0ed84e400

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.424347] 3d40: ffffffffffffffff ffffff8008113fd0 ffffffc0e17f3d80 ffffff80081141a8

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.426181] 3d60: ffffe2c0eadc1200 ffffff8008113e24 ffffffc0ed84e400 ffffff8008114128

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.428012] 3d80: ffffffc0e17f3e00 ffffff80080d6d80 ffffffc0ed858280 ffffffc0e1612a00

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.429871] 3da0: ffffff8008e216d2 ffffffc0ed84e400 ffffff8008114070 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.431730] 3dc0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.433601] 3de0: ffffffc0ed858280 ffffffc0e1612a00 0000000000000000 ffffff8008113fd0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.435468] 3e00: 0000000000000000 ffffff8008082ef0 ffffff80080d6ca0 ffffffc0ed858280

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.437342] 3e20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.439220] 3e40: ffffffc0e17f3e60 0000000000000000 ffffffc0ee71c600 ffffffc0ed84e400

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.441081] 3e60: ffffffc000000000 dead4ead00000000 ffffffc0ffffffff ffffffffffffffff

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.442954] 3e80: ffffffc0e17f3e80 ffffffc0e17f3e80 0000000000000001 dead4ead00010001

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.444822] 3ea0: 00000000ffffffff ffffffffffffffff ffffffc0e17f3eb0 ffffffc0e17f3eb0

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.446698] 3ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.448571] 3ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.450445] 3f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.452279] 3f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.454141] 3f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.455964] 3f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.457776] 3f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.459550] 3fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.461296] 3fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.463020] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000

Message from syslogd@localhost at Oct  7 17:41:03 ...
 kernel:[13484.520256] Code: d503201f f9430a60 f9400bf3 a8c27bfd (f85c8000) 
[13514.580264] ata5.00: exception Emask 0x0 SAct 0x1c00 SErr 0x0 action 0x6 frozen
[13514.583877] ata5.00: failed command: WRITE FPDMA QUEUED
[13514.587339] ata5.00: cmd 61/08:50:10:82:00/00:00:0c:01:00/40 tag 10 ncq 4096 out
[13514.587339]          res 40/00:01:06:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
[13514.594777] ata5.00: status: { DRDY }
[13514.598247] ata5.00: failed command: WRITE FPDMA QUEUED
[13514.601932] ata5.00: cmd 61/18:58:40:8c:05/00:00:0c:01:00/40 tag 11 ncq 12288 out
[13514.601932]          res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
[13514.609896] ata5.00: status: { DRDY }
[13514.613629] ata5.00: failed command: WRITE FPDMA QUEUED
[13514.617568] ata5.00: cmd 61/18:60:38:d4:01/00:00:10:01:00/40 tag 12 ncq 12288 out
[13514.617568]          res 40/00:01:01:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
[13514.625792] ata5.00: status: { DRDY }
[13514.629550] ata5: hard resetting link
[13515.124053] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[13520.127922] ata5.00: qc timeout (cmd 0xec)
[13520.131747] ata5.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[13520.135765] ata5.00: revalidation failed (errno=-5)
[13520.139617] ata5: hard resetting link
[13520.631960] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[13530.635648] ata5.00: qc timeout (cmd 0xec)
[13530.639451] ata5.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[13530.643448] ata5.00: revalidation failed (errno=-5)
[13530.647276] ata5: limiting SATA link speed to 3.0 Gbps
[13530.651134] ata5: hard resetting link
[13531.143648] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[13561.146868] ata5.00: qc timeout (cmd 0xec)
[13561.150716] ata5.00: failed to IDENTIFY (I/O error, err_mask=0x4)
[13561.154765] ata5.00: revalidation failed (errno=-5)
[13561.158690] ata5.00: disabled
[13561.162424] ata5: hard resetting link
[13561.658842] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 320)
[13561.662914] sd 4:0:0:0: [sde] tag#10 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[13561.667160] sd 4:0:0:0: [sde] tag#10 Sense Key : 0x5 [current] [descriptor] 
[13561.671328] sd 4:0:0:0: [sde] tag#10 ASC=0x21 ASCQ=0x4 
[13561.675285] sd 4:0:0:0: [sde] tag#10 CDB: opcode=0x8a 8a 00 00 00 00 01 0c 00 82 10 00 00 00 08 00 00
[13561.679675] blk_update_request: I/O error, dev sde, sector 4496327184
[13561.683825] zio pool=storage vdev=/dev/disk/by-id/wwn-0x5000c500b27f7291-part1 error=5 type=2 offset=2302118469632 size=4096 flags=180880
[13561.692231] sd 4:0:0:0: [sde] tag#11 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[13561.696717] sd 4:0:0:0: [sde] tag#11 Sense Key : 0x5 [current] [descriptor] 
[13561.701146] sd 4:0:0:0: [sde] tag#11 ASC=0x21 ASCQ=0x4 
[13561.705398] sd 4:0:0:0: [sde] tag#11 CDB: opcode=0x8a 8a 00 00 00 00 01 0c 05 8c 40 00 00 00 18 00 00
[13561.710091] blk_update_request: I/O error, dev sde, sector 4496657472
[13561.714557] zio pool=storage vdev=/dev/disk/by-id/wwn-0x5000c500b27f7291-part1 error=5 type=2 offset=2302287577088 size=12288 flags=40080c80
[13561.723709] sd 4:0:0:0: [sde] tag#12 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
[13561.728582] sd 4:0:0:0: [sde] tag#12 Sense Key : 0x5 [current] [descriptor] 
[13561.733326] sd 4:0:0:0: [sde] tag#12 ASC=0x21 ASCQ=0x4 
[13561.737866] sd 4:0:0:0: [sde] tag#12 CDB: opcode=0x8a 8a 00 00 00 00 01 10 01 d4 38 00 00 00 18 00 00
[13561.742813] blk_update_request: I/O error, dev sde, sector 4563522616
[13561.747537] zio pool=storage vdev=/dev/disk/by-id/wwn-0x5000c500b27f7291-part1 error=5 type=2 offset=2336522530816 size=12288 flags=40080c80
[13561.757162] ata5: EH complete
[13561.761717] sd 4:0:0:0: [sde] tag#15 UNKNOWN(0x2003) Result: hostbyte=0x04 driverbyte=0x00
[13561.766846] sd 4:0:0:0: [sde] tag#15 CDB: opcode=0x88 88 00 00 00 00 01 d1 c0 77 80 00 00 00 08 00 00
[13561.766937] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.766941] sd 4:0:0:0: [sde] Sense not available.
[13561.767036] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.767038] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.767039] sd 4:0:0:0: [sde] Sense not available.
[13561.767040] sd 4:0:0:0: [sde] Sense not available.
[13561.767121] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.767123] sd 4:0:0:0: [sde] Sense not available.
[13561.767223] sd 4:0:0:0: [sde] Write Protect is on
[13561.767226] sd 4:0:0:0: [sde] Mode Sense: 00 7e 4f e1
[13561.767300] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.767305] sd 4:0:0:0: [sde] Sense not available.
[13561.767407] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.767412] sd 4:0:0:0: [sde] Sense not available.
[13561.839323] blk_update_request: I/O error, dev sde, sector 7814018944
[13561.845407] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.850634] sd 4:0:0:0: [sde] Sense not available.
[13561.855552] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.857845] sd 4:0:0:0: [sde] Sense not available.
[13561.858865] zio pool=storage vdev=/dev/disk/by-id/wwn-0x5000c500b27f7291-part1 error=5 type=2 offset=2336522563584 size=4096 flags=180880
[13561.858939] zio pool=storage vdev=/dev/disk/by-id/wwn-0x5000c500b27f7291-part1 error=5 type=2 offset=2578942078976 size=16384 flags=40080c80
[13561.942955] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.948749] sd 4:0:0:0: [sde] Sense not available.
[13561.956531] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13561.962294] sd 4:0:0:0: [sde] Sense not available.
[13561.970630] sd 4:0:0:0: [sde] Write Protect is off
[13561.975979] sd 4:0:0:0: [sde] Mode Sense: 2e 2e 2f 2e
[13562.280549] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.283602] sd 4:0:0:0: [sde] Sense not available.
[13562.286855] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.289411] sd 4:0:0:0: [sde] Sense not available.
[13562.292547] sd 4:0:0:0: [sde] Write Protect is on
[13562.294645] sd 4:0:0:0: [sde] Mode Sense: 40 41 9b ea
[13562.316505] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.321986] sd 4:0:0:0: [sde] Sense not available.
[13562.329699] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.334988] sd 4:0:0:0: [sde] Sense not available.
[13562.340015] sd 4:0:0:0: [sde] Write Protect is off
[13562.344783] sd 4:0:0:0: [sde] Mode Sense: 2e 2e 2f 2e
[13562.349781] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.354848] sd 4:0:0:0: [sde] Sense not available.
[13562.359647] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.364700] sd 4:0:0:0: [sde] Sense not available.
[13562.369750] sd 4:0:0:0: [sde] Write Protect is on
[13562.371633] sd 4:0:0:0: [sde] Mode Sense: ac 64 9c ce
[13562.377498] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.379765] sd 4:0:0:0: [sde] Sense not available.
[13562.381761] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.383965] sd 4:0:0:0: [sde] Sense not available.
[13562.385942] sd 4:0:0:0: [sde] Write Protect is off
[13562.387832] sd 4:0:0:0: [sde] Mode Sense: 00 c0 dd 56
[13562.389949] sd 4:0:0:0: [sde] Read Capacity(16) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.392326] sd 4:0:0:0: [sde] Sense not available.
[13562.394865] sd 4:0:0:0: [sde] Read Capacity(10) failed: Result: hostbyte=0x04 driverbyte=0x00
[13562.397209] sd 4:0:0:0: [sde] Sense not available.

 

 

Boot log (just in case):


DDR Version 1.24 20191016
In
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
change freq to 416MHz 0,1
Channel 0: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
Channel 1: LPDDR4,416MHz
Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB
256B stride
channel 0
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 1
CS = 0
MR0=0x18
MR4=0x1
MR5=0x1
MR8=0x10
MR12=0x72
MR14=0x72
MR18=0x0
MR19=0x0
MR24=0x8
MR25=0x0
channel 0 training pass!
channel 1 training pass!
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
change freq to 856MHz 1,0
ch 0 ddrconfig = 0x101, ddrsize = 0x40
ch 1 ddrconfig = 0x101, ddrsize = 0x40
pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD
ddr_set_rate to 328MHZ
ddr_set_rate to 666MHZ
ddr_set_rate to 928MHZ
channel 0, cs 0, advanced training done
channel 1, cs 0, advanced training done
ddr_set_rate to 416MHZ, ctl_index 0
ddr_set_rate to 856MHZ, ctl_index 1
support 416 856 328 666 928 MHz, current 856MHz
OUT
Boot1: 2019-03-14, version: 1.19
CPUId = 0x0
ChipType = 0x10, 254
SdmmcInit=2 0
BootCapSize=100000
UserCapSize=14910MB
FwPartOffset=2000 , 100000
mmc0:cmd5,20
SdmmcInit=0 0
BootCapSize=0
UserCapSize=30436MB
FwPartOffset=2000 , 0
StorageInit ok = 215428
SecureMode = 0
SecureInit read PBA: 0x4
SecureInit read PBA: 0x404
SecureInit read PBA: 0x804
SecureInit read PBA: 0xc04
SecureInit read PBA: 0x1004
SecureInit read PBA: 0x1404
SecureInit read PBA: 0x1804
SecureInit read PBA: 0x1c04
SecureInit ret = 0, SecureMode = 0
atags_set_bootdev: ret:(0)
GPT 0x3380ec0 signature is wrong
recovery gpt...
GPT 0x3380ec0 signature is wrong
recovery gpt fail!
LoadTrust Addr:0x4000
No find bl30.bin
No find bl32.bin
Load uboot, ReadLba = 2000
Load OK, addr=0x200000, size=0xded90
RunBL31 0x40000
NOTICE:  BL31: v1.3(debug):42583b6
NOTICE:  BL31: Built : 07:55:13, Oct 15 2019
NOTICE:  BL31: Rockchip release version: v1.1
INFO:    GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    plat_rockchip_pmu_init(1190): pd status 3e
INFO:    BL31: Initializing runtime services
WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK
ERROR:   Error initializing runtime service opteed_fast
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x200000
INFO:    SPSR = 0x3c9


U-Boot 2020.07-armbian (Oct 05 2020 - 15:53:18 +0200)

SoC: Rockchip rk3399
Reset cause: POR
DRAM:  3.9 GiB
PMIC:  RK808 
SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB
MMC:   mmc@fe320000: 1, sdhci@fe330000: 0
Loading Environment from MMC... unable to select a mode
*** Warning - No block device, using default environment

In:    serial
Out:   serial
Err:   serial
Model: Helios64
Revision: 1.2 - 4GB non ECC
Net:   eth0: ethernet@fe300000
scanning bus for devices...
Hit any key to stop autoboot:  0 
switch to partitions #0, OK
mmc1 is current device
Scanning mmc 1:1...
Found U-Boot script /boot/boot.scr
3185 bytes read in 5 ms (622.1 KiB/s)
## Executing script at 00500000
Boot script loaded from mmc 1
117 bytes read in 5 ms (22.5 KiB/s)
8511739 bytes read in 365 ms (22.2 MiB/s)
20703240 bytes read in 879 ms (22.5 MiB/s)
101917 bytes read in 12 ms (8.1 MiB/s)
2698 bytes read in 9 ms (292 KiB/s)
Applying kernel provided DT fixup script (rockchip-fixup.scr)
## Executing script at 09000000
## Loading init Ramdisk from Legacy Image at 06000000 ...
   Image Name:   uInitrd
   Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
   Data Size:    8511675 Bytes = 8.1 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 01f00000
   Booting using the fdt blob at 0x1f00000
   Loading Ramdisk to f56c6000, end f5ee40bb ... OK
ERROR: reserving fdt memory region failed (addr=0 size=0)
   Loading Device Tree to 00000000f5644000, end 00000000f56c5fff ... OK

Starting kernel ...

 

 

 

Edited by Werner
Use spoiler for longer pastes
Link to post
Share on other sites

6 minutes ago, antsu said:

I managed to catch the error this time, although I suspect because I caught it almost immediately after it happened, the system did not have a chance to become completely unresponsive.

As you will see in the log below, the disk in the 5th bay (sde) became "disconnected" after the error, which makes me wonder if a software fault caused the disk to "soft-disconnect" or if the disks' hardware is failing after hours of intense activity and triggered the error (in which case I'm just wasting everyone's time).

 

if its the disks fault you might see it in smartlog

smartctl --all /dev/sda

Link to post
Share on other sites

6 minutes ago, flower said:

 

if its the disks fault you might see it in smartlog

smartctl --all /dev/sda

 

Nothing wrong as far as I can tell:

sudo smartctl --all /dev/sde
smartctl 6.6 2017-11-05 r4594 [aarch64-linux-4.4.213-rk3399] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate IronWolf
Device Model:     ST4000VN008-2DR166
Serial Number:    xxxxxx
LU WWN Device Id: xxxxxx
Firmware Version: SC60
User Capacity:    4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5980 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Oct  7 18:33:40 2020 BST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  591) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 ( 664) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x50bd)	SCT Status supported.
					SCT Error Recovery Control supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   080   064   044    Pre-fail  Always       -       97064976
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       132
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   093   060   045    Pre-fail  Always       -       2082420238
  9 Power_On_Hours          0x0032   083   083   000    Old_age   Always       -       14904 (177 35 0)
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       132
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       2
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   071   053   040    Old_age   Always       -       29 (Min/Max 28/29)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       47
193 Load_Cycle_Count        0x0032   088   088   000    Old_age   Always       -       24785
194 Temperature_Celsius     0x0022   029   047   000    Old_age   Always       -       29 (0 16 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       14694 (50 14 0)
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       50906738288
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       157149639538

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     14904         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

 

Link to post
Share on other sites

because my first microSD has a satisfying image i got a second microSD today to test it.
I will try to reproduce my steps to copy + boot from the eMMC.
I have here still the 20.08.4 image for reference.
Tomorrow I have to set up my test setup to test more effective/faster and give feedback again.

 

@aprayoga is it true what @gprovost has written here that you have already fixed the eMMC problem and are working on a suitable Wiki?

If that's true then theoretically I can save myself the test run and just wait for your update.
Unless you would like to get further feedback on it.

Link to post
Share on other sites

11 hours ago, rjgould said:

If you're just having issues with the USB port then consider yourself lucky, on my case the two halves making up the body were not even in alignment :(

 

Could you please send us an email to support@kobol.io with some pictures in order to check what's wrong with your enclosure unit.

Link to post
Share on other sites

On 10/6/2020 at 3:32 PM, flower said:

Is there a way to update from legacy to current? 

You could use armbian-config, System->Other to switch branch but we are not recommend it. It might break the system.

 

 

11 hours ago, flower said:

- is there a way to see if the battery is used? i'd like to write a service which shuts down the unit on powerloss

You can poll /sys/class/power_supply/gpio-charger/online to check main power supply status.
 

12 hours ago, flower said:

- i get log messages about tx disconnect for r8152. followed by usb errors. iperf shows my transferrate correctly at 2.5gbits but file transfers hover around 80-150mb/s which is a bit slow

Yes, this is performance issue mentioned on our table. Our iperf test shown, only a few first transfer correctly at 2.5gbits

Spoiler



root@helios64:~# iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 10.10.10.254, port 57412
[  5] local 10.10.10.2 port 5201 connected to 10.10.10.254 port 57414
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   265 MBytes  2.23 Gbits/sec                  
[  5]   1.00-2.00   sec   280 MBytes  2.35 Gbits/sec                  
[  5]   2.00-3.00   sec   277 MBytes  2.32 Gbits/sec                  
[  5]   3.00-4.00   sec   280 MBytes  2.35 Gbits/sec                  
[  5]   4.00-5.00   sec   255 MBytes  2.14 Gbits/sec                  
[  5]   5.00-6.00   sec  0.00 Bytes  0.00 bits/sec                  
[  5]   6.00-7.00   sec  0.00 Bytes  0.00 bits/sec                  
[  5]   7.00-8.00   sec  0.00 Bytes  0.00 bits/sec                  
[  5]   8.00-9.00   sec  0.00 Bytes  0.00 bits/sec                  
[  5]   9.00-10.00  sec  0.00 Bytes  0.00 bits/sec                  
[  5]  10.00-11.00  sec  0.00 Bytes  0.00 bits/sec                  
[  5]  11.00-12.00  sec  0.00 Bytes  0.00 bits/sec                  
[  5]  12.00-13.00  sec  0.00 Bytes  0.00 bits/sec                  
[  5]  13.00-14.00  sec  0.00 Bytes  0.00 bits/sec                  
[  5]  14.00-14.68  sec  0.00 Bytes  0.00 bits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-14.68  sec  1.33 GBytes   776 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------


 

 

 

Link to post
Share on other sites

13 hours ago, flower said:

- i get log messages about tx disconnect for r8152. followed by usb errors. iperf shows my transferrate correctly at 2.5gbits but file transfers hover around 80-150mb/s which is a bit slow

 

In the meantime you can use ethtool -K eth1 tx off

This will disable checksum offloading which is what cause problem on LK5.8 with RTL8156 usb-to-lan brige (on LK4.4 there is not such problem and you will get sustained 2.35 Gbit/s). When checksum offloading is disable performance will be degraded to around 1.5 Gbit/s.

Link to post
Share on other sites

17 hours ago, gprovost said:

@antsu Maybe you want to create a dedicated thread "ZFS on Helios64" since it's a big topic on its own ? It will useful for later and this will avoid too many cross discussion here.

I agree. Apologies for sort of derailing the thread and my sincere thanks to those who tried to help. I'll keep an eye on the other thread I mentioned in my previous posts, since it is already essentially the same topic.

Link to post
Share on other sites

  • Werner pinned this topic

if someone wants to shutdown their unit on powerloss:

 

create file: /etc/udev/rules.d/15-gpio-charger.rules

SUBSYSTEM=="power_supply", ENV{POWER_SUPPLY_ONLINE}=="0", RUN+="/usr/sbin/halt"

 

i'd love to know a way to start that unit when power is available again though.

 

on 4.4 the system crashes on halt. but as it does this after all services are stopped and the disks are synced this is not really a problem.

on 5.8 the system stops and "system halted" appears on serial console - BUT it is still on and fans are spinning.

Link to post
Share on other sites

On 10/8/2020 at 3:45 AM, gprovost said:

 

Could you please send us an email to support@kobol.io with some pictures in order to check what's wrong with your enclosure unit.


Thanks for the offer but it was easier to just align them so I don't have any before pictures to send.  Basically the two halves of the shell were 2-3 cm adrift from being flush.

Link to post
Share on other sites

On 10/10/2020 at 7:30 AM, rjgould said:

Thanks for the offer but it was easier to just align them so I don't have any before pictures to send.  Basically the two halves of the shell were 2-3 cm adrift from being flush.

 

Hmmm... I think what you are referring to is completely normal. The 2 halves are 2 pieces of extruded aluminum that just slides into each other. What keep them secured, aligned and flushed is the internal metal sheet structure (what we call the Internal Backplane on our assembly manual). When the 2 halves are not secured to the Internal Backplane then, they can freely slides. Completely normal.

 

Link to post
Share on other sites

On 10/10/2020 at 1:09 AM, flower said:

create file: /etc/udev/rules.d/15-gpio-charger.rules


SUBSYSTEM=="power_supply", ENV{POWER_SUPPLY_ONLINE}=="0", RUN+="/usr/sbin/halt"

 

Cool simple trick ;-) Our goal is to have a service doing that in order to trigger the halt (or suspend)  after a configurable amount of time when main power loss.

 

 

On 10/10/2020 at 1:09 AM, flower said:

i'd love to know a way to start that unit when power is available again though.

Yes we have provisioned for it in our design, there is a gpio that you can toggle to enable auto power-on. However this GPIO isn't exposed yet in our DT file, we will put that in our immediate TODO list.

Link to post
Share on other sites

1 hour ago, gprovost said:

Cool simple trick ;-) Our goal is to have a service doing that in order to trigger the halt (or suspend)  after a configurable amount of time when main power loss.

usually it is better to use the batteries charging level instead of a fixed time value as a trigger. eg below 40% shutdown.

Link to post
Share on other sites

5 minutes ago, erikced said:

Is it possible set the fan speed of the pwm fans somehow? For me the fan connected to P6 never ever starts, whereas the fan connected to P7 always runs at full speed (well, a little slower when on battery power).

You can do that through /etc/fancontrol but the syntax is a litte strange. 

 

I tweaked mine to start the fans earlier (i have replaced the original ones with two 80mm noctua which are more silent) 

 

cat /sys/class/hwmon/hwmon0/pwm1                              104

cat /sys/class/hwmon/hwmon1/pwm1                              89

Shows current fan speed. Values are between 0 and 255

 

FCTEMPS connect cpu temp to both fans. 

 

My /etc/fancontrol

INTERVAL=10
FCTEMPS=/dev/fan-p6/pwm1=/dev/thermal-cpu/temp1_input /dev/fan-p7/pwm1=/dev/thermal-cpu/temp1_input
MINTEMP=/dev/fan-p6/pwm1=45 /dev/fan-p7/pwm1=45
MAXTEMP=/dev/fan-p6/pwm1=70 /dev/fan-p7/pwm1=70
MINSTART=/dev/fan-p6/pwm1=60 /dev/fan-p7/pwm1=60
MINSTOP=/dev/fan-p6/pwm1=29 /dev/fan-p7/pwm1=29
MINPWM=20

Link to post
Share on other sites

  • Werner pinned, unpinned, featured and unfeatured this topic
  • Werner locked this topic
Guest
This topic is now closed to further replies.
 Share

24 24