Jump to content

Random reboots on NanoPC-T4 with Armbian 5.69


Carlos Eduardo De Paula

Recommended Posts

As I reported here (https://github.com/armbian/build/issues/1230), I'm seeing frequent reboots and Kernel Panics on a RK3399 board while running ElasticSearch, a kinda heavy application that runs on Java.

 

I currently run a Kubernetes cluster on two RK3399 boards (NanoPC-T4). One of them I has a version of DietPi with a Kernel 4.4.138 compiled by myself. and runs perfectly. The other had a newer version of a Kernel (4.4.154) also compiled by me and that's where I started seeing the reboots.

 

After this, I installed Armbian thinking it might be something with my DietPi distro. I installed 5.69 with Kernel 4.4.167 and saw the same problems. I did a full memory test with *memtester* and found no errors.

 

After I reverted this board to the same 4.4.138 and it's DTB, the board is stable again. I can provide the DTB and Kernel I used that works. Looks like it's something from either newer kernels or newer DTB. I fetched the DTBs from FriendlyArm own tree (https://github.com/friendlyarm/kernel-rockchip) but compiled into the Rockchip Kernel (https://github.com/rockchip-linux/kernel). \

 

My board info:

 

_   _                   ____   ____   _____ _  _   
| \ | | __ _ _ __   ___ |  _ \ / ___| |_   _| || |  
|  \| |/ _` | '_ \ / _ \| |_) | |       | | | || |_ 
| |\  | (_| | | | | (_) |  __/| |___    | | |__   _|
|_| \_|\__,_|_| |_|\___/|_|    \____|   |_|    |_|  
                                                    

Welcome to ARMBIAN 5.69 stable Debian GNU/Linux 9 (stretch) 4.4.167-rk3399   
System load:   2.93 1.25 0.47   Up time:       1 min
Memory usage:  44 % of 3811MB   IP:            192.168.1.72 10.42.0.0
CPU temp:      56°C           
Usage of /:    25% of 15G    

[ 0 security updates available, 15 updates total: apt upgrade ]
Last check: 2019-01-17 16:11

[ General system configuration (beta): armbian-config ]

$ uname -a
Linux k8s-armnode2 4.4.167-rk3399 #70 SMP Thu Jan 10 20:46:25 CET 2019 aarch64 GNU/Linux

 

 

Here are the dumps I got from two crashes:

 

1:

Spoiler

k8s-armnode2 login: [  840.378459] Kernel panic - not syncing: hung_task: blocked tasks
[  840.379900] CPU: 4 PID: 39 Comm: khungtaskd Not tainted 4.4.167-rk3399 #70
[  840.381419] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.382786] Call trace:
[  840.383914] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.385313] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.386685] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.388042] [<ffffff800818eb18>] panic+0xe8/0x23c
[  840.389360] [<ffffff8008157858>] proc_dohung_task_timeout_secs+0x0/0x7c
[  840.390848] [<ffffff80080d7bd4>] kthread+0xe0/0xf0
[  840.392174] [<ffffff8008082ef0>] ret_from_fork+0x10/0x20
[  840.393534] CPU2: stopping
[  840.396332] CPU: 2 PID: 10583 Comm: containerd Not tainted 4.4.167-rk3399 #70
[  840.399565] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.402641] Call trace:
[  840.405452] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.408581] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.411688] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.414778] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.417860] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.420936] Exception stack(0xffffffc0e24ebec0 to 0xffffffc0e24ebff0)
[  840.424114] bec0: 0000000000000000 0000000000000000 0000000000000000 00000044209f6800
[  840.427450] bee0: 0000000000000000 0000000000000000 0000000000000001 0000000000000001
[  840.430735] bf00: 0000000000000062 0000000000000000 0000005586a37e00 0000000000000000
[  840.433990] bf20: 0000000000000000 0000000000000008 0000000000000013 0000000000000000
[  840.437236] bf40: 000000442083b7f0 0000004420340780 00000000000404a7 0000005585e60488
[  840.440487] bf60: 0000005585e877e8 0000000000000000 0000007f787fe5cf 0000005586922ab8
[  840.443739] bf80: 0000007f5bfff2b0 0000000001406f40 000000442083b468 0000000000000010
[  840.447005] bfa0: 000000442085be00 0000007f5bffe960 000000558622fb50 000000442083b800
[  840.450290] bfc0: 000000558622fbf0 0000000020000000 000000442005fd48 ffffffffffffffff
[  840.453587] bfe0: 0000000000000000 0000000000000000
[  840.456584] [<ffffff8008082cd4>] el0_irq_naked+0x4c/0x58
[  840.459631] CPU3: stopping
[  840.462432] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 4.4.167-rk3399 #70
[  840.465649] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.468731] Call trace:
[  840.471566] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.474704] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.477793] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.480871] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.483980] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.487137] Exception stack(0xffffffc0eeefbe30 to 0xffffffc0eeefbf60)
[  840.490414] be20:                                   0000000000000000 00000040eed3a000
[  840.493891] be40: 000000c3a5c2520d 0000000000000000 00000040eed3a000 00000004bc3a9dbc
[  840.497405] be60: 000000000005bbe8 0000000000000000 ffffffc0eeefbf50 0000000000000000
[  840.500919] be80: 0000000000000a30 0000000000000400 00000000000000c1 0000000000000001
[  840.504429] bea0: 0000000000000001 0000000000000000 ffffff8008134bc0 000000442006ae58
[  840.507938] bec0: 00000000000404a7 ffffffc0f7f140c0 000000c3a5c2520d ffffff80091d4000
[  840.511420] bee0: ffffff8009205000 ffffff8009205738 ffffff8008cbd000 000000000345b000
[  840.514875] bf00: 000000000345e000 0000000002ca0234 0000000000000000 ffffffc0eeefbf60
[  840.518322] bf20: ffffff8008130ce8 ffffffc0eeefbf60 ffffff8008130d44 0000000060000145
[  840.521798] bf40: ffffffc0eeefbf60 ffffff8008130ce8 ffffffffffffffff 000000c3a5c2520d
[  840.525269] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.528499] [<ffffff8008130d44>] tick_nohz_idle_exit+0xd8/0xe4
[  840.531848] [<ffffff8008100a14>] cpu_startup_entry+0x48/0x2ac
[  840.535198] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.538595] [<0000000002ca0178>] 0x2ca0178
[  840.541775] CPU1: stopping
[  840.544824] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.4.167-rk3399 #70
[  840.548282] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.551582] Call trace:
[  840.554583] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.557884] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.561126] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.564353] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.567611] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.570909] Exception stack(0xffffffc0eeef3d80 to 0xffffffc0eeef3eb0)
[  840.574331] 3d80: 0000000000007e1c 0000000000000001 00000040eed10000 0000000000000000
[  840.577909] 3da0: 0000000000000015 00ffffffffffffff 000000c3ab5b9438 0000000000000000
[  840.581436] 3dc0: ffffffc0eeee9890 ffffffc0eeef3ef0 0000000000000a30 0000000000000400
[  840.584998] 3de0: 00000000000000b9 0000000000000001 0000000000000001 00000000000003d2
[  840.588591] 3e00: ffffff8008207224 0000007fa8041130 00000000000404a7 ffffffc0f7eee200
[  840.592223] 3e20: ffffffc0eeee8e00 ffffffc0ecab2a00 0000000000000000 ffffff8008c97f98
[  840.595863] 3e40: 0000000000000001 ffffffc0f7eee200 0000000000000000 ffffff8008cbe000
[  840.599489] 3e60: ffffffc0eeee9490 ffffffc0eeef3eb0 ffffff8008c9b200 ffffffc0eeef3eb0
[  840.603127] 3e80: ffffff8008c9b204 0000000060000145 ffffffc0eeef3eb0 ffffff8008c9b200
[  840.606769] 3ea0: ffffffffffffffff ffffffc0eeee8e00
[  840.610129] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.613482] [<ffffff8008c9b204>] _raw_spin_unlock_irq+0x24/0x30
[  840.616935] [<ffffff80080e1500>] finish_task_switch+0x134/0x200
[  840.620375] [<ffffff8008c97f98>] __schedule+0x5ac/0x64c
[  840.623723] [<ffffff8008c98378>] schedule_idle+0x40/0x54
[  840.627041] [<ffffff8008100a20>] cpu_startup_entry+0x54/0x2ac
[  840.630396] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.633793] [<0000000002ca0178>] 0x2ca0178
[  840.636997] CPU5: stopping
[  840.638231] CPU: 5 PID: 0 Comm: swapper/5 Not tainted 4.4.167-rk3399 #70
[  840.639833] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.641304] Call trace:
[  840.642525] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.644004] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.645441] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.646869] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.648311] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.649784] Exception stack(0xffffffc0eef03da0 to 0xffffffc0eef03ed0)
[  840.651339] 3da0: 0000000000000000 0000000000000005 00000040eed64000 0000000000000020
[  840.653027] 3dc0: 00ffffffffffffff 00000004bc3a9dbc 000000000005bbe8 0000000000000005
[  840.654707] 3de0: 00000034b5593519 ffffff8008081800 0000000000001000 0000000000000000
[  840.656376] 3e00: 0000000034d5d91d 00000040eed64000 ffffffc0eeeec600 0000000000000000
[  840.658043] 3e20: 0000000000000000 0000000000000000 0000000030d00800 000000c3a5c2f934
[  840.659699] 3e40: 0000000000000002 ffffffc0ec4faa00 0000000000000002 ffffff800935eab8
[  840.661358] 3e60: 0000000000000001 000000c3a48ea564 ffffff800930d3f8 0000000002ca0234
[  840.663024] 3e80: 0000000000000000 ffffffc0eef03ed0 ffffff8008a279b4 ffffffc0eef03ed0
[  840.664692] 3ea0: ffffff8008a279b8 0000000060000145 ffffffc0eef03ed0 ffffff8008a279b4
[  840.666362] 3ec0: ffffffffffffffff 0000000000000002
[  840.667769] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.669171] [<ffffff8008a279b8>] cpuidle_enter_state+0x1fc/0x254
[  840.670666] [<ffffff8008a27a84>] cpuidle_enter+0x34/0x44
[  840.672091] [<ffffff80081009c4>] call_cpuidle+0x70/0x78
[  840.673501] [<ffffff8008100c68>] cpu_startup_entry+0x29c/0x2ac
[  840.674969] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.676484] [<0000000002ca0178>] 0x2ca0178
[  840.677813] CPU0: stopping
[  840.680834] CPU: 0 PID: 994 Comm: kubelet Not tainted 4.4.167-rk3399 #70
[  840.684241] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.687478] Call trace:
[  840.690458] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.693736] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.696963] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.700152] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.703338] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.706563] Exception stack(0xffffffc0eaadf930 to 0xffffffc0eaadfa60)
[  840.709887] f920:                                   0000000000006e62 0000000000000000
[  840.713381] f940: 00000040eecfb000 0000000000000000 ffffffc0f7ed9200 0000000000000001
[  840.716863] f960: 00000000009406da 00000000000002e9 0000000000c37e1e 0000000000000191
[  840.720341] f980: 0000000000000348 0000000011d5ca0b 0000000000000018 000000005c40a90c
[  840.723816] f9a0: 001e11e2f6890fa2 00005506f10d0926 ffffff80081f4ee8 0000000000000008
[  840.727304] f9c0: 00000000000404a7 0000000000000140 ffffffc0e703ee00 0000000000000140
[  840.730794] f9e0: 0000000000000001 0000000000000304 0000000000007ff5 0000000000000000
[  840.734287] fa00: 000000000000000b ffffffc0eaadfcd0 ffffffc0e6727c28 ffffffc0eaadfa60
[  840.737801] fa20: ffffff8008c9b1d0 ffffffc0eaadfa60 ffffff8008c9b1d4 0000000060000145
[  840.741323] fa40: ffffffc0eaadfa60 ffffff8008c9b1d0 0000008000000000 0000000000000001
[  840.744833] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.748094] [<ffffff8008c9b1d4>] _raw_spin_unlock_irqrestore+0x28/0x34
[  840.751508] [<ffffff80081003a0>] __wake_up_sync_key+0x64/0x78
[  840.754823] [<ffffff8008ba9a64>] unix_write_space+0x50/0x78
[  840.758112] [<ffffff8008af15ec>] sock_wfree+0x54/0x8c
[  840.761332] [<ffffff8008ba9f28>] unix_destruct_scm+0x60/0x6c
[  840.764622] [<ffffff8008af2c04>] skb_release_head_state+0x7c/0xd8
[  840.767982] [<ffffff8008af5c28>] __kfree_skb+0x20/0xa4
[  840.771254] [<ffffff8008af65f4>] consume_skb+0x94/0xc4
[  840.774509] [<ffffff8008babb44>] unix_stream_read_generic+0x520/0x6e0
[  840.777876] [<ffffff8008babde8>] unix_stream_recvmsg+0x50/0x60
[  840.781130] [<ffffff8008aeab10>] sock_recvmsg+0x5c/0x6c
[  840.784319] [<ffffff8008aeab98>] sock_read_iter+0x78/0xb0
[  840.787503] [<ffffff80081f3c24>] __vfs_read+0xc8/0xe8
[  840.790640] [<ffffff80081f4454>] vfs_read+0x84/0x138
[  840.793748] [<ffffff80081f4f3c>] SyS_read+0x54/0x98
[  840.796814] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  840.799896] CRU:
[  840.800957] 00000000: 0000003f 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.802636] 00000020: 00000053 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.804299] 00000040: 00000064 00001301 8000031f 00000108 00000007 00007f00 00000000 00000000
[  840.805948] 00000060: 000000c0 00001302 8000031f 00000008 00000007 00007f00 00000000 00000000
[  840.807587] 00000080: 00000064 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.809221] 000000a0: 0000004b 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.810845] 000000c0: 000000c6 00001202 8000031f 00000008 00000007 00007f00 00000000 00000000
[  840.812462] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.814071] 00000100: 00000100 00000707 00000140 00006909 00000083 00008581 00008320 00000141
[  840.815672] 00000120: 00000181 00008181 00000141 00000141 00004141 00008340 00003185 00000201
[  840.817271] 00000140: 0000041d 00000300 00002e87 00000110 00009381 00008387 00001103 00005282
[  840.818862] 00000160: 00008247 00000187 00001743 0000001f 00000380 00000300 00000380 00000000
[  840.820443] 00000180: 00006380 00009200 00000200 00000200 00000200 00000200 00003f3f 00000081
[  840.822019] 000001a0: 00000000 00000000 00004141 00000421 00008700 000002dc 00000004 00000381
[  840.823589] 000001c0: 00000381 00000001 00000003 00000087 00000087 00000141 00000141 00008181
[  840.825158] 000001e0: 00008320 00000007 00008f1f 00008f8f 00008f8f 00008787 00008787 00008787
[  840.826735] 00000200: 000000cf 000000cf 00000000 00000000 00000000 00000000 00000000 00000000
[  840.828316] 00000220: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.829887] 00000240: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.831436] 00000260: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.832958] 00000280: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60
[  840.834481] 000002a0: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 00000000 00000000 00000000 00000000
[  840.835999] 000002c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.837518] 000002e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.839016] 00000300: 00000080 00000080 00000202 0000006b 00000c30 00000000 0000001c 000001c0
[  840.840506] 00000320: 0000fff8 0000f0ff 0000f0ff 0000c130 0000000a 0000e233 00000000 00000000
[  840.841997] 00000340: 00000505 00000505 00000000 00000000 00000e04 0000000f 0000cfeb 00003f00
[  840.843482] 00000360: 0000ef60 00000020 00000ffe 000001f0 000000cc 00000f86 00000d0a 00000198
[  840.844962] 00000380: 00002010 00000000 0000002a 00000000 00000000 00000000 00000000 00000000
[  840.846434] 000003a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.847883] 000003c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.849314] 000003e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.850727] 00000400: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.852127] 00000420: 00000000 00004070 00000000 00000014 00000000 00000000 00000000 00000000
[  840.853518] 00000440: 00000000 00000000 00000000 00000000 00001000 00000000 00000000 00000000
[  840.854898] 00000460: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.856264] 00000480: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.857617] 000004a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.858964] 000004c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.860295] 000004e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.861616] 00000500: 00000000 00000000 00640064 00000000 00000003 00000001 00000000 00000000
[  840.862926] 00000520: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.864233] 00000540: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.865526] 00000560: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.866808] 00000580: 00000002 00000000 00000004 00000854 00000004
[  840.867885] PMU CRU:
[  840.868613] 00000000: 000000a9 00001203 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.869933] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.871226] 00000040: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.872519] 00000060: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.873809] 00000080: 0000060d 00001986 00000302 00000003 000002dc 00000600 0bb8ea60 00010014
[  840.875109] 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.876415] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.877720] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.879020] 00000100: 00000ffc 0000fb80 0000000f 00000000 00000024 00000000 00000000 00000000
[  840.880316] 00000120: 00000000 00000000 00000000 00000000 00000003
[  840.881398] PMU:
[  840.882099] 00000000: 00000000 00000000 00000000 00000000 00000000 10df8100 10df8100 00000000
[  840.883429] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.884750] 00000040: 00000000 00000000 00000000 00000000 00000000 98df833f 00000000 00000000
[  840.886061] 00000060: 004007f9 004007f9 004007f9 00000010 00000000 00007e00 00000000 28800000
[  840.887375] 00000080: 000003c0 00011940 00005dc0 000003c0 00005dc0 00000060 0000000f 00000018
[  840.888692] 000000a0: 00000018 00000018 00000018 00000006 00000006 00005dc0 00005dc0 00005dc0
[  840.890011] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 3fffffff 00000000
[  840.891326] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.892639] Kernel Offset: disabled
[  840.893521] Memory Limit: none
[  840.894379] rockchip-thermal ff260000.tsadc: channal 0: temperature(43 C)
[  840.895574] THERMAL REGS:
[  840.896405] 00000000: 00000200 00030133 00000031 00000002 00000000 00000000 00000000 00000000
[  840.897794] 00000020: 0000022d 0000021e 00000000 00000000 00000268 00000000 00000000 00000000
[  840.899189] 00000040: 000002a5 000002a5 00000000 00000000 00000000 00000000 00000000 00000000
[  840.900581] 00000060: 00000004 00000004 00000753 00000753 00000000 00000000 00000000 00000000
[  840.901963] 00000080: 00000000 00000000
[  840.902930] Rebooting in 10 seconds..

 

 

2:

Spoiler

[  433.025324] Bad mode in Error handler detected, code 0xbf000000 -- SError
[  433.025932] Internal error: Oops - bad mode: 0 [#1] SMP
[  433.026395] Modules linked in: xt_physdev xt_NFLOG nfnetlink_log veth dummy vport_vxlan vxlan ip6_udp_tunnel udp_tunnel openvswitch nf_defrag_ipv6 ip_set_hash_ip xt_set xt_statistic xt_nat xt_tcpudp ip_set ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc ipv6 overlay ip_tables x_tables [last unloaded: configs]
[  433.030849] CPU: 4 PID: 4711 Comm: java Not tainted 4.4.138 #3
[  433.031365] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.031839] task: ffffffc091eb1b00 task.stack: ffffffc09376c000
[  433.032359] PC is at 0x7f8002133c
[  433.032648] LR is at 0x7f80021344
[  433.032947] pc : [<0000007f8002133c>] lr : [<0000007f80021344>] pstate: 20000000
[  433.033590] sp : 0000007f7f5d6eb0
[  433.033879] x29: 0000007f7f5d6eb0 x28: 0000000000000034 
[  433.034363] x27: 0000000000200021 x26: 0000000100280000 
[  433.034847] x25: 0000000000020000 x24: 0000000000000000 
[  433.035331] x23: 0000000100260000 x22: 0000000000000000 
[  433.035813] x21: 0000000000000000 x20: 0000000100280000 
[  433.036297] x19: 000000010026e000 x18: 0000007f7885af00 
[  433.036780] x17: 0000007f80447908 x16: 0000007f802f9028 
[  433.037263] x15: 0000007f7885b130 x14: 00000001002590c0 
[  433.037746] x13: 0000007f1c76b578 x12: 0000000000000000 
[  433.038229] x11: 0000000000000013 x10: 0000007f1c76c318 
[  433.038712] x9 : 0000000000000012 x8 : 00000000000000de 
[  433.039195] x7 : fffffffffffff000 x6 : fffffffffffff000 
[  433.039678] x5 : 0000000000000000 x4 : 0000000000000000 
[  433.040161] x3 : 0000000000000000 x2 : 1900b81d799a9700 
[  433.040644] x1 : 0000000100280000 x0 : 0000000000001000 
[  433.041128] 
[  433.041269] Process java (pid: 4711, stack limit = 0xffffffc09376c000)
[  433.041905] ---[ end trace 215a1602b5a507c3 ]---
[  433.042313] Kernel panic - not syncing: Fatal exception
[  433.042778] CPU0: stopping
[  433.043036] CPU: 0 PID: 3646 Comm: containerd Tainted: G      D         4.4.138 #3
[  433.043702] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.044175] Call trace:
[  433.044408] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.044884] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.045337] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.045790] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.046253] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.046749] Exception stack(0xffffffc0beb57940 to 0xffffffc0beb57a70)
[  433.047315] 7940: ffffff80091dd000 0000000000000000 00000040eecf7000 00000040eecf7000
[  433.048006] 7960: 0000000000000000 000000000000000c 000000000000003f 0000000000000008
[  433.048696] 7980: 0000000000000001 0000000000000007 0101010101010101 0000000000000001
[  433.049386] 79a0: 001fffffe03fffff 000000000000000b 000000000000000b 0000000000000000
[  433.050076] 79c0: ffffff80081d7eec 0000004420083d70 000000000004048a ffffffc0ed3cedd8
[  433.050767] 79e0: ffffffc0beb57bc0 ffffffc0ed3ced80 ffffffc0beb57d50 00000000002900c4
[  433.051457] 7a00: ffffffc0ef19caa0 0000000000000316 ffffffc0ef19d6e0 ffffff8008c52000
[  433.052148] 7a20: ffffffc0be973600 ffffffc0beb57a70 ffffff8008c39478 ffffffc0beb57a70
[  433.052838] 7a40: ffffff8008106864 0000000060000145 ffffffc0ed3ceb50 ffffffc0beb57d50
[  433.053527] 7a60: 0000008000000000 ffffff8008c393d8
[  433.053956] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.054387] [<ffffff8008106864>] do_raw_spin_unlock+0x90/0xd0
[  433.054897] [<ffffff8008c39478>] _raw_spin_unlock+0x20/0x2c
[  433.055396] [<ffffff8008435660>] lockref_get+0x28/0x34
[  433.055850] [<ffffff80081e4060>] follow_managed+0xb0/0x22c
[  433.056336] [<ffffff80081e484c>] lookup_fast+0x264/0x27c
[  433.056810] [<ffffff80081e4c78>] walk_component+0xc8/0x290
[  433.057295] [<ffffff80081e4fe4>] link_path_walk+0x1a4/0x478
[  433.057792] [<ffffff80081e5a40>] path_openat+0x208/0xbd4
[  433.058267] [<ffffff80081e75f4>] do_filp_open+0x48/0x94
[  433.058731] [<ffffff80081d7d68>] do_sys_open+0x114/0x250
[  433.059205] [<ffffff80081d7f28>] SyS_openat+0x3c/0x4c
[  433.059656] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  433.060129] CPU3: stopping
[  433.060377] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D         4.4.138 #3
[  433.061009] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.061480] Call trace:
[  433.061704] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.062179] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.062629] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.063080] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.063543] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.064038] Exception stack(0xffffffc0ef2f3d50 to 0xffffffc0ef2f3e80)
[  433.064603] 3d40:                                   0000000000001ac6 0000000000000003
[  433.065294] 3d60: 00000040eed36000 0000000000000000 ffffffc0f7f1d970 00ffffffffffffff
[  433.065984] 3d80: 0000000000000000 0000000000000000 ffffffc0ef2db2a0 ffffffc0ef2f3ed0
[  433.066674] 3da0: 00000000000009c0 0000000000000000 0000000000000018 000000005c40edeb
[  433.067365] 3dc0: 0003226c0f21c0f9 0000187c8e003226 ffffff8008122a44 0000007faf73302f
[  433.068055] 3de0: 0000000000000000 ffffffc0f7f1d080 ffffffc0f7f1d080 ffffff8008c35f68
[  433.068745] 3e00: ffffffc0e92db600 0000000000000000 0000000000000001 ffffffc0ef2da880
[  433.069435] 3e20: 0000000000000000 ffffff8008c5e000 ffffffc0ef2daf10 ffffffc0ef2f3e80
[  433.070126] 3e40: ffffff8008c394d8 ffffffc0ef2f3e80 ffffff8008c394dc 0000000060000145
[  433.070817] 3e60: ffffffc0ef2f3e80 ffffff8008c394d8 ffffffffffffffff ffffff8008c36218
[  433.071507] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.071935] [<ffffff8008c394dc>] _raw_spin_unlock_irq+0x24/0x30
[  433.072456] [<ffffff80080e0990>] finish_task_switch+0x128/0x20c
[  433.072978] [<ffffff8008c35f68>] __schedule+0x338/0x65c
[  433.073442] [<ffffff8008c36608>] schedule_idle+0x48/0x5c
[  433.073918] [<ffffff80080fff38>] cpu_startup_entry+0x58/0x2bc
[  433.074426] [<ffffff800808d560>] secondary_start_kernel+0x194/0x1c0
[  433.074980] [<0000000002c3e178>] 0x2c3e178
[  433.075339] CPU1: stopping
[  433.075586] CPU: 1 PID: 2527 Comm: kube-proxy Tainted: G      D         4.4.138 #3
[  433.076252] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.076724] Call trace:
[  433.076948] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.077423] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.077873] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.078324] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.078786] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.079281] Exception stack(0xffffffc0e8df7b90 to 0xffffffc0e8df7cc0)
[  433.079846] 7b80:                                   000000000000340e 0000000000000001
[  433.080536] 7ba0: 00000040eed0c000 0000000000000000 0000000000000000 0000000000000001
[  433.081226] 7bc0: 0000000000000004 00000064d35c0796 ffffffc0e8c70a20 ffffffc0e8df7d10
[  433.081916] 7be0: 00000000000009c0 0000000000000191 00000000000000cc 0000000000000004
[  433.082607] 7c00: 0000000000000001 000017bd2600309e ffffff8008122a44 0000007fa6280440
[  433.083298] 7c20: 000000000004048a ffffffc0f7ef3080 ffffffc0f7ef3080 ffffff8008c35f68
[  433.083988] 7c40: ffffffc0e842d100 0000000000000000 0000000000000001 ffffffc0e8c70000
[  433.084678] 7c60: 0000000000000000 ffffff8009217000 ffffffc0e8c70688 ffffffc0e8df7cc0
[  433.085368] 7c80: ffffff8008c394d8 ffffffc0e8df7cc0 ffffff8008c394dc 0000000060000145
[  433.086059] 7ca0: ffffffc0e8df7cc0 ffffff8008c394d8 0000008000000000 ffffff8008c35da4
[  433.086749] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.087177] [<ffffff8008c394dc>] _raw_spin_unlock_irq+0x24/0x30
[  433.087697] [<ffffff80080e0990>] finish_task_switch+0x128/0x20c
[  433.088217] [<ffffff8008c35f68>] __schedule+0x338/0x65c
[  433.088680] [<ffffff8008c36310>] schedule+0x84/0x98
[  433.089109] [<ffffff8008c38ca8>] do_nanosleep+0x7c/0xf4
[  433.089574] [<ffffff80081229c4>] hrtimer_nanosleep+0x94/0x114
[  433.090083] [<ffffff8008122adc>] SyS_nanosleep+0x98/0x9c
[  433.090557] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  433.091029] CPU5: stopping
[  433.091276] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D         4.4.138 #3
[  433.091907] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.092378] Call trace:
[  433.092605] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.093078] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.093527] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.093976] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.094436] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.094930] Exception stack(0xffffffc0ef2fbd90 to 0xffffffc0ef2fbec0)
[  433.095492] bd80:                                   ffffffc0f7f47080 00000040eed60000
[  433.096181] bda0: ffffffc0f7f47080 0003226c0f21c0f9 00ffffffffffffff 000000027ef86746
[  433.096868] bdc0: 000000000007aaf2 0000000000000000 ffffffc0ef2fbf50 0000000000000000
[  433.097556] bde0: 00000000000009c0 0000000000000644 00000000000004e6 0000000100000005
[  433.098243] be00: 0000000000000004 000000000000000e 0000000000000004 00000000a45aa36f
[  433.098932] be20: 00000000000000b7 00000064cee6c00b 0000000000000000 ffffffc0ede25e00
[  433.099619] be40: ffffff800938ac78 0000000000000000 00000064cee4d4fe ffffff8009332bb8
[  433.100307] be60: ffffffc0ef2dc380 0000000002c3e234 0000000000000000 ffffffc0ef2fbec0
[  433.100994] be80: ffffff800898fbd0 ffffffc0ef2fbec0 ffffff800898fc04 0000000060000145
[  433.101682] bea0: ffffffc0ef2fbec0 ffffff800898fbd0 ffffffffffffffff 0000000000000000
[  433.102369] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.102798] [<ffffff800898fc04>] cpuidle_enter_state+0x1cc/0x25c
[  433.103326] [<ffffff800898fd08>] cpuidle_enter+0x34/0x44
[  433.103799] [<ffffff80080ffed8>] call_cpuidle+0x6c/0x74
[  433.104260] [<ffffff800810018c>] cpu_startup_entry+0x2ac/0x2bc
[  433.104777] [<ffffff800808d560>] secondary_start_kernel+0x194/0x1c0
[  433.105327] [<0000000002c3e178>] 0x2c3e178
[  433.105686] CPU2: stopping
[  433.105936] CPU: 2 PID: 183 Comm: systemd-journal Tainted: G      D         4.4.138 #3
[  433.106625] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.107096] Call trace:
[  433.107320] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.107795] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.108246] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.108696] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.109158] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.109654] Exception stack(0xffffffc0ed577ec0 to 0xffffffc0ed577ff0)
[  433.110220] 7ec0: 00000000000001a8 0000007f7d8dcc80 0000000000000010 0000007f7c4fe760
[  433.110910] 7ee0: 0000007f7c4fe901 0000007f7c4fe848 00000000000000e1 ffffffffffffffff
[  433.111601] 7f00: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
[  433.112291] 7f20: ffffffffffffffff ffffffffffffffff 0000000000000027 00001835eaaadc40
[  433.112981] 7f40: 0000007f7d90d218 0000007f7db58838 0000000000000063 0000007f7db714a8
[  433.113671] 7f60: 0000007f7db64a80 0000000000000003 0000000000000003 0000007f7db64a50
[  433.114361] 7f80: 0000000000000010 0000007f7db75030 000000557ec99760 0000000000000001
[  433.115052] 7fa0: 0000000000000001 0000007fd8715c00 0000007f7db58950 0000007fd8715c00
[  433.115742] 7fc0: 0000007f7db58930 0000000020000000 000000557ec97230 ffffffffffffffff
[  433.116431] 7fe0: 0000000000000000 0000000000000000
[  433.116860] [<ffffff8008082cd4>] el0_irq_naked+0x4c/0x58
[  433.117334] CRU:
[  433.117503] 00000000: 0000003b 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.118251] 00000020: 0000004b 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.118999] 00000040: 00000064 00001301 8000031f 00000108 00000007 00007f00 00000000 00000000
[  433.119747] 00000060: 00000041 00004601 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.120494] 00000080: 00000190 00001206 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.121242] 000000a0: 0000004b 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.121989] 000000c0: 000000c6 00001202 8000031f 00000008 00000007 00007f00 00000000 00000000
[  433.122736] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.123484] 00000100: 00000100 00000606 00000140 00006808 00000083 00008581 00008320 00000141
[  433.124232] 00000120: 00000181 00008181 00000141 00000141 00004141 00008343 00003185 00000201
[  433.124979] 00000140: 0000041d 00000300 00004a87 00000110 00009381 00008387 00001103 00005282
[  433.125727] 00000160: 00008247 00000187 00001743 0000001f 00000380 00000300 00000380 00000000
[  433.126474] 00000180: 0000e380 00009200 00000200 00000200 00000200 00000200 00003f3f 00000081
[  433.127221] 000001a0: 00000000 00000000 00004141 00000421 00008700 000002dc 00000005 00000381
[  433.127968] 000001c0: 00000381 00000100 00000003 00000087 00000087 00000141 00000141 00008141
[  433.128715] 000001e0: 00008321 00000007 00008f1f 00008f8f 00008f8f 00008787 00008787 00008787
[  433.129463] 00000200: 000000cf 000000cf 00000000 00000000 00000000 00000000 00000000 00000000
[  433.130210] 00000220: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.130957] 00000240: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.131705] 00000260: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.132452] 00000280: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60
[  433.133199] 000002a0: 0bb8ea60 0bb8ea60 00010014 0bb8ea60 00000000 00000000 00000000 00000000
[  433.133946] 000002c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.134694] 000002e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.135441] 00000300: 00000080 00000080 00000202 0000006b 00000c30 00000000 0000001c 000001c0
[  433.136188] 00000320: 0000fff8 0000f0ff 0000e0ff 0000c130 0000004a 0000e233 00000000 00000000
[  433.136936] 00000340: 00000505 00000505 00000000 00000000 00000e04 0000000f 0000cfeb 00003f00
[  433.137683] 00000360: 0000ef60 00000020 00000ffe 000001c0 000000c0 00000f86 00000d0a 000001b8
[  433.138430] 00000380: 00000010 00000000 0000002a 00000000 00000000 00000000 00000000 00000000
[  433.139177] 000003a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.139924] 000003c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.140672] 000003e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.141419] 00000400: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.142166] 00000420: 00000000 00004070 00000000 00000014 00000000 00000000 00000000 00000000
[  433.142913] 00000440: 00000000 00000000 00000000 00000000 00001000 00000000 00000000 00000000
[  433.143661] 00000460: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.144408] 00000480: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.145155] 000004a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.145902] 000004c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.146649] 000004e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.147396] 00000500: 00000000 00000000 00640064 00000000 00000003 00000001 00000000 00000000
[  433.148143] 00000520: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.148891] 00000540: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.149637] 00000560: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.150384] 00000580: 00000004 00000000 00000004 0000081c 00000004
[  433.150923] PMU CRU:
[  433.151124] 00000000: 000000a9 00001203 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.151873] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.152622] 00000040: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.153371] 00000060: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.154120] 00000080: 0000060d 00001986 00000302 00000003 000002dc 00000600 0bb8ea60 00010014
[  433.154869] 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.155618] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.156367] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.157116] 00000100: 00000ffc 0000fb80 0000000f 00000000 00000024 00000000 00000000 00000000
[  433.157863] 00000120: 00000000 00000180 00000000 00000000 00000003
[  433.158403] PMU:
[  433.158571] 00000000: 00000000 00000000 00000000 00000000 00000000 008f8100 008f8100 00000000
[  433.159319] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.160068] 00000040: 00000000 00000000 00000000 00000000 00000000 988f833f 00000000 00000000
[  433.160817] 00000060: 00000579 00000579 00000579 00000010 00000000 00007e00 00000000 28800000
[  433.161566] 00000080: 000003c0 00011940 00005dc0 000003c0 00005dc0 00000060 0000000f 00000018
[  433.162315] 000000a0: 00000018 00000018 00000018 00000006 00000006 00005dc0 00005dc0 00005dc0
[  433.163064] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 3fffffff 00000000
[  433.163813] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.164558] Kernel Offset: disabled
[  433.164868] Memory Limit: none
[  433.165151] rockchip-thermal ff260000.tsadc: channal 0: temperature(43 C)
[  433.165747] THERMAL REGS:
[  433.165982] 00000000: 00000200 00030133 00000031 00000002 00000000 00000000 00000000 00000000
[  433.166730] 00000020: 00000225 0000021c 00000000 00000000 0000024e 00000000 00000000 00000000
[  433.167478] 00000040: 000002a5 000002a5 00000000 00000000 00000000 00000000 00000000 00000000
[  433.168226] 00000060: 00000004 00000004 00000753 00000753 00000000 00000000 00000000 00000000
[  433.168971] 00000080: 00000000 00000000
[  433.169306] Rebooting in 10 seconds..

 

I can provide more info if needed.

Edited by Igor
spoilers
Link to comment
Share on other sites

10 hours ago, Carlos Eduardo De Paula said:

As I reported here (https://github.com/armbian/build/issues/1230), I'm seeing frequent reboots and Kernel Panics on a RK3399 board while running ElasticSearch, a kinda heavy application that runs on Java.

 

I currently run a Kubernetes cluster on two RK3399 boards (NanoPC-T4). One of them I has a version of DietPi with a Kernel 4.4.138 compiled by myself. and runs perfectly. The other had a newer version of a Kernel (4.4.154) also compiled by me and that's where I started seeing the reboots.

 

After this, I installed Armbian thinking it might be something with my DietPi distro. I installed 5.69 with Kernel 4.4.167 and saw the same problems. I did a full memory test with *memtester* and found no errors.

 

After I reverted this board to the same 4.4.138 and it's DTB, the board is stable again. I can provide the DTB and Kernel I used that works. Looks like it's something from either newer kernels or newer DTB. I fetched the DTBs from FriendlyArm own tree (https://github.com/friendlyarm/kernel-rockchip) but compiled into the Rockchip Kernel (https://github.com/rockchip-linux/kernel). \

 

My board info:

 


_   _                   ____   ____   _____ _  _   
| \ | | __ _ _ __   ___ |  _ \ / ___| |_   _| || |  
|  \| |/ _` | '_ \ / _ \| |_) | |       | | | || |_ 
| |\  | (_| | | | | (_) |  __/| |___    | | |__   _|
|_| \_|\__,_|_| |_|\___/|_|    \____|   |_|    |_|  
                                                    

Welcome to ARMBIAN 5.69 stable Debian GNU/Linux 9 (stretch) 4.4.167-rk3399   
System load:   2.93 1.25 0.47   Up time:       1 min
Memory usage:  44 % of 3811MB   IP:            192.168.1.72 10.42.0.0
CPU temp:      56°C           
Usage of /:    25% of 15G    

[ 0 security updates available, 15 updates total: apt upgrade ]
Last check: 2019-01-17 16:11

[ General system configuration (beta): armbian-config ]

$ uname -a
Linux k8s-armnode2 4.4.167-rk3399 #70 SMP Thu Jan 10 20:46:25 CET 2019 aarch64 GNU/Linux

 

 

Here are the dumps I got from two crashes:

 

1:

Spoiler


k8s-armnode2 login: [  840.378459] Kernel panic - not syncing: hung_task: blocked tasks
[  840.379900] CPU: 4 PID: 39 Comm: khungtaskd Not tainted 4.4.167-rk3399 #70
[  840.381419] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.382786] Call trace:
[  840.383914] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.385313] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.386685] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.388042] [<ffffff800818eb18>] panic+0xe8/0x23c
[  840.389360] [<ffffff8008157858>] proc_dohung_task_timeout_secs+0x0/0x7c
[  840.390848] [<ffffff80080d7bd4>] kthread+0xe0/0xf0
[  840.392174] [<ffffff8008082ef0>] ret_from_fork+0x10/0x20
[  840.393534] CPU2: stopping
[  840.396332] CPU: 2 PID: 10583 Comm: containerd Not tainted 4.4.167-rk3399 #70
[  840.399565] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.402641] Call trace:
[  840.405452] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.408581] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.411688] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.414778] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.417860] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.420936] Exception stack(0xffffffc0e24ebec0 to 0xffffffc0e24ebff0)
[  840.424114] bec0: 0000000000000000 0000000000000000 0000000000000000 00000044209f6800
[  840.427450] bee0: 0000000000000000 0000000000000000 0000000000000001 0000000000000001
[  840.430735] bf00: 0000000000000062 0000000000000000 0000005586a37e00 0000000000000000
[  840.433990] bf20: 0000000000000000 0000000000000008 0000000000000013 0000000000000000
[  840.437236] bf40: 000000442083b7f0 0000004420340780 00000000000404a7 0000005585e60488
[  840.440487] bf60: 0000005585e877e8 0000000000000000 0000007f787fe5cf 0000005586922ab8
[  840.443739] bf80: 0000007f5bfff2b0 0000000001406f40 000000442083b468 0000000000000010
[  840.447005] bfa0: 000000442085be00 0000007f5bffe960 000000558622fb50 000000442083b800
[  840.450290] bfc0: 000000558622fbf0 0000000020000000 000000442005fd48 ffffffffffffffff
[  840.453587] bfe0: 0000000000000000 0000000000000000
[  840.456584] [<ffffff8008082cd4>] el0_irq_naked+0x4c/0x58
[  840.459631] CPU3: stopping
[  840.462432] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 4.4.167-rk3399 #70
[  840.465649] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.468731] Call trace:
[  840.471566] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.474704] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.477793] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.480871] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.483980] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.487137] Exception stack(0xffffffc0eeefbe30 to 0xffffffc0eeefbf60)
[  840.490414] be20:                                   0000000000000000 00000040eed3a000
[  840.493891] be40: 000000c3a5c2520d 0000000000000000 00000040eed3a000 00000004bc3a9dbc
[  840.497405] be60: 000000000005bbe8 0000000000000000 ffffffc0eeefbf50 0000000000000000
[  840.500919] be80: 0000000000000a30 0000000000000400 00000000000000c1 0000000000000001
[  840.504429] bea0: 0000000000000001 0000000000000000 ffffff8008134bc0 000000442006ae58
[  840.507938] bec0: 00000000000404a7 ffffffc0f7f140c0 000000c3a5c2520d ffffff80091d4000
[  840.511420] bee0: ffffff8009205000 ffffff8009205738 ffffff8008cbd000 000000000345b000
[  840.514875] bf00: 000000000345e000 0000000002ca0234 0000000000000000 ffffffc0eeefbf60
[  840.518322] bf20: ffffff8008130ce8 ffffffc0eeefbf60 ffffff8008130d44 0000000060000145
[  840.521798] bf40: ffffffc0eeefbf60 ffffff8008130ce8 ffffffffffffffff 000000c3a5c2520d
[  840.525269] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.528499] [<ffffff8008130d44>] tick_nohz_idle_exit+0xd8/0xe4
[  840.531848] [<ffffff8008100a14>] cpu_startup_entry+0x48/0x2ac
[  840.535198] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.538595] [<0000000002ca0178>] 0x2ca0178
[  840.541775] CPU1: stopping
[  840.544824] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.4.167-rk3399 #70
[  840.548282] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.551582] Call trace:
[  840.554583] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.557884] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.561126] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.564353] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.567611] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.570909] Exception stack(0xffffffc0eeef3d80 to 0xffffffc0eeef3eb0)
[  840.574331] 3d80: 0000000000007e1c 0000000000000001 00000040eed10000 0000000000000000
[  840.577909] 3da0: 0000000000000015 00ffffffffffffff 000000c3ab5b9438 0000000000000000
[  840.581436] 3dc0: ffffffc0eeee9890 ffffffc0eeef3ef0 0000000000000a30 0000000000000400
[  840.584998] 3de0: 00000000000000b9 0000000000000001 0000000000000001 00000000000003d2
[  840.588591] 3e00: ffffff8008207224 0000007fa8041130 00000000000404a7 ffffffc0f7eee200
[  840.592223] 3e20: ffffffc0eeee8e00 ffffffc0ecab2a00 0000000000000000 ffffff8008c97f98
[  840.595863] 3e40: 0000000000000001 ffffffc0f7eee200 0000000000000000 ffffff8008cbe000
[  840.599489] 3e60: ffffffc0eeee9490 ffffffc0eeef3eb0 ffffff8008c9b200 ffffffc0eeef3eb0
[  840.603127] 3e80: ffffff8008c9b204 0000000060000145 ffffffc0eeef3eb0 ffffff8008c9b200
[  840.606769] 3ea0: ffffffffffffffff ffffffc0eeee8e00
[  840.610129] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.613482] [<ffffff8008c9b204>] _raw_spin_unlock_irq+0x24/0x30
[  840.616935] [<ffffff80080e1500>] finish_task_switch+0x134/0x200
[  840.620375] [<ffffff8008c97f98>] __schedule+0x5ac/0x64c
[  840.623723] [<ffffff8008c98378>] schedule_idle+0x40/0x54
[  840.627041] [<ffffff8008100a20>] cpu_startup_entry+0x54/0x2ac
[  840.630396] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.633793] [<0000000002ca0178>] 0x2ca0178
[  840.636997] CPU5: stopping
[  840.638231] CPU: 5 PID: 0 Comm: swapper/5 Not tainted 4.4.167-rk3399 #70
[  840.639833] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.641304] Call trace:
[  840.642525] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.644004] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.645441] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.646869] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.648311] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.649784] Exception stack(0xffffffc0eef03da0 to 0xffffffc0eef03ed0)
[  840.651339] 3da0: 0000000000000000 0000000000000005 00000040eed64000 0000000000000020
[  840.653027] 3dc0: 00ffffffffffffff 00000004bc3a9dbc 000000000005bbe8 0000000000000005
[  840.654707] 3de0: 00000034b5593519 ffffff8008081800 0000000000001000 0000000000000000
[  840.656376] 3e00: 0000000034d5d91d 00000040eed64000 ffffffc0eeeec600 0000000000000000
[  840.658043] 3e20: 0000000000000000 0000000000000000 0000000030d00800 000000c3a5c2f934
[  840.659699] 3e40: 0000000000000002 ffffffc0ec4faa00 0000000000000002 ffffff800935eab8
[  840.661358] 3e60: 0000000000000001 000000c3a48ea564 ffffff800930d3f8 0000000002ca0234
[  840.663024] 3e80: 0000000000000000 ffffffc0eef03ed0 ffffff8008a279b4 ffffffc0eef03ed0
[  840.664692] 3ea0: ffffff8008a279b8 0000000060000145 ffffffc0eef03ed0 ffffff8008a279b4
[  840.666362] 3ec0: ffffffffffffffff 0000000000000002
[  840.667769] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.669171] [<ffffff8008a279b8>] cpuidle_enter_state+0x1fc/0x254
[  840.670666] [<ffffff8008a27a84>] cpuidle_enter+0x34/0x44
[  840.672091] [<ffffff80081009c4>] call_cpuidle+0x70/0x78
[  840.673501] [<ffffff8008100c68>] cpu_startup_entry+0x29c/0x2ac
[  840.674969] [<ffffff800808d550>] secondary_start_kernel+0x190/0x1bc
[  840.676484] [<0000000002ca0178>] 0x2ca0178
[  840.677813] CPU0: stopping
[  840.680834] CPU: 0 PID: 994 Comm: kubelet Not tainted 4.4.167-rk3399 #70
[  840.684241] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  840.687478] Call trace:
[  840.690458] [<ffffff80080888d8>] dump_backtrace+0x0/0x220
[  840.693736] [<ffffff8008088b1c>] show_stack+0x24/0x30
[  840.696963] [<ffffff800850c56c>] dump_stack+0x98/0xc0
[  840.700152] [<ffffff800808db74>] handle_IPI+0x1d0/0x248
[  840.703338] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  840.706563] Exception stack(0xffffffc0eaadf930 to 0xffffffc0eaadfa60)
[  840.709887] f920:                                   0000000000006e62 0000000000000000
[  840.713381] f940: 00000040eecfb000 0000000000000000 ffffffc0f7ed9200 0000000000000001
[  840.716863] f960: 00000000009406da 00000000000002e9 0000000000c37e1e 0000000000000191
[  840.720341] f980: 0000000000000348 0000000011d5ca0b 0000000000000018 000000005c40a90c
[  840.723816] f9a0: 001e11e2f6890fa2 00005506f10d0926 ffffff80081f4ee8 0000000000000008
[  840.727304] f9c0: 00000000000404a7 0000000000000140 ffffffc0e703ee00 0000000000000140
[  840.730794] f9e0: 0000000000000001 0000000000000304 0000000000007ff5 0000000000000000
[  840.734287] fa00: 000000000000000b ffffffc0eaadfcd0 ffffffc0e6727c28 ffffffc0eaadfa60
[  840.737801] fa20: ffffff8008c9b1d0 ffffffc0eaadfa60 ffffff8008c9b1d4 0000000060000145
[  840.741323] fa40: ffffffc0eaadfa60 ffffff8008c9b1d0 0000008000000000 0000000000000001
[  840.744833] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  840.748094] [<ffffff8008c9b1d4>] _raw_spin_unlock_irqrestore+0x28/0x34
[  840.751508] [<ffffff80081003a0>] __wake_up_sync_key+0x64/0x78
[  840.754823] [<ffffff8008ba9a64>] unix_write_space+0x50/0x78
[  840.758112] [<ffffff8008af15ec>] sock_wfree+0x54/0x8c
[  840.761332] [<ffffff8008ba9f28>] unix_destruct_scm+0x60/0x6c
[  840.764622] [<ffffff8008af2c04>] skb_release_head_state+0x7c/0xd8
[  840.767982] [<ffffff8008af5c28>] __kfree_skb+0x20/0xa4
[  840.771254] [<ffffff8008af65f4>] consume_skb+0x94/0xc4
[  840.774509] [<ffffff8008babb44>] unix_stream_read_generic+0x520/0x6e0
[  840.777876] [<ffffff8008babde8>] unix_stream_recvmsg+0x50/0x60
[  840.781130] [<ffffff8008aeab10>] sock_recvmsg+0x5c/0x6c
[  840.784319] [<ffffff8008aeab98>] sock_read_iter+0x78/0xb0
[  840.787503] [<ffffff80081f3c24>] __vfs_read+0xc8/0xe8
[  840.790640] [<ffffff80081f4454>] vfs_read+0x84/0x138
[  840.793748] [<ffffff80081f4f3c>] SyS_read+0x54/0x98
[  840.796814] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  840.799896] CRU:
[  840.800957] 00000000: 0000003f 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.802636] 00000020: 00000053 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.804299] 00000040: 00000064 00001301 8000031f 00000108 00000007 00007f00 00000000 00000000
[  840.805948] 00000060: 000000c0 00001302 8000031f 00000008 00000007 00007f00 00000000 00000000
[  840.807587] 00000080: 00000064 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.809221] 000000a0: 0000004b 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.810845] 000000c0: 000000c6 00001202 8000031f 00000008 00000007 00007f00 00000000 00000000
[  840.812462] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.814071] 00000100: 00000100 00000707 00000140 00006909 00000083 00008581 00008320 00000141
[  840.815672] 00000120: 00000181 00008181 00000141 00000141 00004141 00008340 00003185 00000201
[  840.817271] 00000140: 0000041d 00000300 00002e87 00000110 00009381 00008387 00001103 00005282
[  840.818862] 00000160: 00008247 00000187 00001743 0000001f 00000380 00000300 00000380 00000000
[  840.820443] 00000180: 00006380 00009200 00000200 00000200 00000200 00000200 00003f3f 00000081
[  840.822019] 000001a0: 00000000 00000000 00004141 00000421 00008700 000002dc 00000004 00000381
[  840.823589] 000001c0: 00000381 00000001 00000003 00000087 00000087 00000141 00000141 00008181
[  840.825158] 000001e0: 00008320 00000007 00008f1f 00008f8f 00008f8f 00008787 00008787 00008787
[  840.826735] 00000200: 000000cf 000000cf 00000000 00000000 00000000 00000000 00000000 00000000
[  840.828316] 00000220: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.829887] 00000240: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.831436] 00000260: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.832958] 00000280: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60
[  840.834481] 000002a0: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 00000000 00000000 00000000 00000000
[  840.835999] 000002c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.837518] 000002e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.839016] 00000300: 00000080 00000080 00000202 0000006b 00000c30 00000000 0000001c 000001c0
[  840.840506] 00000320: 0000fff8 0000f0ff 0000f0ff 0000c130 0000000a 0000e233 00000000 00000000
[  840.841997] 00000340: 00000505 00000505 00000000 00000000 00000e04 0000000f 0000cfeb 00003f00
[  840.843482] 00000360: 0000ef60 00000020 00000ffe 000001f0 000000cc 00000f86 00000d0a 00000198
[  840.844962] 00000380: 00002010 00000000 0000002a 00000000 00000000 00000000 00000000 00000000
[  840.846434] 000003a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.847883] 000003c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.849314] 000003e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.850727] 00000400: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.852127] 00000420: 00000000 00004070 00000000 00000014 00000000 00000000 00000000 00000000
[  840.853518] 00000440: 00000000 00000000 00000000 00000000 00001000 00000000 00000000 00000000
[  840.854898] 00000460: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.856264] 00000480: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.857617] 000004a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.858964] 000004c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.860295] 000004e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.861616] 00000500: 00000000 00000000 00640064 00000000 00000003 00000001 00000000 00000000
[  840.862926] 00000520: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.864233] 00000540: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.865526] 00000560: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.866808] 00000580: 00000002 00000000 00000004 00000854 00000004
[  840.867885] PMU CRU:
[  840.868613] 00000000: 000000a9 00001203 80000000 00000108 00000007 00007f00 00000000 00000000
[  840.869933] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.871226] 00000040: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.872519] 00000060: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.873809] 00000080: 0000060d 00001986 00000302 00000003 000002dc 00000600 0bb8ea60 00010014
[  840.875109] 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.876415] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.877720] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.879020] 00000100: 00000ffc 0000fb80 0000000f 00000000 00000024 00000000 00000000 00000000
[  840.880316] 00000120: 00000000 00000000 00000000 00000000 00000003
[  840.881398] PMU:
[  840.882099] 00000000: 00000000 00000000 00000000 00000000 00000000 10df8100 10df8100 00000000
[  840.883429] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.884750] 00000040: 00000000 00000000 00000000 00000000 00000000 98df833f 00000000 00000000
[  840.886061] 00000060: 004007f9 004007f9 004007f9 00000010 00000000 00007e00 00000000 28800000
[  840.887375] 00000080: 000003c0 00011940 00005dc0 000003c0 00005dc0 00000060 0000000f 00000018
[  840.888692] 000000a0: 00000018 00000018 00000018 00000006 00000006 00005dc0 00005dc0 00005dc0
[  840.890011] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 3fffffff 00000000
[  840.891326] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  840.892639] Kernel Offset: disabled
[  840.893521] Memory Limit: none
[  840.894379] rockchip-thermal ff260000.tsadc: channal 0: temperature(43 C)
[  840.895574] THERMAL REGS:
[  840.896405] 00000000: 00000200 00030133 00000031 00000002 00000000 00000000 00000000 00000000
[  840.897794] 00000020: 0000022d 0000021e 00000000 00000000 00000268 00000000 00000000 00000000
[  840.899189] 00000040: 000002a5 000002a5 00000000 00000000 00000000 00000000 00000000 00000000
[  840.900581] 00000060: 00000004 00000004 00000753 00000753 00000000 00000000 00000000 00000000
[  840.901963] 00000080: 00000000 00000000
[  840.902930] Rebooting in 10 seconds..

 

 

2:

Spoiler


[  433.025324] Bad mode in Error handler detected, code 0xbf000000 -- SError
[  433.025932] Internal error: Oops - bad mode: 0 [#1] SMP
[  433.026395] Modules linked in: xt_physdev xt_NFLOG nfnetlink_log veth dummy vport_vxlan vxlan ip6_udp_tunnel udp_tunnel openvswitch nf_defrag_ipv6 ip_set_hash_ip xt_set xt_statistic xt_nat xt_tcpudp ip_set ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc ipv6 overlay ip_tables x_tables [last unloaded: configs]
[  433.030849] CPU: 4 PID: 4711 Comm: java Not tainted 4.4.138 #3
[  433.031365] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.031839] task: ffffffc091eb1b00 task.stack: ffffffc09376c000
[  433.032359] PC is at 0x7f8002133c
[  433.032648] LR is at 0x7f80021344
[  433.032947] pc : [<0000007f8002133c>] lr : [<0000007f80021344>] pstate: 20000000
[  433.033590] sp : 0000007f7f5d6eb0
[  433.033879] x29: 0000007f7f5d6eb0 x28: 0000000000000034 
[  433.034363] x27: 0000000000200021 x26: 0000000100280000 
[  433.034847] x25: 0000000000020000 x24: 0000000000000000 
[  433.035331] x23: 0000000100260000 x22: 0000000000000000 
[  433.035813] x21: 0000000000000000 x20: 0000000100280000 
[  433.036297] x19: 000000010026e000 x18: 0000007f7885af00 
[  433.036780] x17: 0000007f80447908 x16: 0000007f802f9028 
[  433.037263] x15: 0000007f7885b130 x14: 00000001002590c0 
[  433.037746] x13: 0000007f1c76b578 x12: 0000000000000000 
[  433.038229] x11: 0000000000000013 x10: 0000007f1c76c318 
[  433.038712] x9 : 0000000000000012 x8 : 00000000000000de 
[  433.039195] x7 : fffffffffffff000 x6 : fffffffffffff000 
[  433.039678] x5 : 0000000000000000 x4 : 0000000000000000 
[  433.040161] x3 : 0000000000000000 x2 : 1900b81d799a9700 
[  433.040644] x1 : 0000000100280000 x0 : 0000000000001000 
[  433.041128] 
[  433.041269] Process java (pid: 4711, stack limit = 0xffffffc09376c000)
[  433.041905] ---[ end trace 215a1602b5a507c3 ]---
[  433.042313] Kernel panic - not syncing: Fatal exception
[  433.042778] CPU0: stopping
[  433.043036] CPU: 0 PID: 3646 Comm: containerd Tainted: G      D         4.4.138 #3
[  433.043702] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.044175] Call trace:
[  433.044408] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.044884] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.045337] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.045790] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.046253] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.046749] Exception stack(0xffffffc0beb57940 to 0xffffffc0beb57a70)
[  433.047315] 7940: ffffff80091dd000 0000000000000000 00000040eecf7000 00000040eecf7000
[  433.048006] 7960: 0000000000000000 000000000000000c 000000000000003f 0000000000000008
[  433.048696] 7980: 0000000000000001 0000000000000007 0101010101010101 0000000000000001
[  433.049386] 79a0: 001fffffe03fffff 000000000000000b 000000000000000b 0000000000000000
[  433.050076] 79c0: ffffff80081d7eec 0000004420083d70 000000000004048a ffffffc0ed3cedd8
[  433.050767] 79e0: ffffffc0beb57bc0 ffffffc0ed3ced80 ffffffc0beb57d50 00000000002900c4
[  433.051457] 7a00: ffffffc0ef19caa0 0000000000000316 ffffffc0ef19d6e0 ffffff8008c52000
[  433.052148] 7a20: ffffffc0be973600 ffffffc0beb57a70 ffffff8008c39478 ffffffc0beb57a70
[  433.052838] 7a40: ffffff8008106864 0000000060000145 ffffffc0ed3ceb50 ffffffc0beb57d50
[  433.053527] 7a60: 0000008000000000 ffffff8008c393d8
[  433.053956] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.054387] [<ffffff8008106864>] do_raw_spin_unlock+0x90/0xd0
[  433.054897] [<ffffff8008c39478>] _raw_spin_unlock+0x20/0x2c
[  433.055396] [<ffffff8008435660>] lockref_get+0x28/0x34
[  433.055850] [<ffffff80081e4060>] follow_managed+0xb0/0x22c
[  433.056336] [<ffffff80081e484c>] lookup_fast+0x264/0x27c
[  433.056810] [<ffffff80081e4c78>] walk_component+0xc8/0x290
[  433.057295] [<ffffff80081e4fe4>] link_path_walk+0x1a4/0x478
[  433.057792] [<ffffff80081e5a40>] path_openat+0x208/0xbd4
[  433.058267] [<ffffff80081e75f4>] do_filp_open+0x48/0x94
[  433.058731] [<ffffff80081d7d68>] do_sys_open+0x114/0x250
[  433.059205] [<ffffff80081d7f28>] SyS_openat+0x3c/0x4c
[  433.059656] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  433.060129] CPU3: stopping
[  433.060377] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D         4.4.138 #3
[  433.061009] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.061480] Call trace:
[  433.061704] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.062179] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.062629] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.063080] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.063543] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.064038] Exception stack(0xffffffc0ef2f3d50 to 0xffffffc0ef2f3e80)
[  433.064603] 3d40:                                   0000000000001ac6 0000000000000003
[  433.065294] 3d60: 00000040eed36000 0000000000000000 ffffffc0f7f1d970 00ffffffffffffff
[  433.065984] 3d80: 0000000000000000 0000000000000000 ffffffc0ef2db2a0 ffffffc0ef2f3ed0
[  433.066674] 3da0: 00000000000009c0 0000000000000000 0000000000000018 000000005c40edeb
[  433.067365] 3dc0: 0003226c0f21c0f9 0000187c8e003226 ffffff8008122a44 0000007faf73302f
[  433.068055] 3de0: 0000000000000000 ffffffc0f7f1d080 ffffffc0f7f1d080 ffffff8008c35f68
[  433.068745] 3e00: ffffffc0e92db600 0000000000000000 0000000000000001 ffffffc0ef2da880
[  433.069435] 3e20: 0000000000000000 ffffff8008c5e000 ffffffc0ef2daf10 ffffffc0ef2f3e80
[  433.070126] 3e40: ffffff8008c394d8 ffffffc0ef2f3e80 ffffff8008c394dc 0000000060000145
[  433.070817] 3e60: ffffffc0ef2f3e80 ffffff8008c394d8 ffffffffffffffff ffffff8008c36218
[  433.071507] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.071935] [<ffffff8008c394dc>] _raw_spin_unlock_irq+0x24/0x30
[  433.072456] [<ffffff80080e0990>] finish_task_switch+0x128/0x20c
[  433.072978] [<ffffff8008c35f68>] __schedule+0x338/0x65c
[  433.073442] [<ffffff8008c36608>] schedule_idle+0x48/0x5c
[  433.073918] [<ffffff80080fff38>] cpu_startup_entry+0x58/0x2bc
[  433.074426] [<ffffff800808d560>] secondary_start_kernel+0x194/0x1c0
[  433.074980] [<0000000002c3e178>] 0x2c3e178
[  433.075339] CPU1: stopping
[  433.075586] CPU: 1 PID: 2527 Comm: kube-proxy Tainted: G      D         4.4.138 #3
[  433.076252] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.076724] Call trace:
[  433.076948] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.077423] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.077873] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.078324] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.078786] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.079281] Exception stack(0xffffffc0e8df7b90 to 0xffffffc0e8df7cc0)
[  433.079846] 7b80:                                   000000000000340e 0000000000000001
[  433.080536] 7ba0: 00000040eed0c000 0000000000000000 0000000000000000 0000000000000001
[  433.081226] 7bc0: 0000000000000004 00000064d35c0796 ffffffc0e8c70a20 ffffffc0e8df7d10
[  433.081916] 7be0: 00000000000009c0 0000000000000191 00000000000000cc 0000000000000004
[  433.082607] 7c00: 0000000000000001 000017bd2600309e ffffff8008122a44 0000007fa6280440
[  433.083298] 7c20: 000000000004048a ffffffc0f7ef3080 ffffffc0f7ef3080 ffffff8008c35f68
[  433.083988] 7c40: ffffffc0e842d100 0000000000000000 0000000000000001 ffffffc0e8c70000
[  433.084678] 7c60: 0000000000000000 ffffff8009217000 ffffffc0e8c70688 ffffffc0e8df7cc0
[  433.085368] 7c80: ffffff8008c394d8 ffffffc0e8df7cc0 ffffff8008c394dc 0000000060000145
[  433.086059] 7ca0: ffffffc0e8df7cc0 ffffff8008c394d8 0000008000000000 ffffff8008c35da4
[  433.086749] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.087177] [<ffffff8008c394dc>] _raw_spin_unlock_irq+0x24/0x30
[  433.087697] [<ffffff80080e0990>] finish_task_switch+0x128/0x20c
[  433.088217] [<ffffff8008c35f68>] __schedule+0x338/0x65c
[  433.088680] [<ffffff8008c36310>] schedule+0x84/0x98
[  433.089109] [<ffffff8008c38ca8>] do_nanosleep+0x7c/0xf4
[  433.089574] [<ffffff80081229c4>] hrtimer_nanosleep+0x94/0x114
[  433.090083] [<ffffff8008122adc>] SyS_nanosleep+0x98/0x9c
[  433.090557] [<ffffff8008082f30>] el0_svc_naked+0x24/0x28
[  433.091029] CPU5: stopping
[  433.091276] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D         4.4.138 #3
[  433.091907] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.092378] Call trace:
[  433.092605] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.093078] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.093527] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.093976] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.094436] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.094930] Exception stack(0xffffffc0ef2fbd90 to 0xffffffc0ef2fbec0)
[  433.095492] bd80:                                   ffffffc0f7f47080 00000040eed60000
[  433.096181] bda0: ffffffc0f7f47080 0003226c0f21c0f9 00ffffffffffffff 000000027ef86746
[  433.096868] bdc0: 000000000007aaf2 0000000000000000 ffffffc0ef2fbf50 0000000000000000
[  433.097556] bde0: 00000000000009c0 0000000000000644 00000000000004e6 0000000100000005
[  433.098243] be00: 0000000000000004 000000000000000e 0000000000000004 00000000a45aa36f
[  433.098932] be20: 00000000000000b7 00000064cee6c00b 0000000000000000 ffffffc0ede25e00
[  433.099619] be40: ffffff800938ac78 0000000000000000 00000064cee4d4fe ffffff8009332bb8
[  433.100307] be60: ffffffc0ef2dc380 0000000002c3e234 0000000000000000 ffffffc0ef2fbec0
[  433.100994] be80: ffffff800898fbd0 ffffffc0ef2fbec0 ffffff800898fc04 0000000060000145
[  433.101682] bea0: ffffffc0ef2fbec0 ffffff800898fbd0 ffffffffffffffff 0000000000000000
[  433.102369] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  433.102798] [<ffffff800898fc04>] cpuidle_enter_state+0x1cc/0x25c
[  433.103326] [<ffffff800898fd08>] cpuidle_enter+0x34/0x44
[  433.103799] [<ffffff80080ffed8>] call_cpuidle+0x6c/0x74
[  433.104260] [<ffffff800810018c>] cpu_startup_entry+0x2ac/0x2bc
[  433.104777] [<ffffff800808d560>] secondary_start_kernel+0x194/0x1c0
[  433.105327] [<0000000002c3e178>] 0x2c3e178
[  433.105686] CPU2: stopping
[  433.105936] CPU: 2 PID: 183 Comm: systemd-journal Tainted: G      D         4.4.138 #3
[  433.106625] Hardware name: FriendlyElec NanoPi NEO4 (DT)
[  433.107096] Call trace:
[  433.107320] [<ffffff8008088870>] dump_backtrace+0x0/0x21c
[  433.107795] [<ffffff8008088ab0>] show_stack+0x24/0x30
[  433.108246] [<ffffff8008429eb4>] dump_stack+0x94/0xbc
[  433.108696] [<ffffff800808db94>] handle_IPI+0x1e0/0x260
[  433.109158] [<ffffff8008080ee0>] gic_handle_irq+0x128/0x180
[  433.109654] Exception stack(0xffffffc0ed577ec0 to 0xffffffc0ed577ff0)
[  433.110220] 7ec0: 00000000000001a8 0000007f7d8dcc80 0000000000000010 0000007f7c4fe760
[  433.110910] 7ee0: 0000007f7c4fe901 0000007f7c4fe848 00000000000000e1 ffffffffffffffff
[  433.111601] 7f00: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
[  433.112291] 7f20: ffffffffffffffff ffffffffffffffff 0000000000000027 00001835eaaadc40
[  433.112981] 7f40: 0000007f7d90d218 0000007f7db58838 0000000000000063 0000007f7db714a8
[  433.113671] 7f60: 0000007f7db64a80 0000000000000003 0000000000000003 0000007f7db64a50
[  433.114361] 7f80: 0000000000000010 0000007f7db75030 000000557ec99760 0000000000000001
[  433.115052] 7fa0: 0000000000000001 0000007fd8715c00 0000007f7db58950 0000007fd8715c00
[  433.115742] 7fc0: 0000007f7db58930 0000000020000000 000000557ec97230 ffffffffffffffff
[  433.116431] 7fe0: 0000000000000000 0000000000000000
[  433.116860] [<ffffff8008082cd4>] el0_irq_naked+0x4c/0x58
[  433.117334] CRU:
[  433.117503] 00000000: 0000003b 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.118251] 00000020: 0000004b 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.118999] 00000040: 00000064 00001301 8000031f 00000108 00000007 00007f00 00000000 00000000
[  433.119747] 00000060: 00000041 00004601 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.120494] 00000080: 00000190 00001206 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.121242] 000000a0: 0000004b 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.121989] 000000c0: 000000c6 00001202 8000031f 00000008 00000007 00007f00 00000000 00000000
[  433.122736] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.123484] 00000100: 00000100 00000606 00000140 00006808 00000083 00008581 00008320 00000141
[  433.124232] 00000120: 00000181 00008181 00000141 00000141 00004141 00008343 00003185 00000201
[  433.124979] 00000140: 0000041d 00000300 00004a87 00000110 00009381 00008387 00001103 00005282
[  433.125727] 00000160: 00008247 00000187 00001743 0000001f 00000380 00000300 00000380 00000000
[  433.126474] 00000180: 0000e380 00009200 00000200 00000200 00000200 00000200 00003f3f 00000081
[  433.127221] 000001a0: 00000000 00000000 00004141 00000421 00008700 000002dc 00000005 00000381
[  433.127968] 000001c0: 00000381 00000100 00000003 00000087 00000087 00000141 00000141 00008141
[  433.128715] 000001e0: 00008321 00000007 00008f1f 00008f8f 00008f8f 00008787 00008787 00008787
[  433.129463] 00000200: 000000cf 000000cf 00000000 00000000 00000000 00000000 00000000 00000000
[  433.130210] 00000220: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.130957] 00000240: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.131705] 00000260: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.132452] 00000280: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60
[  433.133199] 000002a0: 0bb8ea60 0bb8ea60 00010014 0bb8ea60 00000000 00000000 00000000 00000000
[  433.133946] 000002c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.134694] 000002e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.135441] 00000300: 00000080 00000080 00000202 0000006b 00000c30 00000000 0000001c 000001c0
[  433.136188] 00000320: 0000fff8 0000f0ff 0000e0ff 0000c130 0000004a 0000e233 00000000 00000000
[  433.136936] 00000340: 00000505 00000505 00000000 00000000 00000e04 0000000f 0000cfeb 00003f00
[  433.137683] 00000360: 0000ef60 00000020 00000ffe 000001c0 000000c0 00000f86 00000d0a 000001b8
[  433.138430] 00000380: 00000010 00000000 0000002a 00000000 00000000 00000000 00000000 00000000
[  433.139177] 000003a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.139924] 000003c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.140672] 000003e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.141419] 00000400: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.142166] 00000420: 00000000 00004070 00000000 00000014 00000000 00000000 00000000 00000000
[  433.142913] 00000440: 00000000 00000000 00000000 00000000 00001000 00000000 00000000 00000000
[  433.143661] 00000460: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.144408] 00000480: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.145155] 000004a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.145902] 000004c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.146649] 000004e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.147396] 00000500: 00000000 00000000 00640064 00000000 00000003 00000001 00000000 00000000
[  433.148143] 00000520: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.148891] 00000540: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.149637] 00000560: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.150384] 00000580: 00000004 00000000 00000004 0000081c 00000004
[  433.150923] PMU CRU:
[  433.151124] 00000000: 000000a9 00001203 80000000 00000108 00000007 00007f00 00000000 00000000
[  433.151873] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.152622] 00000040: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.153371] 00000060: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.154120] 00000080: 0000060d 00001986 00000302 00000003 000002dc 00000600 0bb8ea60 00010014
[  433.154869] 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.155618] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.156367] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.157116] 00000100: 00000ffc 0000fb80 0000000f 00000000 00000024 00000000 00000000 00000000
[  433.157863] 00000120: 00000000 00000180 00000000 00000000 00000003
[  433.158403] PMU:
[  433.158571] 00000000: 00000000 00000000 00000000 00000000 00000000 008f8100 008f8100 00000000
[  433.159319] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.160068] 00000040: 00000000 00000000 00000000 00000000 00000000 988f833f 00000000 00000000
[  433.160817] 00000060: 00000579 00000579 00000579 00000010 00000000 00007e00 00000000 28800000
[  433.161566] 00000080: 000003c0 00011940 00005dc0 000003c0 00005dc0 00000060 0000000f 00000018
[  433.162315] 000000a0: 00000018 00000018 00000018 00000006 00000006 00005dc0 00005dc0 00005dc0
[  433.163064] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 3fffffff 00000000
[  433.163813] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  433.164558] Kernel Offset: disabled
[  433.164868] Memory Limit: none
[  433.165151] rockchip-thermal ff260000.tsadc: channal 0: temperature(43 C)
[  433.165747] THERMAL REGS:
[  433.165982] 00000000: 00000200 00030133 00000031 00000002 00000000 00000000 00000000 00000000
[  433.166730] 00000020: 00000225 0000021c 00000000 00000000 0000024e 00000000 00000000 00000000
[  433.167478] 00000040: 000002a5 000002a5 00000000 00000000 00000000 00000000 00000000 00000000
[  433.168226] 00000060: 00000004 00000004 00000753 00000753 00000000 00000000 00000000 00000000
[  433.168971] 00000080: 00000000 00000000
[  433.169306] Rebooting in 10 seconds..

 

I can provide more info if needed.

I have the same problem with you,and my network crashed when I download bittorrent files.

Edited by Igor
spoilers
Link to comment
Share on other sites

Sorry about the delay answering your message @littlema, I uploaded the Kernel files I tried and got crashes.

 

I tried with latest sources and patches from Armbian too but same results. I only see these crashes while running ElasticSearch.

 

This is the last crash I got with the Kernel 4.4.174 built from Armbian builder. I was running strace on the Java process:

 

Spoiler

[  443.284839] Bad mode in Error handler detected, code 0xbf000000 -- SError
[  443.285455] Internal error: Oops - bad mode: 0 [#1] SMP
[  443.285918] Modules linked in: veth dummy vport_vxlan vxlan ip6_udp_tunnel udp_tunnel openvswitch af_packet xt_NFLOG xt_physdev xt_statistic xt_nat xt_tcpudp xt_recent nfnetlink_log ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs ip_set_hash_ip xt_set ip_set rpcsec_gss_krb5 auth_rpcgss nfsv4 nfs lockd grace ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay midgard_kbase rk_vcodec sunrpc ip_tables x_tables autofs4
[  443.291235] CPU: 2 PID: 10020 Comm: strace Not tainted 4.4.174-rk3399 #4
[  443.291822] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.292275] task: ffffffc0e1ace200 task.stack: ffffffc0e5324000
[  443.292795] PC is at 0x7f8080d3e8
[  443.293087] LR is at 0x55919aa850
[  443.293379] pc : [<0000007f8080d3e8>] lr : [<00000055919aa850>] pstate: 60000000
[  443.294023] sp : 0000007fcda992c0
[  443.294315] x29: 0000007fcda992c0 x28: 0000000000000000
[  443.294785] x27: 0000000000000000 x26: 0000000000000000
[  443.295256] x25: 0000000000000000 x24: 0000000000000000
[  443.295727] x23: 0000000000000000 x22: 0000000000000000
[  443.296198] x21: 0000005591a20000 x20: 0000005591a282b8
[  443.296669] x19: 0000005591a28000 x18: 0000000000000000
[  443.297140] x17: 0000007f8080d3e0 x16: 0000005591a20d50
[  443.297610] x15: 0000000000000001 x14: 0000000000000004
[  443.298080] x13: 0000000000000000 x12: 0000000000000000
[  443.298550] x11: 0000000000000020 x10: 00000000ffffff80
[  443.299021] x9 : 0000000000000017 x8 : 0000000000000104
[  443.299492] x7 : 0000000032393138 x6 : 0000000032393138
[  443.299962] x5 : 0000007fcda99280 x4 : 0000000000000000
[  443.300433] x3 : 0000000000000000 x2 : 0000000040000000
[  443.300904] x1 : 0000007fcda9932c x0 : 0000000000002819
[  443.301374]
[  443.301509] Process strace (pid: 10020, stack limit = 0xffffffc0e5324000)
[  443.302313] ---[ end trace 9efc30e7925e8b19 ]---
[  443.302731] Kernel panic - not syncing: Fatal exception
[  443.303198] CPU1: stopping
[  443.303449] CPU: 1 PID: 231 Comm: systemd-journal Tainted: G      D         4.4.174-rk3399 #4
[  443.304192] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.304644] Call trace:
[  443.304877] [<ffffff80080881d8>] dump_backtrace+0x0/0x220
[  443.305353] [<ffffff800808841c>] show_stack+0x24/0x30
[  443.305801] [<ffffff800850cfec>] dump_stack+0x98/0xc0
[  443.306247] [<ffffff800808ca38>] handle_IPI+0x1d0/0x248
[  443.306705] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  443.307193] Exception stack(0xffffffc0e5867a40 to 0xffffffc0e5867b70)
[  443.307758] 7a40: 000000000000005d 00000000c00000b7 0000000000000004 0000000000000010
[  443.308442] 7a60: 000000556f893230 0000000000000000 0000000000000000 bedf566d9f256dcc
[  443.309126] 7a80: 00000000000000ac 0000007ff0b66b90 0000000000000015 0000000000000000
[  443.309811] 7aa0: 0000000000000018 000000005c671868 003a79a38fbd32b6 000057009fab5cd9
[  443.310495] 7ac0: 0000000000000800 0000007f9806c420 0000000000000063 ffffff800b37e040
[  443.311179] 7ae0: ffffffc0e5867bb8 ffffff8008ccd000 0000000000000000 ffffff8008ccdf00
[  443.311863] 7b00: 0000000000000015 000000000000011d 00000000000000ac ffffff8008cb2000
[  443.312548] 7b20: ffffffc0ed539c00 ffffffc0e5867b70 ffffff80081580b8 ffffffc0e5867b70
[  443.313230] 7b40: ffffff800817f7f8 0000000040000145 ffffffc0e5867b80 ffffff8008c9bed8
[  443.313913] 7b60: 0000008000000000 ffffff8008c9bf78
[  443.314342] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  443.314774] [<ffffff800817f7f8>] __bpf_prog_run+0x4c/0xf20
[  443.315259] [<ffffff80081580b8>] seccomp_phase1+0x10c/0x1c8
[  443.315748] [<ffffff8008158240>] __secure_computing+0x18/0x40
[  443.316253] [<ffffff8008086ba8>] syscall_trace_enter+0x158/0x170
[  443.316779] [<ffffff8008082f5c>] __sys_trace+0x1c/0x4c
[  443.317230] CPU0: stopping
[  443.317473] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D         4.4.174-rk3399 #4
[  443.318155] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.318605] Call trace:
[  443.318825] [<ffffff80080881d8>] dump_backtrace+0x0/0x220
[  443.319300] [<ffffff800808841c>] show_stack+0x24/0x30
[  443.319744] [<ffffff800850cfec>] dump_stack+0x98/0xc0
[  443.320188] [<ffffff800808ca38>] handle_IPI+0x1d0/0x248
[  443.320646] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  443.321134] Exception stack(0xffffff8009203d50 to 0xffffff8009203e80)
[  443.321697] 3d40:                                   000000000000196c 0000000000000000
[  443.322381] 3d60: 00000040eecfe000 0000000000000000 0000000000000015 00ffffffffffffff
[  443.323066] 3d80: 0000006736ee41c6 0000000000000000 ffffff8009210460 ffffff8009203ec0
[  443.323748] 3da0: 0000000000000a30 0000000000000191 0000000000000191 0000000000000001
[  443.324432] 3dc0: 0000000000000001 0000000000000000 ffffff8008133ad4 0000007f83787229
[  443.325117] 3de0: 00000000000404ae ffffffc0f7edc200 ffffff800920f9d0 ffffffc0e6ef7000
[  443.325801] 3e00: 0000000000000000 ffffff8008c98d50 0000000000000001 ffffffc0f7edc200
[  443.326485] 3e20: 0000000000000000 ffffff8008cbe000 ffffff8009210060 ffffff8009203e80
[  443.327169] 3e40: ffffff8008c9bfd8 ffffff8009203e80 ffffff8008c9bfdc 0000000060000145
[  443.327854] 3e60: ffffff8009203e80 ffffff8008c9bfd8 ffffffffffffffff ffffff800920f9d0
[  443.328538] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  443.328972] [<ffffff8008c9bfdc>] _raw_spin_unlock_irq+0x24/0x30
[  443.329495] [<ffffff80080e03f0>] finish_task_switch+0x134/0x200
[  443.330015] [<ffffff8008c98d50>] __schedule+0x5ac/0x64c
[  443.330474] [<ffffff8008c99130>] schedule_idle+0x40/0x54
[  443.330944] [<ffffff80080ff910>] cpu_startup_entry+0x54/0x2ac
[  443.331448] [<ffffff8008c979f4>] rest_init+0x74/0x7c
[  443.331886] [<ffffff80090e0bc4>] start_kernel+0x3d0/0x3f4
[  443.332360] [<ffffff80090e01c4>] __primary_switched+0x30/0x6c
[  443.332863] CPU3: stopping
[  443.333107] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D         4.4.174-rk3399 #4
[  443.333789] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.334238] Call trace:
[  443.334459] [<ffffff80080881d8>] dump_backtrace+0x0/0x220
[  443.334933] [<ffffff800808841c>] show_stack+0x24/0x30
[  443.335377] [<ffffff800850cfec>] dump_stack+0x98/0xc0
[  443.335821] [<ffffff800808ca38>] handle_IPI+0x1d0/0x248
[  443.336279] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  443.336766] Exception stack(0xffffffc0ef2fbda0 to 0xffffffc0ef2fbed0)
[  443.337329] bda0: ffffffc0f7f1b200 00000040eed3d000 ffffffc0f7f1b200 ffffffc0ef2fbeb0
[  443.338013] bdc0: 00ffffffffffffff 00000002881a6fee 000000000003451a 0000000000000000
[  443.338697] bde0: ffffffc0ef2fbf50 0000000000000000 0000000000000a30 0000000000000000
[  443.339380] be00: 0000000000000191 0000000000000001 0000000000000001 0000000000000000
[  443.340064] be20: ffffff80082061ec 0000000000000000 0000000000000000 00000067326f039c
[  443.340748] be40: 0000000000000000 ffffffc0ed471a00 0000000000000000 ffffff800935f038
[  443.341433] be60: 0000000000000000 00000067326ec4f2 ffffff800930d4b8 0000000002ca2244
[  443.342117] be80: 0000000000000000 ffffffc0ef2fbed0 ffffff8008a2863c ffffffc0ef2fbed0
[  443.342801] bea0: ffffff8008a28670 0000000060000145 ffffffc0ef2fbed0 ffffff8008a2863c
[  443.343484] bec0: ffffffffffffffff 0000000000000000
[  443.343912] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  443.344346] [<ffffff8008a28670>] cpuidle_enter_state+0x1fc/0x254
[  443.344872] [<ffffff8008a2873c>] cpuidle_enter+0x34/0x44
[  443.345339] [<ffffff80080ff8b4>] call_cpuidle+0x70/0x78
[  443.345798] [<ffffff80080ffb58>] cpu_startup_entry+0x29c/0x2ac
[  443.346309] [<ffffff800808c414>] secondary_start_kernel+0x190/0x1bc
[  443.346857] [<0000000002ca2188>] 0x2ca2188
[  443.347219] CPU4: stopping
[  443.347463] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G      D         4.4.174-rk3399 #4
[  443.348145] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.348593] Call trace:
[  443.348815] [<ffffff80080881d8>] dump_backtrace+0x0/0x220
[  443.349288] [<ffffff800808841c>] show_stack+0x24/0x30
[  443.349730] [<ffffff800850cfec>] dump_stack+0x98/0xc0
[  443.350172] [<ffffff800808ca38>] handle_IPI+0x1d0/0x248
[  443.350628] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  443.351114] Exception stack(0xffffffc0ef2ffda0 to 0xffffffc0ef2ffed0)
[  443.351675] fda0: ffffffc0f7f30200 00000040eed52000 ffffffc0f7f30200 ffffffc0ef2ffeb0
[  443.352358] fdc0: 00ffffffffffffff 00000002881a6fee 000000000003451a 0000000000000000
[  443.353039] fde0: ffffffc0ef2fff50 0000000000000000 0000000000000a30 0000000000000643
[  443.353721] fe00: 00000000000002ab 0000000100000005 0000000100000004 00000000feec3565
[  443.354401] fe20: 0000000000000038 0000007f980939f0 0000000000000002 00000067326f039c
[  443.355082] fe40: 0000000000000000 ffffffc0ed471c00 0000000000000000 ffffff800935f038
[  443.355764] fe60: 0000000000000000 0000006732696810 ffffff800930d4b8 0000000002ca2244
[  443.356445] fe80: 0000000000000000 ffffffc0ef2ffed0 ffffff8008a2863c ffffffc0ef2ffed0
[  443.357126] fea0: ffffff8008a28670 0000000060000145 ffffffc0ef2ffed0 ffffff8008a2863c
[  443.357807] fec0: ffffffffffffffff 0000000000000000
[  443.358234] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  443.358661] [<ffffff8008a28670>] cpuidle_enter_state+0x1fc/0x254
[  443.359184] [<ffffff8008a2873c>] cpuidle_enter+0x34/0x44
[  443.359649] [<ffffff80080ff8b4>] call_cpuidle+0x70/0x78
[  443.360105] [<ffffff80080ffb58>] cpu_startup_entry+0x29c/0x2ac
[  443.360613] [<ffffff800808c414>] secondary_start_kernel+0x190/0x1bc
[  443.361158] [<0000000002ca2188>] 0x2ca2188
[  443.361517] CPU5: stopping
[  443.361758] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D         4.4.174-rk3399 #4
[  443.362439] Hardware name: FriendlyElec NanoPC-T4 (DT)
[  443.362887] Call trace:
[  443.363105] [<ffffff80080881d8>] dump_backtrace+0x0/0x220
[  443.363577] [<ffffff800808841c>] show_stack+0x24/0x30
[  443.364019] [<ffffff800850cfec>] dump_stack+0x98/0xc0
[  443.364460] [<ffffff800808ca38>] handle_IPI+0x1d0/0x248
[  443.364915] [<ffffff8008080f24>] gic_handle_irq+0x17c/0x180
[  443.365400] Exception stack(0xffffffc0ef303da0 to 0xffffffc0ef303ed0)
[  443.365961] 3da0: ffffffc0f7f45200 00000040eed67000 ffffffc0f7f45200 ffffffc0ef303eb0
[  443.366643] 3dc0: 00ffffffffffffff 00000002881a6fee 000000000003451a 0000000000000000
[  443.367325] 3de0: ffffffc0ef303f50 0000000000000000 0000000000000a30 0000000000000643
[  443.368006] 3e00: 00000000000002ab 0000000000000005 0000000100000004 00000000de552d86
[  443.368688] 3e20: 0000000000000078 0000007f980939f0 0000000000000002 00000067326f039c
[  443.369369] 3e40: 0000000000000000 ffffffc0ed471e00 0000000000000000 ffffff800935f038
[  443.370050] 3e60: 0000000000000000 00000067326c1f0d ffffff800930d4b8 0000000002ca2244
[  443.370731] 3e80: 0000000000000000 ffffffc0ef303ed0 ffffff8008a2863c ffffffc0ef303ed0
[  443.371413] 3ea0: ffffff8008a28670 0000000060000145 ffffffc0ef303ed0 ffffff8008a2863c
[  443.372094] 3ec0: ffffffffffffffff 0000000000000000
[  443.372519] [<ffffff80080827b4>] el1_irq+0xb4/0x140
[  443.372945] [<ffffff8008a28670>] cpuidle_enter_state+0x1fc/0x254
[  443.373468] [<ffffff8008a2873c>] cpuidle_enter+0x34/0x44
[  443.373932] [<ffffff80080ff8b4>] call_cpuidle+0x70/0x78
[  443.374388] [<ffffff80080ffb58>] cpu_startup_entry+0x29c/0x2ac
[  443.374897] [<ffffff800808c414>] secondary_start_kernel+0x190/0x1bc
[  443.375442] [<0000000002ca2188>] 0x2ca2188
[  443.375804] CRU:
[  443.375978] 00000000: 0000003f 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  443.376726] 00000020: 00000053 00001101 80000000 00000108 00000007 00007f00 00000000 00000000
[  443.377473] 00000040: 00000032 00001301 8000031f 00000108 00000007 00007f00 00000000 00000000
[  443.378221] 00000060: 000000c0 00001302 8000031f 00000008 00000007 00007f00 00000000 00000000
[  443.378968] 00000080: 00000064 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  443.379716] 000000a0: 0000004b 00001301 80000000 00000108 00000007 00007f00 00000000 00000000
[  443.380464] 000000c0: 000000c6 00001202 8000031f 00000008 00000007 00007f00 00000000 00000000
[  443.381212] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.381958] 00000100: 00000100 00000707 00000140 00006909 00000083 00008581 00008320 00000141
[  443.382706] 00000120: 00000181 00008181 00000141 00000141 00004141 00008343 00003185 00000201
[  443.383454] 00000140: 0000041d 00000300 00002e87 00000110 00009381 00008387 00001103 00005282
[  443.384202] 00000160: 00008247 00000187 00001743 0000001f 00000380 00000300 00000380 00000000
[  443.384950] 00000180: 00006380 00009200 00000200 00000200 00000200 00000200 00003f3f 00000081
[  443.385698] 000001a0: 00000000 00000000 00004141 00000421 00008700 000002dc 00000004 00000381
[  443.386445] 000001c0: 00000381 00000001 00000003 00000087 00000087 00000141 00000141 00008181
[  443.387193] 000001e0: 00008320 00000007 00008f1f 00008f8f 00008f8f 00008787 00008787 00008787
[  443.387941] 00000200: 000000cf 000000cf 00000000 00000000 00000000 00000000 00000000 00000000
[  443.388689] 00000220: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.389436] 00000240: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.390184] 00000260: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.390932] 00000280: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60
[  443.391680] 000002a0: 0bb8ea60 0bb8ea60 0bb8ea60 0bb8ea60 00000000 00000000 00000000 00000000
[  443.392427] 000002c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.393175] 000002e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.393923] 00000300: 00000080 00000080 00000202 0000006b 00000c30 00000000 0000001c 000001c0
[  443.394671] 00000320: 0000fff8 0000f0ff 0000f0ff 0000c130 0000000a 0000e233 00000000 00000000
[  443.395418] 00000340: 00000505 00000505 00000000 00000000 00000e04 0000000f 0000cfeb 00003f00
[  443.396166] 00000360: 0000ef60 00000020 00000ffe 000001f0 000000cc 00000f86 00000d0a 00000198
[  443.396912] 00000380: 00002010 00000000 0000002a 00000000 00000000 00000000 00000000 00000000
[  443.397660] 000003a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.398408] 000003c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.399155] 000003e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.399903] 00000400: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.400650] 00000420: 00000000 00004070 00000000 00000014 00000000 00000000 00000000 00000000
[  443.401398] 00000440: 00000000 00000000 00000000 00000000 00001000 00000000 00000000 00000000
[  443.402144] 00000460: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.402892] 00000480: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.403639] 000004a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.404385] 000004c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.405132] 000004e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.405879] 00000500: 00000000 00000000 00640064 00000000 00000003 00000001 00000000 00000000
[  443.406625] 00000520: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.407373] 00000540: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.408121] 00000560: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.408866] 00000580: 00000002 00000000 00000004 0000081c 00000004
[  443.409405] PMU CRU:
[  443.409606] 00000000: 000000a9 00001203 80000000 00000108 00000007 00007f00 00000000 00000000
[  443.410356] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.411105] 00000040: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.411853] 00000060: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.412601] 00000080: 0000060d 00001986 00000302 00000003 000002dc 00000600 0bb8ea60 00010014
[  443.413350] 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.414100] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.414849] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.415599] 00000100: 00000ffc 0000fb80 0000000f 00000000 00000024 00000000 00000000 00000000
[  443.416345] 00000120: 00000000 00000180 00000000 00000000 00000003
[  443.416886] PMU:
[  443.417057] 00000000: 00000000 00000000 00000000 00000000 00000000 10df8100 10df8100 00000000
[  443.417806] 00000020: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.418556] 00000040: 00000000 00000000 00000000 00000000 00000000 98df833f 00000000 00000000
[  443.419304] 00000060: 004007f9 004007f9 004007f9 00000010 00000000 00007e00 00000000 28800000
[  443.420054] 00000080: 000003c0 00011940 00005dc0 000003c0 00005dc0 00000060 0000000f 00000018
[  443.420801] 000000a0: 00000018 00000018 00000018 00000006 00000006 00005dc0 00005dc0 00005dc0
[  443.421551] 000000c0: 00000000 00000000 00000000 00000000 00000000 00000000 3fffffff 00000000
[  443.422300] 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  443.423042] Kernel Offset: disabled
[  443.423347] Memory Limit: none
[  443.423627] rockchip-thermal ff260000.tsadc: channal 0: temperature(55 C)
[  443.424219] THERMAL REGS:
[  443.424457] 00000000: 00000200 00030133 00000031 00000002 00000000 00000000 00000000 00000000
[  443.425205] 00000020: 00000237 00000229 00000000 00000000 00000268 00000000 00000000 00000000
[  443.425954] 00000040: 000002a5 000002a5 00000000 00000000 00000000 00000000 00000000 00000000
[  443.426702] 00000060: 00000004 00000004 00000753 00000753 00000000 00000000 00000000 00000000
[  443.427446] 00000080: 00000000 00000000

 

 

https://ufile.io/rwsz1

 

If anyone have a clue on how to proceed, please let me know.

Link to comment
Share on other sites

On 1/18/2019 at 8:37 PM, Carlos Eduardo De Paula said:

I'm seeing frequent reboots and Kernel Panics

This can also be a power problem.

How many devices do you have attached?  (can you put a power USB-Hub in between for example)

How many Watt can you PowerSupply deliver?

Link to comment
Share on other sites

RK3399 support is from our perspective declared as WIP, "for testing only" and such problems are expected! If you want to use those boards for some real cases, don't. Not now. I would like to tell you hove to fix those problems, but I don't know. Not without deep investigation ... which is sadly very far away due to huge demand on our tiny resources from users side.

 

In case of T4/M4/Neo4 we use more or less stock kernel from Friendlyarm which means if they will fix this in the mean time, it will show up in Armbian at once.

Link to comment
Share on other sites

On friday, I ended up erasing all flash and re-flashing the image I had working on another board to it. What is weird is that the Kernel and the DTB are the same, what's different is that I built a newer u-boot and created a kernel partition that is mountable so I could configure u-boot menu via extlinux.conf file.

 

The board is stable since then so I think it might be something wrong either with u-boot or the partition scheme I use. Question, can u-boot influence the stability of the OS? I have no clue.

 

Thanks!

Link to comment
Share on other sites

Guest
This topic is now closed to further replies.
×
×
  • Create New...

Important Information

Terms of Use - Privacy Policy - Guidelines