OPI Kernel oops using eth0 to masq internal network!!

rick · May 20, 2017

Hello.

I am getting a kernel oops when I setup a masq firewall using firehol. It happenes when a device on the internal net trys anything more than a ping, like loading a web page or doing a speedtest.

My network uses interface wlx??? as my external connection to the outside world (internet) and the builtin eth0 as my internal masq’d network (192.168.77.0/24). I am running armbian ubuntu, upgraded (up to date), with the kernel 4.10.0-sun8i and netmanager to configure the interfaces themselves.

When I replace eth0 with a cheap usb dongle, everything just works so it seems isolated to the builtin eth0.

My eth0 is configured to automatically connect, all users, and ip4 manual to 192.168.77.1/24 , ipv6 ignore.

To load the firehol rules into iptables: “firehol try” To clear iptables: “firehol stop”

Below is my /etc/firehol/firehol.conf (stripped down to bare minimum that will reproduce the error) and a capt of the oops from my serial console output:

--------- ---

#

# !/bin/sh #to force bash mode in editor

#/etc/firehol/firehol.conf firehol config:

extif=wlxe84e0635abf2 #${extif}

intif=eth0 #${intif}

# lanif is a private network with dhcpd and eventually dns.

# v5 for debugging, to exclude ipv6 rules

version 5

#internal if, masqd

interface ${intif} intif

policy accept

#external if, world

interface ${extif} wan-internet

policy accept

# Route LAN requests to the internet.

router lan2internet inface ${intif} outface ${extif}

masquerade

route all accept

-=-=-=-=-=-=-=-=-=-=-

[ 620.222707] ------------[ cut here ]------------

[ 620.227368] kernel BUG at net/core/dev.c:2579!

[ 620.231825] Internal error: Oops - BUG: 0 [#1] SMP THUMB2

[ 620.237233] Modules linked in: nf_nat_irc nf_nat_ftp nf_conntrack_irc nf_conntrack_ftp ccm ip6table_filter ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables xt_helper xt_tcpudp nf_log_ipv4 nf_log_common xt_LOG xt_ls

[ 620.290643] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.10.0-sun8i #3

[ 620.297091] Hardware name: Allwinner sun8i Family

[ 620.301807] task: c0b07480 task.stack: c0b00000

[ 620.306361] PC is at skb_checksum_help+0xe4/0xec

[ 620.310994] LR is at validate_xmit_skb+0x16d/0x204

[ 620.315797] pc : [<c05f4b3c>] lr : [<c05f8b2d>] psr: 00060133

[ 620.315797] sp : c0b01bf8 ip : 00000000 fp : 00000036

[ 620.327289] r10: ee07ba50 r9 : c9fa2000 r8 : 00000000

[ 620.332526] r7 : 00000000 r6 : ffffffbe r5 : db2b3740 r4 : ed7e0c00

[ 620.339062] r3 : 00000042 r2 : 00000036 r1 : 00000036 r0 : db2b2f00

[ 620.345600] Flags: nzcv IRQs on FIQs on Mode SVC_32 ISA Thumb Segment none

[ 620.352926] Control: 50c5387d Table: 6e00c06a DAC: 00000051

[ 620.358681] Process swapper/0 (pid: 0, stack limit = 0xc0b00210)

[ 620.364700] Stack: (0xc0b01bf8 to 0xc0b02000)

[ 620.369072] 1be0: ed7e0c00 db2b3740

[ 620.377275] 1c00: 00000000 c05f8b2d c0b01c28 c06624a3 00000000 ee170a00 00000000 c9fa2000

[ 620.385477] 1c20: 00000000 00000000 ee07ba50 c05f8bed ee07ba00 ee170a00 ee07ba50 ed7e0c00

[ 620.393677] 1c40: c9fa2000 c0612bfd ed7e0c00 00000010 c9fa2000 00000001 ee07ba00 00000000

[ 620.401938] 1c60: 00000000 009227d4 00000000 c05f8f11 ee07ba50 00000001 c405a8c0 00000000

[ 620.410170] 1c80: 00000036 00000000 00000000 fffffff4 00000000 00065000 c0b01cec ee066288

[ 620.418391] 1ca0: ed7e0c00 00000000 ee066200 0000000e 00000000 ef056000 c06a4451 c06283bb

[ 620.426594] 1cc0: ed7e0c00 0105a8c0 ed7e0c00 ed7e0c00 c0b4c500 00000000 c9fa2000 006a2cd3

[ 620.434794] 1ce0: 00000000 c0629f2b 00000000 00000004 c0b01d02 00000000 c9fa2000 00000000

[ 620.442992] 1d00: c0b4c500 c0629659 00000000 ed7e0c00 00000000 c0b4c500 00000002 ef056000

[ 620.451189] 1d20: ed7e0cb8 c06275af db2b2f50 00000002 ed7e0c02 ef056000 c9fa2000 00000000

[ 620.459387] 1d40: c0b4c500 c06271f5 c0625989 c0625989 00000002 ed7e0c00 c0b4c500 c0626187

[ 620.467582] 1d60: 0000002e 00000000 c06a4402 ef056000 00000000 00000000 c0b4c500 c0625989

[ 620.475780] 1d80: ed7e0c00 c0b061f4 c0625e61 00000008 ef05605c c05f5049 00000000 01080020

[ 620.483977] 1da0: 000010b5 ed7e0c00 00000008 c0650fa1 23bda400 14c03a20 dba2b47b ed7e0c00

[ 620.492174] 1dc0: ed7e0c00 ef056000 ef056598 c0b04bb4 ed7e0c00 ef056000 ef056598 00000000

[ 620.500371] 1de0: 00000000 ef056580 0000003c c05f6acd ef056598 ef056000 ef056598 00000000

[ 620.508567] 1e00: 00000000 ed7e0c00 00000003 c05f72b3 80000000 000000a8 0000002a c051a057

[ 620.516764] 1e20: 00000000 c0b01e54 00000000 00000040 c0b09644 ed7e0c00 000000a8 c011093d

[ 620.524960] 1e40: 00000000 ef056598 00000040 0000012c c0b02d00 ef6ad540 c0b01e80 2ec57000

[ 620.533157] 1e60: 00007d16 c05f6dc3 c0a56540 c0b540ba c0b04bb4 c08fd1e4 c09012e0 00000001

[ 620.541354] 1e80: c0b01e80 c0b01e80 c0b01e88 c0b01e88 c0b00000 40000000 00000000 00000003

[ 620.549552] 1ea0: c0b0208c c0b00000 00000100 c0b02080 c0b0208c c011b57d ef00f000 f0803000

[ 620.557749] 1ec0: c0b01eb8 c0b56980 00000008 00007d15 c0b02d00 00200102 ef03bb60 c0b01f00

[ 620.565946] 1ee0: 00000020 00000000 00000000 ef00f000 f0803000 00000000 00000000 c011b875

[ 620.574143] 1f00: c0a53e24 c01546c3 c0b25b2c c0b04050 f080200c c0b01f40 f0802000 c010133f

[ 620.582341] 1f20: c0106881 c0106882 40060033 ffffffff c0b01f74 c0b01f98 c0b00000 c0109765

[ 620.590537] 1f40: 00000001 00000000 00000000 c0114141 c0b00000 c0b03cd0 c0b03c6c c0a54f08

[ 620.598734] 1f60: c0b01f98 00000000 00000000 00000000 00000000 c0b01f90 c0106881 c0106882

[ 620.606931] 1f80: 40060033 ffffffff 00000051 00000000 00000000 c01486f1 000000bb 00000001

[ 620.615128] 1fa0: c0b03c40 ffffffff c0b56000 c0a3ba30 efffca40 c0148913 00000001 c0a00a11

[ 620.623324] 1fc0: ffffffff ffffffff 00000000 c0a00583 00000000 c0a3ba30 c0b56294 c0b03c58

[ 620.631519] 1fe0: c0a3ba2c c0b08f68 4000406a 410fc075 00000000 4000807f 00000000 00000000

[ 620.639741] [<c05f4b3c>] (skb_checksum_help) from [<c05f8b2d>] (validate_xmit_skb+0x16d/0x204)

[ 620.648377] [<c05f8b2d>] (validate_xmit_skb) from [<c05f8bed>] (validate_xmit_skb_list+0x29/0x3c)

[ 620.657272] [<c05f8bed>] (validate_xmit_skb_list) from [<c0612bfd>] (sch_direct_xmit+0x69/0x11c)

[ 620.666079] [<c0612bfd>] (sch_direct_xmit) from [<c05f8f11>] (__dev_queue_xmit+0x1b9/0x524)

[ 620.674455] [<c05f8f11>] (__dev_queue_xmit) from [<c06283bb>] (ip_finish_output2+0x12b/0x2e0)

[ 620.683003] [<c06283bb>] (ip_finish_output2) from [<c0629f2b>] (ip_output+0xc7/0xd0)

[ 620.690768] [<c0629f2b>] (ip_output) from [<c06275af>] (ip_forward+0x303/0x350)

[ 620.698094] [<c06275af>] (ip_forward) from [<c0626187>] (ip_rcv+0x327/0x420)

[ 620.705158] [<c0626187>] (ip_rcv) from [<c05f5049>] (__netif_receive_skb_core+0x40d/0x7d0)

[ 620.713446] [<c05f5049>] (__netif_receive_skb_core) from [<c05f6acd>] (netif_receive_skb_internal+0x2d/0x74)

[ 620.723292] [<c05f6acd>] (netif_receive_skb_internal) from [<c05f72b3>] (napi_gro_receive+0x53/0x88)

[ 620.732448] [<c05f72b3>] (napi_gro_receive) from [<c051a057>] (sun8i_emac_poll+0x4d7/0x530)

[ 620.740822] [<c051a057>] (sun8i_emac_poll) from [<c05f6dc3>] (net_rx_action+0x153/0x1f4)

[ 620.748937] [<c05f6dc3>] (net_rx_action) from [<c011b57d>] (__do_softirq+0x9d/0x194)

[ 620.756705] [<c011b57d>] (__do_softirq) from [<c011b875>] (irq_exit+0x8d/0xdc)

[ 620.763952] [<c011b875>] (irq_exit) from [<c01546c3>] (__handle_domain_irq+0x3f/0x7c)

[ 620.771806] [<c01546c3>] (__handle_domain_irq) from [<c010133f>] (gic_handle_irq+0x3b/0x70)

[ 620.780178] [<c010133f>] (gic_handle_irq) from [<c0109765>] (__irq_svc+0x65/0x94)

[ 620.787675] Exception stack(0xc0b01f40 to 0xc0b01f88)

[ 620.792740] 1f40: 00000001 00000000 00000000 c0114141 c0b00000 c0b03cd0 c0b03c6c c0a54f08

[ 620.800936] 1f60: c0b01f98 00000000 00000000 00000000 00000000 c0b01f90 c0106881 c0106882

[ 620.809128] 1f80: 40060033 ffffffff

[ 620.812636] [<c0109765>] (__irq_svc) from [<c0106882>] (arch_cpu_idle+0x22/0x24)

[ 620.820057] [<c0106882>] (arch_cpu_idle) from [<c01486f1>] (do_idle+0x105/0x160)

[ 620.827476] [<c01486f1>] (do_idle) from [<c0148913>] (cpu_startup_entry+0x13/0x14)

[ 620.835070] [<c0148913>] (cpu_startup_entry) from [<c0a00a11>] (start_kernel+0x2fb/0x306)

[ 620.843268] Code: ff3f f06f 0015 bd70 (de02) f06f

[ 620.848071] ---[ end trace 02c62cacdc4c16d7 ]---

[ 620.852698] Kernel panic - not syncing: Fatal exception in interrupt

[ 620.859071] CPU2: stopping

[ 620.861808] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G D 4.10.0-sun8i #3

[ 620.869478] Hardware name: Allwinner sun8i Family

[ 620.874204] [<c010b91d>] (unwind_backtrace) from [<c0108f1b>] (show_stack+0xb/0xc)

[ 620.881798] [<c0108f1b>] (show_stack) from [<c0454317>] (dump_stack+0x67/0x74)

[ 620.889045] [<c0454317>] (dump_stack) from [<c010af9f>] (handle_IPI+0x137/0x150)

[ 620.896462] [<c010af9f>] (handle_IPI) from [<c010136d>] (gic_handle_irq+0x69/0x70)

[ 620.904052] [<c010136d>] (gic_handle_irq) from [<c0109765>] (__irq_svc+0x65/0x94)

[ 620.911548] Exception stack(0xef095f78 to 0xef095fc0)

[ 620.916609] 5f60: 00000001 00000000

[ 620.924806] 5f80: 00000000 c0114141 ef094000 c0b03cd0 c0b03c6c c0a54f08 ef095fd0 00000000

[ 620.933003] 5fa0: 00000000 00000000 ef09403c ef095fc8 c0106881 c0106882 40060033 ffffffff

[ 620.941202] [<c0109765>] (__irq_svc) from [<c0106882>] (arch_cpu_idle+0x22/0x24)

[ 620.948621] [<c0106882>] (arch_cpu_idle) from [<c01486f1>] (do_idle+0x105/0x160)

[ 620.956039] [<c01486f1>] (do_idle) from [<c0148913>] (cpu_startup_entry+0x13/0x14)

[ 620.963628] [<c0148913>] (cpu_startup_entry) from [<40101411>] (0x40101411)

[ 620.970597] CPU1: stopping

[ 620.973321] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D 4.10.0-sun8i #3

[ 620.980990] Hardware name: Allwinner sun8i Family

[ 620.985712] [<c010b91d>] (unwind_backtrace) from [<c0108f1b>] (show_stack+0xb/0xc)

[ 620.993303] [<c0108f1b>] (show_stack) from [<c0454317>] (dump_stack+0x67/0x74)

[ 621.000547] [<c0454317>] (dump_stack) from [<c010af9f>] (handle_IPI+0x137/0x150)

[ 621.007964] [<c010af9f>] (handle_IPI) from [<c010136d>] (gic_handle_irq+0x69/0x70)

[ 621.015553] [<c010136d>] (gic_handle_irq) from [<c0109765>] (__irq_svc+0x65/0x94)

[ 621.023051] Exception stack(0xef093f78 to 0xef093fc0)

[ 621.028111] 3f60: 00000001 00000000

[ 621.036308] 3f80: 00000000 c0114141 ef092000 c0b03cd0 c0b03c6c c0a54f08 ef093fd0 00000000

[ 621.044505] 3fa0: 00000000 00000000 ef09203c ef093fc8 c0106881 c0106882 40060033 ffffffff

[ 621.052703] [<c0109765>] (__irq_svc) from [<c0106882>] (arch_cpu_idle+0x22/0x24)

[ 621.060122] [<c0106882>] (arch_cpu_idle) from [<c01486f1>] (do_idle+0x105/0x160)

[ 621.067539] [<c01486f1>] (do_idle) from [<c0148913>] (cpu_startup_entry+0x13/0x14)

[ 621.075128] [<c0148913>] (cpu_startup_entry) from [<40101411>] (0x40101411)

[ 621.082096] CPU3: stopping

[ 621.084819] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D 4.10.0-sun8i #3

[ 621.092488] Hardware name: Allwinner sun8i Family

[ 621.097210] [<c010b91d>] (unwind_backtrace) from [<c0108f1b>] (show_stack+0xb/0xc)

[ 621.104800] [<c0108f1b>] (show_stack) from [<c0454317>] (dump_stack+0x67/0x74)

[ 621.112045] [<c0454317>] (dump_stack) from [<c010af9f>] (handle_IPI+0x137/0x150)

[ 621.119462] [<c010af9f>] (handle_IPI) from [<c010136d>] (gic_handle_irq+0x69/0x70)

[ 621.127052] [<c010136d>] (gic_handle_irq) from [<c0109765>] (__irq_svc+0x65/0x94)

[ 621.134549] Exception stack(0xef097f78 to 0xef097fc0)

[ 621.139609] 7f60: 00000001 00000000

[ 621.147806] 7f80: 00000000 c0114141 ef096000 c0b03cd0 c0b03c6c c0a54f08 ef097fd0 00000000

[ 621.156003] 7fa0: 00000000 00000000 ef09603c ef097fc8 c0106881 c0106882 40060033 ffffffff

[ 621.164202] [<c0109765>] (__irq_svc) from [<c0106882>] (arch_cpu_idle+0x22/0x24)

[ 621.171621] [<c0106882>] (arch_cpu_idle) from [<c01486f1>] (do_idle+0x105/0x160)

[ 621.179039] [<c01486f1>] (do_idle) from [<c0148913>] (cpu_startup_entry+0x13/0x14)

[ 621.186627] [<c0148913>] (cpu_startup_entry) from [<40101411>] (0x40101411)

[ 621.193601] Rebooting in 10 seconds..

zador.blood.stained · May 20, 2017

H3 Ethernet driver in current mainline sun8i kernels has known issues that will not be fixed because this driver is obsolete/not maintained.

There were some fixes in kernel 4.11, so upgrading to a newer kernel may fix some issues, but it also may break things because it's a development kernel, so you may try to upgrade at your own risk.

rick · May 20, 2017

So, is that to say that this board will never have a working Ethernet port either?

zador.blood.stained · May 20, 2017

1 hour ago, rick said:

So, is that to say that this board will never have a working Ethernet port either?

No. That is to say that you for some reason chose mainline based image (clearly marked as "experimental" and "development"). Mainline kernel will have a new driver, but most likely in 4-6 months, and for now we are using an older driver.

So please try stable (legacy kernel based) images, I don't remember any reports of significant Ethernet problems there.

rick · May 21, 2017

I need a kernel 4.4>= for BTRFS and such. It was the reason I bought these little time wasters, to save time and electricity. Didn't work out that way

When I bought these boards I didn't realize that you could have a system that runs the current Ubuntu but a 2012 ancient kernel. I learned. I have spent a hundred hours messing with board/kernel related errors and not been able to deploy a single system.

Any production ready boards you can recommend as net/file servers? I am in a corner now. I have failed badly and wasted soooo mush time and some money too.