Stuart Naylor Posted July 25, 2019 Posted July 25, 2019 I have got 2x USB 3.0 RTL8156 ethernet dongles using one on my Rockpi4 the other windows client If the rockpi4 is the server speeds are awful [rock@rockpi4 ~]$ iperf3 -s ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 192.168.1.12, port 52620 [ 5] local 192.168.1.9 port 5201 connected to 192.168.1.12 port 52621 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 56.7 MBytes 475 Mbits/sec [ 5] 1.00-2.00 sec 43.7 MBytes 367 Mbits/sec [ 5] 2.00-3.00 sec 46.3 MBytes 388 Mbits/sec [ 5] 3.00-4.00 sec 39.3 MBytes 330 Mbits/sec [ 5] 4.00-5.00 sec 45.2 MBytes 379 Mbits/sec [ 5] 5.00-6.00 sec 38.3 MBytes 321 Mbits/sec [ 5] 6.00-7.00 sec 41.4 MBytes 347 Mbits/sec [ 5] 7.00-8.00 sec 38.0 MBytes 319 Mbits/sec [ 5] 8.00-9.00 sec 42.0 MBytes 353 Mbits/sec [ 5] 9.00-10.00 sec 46.4 MBytes 389 Mbits/sec [ 5] 10.00-10.05 sec 2.29 MBytes 404 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.05 sec 440 MBytes 367 Mbits/sec receiver ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- RockPi4 as client [rock@rockpi4 ~]$ iperf3 -c 192.168.1.12 Connecting to host 192.168.1.12, port 5201 [ 5] local 192.168.1.9 port 38240 connected to 192.168.1.12 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 186 MBytes 1.55 Gbits/sec 0 220 KBytes [ 5] 1.00-2.00 sec 190 MBytes 1.60 Gbits/sec 10 212 KBytes [ 5] 2.00-3.00 sec 215 MBytes 1.80 Gbits/sec 0 212 KBytes [ 5] 3.00-4.01 sec 208 MBytes 1.74 Gbits/sec 10 245 KBytes [ 5] 4.01-5.00 sec 180 MBytes 1.52 Gbits/sec 30 212 KBytes [ 5] 5.00-6.00 sec 197 MBytes 1.65 Gbits/sec 10 214 KBytes [ 5] 6.00-7.01 sec 161 MBytes 1.34 Gbits/sec 0 214 KBytes [ 5] 7.01-8.00 sec 137 MBytes 1.15 Gbits/sec 30 214 KBytes [ 5] 8.00-9.01 sec 138 MBytes 1.15 Gbits/sec 20 217 KBytes [ 5] 9.01-10.00 sec 159 MBytes 1.34 Gbits/sec 0 217 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 1.73 GBytes 1.48 Gbits/sec 110 sender [ 5] 0.00-10.00 sec 1.73 GBytes 1.48 Gbits/sec receiver iperf Done. I prob need to sort some better cabling as my dodgy collection of battered and old ethernet cables made me rummage around until I got 2 half decent ones but I am not sure why client/server should make such a big difference and set speed? If the rockpi4 is the server and the client uses -R then [rock@rockpi4 ~]$ iperf3 -s ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 192.168.1.12, port 52663 [ 5] local 192.168.1.9 port 5201 connected to 192.168.1.12 port 52664 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 181 MBytes 1.52 Gbits/sec 10 151 KBytes [ 5] 1.00-2.00 sec 187 MBytes 1.57 Gbits/sec 20 231 KBytes [ 5] 2.00-3.01 sec 199 MBytes 1.66 Gbits/sec 31 210 KBytes [ 5] 3.01-4.00 sec 204 MBytes 1.71 Gbits/sec 10 155 KBytes [ 5] 4.00-5.01 sec 184 MBytes 1.54 Gbits/sec 124 212 KBytes [ 5] 5.01-6.01 sec 205 MBytes 1.72 Gbits/sec 0 212 KBytes [ 5] 6.01-7.00 sec 187 MBytes 1.58 Gbits/sec 20 214 KBytes [ 5] 7.00-8.01 sec 207 MBytes 1.73 Gbits/sec 10 238 KBytes [ 5] 8.01-9.01 sec 198 MBytes 1.67 Gbits/sec 11 212 KBytes [ 5] 9.01-10.00 sec 182 MBytes 1.53 Gbits/sec 30 230 KBytes [ 5] 10.00-10.04 sec 8.15 MBytes 1.85 Gbits/sec 0 230 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.04 sec 1.90 GBytes 1.62 Gbits/sec 266 sender ----------------------------------------------------------- Server listening on 5201 Confused as it can but why not as the server? Anyone know more about iperf and networking than obviously me I prob need to get some better cabling as had a mare with some cables that just where not liked even though just 2.5g Also any tweaks or tips on network and packet settings to get the most and lower overhead?
Igor Posted July 25, 2019 Posted July 25, 2019 Try better cables and on some other machines. Perhaps drivers / hw is just crap? Maybe you should get this one https://amzn.to/2Ojgd60 It's very pricey but I wonder if that one can go full speed? Put it on wish list - perhaps someone donates it? Its a lot of money just to play with.
qstaq Posted July 25, 2019 Posted July 25, 2019 Looks like a faulty cable from the inconsistent results pattern, especially the retries I see this same pattern quite a lot with 2.5/10/40GBe devices. The driver thinks the ethernet cable is constantly up and down, many times a second sometimes Can you grep dmesg output for "cdc_ncm" and see if you have lots of disconnects and reconnects. If so its almost certainly the cable
Stuart Naylor Posted July 25, 2019 Author Posted July 25, 2019 @Igor Oooof erm nope not at that price as will stick with my £20 2.5gb https://cpc.farnell.com/pro-signal/psg91497/usb3-0-to-2-5g-ethernet-adapter/dp/CS32425 @qstaq Yeah got that torrent as a big flood of that message There is no 'driver' after 4.15 just all use the cdc ncm driver. Cables do matter as after some head scratching and searching through my box of cables to find my 'best' ones I actually got it to work. I have ordered 2x cat 6e cables even though they are 2.5g My netgearswitch can do 10gb as it multispeed Thing I don't get is client and server have to travel over the same cables and the only change which is client and server I bodged the affinity on cpu5 to that usb also [root@rockpi4 ~]# grep -E 'usb' /proc/interrupts 28: 2 0 0 0 0 0 GICv3 58 Level ehci_hcd:usb1 29: 30 0 0 0 0 0 GICv3 60 Level ohci_hcd:usb3 30: 0 0 0 0 0 0 GICv3 62 Level ehci_hcd:usb2 31: 0 0 0 0 0 0 GICv3 64 Level ohci_hcd:usb4 219: 1 0 0 0 0 0 GICv3 59 Level rockchip_usb2phy 220: 0 0 0 0 0 0 GICv3 135 Level rockchip_usb2phy_bvalid 221: 0 0 0 0 0 0 GICv3 63 Level rockchip_usb2phy 222: 0 0 0 0 0 0 GICv3 137 Level dwc3-otg, xhci-hcd:usb5 223: 40809 0 0 0 0 969377 GICv3 142 Level xhci-hcd:usb7 echo 5 > /proc/irq/223/smp_affinity_list [root@rockpi4 ~]# iperf3 -c 192.168.1.12 Connecting to host 192.168.1.12, port 5201 [ 5] local 192.168.1.9 port 38752 connected to 192.168.1.12 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 249 MBytes 2.09 Gbits/sec 0 211 KBytes [ 5] 1.00-2.00 sec 254 MBytes 2.12 Gbits/sec 0 211 KBytes [ 5] 2.00-3.00 sec 246 MBytes 2.07 Gbits/sec 10 212 KBytes [ 5] 3.00-4.01 sec 255 MBytes 2.13 Gbits/sec 0 212 KBytes [ 5] 4.01-5.00 sec 245 MBytes 2.06 Gbits/sec 10 217 KBytes [ 5] 5.00-6.00 sec 256 MBytes 2.14 Gbits/sec 0 217 KBytes [ 5] 6.00-7.00 sec 253 MBytes 2.13 Gbits/sec 0 217 KBytes [ 5] 7.00-8.01 sec 253 MBytes 2.12 Gbits/sec 0 217 KBytes [ 5] 8.01-9.00 sec 253 MBytes 2.13 Gbits/sec 0 217 KBytes [ 5] 9.00-10.00 sec 254 MBytes 2.13 Gbits/sec 0 217 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 2.46 GBytes 2.11 Gbits/sec 20 sender [ 5] 0.00-10.00 sec 2.46 GBytes 2.11 Gbits/sec receiver But same thing reverse client server with -R [root@rockpi4 ~]# iperf3 -c 192.168.1.12 -R Connecting to host 192.168.1.12, port 5201 Reverse mode, remote host 192.168.1.12 is sending [ 5] local 192.168.1.9 port 37332 connected to 192.168.1.12 port 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 39.4 MBytes 331 Mbits/sec [ 5] 1.00-2.00 sec 57.3 MBytes 481 Mbits/sec [ 5] 2.00-3.00 sec 49.4 MBytes 414 Mbits/sec [ 5] 3.00-4.00 sec 57.3 MBytes 481 Mbits/sec [ 5] 4.00-5.00 sec 59.4 MBytes 498 Mbits/sec [ 5] 5.00-6.00 sec 61.0 MBytes 512 Mbits/sec [ 5] 6.00-7.00 sec 48.5 MBytes 407 Mbits/sec [ 5] 7.00-8.00 sec 51.9 MBytes 435 Mbits/sec [ 5] 8.00-9.00 sec 60.4 MBytes 507 Mbits/sec [ 5] 9.00-10.00 sec 52.5 MBytes 440 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 537 MBytes 451 Mbits/sec sender [ 5] 0.00-10.00 sec 537 MBytes 451 Mbits/sec receiver iperf Done. I am struggling to understand why direction of client server makes any difference? Cables could do with being better but thought the results would be the same
qstaq Posted July 25, 2019 Posted July 25, 2019 The imbalance in directional performance can be caused by quite a few different things, including bad cables still (I know it shouldnt according to spec, but on real equipment, especially cheaper stuff it does) Can you do the same tests, configured as follows, to give me a better idea of whats going on please? Connect the 2 RTL8156 nics directly with a single cable (The RTL8156 is MDI / MDI-X compliant so it should automatically go into crossover mode without needing a 4 pair crossover cable) Test with reversed cable direction (I know this seems stupid but humour me) Force the RTL8156 on the RockPi side into 1GB Before testing make sure that haveged is started and running and while the tests are running can you watch for: CPU use and specifically look to see if 1 particular CPU core maxes out dmesg for cdc_ncm disconnects (how many?) dmesg for "entropy", "CRNG" or "crng" (less likely)
Stuart Naylor Posted July 25, 2019 Author Posted July 25, 2019 [root@rockpi4 ~]# cat /proc/sys/kernel/random/entropy_avail 3413 I will install haveged though, do I need it though? Strange thing is I am being flooded with [ 6175.009458] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.041375] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.073407] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.105358] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.137422] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.169444] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.201400] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.233412] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.265362] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.297404] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.329458] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.361402] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.393425] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.425421] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.457424] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.489395] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.521382] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.553421] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.585406] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink [ 6175.617350] cdc_ncm 8-1:2.0 usb0: network connection: connected [ 6175.649425] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink But never a disconnect. Prob be tomoz and will post, thanks
qstaq Posted July 25, 2019 Posted July 25, 2019 You probably dont need haveged and your current entropy pool is fine and full but if it empties when iperf is running then it might temporarily block random traffic generation Also iperf does sometime give unexpected results when using "-R" as opposed to "-s", just listening as a server so it might be worthwhile using netcat to get an alternative baseline and see what performance you get firing a 100MB+ file over it Im not concerned about the cdc_ncm usb0: network connection: connected syslog flood, as long as it doesnt have disconnects. The flooding is seen on all RTL8156 USB devices I have used when using cdc_ncm as opposed to the Realtek driver. For kernels >4.15 cdc_ncm is the only option anyway
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 Just an update but got the Cat6e cables was still the same. Also it dawned on me when I tried to set up OTG USB ethernet on the rockpi I got exactly the same results. That was a while back and forgot about that. Anyway rummaged through my spares and bits and built up another windows 10 machine C:\Users\Stuart\Downloads\iperf-3.1.3-win64>iperf3 -c 192.168.1.12 Connecting to host 192.168.1.12, port 5201 [ 4] local 192.168.1.9 port 50138 connected to 192.168.1.12 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 277 MBytes 2.32 Gbits/sec [ 4] 1.00-2.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 2.00-3.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 3.00-4.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 4.00-5.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 5.00-6.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 6.00-7.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 7.00-8.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 8.00-9.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 9.00-10.00 sec 282 MBytes 2.37 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 2.75 GBytes 2.37 Gbits/sec sender [ 4] 0.00-10.00 sec 2.75 GBytes 2.37 Gbits/sec receiver iperf Done. C:\Users\Stuart\Downloads\iperf-3.1.3-win64>iperf3 -c 192.168.1.12 =R Connecting to host 192.168.1.12, port 5201 [ 4] local 192.168.1.9 port 50141 connected to 192.168.1.12 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 277 MBytes 2.32 Gbits/sec [ 4] 1.00-2.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 2.00-3.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 3.00-4.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 4.00-5.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 5.00-6.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 6.00-7.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 7.00-8.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 8.00-9.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 9.00-10.00 sec 283 MBytes 2.37 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 2.75 GBytes 2.37 Gbits/sec sender [ 4] 0.00-10.00 sec 2.75 GBytes 2.37 Gbits/sec receiver iperf Done. So back to checking entropy I guess.
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 Here is the cpu cores with entropy and the corresponding iperf3 run -R from the rockpi4 Spoiler Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:05 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:05 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.50 18:41:05 0 3.06 0.00 2.18 0.39 0.00 1.08 0.00 0.00 0.00 93.29 18:41:05 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.59 18:41:05 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:05 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:05 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:05 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.57 1224 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:06 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:06 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:06 0 3.06 0.00 2.18 0.39 0.00 1.09 0.00 0.00 0.00 93.28 18:41:06 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:06 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:06 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:06 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:06 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.57 1243 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:06 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:06 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:06 0 3.06 0.00 2.18 0.39 0.00 1.10 0.00 0.00 0.00 93.26 18:41:06 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.59 18:41:06 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:06 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:06 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:06 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.57 1195 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:07 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:07 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:07 0 3.06 0.00 2.19 0.39 0.00 1.10 0.00 0.00 0.00 93.26 18:41:07 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:07 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:07 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:07 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:07 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1209 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:07 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:07 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:07 0 3.06 0.00 2.19 0.39 0.00 1.11 0.00 0.00 0.00 93.25 18:41:07 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:07 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:07 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:07 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:07 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1224 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:08 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:08 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:08 0 3.06 0.00 2.19 0.39 0.00 1.12 0.00 0.00 0.00 93.24 18:41:08 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:08 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:08 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:08 4 0.52 0.00 4.11 0.26 0.00 0.01 0.00 0.00 0.00 95.11 18:41:08 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1239 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:08 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:08 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:08 0 3.06 0.00 2.19 0.39 0.00 1.13 0.00 0.00 0.00 93.23 18:41:08 1 2.14 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:08 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:08 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:08 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:08 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1190 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:09 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:09 all 1.33 0.00 1.76 0.24 0.00 0.18 0.00 0.00 0.00 96.49 18:41:09 0 3.06 0.00 2.19 0.39 0.00 1.13 0.00 0.00 0.00 93.23 18:41:09 1 2.15 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:09 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:09 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:09 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:09 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1205 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:09 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:09 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.49 18:41:09 0 3.06 0.00 2.19 0.39 0.00 1.14 0.00 0.00 0.00 93.22 18:41:09 1 2.15 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:09 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:09 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:09 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:09 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1218 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:10 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:10 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:10 0 3.06 0.00 2.20 0.39 0.00 1.15 0.00 0.00 0.00 93.21 18:41:10 1 2.15 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:10 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:10 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:10 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:10 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1233 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:10 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:10 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:10 0 3.06 0.00 2.20 0.39 0.00 1.15 0.00 0.00 0.00 93.20 18:41:10 1 2.15 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:10 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:10 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:10 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:10 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1184 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:11 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:11 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:11 0 3.05 0.00 2.20 0.39 0.00 1.16 0.00 0.00 0.00 93.19 18:41:11 1 2.15 0.00 2.09 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:11 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.23 18:41:11 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:11 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:11 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1199 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:12 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:12 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:12 0 3.05 0.00 2.20 0.39 0.00 1.17 0.00 0.00 0.00 93.18 18:41:12 1 2.15 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:12 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:12 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:12 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.12 18:41:12 5 0.54 0.00 0.56 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1216 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:12 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:12 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:12 0 3.05 0.00 2.20 0.39 0.00 1.18 0.00 0.00 0.00 93.17 18:41:12 1 2.15 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:12 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:12 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:12 4 0.52 0.00 4.10 0.26 0.00 0.01 0.00 0.00 0.00 95.13 18:41:12 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1233 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:13 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:13 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:13 0 3.05 0.00 2.20 0.39 0.00 1.19 0.00 0.00 0.00 93.16 18:41:13 1 2.15 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:13 2 1.26 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:13 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:13 4 0.52 0.00 4.09 0.26 0.00 0.01 0.00 0.00 0.00 95.13 18:41:13 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1184 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:13 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:13 all 1.33 0.00 1.76 0.24 0.00 0.19 0.00 0.00 0.00 96.48 18:41:13 0 3.05 0.00 2.20 0.39 0.00 1.19 0.00 0.00 0.00 93.16 18:41:13 1 2.15 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:13 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:13 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:13 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.13 18:41:13 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1199 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:14 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:14 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.48 18:41:14 0 3.05 0.00 2.20 0.39 0.00 1.20 0.00 0.00 0.00 93.15 18:41:14 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:14 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:14 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:14 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.13 18:41:14 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.56 1213 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:14 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:14 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.48 18:41:14 0 3.05 0.00 2.21 0.39 0.00 1.21 0.00 0.00 0.00 93.14 18:41:14 1 2.15 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:14 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:14 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:14 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.13 18:41:14 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1229 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:15 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:15 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.47 18:41:15 0 3.05 0.00 2.21 0.39 0.00 1.22 0.00 0.00 0.00 93.13 18:41:15 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:15 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:15 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:15 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.13 18:41:15 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1245 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:15 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:15 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.47 18:41:15 0 3.05 0.00 2.21 0.39 0.00 1.23 0.00 0.00 0.00 93.13 18:41:15 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:15 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:15 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:15 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.13 18:41:15 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1195 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:16 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:16 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.47 18:41:16 0 3.05 0.00 2.21 0.39 0.00 1.23 0.00 0.00 0.00 93.13 18:41:16 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:16 2 1.25 0.00 1.34 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:16 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:16 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.14 18:41:16 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1202 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:16 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:16 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.47 18:41:16 0 3.05 0.00 2.21 0.39 0.00 1.23 0.00 0.00 0.00 93.13 18:41:16 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:16 2 1.25 0.00 1.33 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:16 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:16 4 0.51 0.00 4.09 0.25 0.00 0.01 0.00 0.00 0.00 95.14 18:41:16 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1202 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:41:17 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:41:17 all 1.33 0.00 1.76 0.24 0.00 0.20 0.00 0.00 0.00 96.48 18:41:17 0 3.05 0.00 2.21 0.39 0.00 1.23 0.00 0.00 0.00 93.13 18:41:17 1 2.16 0.00 2.08 0.18 0.00 0.00 0.00 0.00 0.00 95.58 18:41:17 2 1.25 0.00 1.33 0.17 0.00 0.00 0.00 0.00 0.00 97.24 18:41:17 3 0.53 0.00 0.30 0.11 0.00 0.00 0.00 0.00 0.00 99.06 18:41:17 4 0.51 0.00 4.08 0.25 0.00 0.01 0.00 0.00 0.00 95.14 18:41:17 5 0.54 0.00 0.57 0.33 0.00 0.00 0.00 0.00 0.00 98.55 1204 Connecting to host 192.168.1.9, port 5201 Reverse mode, remote host 192.168.1.9 is sending [ 4] local 192.168.1.12 port 45402 connected to 192.168.1.9 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 48.1 MBytes 403 Mbits/sec [ 4] 1.00-2.00 sec 35.7 MBytes 300 Mbits/sec [ 4] 2.00-3.00 sec 37.8 MBytes 317 Mbits/sec [ 4] 3.00-4.00 sec 34.5 MBytes 290 Mbits/sec [ 4] 4.00-5.00 sec 36.4 MBytes 305 Mbits/sec [ 4] 5.00-6.00 sec 39.6 MBytes 332 Mbits/sec [ 4] 6.00-7.00 sec 41.7 MBytes 350 Mbits/sec [ 4] 7.00-8.00 sec 35.9 MBytes 301 Mbits/sec [ 4] 8.00-9.00 sec 37.6 MBytes 315 Mbits/sec [ 4] 9.00-10.00 sec 36.3 MBytes 305 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 384 MBytes 322 Mbits/sec sender [ 4] 0.00-10.00 sec 384 MBytes 322 Mbits/sec receiver iperf Done.
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 (edited) Here is -c connect as client same again on .5 sec Spoiler Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:03 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:03 all 1.30 0.00 1.68 0.28 0.00 0.14 0.00 0.00 0.00 96.60 18:37:03 0 2.87 0.00 2.20 0.45 0.00 0.86 0.00 0.00 0.00 93.62 18:37:03 1 2.11 0.00 2.26 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:03 2 1.27 0.00 1.30 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:03 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:03 4 0.54 0.00 3.46 0.30 0.00 0.01 0.00 0.00 0.00 95.69 18:37:03 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.50 2381 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:04 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:04 all 1.30 0.00 1.69 0.28 0.00 0.14 0.00 0.00 0.00 96.59 18:37:04 0 2.87 0.00 2.21 0.45 0.00 0.86 0.00 0.00 0.00 93.61 18:37:04 1 2.12 0.00 2.26 0.21 0.00 0.00 0.00 0.00 0.00 95.41 18:37:04 2 1.27 0.00 1.30 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:04 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:04 4 0.54 0.00 3.48 0.30 0.00 0.01 0.00 0.00 0.00 95.67 18:37:04 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.50 2401 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:04 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:04 all 1.30 0.00 1.69 0.28 0.00 0.14 0.00 0.00 0.00 96.59 18:37:04 0 2.87 0.00 2.21 0.45 0.00 0.87 0.00 0.00 0.00 93.61 18:37:04 1 2.12 0.00 2.26 0.21 0.00 0.00 0.00 0.00 0.00 95.41 18:37:04 2 1.27 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:04 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:04 4 0.54 0.00 3.51 0.30 0.00 0.01 0.00 0.00 0.00 95.64 18:37:04 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.50 2368 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:05 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:05 all 1.30 0.00 1.70 0.28 0.00 0.14 0.00 0.00 0.00 96.58 18:37:05 0 2.87 0.00 2.21 0.45 0.00 0.87 0.00 0.00 0.00 93.61 18:37:05 1 2.12 0.00 2.26 0.21 0.00 0.00 0.00 0.00 0.00 95.41 18:37:05 2 1.27 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:05 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:05 4 0.54 0.00 3.55 0.30 0.00 0.01 0.00 0.00 0.00 95.61 18:37:05 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2335 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:05 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:05 all 1.30 0.00 1.70 0.28 0.00 0.14 0.00 0.00 0.00 96.58 18:37:05 0 2.87 0.00 2.21 0.45 0.00 0.87 0.00 0.00 0.00 93.60 18:37:05 1 2.12 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:05 2 1.27 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:05 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:05 4 0.54 0.00 3.58 0.30 0.00 0.01 0.00 0.00 0.00 95.58 18:37:05 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2302 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:06 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:06 all 1.30 0.00 1.71 0.28 0.00 0.14 0.00 0.00 0.00 96.57 18:37:06 0 2.87 0.00 2.21 0.45 0.00 0.87 0.00 0.00 0.00 93.60 18:37:06 1 2.12 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:06 2 1.27 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:06 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:06 4 0.54 0.00 3.61 0.30 0.00 0.01 0.00 0.00 0.00 95.55 18:37:06 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2269 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:06 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:06 all 1.30 0.00 1.71 0.28 0.00 0.14 0.00 0.00 0.00 96.57 18:37:06 0 2.87 0.00 2.21 0.45 0.00 0.87 0.00 0.00 0.00 93.60 18:37:06 1 2.12 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:06 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:06 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:06 4 0.54 0.00 3.64 0.30 0.00 0.01 0.00 0.00 0.00 95.52 18:37:06 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2236 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:07 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:07 all 1.30 0.00 1.72 0.28 0.00 0.14 0.00 0.00 0.00 96.56 18:37:07 0 2.87 0.00 2.21 0.45 0.00 0.88 0.00 0.00 0.00 93.60 18:37:07 1 2.12 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:07 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.24 18:37:07 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:07 4 0.54 0.00 3.67 0.30 0.00 0.01 0.00 0.00 0.00 95.48 18:37:07 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2203 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:07 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:07 all 1.30 0.00 1.72 0.28 0.00 0.14 0.00 0.00 0.00 96.56 18:37:07 0 2.87 0.00 2.21 0.45 0.00 0.88 0.00 0.00 0.00 93.60 18:37:07 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:07 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:07 3 0.57 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:07 4 0.54 0.00 3.70 0.30 0.00 0.01 0.00 0.00 0.00 95.45 18:37:07 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2170 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:08 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:08 all 1.30 0.00 1.73 0.28 0.00 0.15 0.00 0.00 0.00 96.55 18:37:08 0 2.87 0.00 2.21 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:08 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:08 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:08 3 0.57 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:08 4 0.54 0.00 3.74 0.30 0.00 0.01 0.00 0.00 0.00 95.42 18:37:08 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2136 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:09 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:09 all 1.30 0.00 1.73 0.28 0.00 0.15 0.00 0.00 0.00 96.54 18:37:09 0 2.87 0.00 2.21 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:09 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.42 18:37:09 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:09 3 0.57 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:09 4 0.54 0.00 3.77 0.30 0.00 0.01 0.00 0.00 0.00 95.39 18:37:09 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2102 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:09 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:09 all 1.30 0.00 1.74 0.28 0.00 0.15 0.00 0.00 0.00 96.54 18:37:09 0 2.86 0.00 2.21 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:09 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:09 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:09 3 0.57 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.01 18:37:09 4 0.54 0.00 3.80 0.30 0.00 0.01 0.00 0.00 0.00 95.36 18:37:09 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2068 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:10 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:10 all 1.30 0.00 1.74 0.28 0.00 0.15 0.00 0.00 0.00 96.53 18:37:10 0 2.86 0.00 2.20 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:10 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:10 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:10 3 0.57 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:10 4 0.54 0.00 3.83 0.30 0.00 0.01 0.00 0.00 0.00 95.33 18:37:10 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2040 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:10 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:10 all 1.30 0.00 1.75 0.28 0.00 0.15 0.00 0.00 0.00 96.53 18:37:10 0 2.86 0.00 2.20 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:10 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:10 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:10 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:10 4 0.54 0.00 3.86 0.30 0.00 0.01 0.00 0.00 0.00 95.29 18:37:10 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 2013 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:11 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:11 all 1.30 0.00 1.75 0.28 0.00 0.15 0.00 0.00 0.00 96.52 18:37:11 0 2.86 0.00 2.20 0.45 0.00 0.89 0.00 0.00 0.00 93.59 18:37:11 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:11 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:11 3 0.58 0.00 0.30 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:11 4 0.54 0.00 3.89 0.30 0.00 0.01 0.00 0.00 0.00 95.26 18:37:11 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 1995 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:11 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:11 all 1.30 0.00 1.76 0.28 0.00 0.15 0.00 0.00 0.00 96.52 18:37:11 0 2.86 0.00 2.20 0.45 0.00 0.90 0.00 0.00 0.00 93.59 18:37:11 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:11 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:11 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:11 4 0.54 0.00 3.93 0.30 0.00 0.01 0.00 0.00 0.00 95.23 18:37:11 5 0.52 0.00 0.60 0.39 0.00 0.00 0.00 0.00 0.00 98.49 1977 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:12 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:12 all 1.30 0.00 1.76 0.28 0.00 0.15 0.00 0.00 0.00 96.51 18:37:12 0 2.86 0.00 2.20 0.45 0.00 0.90 0.00 0.00 0.00 93.58 18:37:12 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:12 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:12 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:12 4 0.54 0.00 3.96 0.29 0.00 0.01 0.00 0.00 0.00 95.20 18:37:12 5 0.52 0.00 0.61 0.39 0.00 0.00 0.00 0.00 0.00 98.49 1960 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:12 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:12 all 1.30 0.00 1.77 0.28 0.00 0.15 0.00 0.00 0.00 96.50 18:37:12 0 2.86 0.00 2.20 0.45 0.00 0.92 0.00 0.00 0.00 93.57 18:37:12 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:12 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:12 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:12 4 0.54 0.00 3.99 0.29 0.00 0.01 0.00 0.00 0.00 95.17 18:37:12 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1941 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:13 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:13 all 1.30 0.00 1.77 0.28 0.00 0.15 0.00 0.00 0.00 96.50 18:37:13 0 2.86 0.00 2.20 0.45 0.00 0.94 0.00 0.00 0.00 93.54 18:37:13 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:13 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:13 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:13 4 0.54 0.00 4.02 0.29 0.00 0.01 0.00 0.00 0.00 95.14 18:37:13 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1924 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:13 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:13 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:13 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.54 18:37:13 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:13 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:13 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:13 4 0.54 0.00 4.05 0.29 0.00 0.01 0.00 0.00 0.00 95.10 18:37:13 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1906 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:14 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:14 all 1.30 0.00 1.78 0.28 0.00 0.16 0.00 0.00 0.00 96.49 18:37:14 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.54 18:37:14 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:14 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:14 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:14 4 0.54 0.00 4.08 0.29 0.00 0.01 0.00 0.00 0.00 95.08 18:37:14 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1942 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:14 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:14 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:14 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.54 18:37:14 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:14 2 1.27 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:14 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:14 4 0.54 0.00 4.08 0.29 0.00 0.01 0.00 0.00 0.00 95.08 18:37:14 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1943 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:15 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:15 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:15 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.54 18:37:15 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:15 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:15 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:15 4 0.54 0.00 4.07 0.29 0.00 0.01 0.00 0.00 0.00 95.08 18:37:15 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1944 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:15 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:15 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:15 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.55 18:37:15 1 2.11 0.00 2.24 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:15 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:15 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:15 4 0.54 0.00 4.07 0.29 0.00 0.01 0.00 0.00 0.00 95.08 18:37:15 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1945 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:16 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:16 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:16 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.55 18:37:16 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.44 18:37:16 2 1.26 0.00 1.29 0.20 0.00 0.00 0.00 0.00 0.00 97.25 18:37:16 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:16 4 0.54 0.00 4.07 0.29 0.00 0.01 0.00 0.00 0.00 95.09 18:37:16 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.49 1946 Linux 4.4.182-rockchip64 (rockpi) 07/26/19 _aarch64_ (6 CPU) 18:37:16 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %gnice %idle 18:37:16 all 1.30 0.00 1.78 0.28 0.00 0.15 0.00 0.00 0.00 96.49 18:37:16 0 2.86 0.00 2.20 0.45 0.00 0.95 0.00 0.00 0.00 93.55 18:37:16 1 2.11 0.00 2.25 0.21 0.00 0.00 0.00 0.00 0.00 95.43 18:37:16 2 1.26 0.00 1.29 0.19 0.00 0.00 0.00 0.00 0.00 97.25 18:37:16 3 0.58 0.00 0.29 0.13 0.00 0.00 0.00 0.00 0.00 99.00 18:37:16 4 0.54 0.00 4.07 0.29 0.00 0.01 0.00 0.00 0.00 95.09 18:37:16 5 0.52 0.00 0.61 0.38 0.00 0.00 0.00 0.00 0.00 98.48 1947 Connecting to host 192.168.1.9, port 5201 [ 4] local 192.168.1.12 port 45394 connected to 192.168.1.9 port 5201 [ ID] Interval Transfer Bandwidth Retr Cwnd [ 4] 0.00-1.01 sec 136 MBytes 1.14 Gbits/sec 0 428 KBytes [ 4] 1.01-2.00 sec 161 MBytes 1.36 Gbits/sec 0 428 KBytes [ 4] 2.00-3.00 sec 162 MBytes 1.36 Gbits/sec 0 428 KBytes [ 4] 3.00-4.00 sec 162 MBytes 1.36 Gbits/sec 0 428 KBytes [ 4] 4.00-5.01 sec 164 MBytes 1.37 Gbits/sec 0 428 KBytes [ 4] 5.01-6.00 sec 165 MBytes 1.38 Gbits/sec 0 428 KBytes [ 4] 6.00-7.00 sec 166 MBytes 1.40 Gbits/sec 0 428 KBytes [ 4] 7.00-8.00 sec 167 MBytes 1.40 Gbits/sec 0 428 KBytes [ 4] 8.00-9.00 sec 168 MBytes 1.40 Gbits/sec 0 428 KBytes [ 4] 9.00-10.00 sec 166 MBytes 1.40 Gbits/sec 0 428 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 1.58 GBytes 1.36 Gbits/sec 0 sender [ 4] 0.00-10.00 sec 1.58 GBytes 1.36 Gbits/sec receiver Edited July 26, 2019 by Igor use spoilers when adding wall of text
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 Apols about that can not even work out on the forum how to get horizontal scrolls even though managed it with one somehow? So struggling with this, but its not the adapters as we have seen in windows they works near max both ways. Without affinity on the rockpi4 it doesn't cope with the load as well as windows but can as a client manage over 2gbs But why as a server it plummets to 400gbs with affinity I am not really sure. What I don't know is how other SBC react the same as thinking its something to do with the Rockchip code as the rk3328 has a similar performance profile and wonder if its the same with speed being asymmetrical depending on client or server? There seems to be zero load loads of entropy and no reason apart from maybe rockchip code. I am also mightily confused to the CPU arrangement as the default affinity is all cores apart from big, maybe that makes sense. I am going to play with affinity as maybe as a client the task has a higher affinity and runs on both big cores as client? I will just remember its a bit map and not core number
qstaq Posted July 26, 2019 Posted July 26, 2019 It doesnt seem related to cpu affinity from your output. Its certainly not entropy. Very strange behaviour. Did you try using netcat to get a baseline outside of iperf? I actually stopped by at CPC on my way home today and picked up a couple of the PSG91497 Pro signal adaptors you have. They seemed too cheap to be true! I dont have any RK devices with USB3 unfortunately, apart from Android TV boxes so I cant really do an RK specific test (unless I can find an armbian or libreelec build for them). I will try them tonight on a Jetson Nano and any other USB3 arm devices I have at home
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 Nope I forgot to be honest its confusing and totally forgot as been trying many things and it just seems the rockchip code depending on slave or master. I will do now though as its not just this 2.5gb USB all are useless but strange thing is from memory my plugable 1gbe usb gives exactly same results, I mean exact same figures if that 300+ level is a max or same with g_ether OTG For £20 2.5gb which actually it isn't true they will run on existing as they are pretty picky with quality and length but reasonable cables rather than my usual battered spagetti 2.5 runs great. I am going to dual boot this windows PC with bionic and try x86 linux to linux which I am expecting will work fine. I am not sure if its rockchip / rk3399 or something but prob. I shall be at netcat whilst you try out your new eth adaptors I am sure you will find them OK the overly bright white led drives me nuts, they get warm compared to some hot usb 1gb I have had. Windows wise they work great so its not the adapters.
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 Net rockpi4 client 100MBs sort of 1gbe speed? root@rockpi:~# dd if=/dev/zero bs=1024k count=1024 | nc -v 192.168.1.9 2222 Connection to 192.168.1.9 2222 port [tcp/*] succeeded! 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.98256 s, 108 MB/s x86 client rockpi server stuart@stuart-pc:~$ dd if=/dev/zero bs=1024K count=1024 | nc -v 192.168.1.12 2222 Connection to 192.168.1.12 2222 port [tcp/*] succeeded! 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 23.158 s, 46.4 MB/s Somehow auto negiotated to 1gbe me thinks and will have to check nmcli 1
qstaq Posted July 26, 2019 Posted July 26, 2019 Ive started some testing but there is clearly a problem with this NIC or driver. I will post the Jetson Nano results now as it will take me another hour or so to finish compiling and setting up tests for the rockchip TV Box based boards as I want to try an older kernel with the official realtek driver. Im not even bothering with iperf yet Test environment and server testing against is as follows: Network: Netgear XS712T-200NES 10GB switchConfig: Everything as defaults, No cpu affinityfaphq.lan: x86_64, i9-7980XE, Intel 10GB ethernet, Linux Mint 19.1, Kernel 5.0 (Home Server) Clients config: jetson.lan: aarch64, Jetson Nano, USB RTL8156 (cdc_ncm), Ubuntu 18.04, Kernel 5.2tvbox1.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (cdc_ncm), Custom userland, Kernel 4.19tvbox2.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (RTL driver), Custom userland, Kernel 4.4-rk Test 1: Netcat UDP - jetson.lan --> faphq.lan root@jetson:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999 Connection to faphq.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.4171 s, 244 MB/s Test 2: Netcat UDP - faphq.lan --> jetson.lan root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u jetson.lan 9999 Connection to jetson.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.980 s, 98.2 MB/s Edit: On the jetson it automatically negotiated the correct 2.5Gb link speed, not 1Gb but obviously there is a huge difference in performance depending on the direction
qstaq Posted July 26, 2019 Posted July 26, 2019 Test 3: Netcat UDP, tvbox1.lan --> faphq.lan root@tvbox1:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999 Connection to faphq.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.98239 s, 107 MB/s Test 4: Netcat UDP, faphq.lan --> tvbox1.lan root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u tvbox1.lan 9999 Connection to tvbox1.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 23.008 s, 46.9 MB/s First test on the RK3399 device is roughly half the performance of the Jetson, again the recieve performance is much lower than the send. This is on kernel 4.19 (I already had a config I knew would work). Im compiling a new 5.2 kernel now so I can test like for like kernel versions for cdc_ncm Edit: Performance on Kernel 5.2 is identical to 4.19 +/- 2%. Same asynchronous transfer speed and still half the performance of the Jetson
qstaq Posted July 26, 2019 Posted July 26, 2019 tvbox2.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (RTL driver), Custom userland, Kernel 4.4-rk Test 5: Netcat UDP, tvbox2.lan --> faphq.lan root@tvbox2:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999 Connection to faphq.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.112 s, 99.7 MB/s Test 6: Netcat UDP, faphq.lan --> tvbox2.lan root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u tvbox2.lan 9999 Connection to tvbox2.lan 9999 port [udp/*] succeeded! 10+0 records in 10+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.109 s, 99.7 MB/s Using the 4.4-rk kernel and realtek driver I cant get it to connect at 2.5Gb at all I have also just done a quick test between 2 Linux Mint 19.1 x86_64 boxes with the RTL8156's and kernel 5.0 and surprisingly they connect at 2.5Gb line rate and data transfer speeds are as they should be: 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.9438 s, 273 MB/s Ran out of time for any further testing tonight sorry
Stuart Naylor Posted July 26, 2019 Author Posted July 26, 2019 I didn't get much further as my scrapyard spare x86 for some reason just dies when I try to install ubuntu. Blingdows installed ok and if I go from ubuntu server to windows client iperf both x86 then same as before. Think I will grab Manjaro Accepted connection from 192.168.1.9, port 41180 [ 5] local 192.168.1.12 port 5201 connected to 192.168.1.9 port 41182 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 251 MBytes 2.11 Gbits/sec [ 5] 1.00-2.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 2.00-3.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 3.00-4.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 4.00-5.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 5.00-6.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 6.00-7.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 7.00-8.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 8.00-9.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 9.00-10.00 sec 281 MBytes 2.35 Gbits/sec [ 5] 10.00-10.04 sec 11.7 MBytes 2.35 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.04 sec 2.72 GBytes 2.33 Gbits/sec receiver ----------------------------------------------------------- Server listening on 5201 Manjaro Kernel 5.1 so yeah either a kernel or firmware thing. There was a lot of politics about 2.5 that was coming and at first then oh no your not then to actually come in. So adapter works fine but which kernel/firmware might be a bit of a minefield. The above is Manjaro as a server (Accepted connection from 192.168.1.9) Still don't get why not in reverse though with some kernel versions / drivers but the above is a perfect 95% efficiency that you should expect.
Stuart Naylor Posted July 28, 2019 Author Posted July 28, 2019 Dunno what I was doing with the driver!!? Finally got rid of the cdc-ncd driver and used the r8152 driver [rock@rockpi4 ~]$ sudo lshw -C network [sudo] password for rock: *-network:0 description: Ethernet interface physical id: 9 logical name: eth0 serial: da:19:c8:7a:6d:f4 capacity: 1Gbit/s capabilities: ethernet physical tp mii 10bt 10bt-fd 100bt 100bt-fd 1000bt 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=st_gmac driverversion=Jan_2016 link=no multicast=yes port=MII *-network:1 description: Ethernet interface physical id: a logical name: eth1 serial: a0:ce:c8:c8:2b:31 capacity: 1Gbit/s capabilities: ethernet physical mii 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=r8152 driverversion=v2.12.0 (2019/04/29) duplex=full ip=192.168.1.12 link=yes multicast=yes port=MII [rock@rockpi4 ~]$ iperf3 -c 192.168.1.9 -R Connecting to host 192.168.1.9, port 5201 Reverse mode, remote host 192.168.1.9 is sending [ 5] local 192.168.1.12 port 38496 connected to 192.168.1.9 port 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 266 MBytes 2.23 Gbits/sec [ 5] 1.00-2.00 sec 239 MBytes 2.01 Gbits/sec [ 5] 2.00-3.00 sec 244 MBytes 2.05 Gbits/sec [ 5] 3.00-4.00 sec 237 MBytes 1.99 Gbits/sec [ 5] 4.00-5.00 sec 239 MBytes 2.01 Gbits/sec [ 5] 5.00-6.00 sec 250 MBytes 2.10 Gbits/sec [ 5] 6.00-7.00 sec 248 MBytes 2.08 Gbits/sec [ 5] 7.00-8.00 sec 244 MBytes 2.05 Gbits/sec [ 5] 8.00-9.00 sec 249 MBytes 2.09 Gbits/sec [ 5] 9.00-10.00 sec 248 MBytes 2.08 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 2.41 GBytes 2.07 Gbits/sec sender [ 5] 0.00-10.00 sec 2.41 GBytes 2.07 Gbits/sec receiver Bit of big core affinity [root@rockpi4 ~]# echo 5 > /proc/irq/221/smp_affinity_list [root@rockpi4 ~]# iperf3 -c 192.168.1.9 -R Connecting to host 192.168.1.9, port 5201 Reverse mode, remote host 192.168.1.9 is sending [ 5] local 192.168.1.12 port 38502 connected to 192.168.1.9 port 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 274 MBytes 2.30 Gbits/sec [ 5] 1.00-2.00 sec 276 MBytes 2.32 Gbits/sec [ 5] 2.00-3.00 sec 276 MBytes 2.32 Gbits/sec [ 5] 3.00-4.00 sec 278 MBytes 2.33 Gbits/sec [ 5] 4.00-5.00 sec 277 MBytes 2.33 Gbits/sec [ 5] 5.00-6.00 sec 276 MBytes 2.31 Gbits/sec [ 5] 6.00-7.00 sec 277 MBytes 2.32 Gbits/sec [ 5] 7.00-8.00 sec 277 MBytes 2.32 Gbits/sec [ 5] 8.00-9.00 sec 277 MBytes 2.33 Gbits/sec [ 5] 9.00-10.00 sec 277 MBytes 2.32 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 2.70 GBytes 2.32 Gbits/sec sender [ 5] 0.00-10.00 sec 2.70 GBytes 2.32 Gbits/sec receiver iperf Done. I am using Manjaro 5.2 as latest kernel was on that and had it on an SD but yeah they will work on Arm. I need to go back to Armbian and work out why when the driver was suggested it failed and didn't work. I am not that great with custom driver install and know manjaro a little bit better and new the kernel was much newer. I will give it a go again but no kernel ring flood and near as damn it 2.5gb on the rockpi4 aint bad.
Igor Posted August 6, 2019 Posted August 6, 2019 On 7/28/2019 at 8:02 AM, Stuart Naylor said: Finally got rid of the cdc-ncd driver and used the r8152 driver Fixed/updated driver and tested with Rock64Pro 4.4.y default kernel vs Debian Buster xps13 laptop. Got roughly 2 Gbits/sec in both directions by using dumb Netgear XS508M switch.
qstaq Posted August 7, 2019 Posted August 7, 2019 Updated driver / kernel works perfect with both of my rk3399 TV boxes, Orange Pi RK3399 and my OP1 SoC ASUS chromebook
Igor Posted June 29, 2020 Posted June 29, 2020 @Stuart Naylor Rockchip driver v2.13.0 (2020/04/20) seems to run better -> Odroid N2 http://ix.io/2qv6 vs. my desktop. Both ways something like this: [ 5] 0.00-1.00 sec 233 MBytes 1.96 Gbits/sec 32 628 KBytes [ 5] 1.00-2.00 sec 279 MBytes 2.34 Gbits/sec 5 735 KBytes [ 5] 2.00-3.00 sec 281 MBytes 2.36 Gbits/sec 0 805 KBytes [ 5] 3.00-4.00 sec 246 MBytes 2.07 Gbits/sec 22 686 KBytes [ 5] 4.00-5.00 sec 250 MBytes 2.10 Gbits/sec 11 741 KBytes [ 5] 5.00-6.00 sec 248 MBytes 2.08 Gbits/sec 14 567 KBytes [ 5] 6.00-7.00 sec 248 MBytes 2.08 Gbits/sec 5 619 KBytes [ 5] 7.00-8.00 sec 249 MBytes 2.09 Gbits/sec 11 669 KBytes [ 5] 8.00-9.00 sec 246 MBytes 2.07 Gbits/sec 5 717 KBytes [ 5] 9.00-10.00 sec 246 MBytes 2.07 Gbits/sec 10 758 KBytes
Stuart Naylor Posted June 29, 2020 Author Posted June 29, 2020 Its been a while @Igor but yeah eventually with drivers I got great both way access speeds. I was messing around with drivers but there was a Realtek driver that seemed to do the trick but if there are Rockchip drivers and as above even better. I dropped the RockPi4 and somehow like a coin it landed edge up on the SD card and has since gathered dust, but also due to the Pi4 that mainly I play with now. I never got round to benching the RPi4 with those exceptionally good value 2.5Gb USB ethernet adapters, but the adapters from what I found are really good.
Igor Posted June 30, 2020 Posted June 30, 2020 20 hours ago, Stuart Naylor said: Its been a while Indeed Time goes around pretty fast. 20 hours ago, Stuart Naylor said: I never got round to benching the RPi4 with those exceptionally good value 2.5Gb USB Ethernet adapters, but the adapters from what I found are really good. I made tests on Odroid XU4, N2 and my x86 desktop. Results are similar, actually a bit better than N2. No Rpi4 Pi around, but I would assume it should be the same. 20 hours ago, Stuart Naylor said: I dropped the RockPi4 I also had an accident with Rockpi 4, but not a fatal one I manage to forcefully detach audio connector when trying to check audio support.
Stuart Naylor Posted June 30, 2020 Author Posted June 30, 2020 Yeah I think they beefed up the audio port as it was a little flakey. I desoldered the broken sd connector and it will run but just mmc. Its just gathered dust since the raspberry 4 as the 4 lanes of pci-e are actually hard to populate. PS my fave Rockpi would be the RK3308 Pi-S if they actually did publish how to interface the x4(x1) VAD mics. Its an average general purpose SoC but for voice AI if there was more info it would be exceptional.
![m][sko](https://forum.armbian.com/uploads/n2a/n2a-180904eb9612afa23a4c3358385bd86f384613e3.avatars_letters_gd.png){kind=avatar}
Recommended Posts