Jump to content

2.5gbe USB rtl


Stuart Naylor

Recommended Posts

I have got 2x USB 3.0 RTL8156 ethernet dongles using one on my Rockpi4 the other windows client

 

If the rockpi4 is the server speeds are awful 

 

[rock@rockpi4 ~]$ iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.12, port 52620
[  5] local 192.168.1.9 port 5201 connected to 192.168.1.12 port 52621
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  56.7 MBytes   475 Mbits/sec
[  5]   1.00-2.00   sec  43.7 MBytes   367 Mbits/sec
[  5]   2.00-3.00   sec  46.3 MBytes   388 Mbits/sec
[  5]   3.00-4.00   sec  39.3 MBytes   330 Mbits/sec
[  5]   4.00-5.00   sec  45.2 MBytes   379 Mbits/sec
[  5]   5.00-6.00   sec  38.3 MBytes   321 Mbits/sec
[  5]   6.00-7.00   sec  41.4 MBytes   347 Mbits/sec
[  5]   7.00-8.00   sec  38.0 MBytes   319 Mbits/sec
[  5]   8.00-9.00   sec  42.0 MBytes   353 Mbits/sec
[  5]   9.00-10.00  sec  46.4 MBytes   389 Mbits/sec
[  5]  10.00-10.05  sec  2.29 MBytes   404 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.05  sec   440 MBytes   367 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------



RockPi4 as client
 

[rock@rockpi4 ~]$ iperf3 -c 192.168.1.12
Connecting to host 192.168.1.12, port 5201
[  5] local 192.168.1.9 port 38240 connected to 192.168.1.12 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   186 MBytes  1.55 Gbits/sec    0    220 KBytes
[  5]   1.00-2.00   sec   190 MBytes  1.60 Gbits/sec   10    212 KBytes
[  5]   2.00-3.00   sec   215 MBytes  1.80 Gbits/sec    0    212 KBytes
[  5]   3.00-4.01   sec   208 MBytes  1.74 Gbits/sec   10    245 KBytes
[  5]   4.01-5.00   sec   180 MBytes  1.52 Gbits/sec   30    212 KBytes
[  5]   5.00-6.00   sec   197 MBytes  1.65 Gbits/sec   10    214 KBytes
[  5]   6.00-7.01   sec   161 MBytes  1.34 Gbits/sec    0    214 KBytes
[  5]   7.01-8.00   sec   137 MBytes  1.15 Gbits/sec   30    214 KBytes
[  5]   8.00-9.01   sec   138 MBytes  1.15 Gbits/sec   20    217 KBytes
[  5]   9.01-10.00  sec   159 MBytes  1.34 Gbits/sec    0    217 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.73 GBytes  1.48 Gbits/sec  110             sender
[  5]   0.00-10.00  sec  1.73 GBytes  1.48 Gbits/sec                  receiver

iperf Done.



I prob need to sort some better cabling as my dodgy collection of battered and old ethernet cables made me rummage around until I got 2 half decent ones but I am not sure why client/server should make such a big difference and set speed?

If the rockpi4 is the server and the client uses -R then
 

[rock@rockpi4 ~]$ iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.12, port 52663
[  5] local 192.168.1.9 port 5201 connected to 192.168.1.12 port 52664
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   181 MBytes  1.52 Gbits/sec   10    151 KBytes
[  5]   1.00-2.00   sec   187 MBytes  1.57 Gbits/sec   20    231 KBytes
[  5]   2.00-3.01   sec   199 MBytes  1.66 Gbits/sec   31    210 KBytes
[  5]   3.01-4.00   sec   204 MBytes  1.71 Gbits/sec   10    155 KBytes
[  5]   4.00-5.01   sec   184 MBytes  1.54 Gbits/sec  124    212 KBytes
[  5]   5.01-6.01   sec   205 MBytes  1.72 Gbits/sec    0    212 KBytes
[  5]   6.01-7.00   sec   187 MBytes  1.58 Gbits/sec   20    214 KBytes
[  5]   7.00-8.01   sec   207 MBytes  1.73 Gbits/sec   10    238 KBytes
[  5]   8.01-9.01   sec   198 MBytes  1.67 Gbits/sec   11    212 KBytes
[  5]   9.01-10.00  sec   182 MBytes  1.53 Gbits/sec   30    230 KBytes
[  5]  10.00-10.04  sec  8.15 MBytes  1.85 Gbits/sec    0    230 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.04  sec  1.90 GBytes  1.62 Gbits/sec  266             sender
-----------------------------------------------------------
Server listening on 5201


Confused as it can but why not as the server?
Anyone know more about iperf and networking than obviously me :)
I prob need to get some better cabling as had a mare with some cables that just where not liked even though just 2.5g

Also any tweaks or tips on network and packet settings to get the most and lower overhead?
 

Link to comment
Share on other sites

Looks like a faulty cable from the inconsistent results pattern, especially the retries

 

I see this same pattern quite a lot with 2.5/10/40GBe devices. The driver thinks the ethernet cable is constantly up and down, many times a second sometimes

 

Can you grep dmesg output for "cdc_ncm" and see if you have lots of disconnects and reconnects. If so its almost certainly the cable

Link to comment
Share on other sites

@Igor Oooof erm nope not at that price as will stick with my £20 2.5gb :)

https://cpc.farnell.com/pro-signal/psg91497/usb3-0-to-2-5g-ethernet-adapter/dp/CS32425

 

@qstaq Yeah got that torrent as a big flood of that message

 

There is no 'driver' after 4.15 just all use the cdc ncm driver.

Cables do matter as after some head scratching and searching through my box of cables to find my 'best' ones I actually got it to work.
I have ordered 2x cat 6e cables even though they are 2.5g
My netgearswitch can do 10gb as it multispeed

Thing I don't get is client and server have to travel over the same cables and the only change which is client and server
I bodged the affinity on cpu5 to that usb also

[root@rockpi4 ~]# grep -E 'usb' /proc/interrupts
 28:          2          0          0          0          0          0     GICv3  58 Level     ehci_hcd:usb1
 29:         30          0          0          0          0          0     GICv3  60 Level     ohci_hcd:usb3
 30:          0          0          0          0          0          0     GICv3  62 Level     ehci_hcd:usb2
 31:          0          0          0          0          0          0     GICv3  64 Level     ohci_hcd:usb4
219:          1          0          0          0          0          0     GICv3  59 Level     rockchip_usb2phy
220:          0          0          0          0          0          0     GICv3 135 Level     rockchip_usb2phy_bvalid
221:          0          0          0          0          0          0     GICv3  63 Level     rockchip_usb2phy
222:          0          0          0          0          0          0     GICv3 137 Level     dwc3-otg, xhci-hcd:usb5
223:      40809          0          0          0          0     969377     GICv3 142 Level     xhci-hcd:usb7

echo 5 > /proc/irq/223/smp_affinity_list
[root@rockpi4 ~]# iperf3 -c 192.168.1.12
Connecting to host 192.168.1.12, port 5201
[  5] local 192.168.1.9 port 38752 connected to 192.168.1.12 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   249 MBytes  2.09 Gbits/sec    0    211 KBytes
[  5]   1.00-2.00   sec   254 MBytes  2.12 Gbits/sec    0    211 KBytes
[  5]   2.00-3.00   sec   246 MBytes  2.07 Gbits/sec   10    212 KBytes
[  5]   3.00-4.01   sec   255 MBytes  2.13 Gbits/sec    0    212 KBytes
[  5]   4.01-5.00   sec   245 MBytes  2.06 Gbits/sec   10    217 KBytes
[  5]   5.00-6.00   sec   256 MBytes  2.14 Gbits/sec    0    217 KBytes
[  5]   6.00-7.00   sec   253 MBytes  2.13 Gbits/sec    0    217 KBytes
[  5]   7.00-8.01   sec   253 MBytes  2.12 Gbits/sec    0    217 KBytes
[  5]   8.01-9.00   sec   253 MBytes  2.13 Gbits/sec    0    217 KBytes
[  5]   9.00-10.00  sec   254 MBytes  2.13 Gbits/sec    0    217 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  2.46 GBytes  2.11 Gbits/sec   20             sender
[  5]   0.00-10.00  sec  2.46 GBytes  2.11 Gbits/sec                  receiver

But same thing reverse client server with -R

 

[root@rockpi4 ~]# iperf3 -c 192.168.1.12 -R
Connecting to host 192.168.1.12, port 5201
Reverse mode, remote host 192.168.1.12 is sending
[  5] local 192.168.1.9 port 37332 connected to 192.168.1.12 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  39.4 MBytes   331 Mbits/sec
[  5]   1.00-2.00   sec  57.3 MBytes   481 Mbits/sec
[  5]   2.00-3.00   sec  49.4 MBytes   414 Mbits/sec
[  5]   3.00-4.00   sec  57.3 MBytes   481 Mbits/sec
[  5]   4.00-5.00   sec  59.4 MBytes   498 Mbits/sec
[  5]   5.00-6.00   sec  61.0 MBytes   512 Mbits/sec
[  5]   6.00-7.00   sec  48.5 MBytes   407 Mbits/sec
[  5]   7.00-8.00   sec  51.9 MBytes   435 Mbits/sec
[  5]   8.00-9.00   sec  60.4 MBytes   507 Mbits/sec
[  5]   9.00-10.00  sec  52.5 MBytes   440 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec   537 MBytes   451 Mbits/sec                  sender
[  5]   0.00-10.00  sec   537 MBytes   451 Mbits/sec                  receiver

iperf Done.

I am struggling to understand why direction of client server makes any difference?

Cables could do with being better but thought the results would be the same


 

Link to comment
Share on other sites

The imbalance in directional performance can be caused by quite a few different things, including bad cables still (I know it shouldnt according to spec, but on real equipment, especially cheaper stuff it does)

 

Can you do the same tests, configured as follows, to give me a better idea of whats going on please?

 

  1. Connect the 2 RTL8156 nics directly with a single cable (The RTL8156 is MDI / MDI-X compliant so it should automatically go into crossover mode without needing a 4 pair crossover cable)
  2. Test with reversed cable direction (I know this seems stupid but humour me)
  3. Force the RTL8156 on the RockPi side into 1GB

 

Before testing make sure that haveged is started and running and while the tests are running can you watch for:

  • CPU use and specifically look to see if 1 particular CPU core maxes out
  • dmesg for cdc_ncm disconnects (how many?)
  • dmesg for "entropy", "CRNG" or "crng" (less likely)

 

 

Link to comment
Share on other sites

[root@rockpi4 ~]# cat /proc/sys/kernel/random/entropy_avail
3413

I will install haveged though, do I need it though?
 Strange thing is I am being flooded with

[ 6175.009458] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.041375] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.073407] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.105358] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.137422] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.169444] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.201400] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.233412] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.265362] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.297404] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.329458] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.361402] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.393425] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.425421] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.457424] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.489395] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.521382] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.553421] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.585406] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink
[ 6175.617350] cdc_ncm 8-1:2.0 usb0: network connection: connected
[ 6175.649425] cdc_ncm 8-1:2.0 usb0: 2500 mbit/s downlink 2500 mbit/s uplink

But never a disconnect.
Prob be tomoz and will post, thanks

 

 

Link to comment
Share on other sites

You probably dont need haveged and your current entropy pool is fine and full but if it empties when iperf is running then it might temporarily block random traffic generation

 

Also iperf does sometime give unexpected results when using "-R" as opposed to "-s", just listening as a server so it might be worthwhile using netcat to get an alternative baseline and see what performance you get firing a 100MB+ file over it

 

Im not concerned about the cdc_ncm usb0: network connection: connected syslog flood, as long as it doesnt have disconnects. The flooding is seen on all RTL8156 USB devices I have used when using cdc_ncm as opposed to the Realtek driver. For kernels >4.15 cdc_ncm is the only option anyway

Link to comment
Share on other sites

Just an update but got the Cat6e cables was still the same.
Also it dawned on me when I tried to set up OTG USB ethernet on the rockpi I got exactly the same results.
That was a while back and forgot about that.

Anyway rummaged through my spares and bits and built up another windows 10 machine

 

C:\Users\Stuart\Downloads\iperf-3.1.3-win64>iperf3 -c 192.168.1.12
Connecting to host 192.168.1.12, port 5201
[  4] local 192.168.1.9 port 50138 connected to 192.168.1.12 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   277 MBytes  2.32 Gbits/sec
[  4]   1.00-2.00   sec   282 MBytes  2.37 Gbits/sec
[  4]   2.00-3.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   3.00-4.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   4.00-5.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   5.00-6.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   6.00-7.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   7.00-8.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   8.00-9.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   9.00-10.00  sec   282 MBytes  2.37 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  2.75 GBytes  2.37 Gbits/sec                  sender
[  4]   0.00-10.00  sec  2.75 GBytes  2.37 Gbits/sec                  receiver

iperf Done.

C:\Users\Stuart\Downloads\iperf-3.1.3-win64>iperf3 -c 192.168.1.12 =R
Connecting to host 192.168.1.12, port 5201
[  4] local 192.168.1.9 port 50141 connected to 192.168.1.12 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   277 MBytes  2.32 Gbits/sec
[  4]   1.00-2.00   sec   282 MBytes  2.37 Gbits/sec
[  4]   2.00-3.00   sec   282 MBytes  2.37 Gbits/sec
[  4]   3.00-4.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   4.00-5.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   5.00-6.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   6.00-7.00   sec   282 MBytes  2.37 Gbits/sec
[  4]   7.00-8.00   sec   283 MBytes  2.37 Gbits/sec
[  4]   8.00-9.00   sec   282 MBytes  2.37 Gbits/sec
[  4]   9.00-10.00  sec   283 MBytes  2.37 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  2.75 GBytes  2.37 Gbits/sec                  sender
[  4]   0.00-10.00  sec  2.75 GBytes  2.37 Gbits/sec                  receiver

iperf Done.

So back to checking entropy I guess.
 

Link to comment
Share on other sites

Here is the cpu cores with entropy and the corresponding iperf3 run

 

-R from the rockpi4

Spoiler

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:05     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:05     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.50
18:41:05       0    3.06    0.00    2.18    0.39    0.00    1.08    0.00    0.00    0.00   93.29
18:41:05       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.59
18:41:05       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:05       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:05       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:05       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.57

1224

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:06     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:06     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:06       0    3.06    0.00    2.18    0.39    0.00    1.09    0.00    0.00    0.00   93.28
18:41:06       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:06       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:06       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:06       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:06       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.57

1243

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:06     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:06     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:06       0    3.06    0.00    2.18    0.39    0.00    1.10    0.00    0.00    0.00   93.26
18:41:06       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.59
18:41:06       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:06       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:06       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:06       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.57

1195

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:07     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:07     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:07       0    3.06    0.00    2.19    0.39    0.00    1.10    0.00    0.00    0.00   93.26
18:41:07       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:07       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:07       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:07       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:07       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1209

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:07     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:07     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:07       0    3.06    0.00    2.19    0.39    0.00    1.11    0.00    0.00    0.00   93.25
18:41:07       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:07       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:07       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:07       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:07       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1224

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:08     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:08     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:08       0    3.06    0.00    2.19    0.39    0.00    1.12    0.00    0.00    0.00   93.24
18:41:08       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:08       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:08       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:08       4    0.52    0.00    4.11    0.26    0.00    0.01    0.00    0.00    0.00   95.11
18:41:08       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1239

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:08     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:08     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:08       0    3.06    0.00    2.19    0.39    0.00    1.13    0.00    0.00    0.00   93.23
18:41:08       1    2.14    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:08       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:08       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:08       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:08       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1190

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:09     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:09     all    1.33    0.00    1.76    0.24    0.00    0.18    0.00    0.00    0.00   96.49
18:41:09       0    3.06    0.00    2.19    0.39    0.00    1.13    0.00    0.00    0.00   93.23
18:41:09       1    2.15    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:09       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:09       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:09       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:09       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1205

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:09     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:09     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.49
18:41:09       0    3.06    0.00    2.19    0.39    0.00    1.14    0.00    0.00    0.00   93.22
18:41:09       1    2.15    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:09       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:09       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:09       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:09       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1218

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:10     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:10     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:10       0    3.06    0.00    2.20    0.39    0.00    1.15    0.00    0.00    0.00   93.21
18:41:10       1    2.15    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:10       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:10       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:10       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:10       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1233

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:10     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:10     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:10       0    3.06    0.00    2.20    0.39    0.00    1.15    0.00    0.00    0.00   93.20
18:41:10       1    2.15    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:10       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:10       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:10       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:10       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1184

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:11     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:11     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:11       0    3.05    0.00    2.20    0.39    0.00    1.16    0.00    0.00    0.00   93.19
18:41:11       1    2.15    0.00    2.09    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:11       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.23
18:41:11       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:11       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:11       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1199

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:12     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:12     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:12       0    3.05    0.00    2.20    0.39    0.00    1.17    0.00    0.00    0.00   93.18
18:41:12       1    2.15    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:12       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:12       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:12       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.12
18:41:12       5    0.54    0.00    0.56    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1216

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:12     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:12     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:12       0    3.05    0.00    2.20    0.39    0.00    1.18    0.00    0.00    0.00   93.17
18:41:12       1    2.15    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:12       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:12       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:12       4    0.52    0.00    4.10    0.26    0.00    0.01    0.00    0.00    0.00   95.13
18:41:12       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1233

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:13     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:13     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:13       0    3.05    0.00    2.20    0.39    0.00    1.19    0.00    0.00    0.00   93.16
18:41:13       1    2.15    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:13       2    1.26    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:13       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:13       4    0.52    0.00    4.09    0.26    0.00    0.01    0.00    0.00    0.00   95.13
18:41:13       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1184

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:13     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:13     all    1.33    0.00    1.76    0.24    0.00    0.19    0.00    0.00    0.00   96.48
18:41:13       0    3.05    0.00    2.20    0.39    0.00    1.19    0.00    0.00    0.00   93.16
18:41:13       1    2.15    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:13       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:13       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:13       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.13
18:41:13       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1199

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:14     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:14     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.48
18:41:14       0    3.05    0.00    2.20    0.39    0.00    1.20    0.00    0.00    0.00   93.15
18:41:14       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:14       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:14       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:14       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.13
18:41:14       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.56

1213

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:14     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:14     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.48
18:41:14       0    3.05    0.00    2.21    0.39    0.00    1.21    0.00    0.00    0.00   93.14
18:41:14       1    2.15    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:14       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:14       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:14       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.13
18:41:14       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1229

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:15     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:15     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.47
18:41:15       0    3.05    0.00    2.21    0.39    0.00    1.22    0.00    0.00    0.00   93.13
18:41:15       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:15       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:15       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:15       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.13
18:41:15       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1245

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:15     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:15     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.47
18:41:15       0    3.05    0.00    2.21    0.39    0.00    1.23    0.00    0.00    0.00   93.13
18:41:15       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:15       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:15       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:15       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.13
18:41:15       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1195

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:16     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:16     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.47
18:41:16       0    3.05    0.00    2.21    0.39    0.00    1.23    0.00    0.00    0.00   93.13
18:41:16       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:16       2    1.25    0.00    1.34    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:16       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:16       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.14
18:41:16       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1202

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:16     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:16     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.47
18:41:16       0    3.05    0.00    2.21    0.39    0.00    1.23    0.00    0.00    0.00   93.13
18:41:16       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:16       2    1.25    0.00    1.33    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:16       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:16       4    0.51    0.00    4.09    0.25    0.00    0.01    0.00    0.00    0.00   95.14
18:41:16       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1202

Linux 4.4.182-rockchip64 (rockpi)     07/26/19     _aarch64_    (6 CPU)

18:41:17     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:41:17     all    1.33    0.00    1.76    0.24    0.00    0.20    0.00    0.00    0.00   96.48
18:41:17       0    3.05    0.00    2.21    0.39    0.00    1.23    0.00    0.00    0.00   93.13
18:41:17       1    2.16    0.00    2.08    0.18    0.00    0.00    0.00    0.00    0.00   95.58
18:41:17       2    1.25    0.00    1.33    0.17    0.00    0.00    0.00    0.00    0.00   97.24
18:41:17       3    0.53    0.00    0.30    0.11    0.00    0.00    0.00    0.00    0.00   99.06
18:41:17       4    0.51    0.00    4.08    0.25    0.00    0.01    0.00    0.00    0.00   95.14
18:41:17       5    0.54    0.00    0.57    0.33    0.00    0.00    0.00    0.00    0.00   98.55

1204

Connecting to host 192.168.1.9, port 5201
Reverse mode, remote host 192.168.1.9 is sending
[  4] local 192.168.1.12 port 45402 connected to 192.168.1.9 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  48.1 MBytes   403 Mbits/sec                  
[  4]   1.00-2.00   sec  35.7 MBytes   300 Mbits/sec                  
[  4]   2.00-3.00   sec  37.8 MBytes   317 Mbits/sec                  
[  4]   3.00-4.00   sec  34.5 MBytes   290 Mbits/sec                  
[  4]   4.00-5.00   sec  36.4 MBytes   305 Mbits/sec                  
[  4]   5.00-6.00   sec  39.6 MBytes   332 Mbits/sec                  
[  4]   6.00-7.00   sec  41.7 MBytes   350 Mbits/sec                  
[  4]   7.00-8.00   sec  35.9 MBytes   301 Mbits/sec                  
[  4]   8.00-9.00   sec  37.6 MBytes   315 Mbits/sec                  
[  4]   9.00-10.00  sec  36.3 MBytes   305 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   384 MBytes   322 Mbits/sec                  sender
[  4]   0.00-10.00  sec   384 MBytes   322 Mbits/sec                  receiver

iperf Done.

 

 

Link to comment
Share on other sites

Here is -c connect as client same again on .5 sec

Spoiler

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:03     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:03     all    1.30    0.00    1.68    0.28    0.00    0.14    0.00    0.00    0.00   96.60
18:37:03       0    2.87    0.00    2.20    0.45    0.00    0.86    0.00    0.00    0.00   93.62
18:37:03       1    2.11    0.00    2.26    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:03       2    1.27    0.00    1.30    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:03       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:03       4    0.54    0.00    3.46    0.30    0.00    0.01    0.00    0.00    0.00   95.69
18:37:03       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.50

2381

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:04     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:04     all    1.30    0.00    1.69    0.28    0.00    0.14    0.00    0.00    0.00   96.59
18:37:04       0    2.87    0.00    2.21    0.45    0.00    0.86    0.00    0.00    0.00   93.61
18:37:04       1    2.12    0.00    2.26    0.21    0.00    0.00    0.00    0.00    0.00   95.41
18:37:04       2    1.27    0.00    1.30    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:04       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:04       4    0.54    0.00    3.48    0.30    0.00    0.01    0.00    0.00    0.00   95.67
18:37:04       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.50

2401

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:04     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:04     all    1.30    0.00    1.69    0.28    0.00    0.14    0.00    0.00    0.00   96.59
18:37:04       0    2.87    0.00    2.21    0.45    0.00    0.87    0.00    0.00    0.00   93.61
18:37:04       1    2.12    0.00    2.26    0.21    0.00    0.00    0.00    0.00    0.00   95.41
18:37:04       2    1.27    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:04       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:04       4    0.54    0.00    3.51    0.30    0.00    0.01    0.00    0.00    0.00   95.64
18:37:04       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.50

2368

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:05     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:05     all    1.30    0.00    1.70    0.28    0.00    0.14    0.00    0.00    0.00   96.58
18:37:05       0    2.87    0.00    2.21    0.45    0.00    0.87    0.00    0.00    0.00   93.61
18:37:05       1    2.12    0.00    2.26    0.21    0.00    0.00    0.00    0.00    0.00   95.41
18:37:05       2    1.27    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:05       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:05       4    0.54    0.00    3.55    0.30    0.00    0.01    0.00    0.00    0.00   95.61
18:37:05       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2335

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:05     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:05     all    1.30    0.00    1.70    0.28    0.00    0.14    0.00    0.00    0.00   96.58
18:37:05       0    2.87    0.00    2.21    0.45    0.00    0.87    0.00    0.00    0.00   93.60
18:37:05       1    2.12    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:05       2    1.27    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:05       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:05       4    0.54    0.00    3.58    0.30    0.00    0.01    0.00    0.00    0.00   95.58
18:37:05       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2302

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:06     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:06     all    1.30    0.00    1.71    0.28    0.00    0.14    0.00    0.00    0.00   96.57
18:37:06       0    2.87    0.00    2.21    0.45    0.00    0.87    0.00    0.00    0.00   93.60
18:37:06       1    2.12    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:06       2    1.27    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:06       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:06       4    0.54    0.00    3.61    0.30    0.00    0.01    0.00    0.00    0.00   95.55
18:37:06       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2269

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:06     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:06     all    1.30    0.00    1.71    0.28    0.00    0.14    0.00    0.00    0.00   96.57
18:37:06       0    2.87    0.00    2.21    0.45    0.00    0.87    0.00    0.00    0.00   93.60
18:37:06       1    2.12    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:06       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:06       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:06       4    0.54    0.00    3.64    0.30    0.00    0.01    0.00    0.00    0.00   95.52
18:37:06       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2236

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:07     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:07     all    1.30    0.00    1.72    0.28    0.00    0.14    0.00    0.00    0.00   96.56
18:37:07       0    2.87    0.00    2.21    0.45    0.00    0.88    0.00    0.00    0.00   93.60
18:37:07       1    2.12    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:07       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.24
18:37:07       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:07       4    0.54    0.00    3.67    0.30    0.00    0.01    0.00    0.00    0.00   95.48
18:37:07       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2203

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:07     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:07     all    1.30    0.00    1.72    0.28    0.00    0.14    0.00    0.00    0.00   96.56
18:37:07       0    2.87    0.00    2.21    0.45    0.00    0.88    0.00    0.00    0.00   93.60
18:37:07       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:07       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:07       3    0.57    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:07       4    0.54    0.00    3.70    0.30    0.00    0.01    0.00    0.00    0.00   95.45
18:37:07       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2170

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:08     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:08     all    1.30    0.00    1.73    0.28    0.00    0.15    0.00    0.00    0.00   96.55
18:37:08       0    2.87    0.00    2.21    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:08       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:08       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:08       3    0.57    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:08       4    0.54    0.00    3.74    0.30    0.00    0.01    0.00    0.00    0.00   95.42
18:37:08       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2136

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:09     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:09     all    1.30    0.00    1.73    0.28    0.00    0.15    0.00    0.00    0.00   96.54
18:37:09       0    2.87    0.00    2.21    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:09       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.42
18:37:09       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:09       3    0.57    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:09       4    0.54    0.00    3.77    0.30    0.00    0.01    0.00    0.00    0.00   95.39
18:37:09       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2102

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:09     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:09     all    1.30    0.00    1.74    0.28    0.00    0.15    0.00    0.00    0.00   96.54
18:37:09       0    2.86    0.00    2.21    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:09       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:09       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:09       3    0.57    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.01
18:37:09       4    0.54    0.00    3.80    0.30    0.00    0.01    0.00    0.00    0.00   95.36
18:37:09       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2068

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:10     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:10     all    1.30    0.00    1.74    0.28    0.00    0.15    0.00    0.00    0.00   96.53
18:37:10       0    2.86    0.00    2.20    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:10       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:10       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:10       3    0.57    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:10       4    0.54    0.00    3.83    0.30    0.00    0.01    0.00    0.00    0.00   95.33
18:37:10       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2040

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:10     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:10     all    1.30    0.00    1.75    0.28    0.00    0.15    0.00    0.00    0.00   96.53
18:37:10       0    2.86    0.00    2.20    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:10       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:10       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:10       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:10       4    0.54    0.00    3.86    0.30    0.00    0.01    0.00    0.00    0.00   95.29
18:37:10       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

2013

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:11     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:11     all    1.30    0.00    1.75    0.28    0.00    0.15    0.00    0.00    0.00   96.52
18:37:11       0    2.86    0.00    2.20    0.45    0.00    0.89    0.00    0.00    0.00   93.59
18:37:11       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:11       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:11       3    0.58    0.00    0.30    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:11       4    0.54    0.00    3.89    0.30    0.00    0.01    0.00    0.00    0.00   95.26
18:37:11       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

1995

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:11     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:11     all    1.30    0.00    1.76    0.28    0.00    0.15    0.00    0.00    0.00   96.52
18:37:11       0    2.86    0.00    2.20    0.45    0.00    0.90    0.00    0.00    0.00   93.59
18:37:11       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:11       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:11       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:11       4    0.54    0.00    3.93    0.30    0.00    0.01    0.00    0.00    0.00   95.23
18:37:11       5    0.52    0.00    0.60    0.39    0.00    0.00    0.00    0.00    0.00   98.49

1977

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:12     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:12     all    1.30    0.00    1.76    0.28    0.00    0.15    0.00    0.00    0.00   96.51
18:37:12       0    2.86    0.00    2.20    0.45    0.00    0.90    0.00    0.00    0.00   93.58
18:37:12       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:12       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:12       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:12       4    0.54    0.00    3.96    0.29    0.00    0.01    0.00    0.00    0.00   95.20
18:37:12       5    0.52    0.00    0.61    0.39    0.00    0.00    0.00    0.00    0.00   98.49

1960

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:12     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:12     all    1.30    0.00    1.77    0.28    0.00    0.15    0.00    0.00    0.00   96.50
18:37:12       0    2.86    0.00    2.20    0.45    0.00    0.92    0.00    0.00    0.00   93.57
18:37:12       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:12       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:12       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:12       4    0.54    0.00    3.99    0.29    0.00    0.01    0.00    0.00    0.00   95.17
18:37:12       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1941

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:13     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:13     all    1.30    0.00    1.77    0.28    0.00    0.15    0.00    0.00    0.00   96.50
18:37:13       0    2.86    0.00    2.20    0.45    0.00    0.94    0.00    0.00    0.00   93.54
18:37:13       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:13       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:13       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:13       4    0.54    0.00    4.02    0.29    0.00    0.01    0.00    0.00    0.00   95.14
18:37:13       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1924

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:13     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:13     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:13       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.54
18:37:13       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:13       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:13       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:13       4    0.54    0.00    4.05    0.29    0.00    0.01    0.00    0.00    0.00   95.10
18:37:13       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1906

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:14     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:14     all    1.30    0.00    1.78    0.28    0.00    0.16    0.00    0.00    0.00   96.49
18:37:14       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.54
18:37:14       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:14       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:14       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:14       4    0.54    0.00    4.08    0.29    0.00    0.01    0.00    0.00    0.00   95.08
18:37:14       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1942

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:14     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:14     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:14       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.54
18:37:14       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:14       2    1.27    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:14       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:14       4    0.54    0.00    4.08    0.29    0.00    0.01    0.00    0.00    0.00   95.08
18:37:14       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1943

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:15     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:15     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:15       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.54
18:37:15       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:15       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:15       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:15       4    0.54    0.00    4.07    0.29    0.00    0.01    0.00    0.00    0.00   95.08
18:37:15       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1944

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:15     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:15     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:15       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.55
18:37:15       1    2.11    0.00    2.24    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:15       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:15       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:15       4    0.54    0.00    4.07    0.29    0.00    0.01    0.00    0.00    0.00   95.08
18:37:15       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1945

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:16     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:16     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:16       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.55
18:37:16       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.44
18:37:16       2    1.26    0.00    1.29    0.20    0.00    0.00    0.00    0.00    0.00   97.25
18:37:16       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:16       4    0.54    0.00    4.07    0.29    0.00    0.01    0.00    0.00    0.00   95.09
18:37:16       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.49

1946

Linux 4.4.182-rockchip64 (rockpi) 	07/26/19 	_aarch64_	(6 CPU)

18:37:16     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
18:37:16     all    1.30    0.00    1.78    0.28    0.00    0.15    0.00    0.00    0.00   96.49
18:37:16       0    2.86    0.00    2.20    0.45    0.00    0.95    0.00    0.00    0.00   93.55
18:37:16       1    2.11    0.00    2.25    0.21    0.00    0.00    0.00    0.00    0.00   95.43
18:37:16       2    1.26    0.00    1.29    0.19    0.00    0.00    0.00    0.00    0.00   97.25
18:37:16       3    0.58    0.00    0.29    0.13    0.00    0.00    0.00    0.00    0.00   99.00
18:37:16       4    0.54    0.00    4.07    0.29    0.00    0.01    0.00    0.00    0.00   95.09
18:37:16       5    0.52    0.00    0.61    0.38    0.00    0.00    0.00    0.00    0.00   98.48

1947

Connecting to host 192.168.1.9, port 5201
[  4] local 192.168.1.12 port 45394 connected to 192.168.1.9 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.01   sec   136 MBytes  1.14 Gbits/sec    0    428 KBytes       
[  4]   1.01-2.00   sec   161 MBytes  1.36 Gbits/sec    0    428 KBytes       
[  4]   2.00-3.00   sec   162 MBytes  1.36 Gbits/sec    0    428 KBytes       
[  4]   3.00-4.00   sec   162 MBytes  1.36 Gbits/sec    0    428 KBytes       
[  4]   4.00-5.01   sec   164 MBytes  1.37 Gbits/sec    0    428 KBytes       
[  4]   5.01-6.00   sec   165 MBytes  1.38 Gbits/sec    0    428 KBytes       
[  4]   6.00-7.00   sec   166 MBytes  1.40 Gbits/sec    0    428 KBytes       
[  4]   7.00-8.00   sec   167 MBytes  1.40 Gbits/sec    0    428 KBytes       
[  4]   8.00-9.00   sec   168 MBytes  1.40 Gbits/sec    0    428 KBytes       
[  4]   9.00-10.00  sec   166 MBytes  1.40 Gbits/sec    0    428 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  1.58 GBytes  1.36 Gbits/sec    0             sender
[  4]   0.00-10.00  sec  1.58 GBytes  1.36 Gbits/sec                  receiver

 

 

 

Edited by Igor
use spoilers when adding wall of text
Link to comment
Share on other sites

Apols about that can not even work out on the forum how to get horizontal scrolls even though managed it with one somehow?
So struggling with this, but its not the adapters as we have seen in windows they works near max both ways.
Without affinity on the rockpi4 it doesn't cope with the load as well as windows but can as a client manage over 2gbs

But why as a server it plummets to 400gbs with affinity I am not really sure.

What I don't know is how other SBC react the same as thinking its something to do with the Rockchip code as the rk3328 has a similar performance profile and wonder if its the same with speed being asymmetrical depending on client or server?   

There seems to be zero load loads of entropy and no reason apart from maybe rockchip code.
I am also mightily confused to the CPU arrangement as the default affinity is all cores apart from big, maybe that makes sense.
I am going to play with affinity as maybe as a client the task has a higher affinity and runs on both big cores as client?
I will just remember its a bit map and not core number :)   

Link to comment
Share on other sites

It doesnt seem related to cpu affinity from your output. Its certainly not entropy. Very strange behaviour. Did you try using netcat to get a baseline outside of iperf?

 

I actually stopped by at CPC on my way home today and picked up a couple of the PSG91497 Pro signal adaptors you have. They seemed too cheap to be true! I dont have any RK devices with USB3 unfortunately, apart from Android TV boxes so I cant really do an RK specific test (unless I can find an armbian or libreelec build for them). I will try them tonight on a Jetson Nano and any other USB3 arm devices I have at home

 

 

Link to comment
Share on other sites

Nope I forgot to be honest its confusing and totally forgot as been trying many things and it just seems the rockchip code depending on slave or master.
I will do now though as its not just this 2.5gb USB all are useless but strange thing is from memory my plugable 1gbe usb gives exactly same results, I mean exact same figures if that 300+ level is a max or same with g_ether OTG

For £20 2.5gb which actually it isn't true they will run on existing as they are pretty picky with quality and length but reasonable cables rather than my usual battered spagetti 2.5 runs great.
I am going to dual boot this windows PC with bionic and try x86 linux to linux which I am expecting will work fine.
I am not sure if its rockchip / rk3399 or something but prob.

I shall be at netcat whilst you try out your new eth adaptors I am sure you will find them OK the overly bright white led drives me nuts, they get warm compared to some hot usb 1gb I have had.
Windows wise they work great so its not the adapters.  

Link to comment
Share on other sites

Net rockpi4 client 100MBs sort of 1gbe speed?
 

root@rockpi:~# dd if=/dev/zero bs=1024k count=1024 | nc -v 192.168.1.9 2222
Connection to 192.168.1.9 2222 port [tcp/*] succeeded!
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.98256 s, 108 MB/s

x86 client rockpi server

stuart@stuart-pc:~$ dd if=/dev/zero bs=1024K count=1024 | nc -v 192.168.1.12 2222
Connection to 192.168.1.12 2222 port [tcp/*] succeeded!
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 23.158 s, 46.4 MB/s

Somehow auto negiotated to 1gbe me thinks and will have to check nmcli

Link to comment
Share on other sites

Ive started some testing but there is clearly a problem with this NIC or driver. I will post the Jetson Nano results now as it will take me another hour or so to finish compiling and setting up tests for the rockchip TV Box based boards as I want to try an older kernel with the official realtek driver. Im not even bothering with iperf yet

 

Test environment and server testing against is as follows:

Network: Netgear XS712T-200NES 10GB switch
Config: Everything as defaults, No cpu affinity
faphq.lan: x86_64, i9-7980XE, Intel 10GB ethernet, Linux Mint 19.1, Kernel 5.0 (Home Server)

 

Clients config:

jetson.lan: aarch64, Jetson Nano, USB RTL8156 (cdc_ncm), Ubuntu 18.04, Kernel 5.2
tvbox1.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (cdc_ncm), Custom userland, Kernel 4.19
tvbox2.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (RTL driver), Custom userland, Kernel 4.4-rk

 

Test 1: Netcat UDP - jetson.lan --> faphq.lan

root@jetson:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999
Connection to faphq.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.4171 s, 244 MB/s

Test 2: Netcat UDP - faphq.lan --> jetson.lan

root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u jetson.lan 9999
Connection to jetson.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.980 s, 98.2 MB/s

Edit: On the jetson it automatically negotiated the correct 2.5Gb link speed, not 1Gb but obviously there is a huge difference in performance depending on the direction

 

Link to comment
Share on other sites

Test 3: Netcat UDP, tvbox1.lan --> faphq.lan

root@tvbox1:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999
Connection to faphq.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.98239 s, 107 MB/s

Test 4: Netcat UDP, faphq.lan --> tvbox1.lan

root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u tvbox1.lan 9999
Connection to tvbox1.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 23.008 s, 46.9 MB/s

First test on the RK3399 device is roughly half the performance of the Jetson, again the recieve performance is much lower than the send. This is on kernel 4.19 (I already had a config I knew would work). Im compiling a new 5.2 kernel now so I can test like for like kernel versions for cdc_ncm

 

Edit: Performance on Kernel 5.2 is identical to 4.19 +/- 2%. Same asynchronous transfer speed and still half the performance of the Jetson

Link to comment
Share on other sites

tvbox2.lan: aarch64, H96MaxTVBox-RK3399, USB RTL8156 (RTL driver), Custom userland, Kernel 4.4-rk

 

Test 5: Netcat UDP, tvbox2.lan --> faphq.lan

root@tvbox2:~# dd if=/dev/zero bs=100M count=10 | nc -v -u faphq.lan 9999
Connection to faphq.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.112 s, 99.7 MB/s

Test 6: Netcat UDP, faphq.lan --> tvbox2.lan

root@faphq:~# dd if=/dev/zero bs=100M count=10 | nc -v -u tvbox2.lan 9999
Connection to tvbox2.lan 9999 port [udp/*] succeeded!
10+0 records in
10+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 10.109 s, 99.7 MB/s

Using the 4.4-rk kernel and realtek driver I cant get it to connect at 2.5Gb at all

 

I have also just done a quick test between 2 Linux Mint 19.1 x86_64 boxes with the RTL8156's and kernel 5.0 and surprisingly they connect at 2.5Gb line rate and data transfer speeds are as they should be:

1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.9438 s, 273 MB/s

Ran out of time for any further testing tonight sorry 

Link to comment
Share on other sites

I didn't get much further as my scrapyard spare x86 for some reason just dies when I try to install ubuntu.
Blingdows installed ok and if I go from ubuntu server to windows client iperf both x86 then same as before.
Think I will grab Manjaro

 

Accepted connection from 192.168.1.9, port 41180
[  5] local 192.168.1.12 port 5201 connected to 192.168.1.9 port 41182
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   251 MBytes  2.11 Gbits/sec                  
[  5]   1.00-2.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   2.00-3.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   3.00-4.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   4.00-5.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   5.00-6.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   6.00-7.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   7.00-8.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   8.00-9.00   sec   281 MBytes  2.35 Gbits/sec                  
[  5]   9.00-10.00  sec   281 MBytes  2.35 Gbits/sec                  
[  5]  10.00-10.04  sec  11.7 MBytes  2.35 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.04  sec  2.72 GBytes  2.33 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201

Manjaro Kernel 5.1 so yeah either a kernel or firmware thing.
There was a lot of politics about 2.5 that was coming and at first then oh no your not then to actually come in.
So adapter works fine but which kernel/firmware might be a bit of a minefield.
The above is Manjaro as a server (Accepted connection from 192.168.1.9)


Still don't get why not in reverse though with some kernel versions / drivers but the above is a perfect 95% efficiency that you should expect.
 

Link to comment
Share on other sites

Dunno what I was doing with the driver!!?

Finally got rid of the cdc-ncd driver and used the r8152 driver

 

[rock@rockpi4 ~]$ sudo lshw -C network
[sudo] password for rock:
  *-network:0
       description: Ethernet interface
       physical id: 9
       logical name: eth0
       serial: da:19:c8:7a:6d:f4
       capacity: 1Gbit/s
       capabilities: ethernet physical tp mii 10bt 10bt-fd 100bt 100bt-fd 1000bt 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=st_gmac driverversion=Jan_2016 link=no multicast=yes port=MII
  *-network:1
       description: Ethernet interface
       physical id: a
       logical name: eth1
       serial: a0:ce:c8:c8:2b:31
       capacity: 1Gbit/s
       capabilities: ethernet physical mii 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=r8152 driverversion=v2.12.0 (2019/04/29) duplex=full ip=192.168.1.12 link=yes multicast=yes port=MII
[rock@rockpi4 ~]$ iperf3 -c 192.168.1.9 -R
Connecting to host 192.168.1.9, port 5201
Reverse mode, remote host 192.168.1.9 is sending
[  5] local 192.168.1.12 port 38496 connected to 192.168.1.9 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   266 MBytes  2.23 Gbits/sec
[  5]   1.00-2.00   sec   239 MBytes  2.01 Gbits/sec
[  5]   2.00-3.00   sec   244 MBytes  2.05 Gbits/sec
[  5]   3.00-4.00   sec   237 MBytes  1.99 Gbits/sec
[  5]   4.00-5.00   sec   239 MBytes  2.01 Gbits/sec
[  5]   5.00-6.00   sec   250 MBytes  2.10 Gbits/sec
[  5]   6.00-7.00   sec   248 MBytes  2.08 Gbits/sec
[  5]   7.00-8.00   sec   244 MBytes  2.05 Gbits/sec
[  5]   8.00-9.00   sec   249 MBytes  2.09 Gbits/sec
[  5]   9.00-10.00  sec   248 MBytes  2.08 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  2.41 GBytes  2.07 Gbits/sec                  sender
[  5]   0.00-10.00  sec  2.41 GBytes  2.07 Gbits/sec                  receiver

Bit of big core affinity

 

[root@rockpi4 ~]# echo 5 > /proc/irq/221/smp_affinity_list
[root@rockpi4 ~]# iperf3 -c 192.168.1.9 -R
Connecting to host 192.168.1.9, port 5201
Reverse mode, remote host 192.168.1.9 is sending
[  5] local 192.168.1.12 port 38502 connected to 192.168.1.9 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   274 MBytes  2.30 Gbits/sec
[  5]   1.00-2.00   sec   276 MBytes  2.32 Gbits/sec
[  5]   2.00-3.00   sec   276 MBytes  2.32 Gbits/sec
[  5]   3.00-4.00   sec   278 MBytes  2.33 Gbits/sec
[  5]   4.00-5.00   sec   277 MBytes  2.33 Gbits/sec
[  5]   5.00-6.00   sec   276 MBytes  2.31 Gbits/sec
[  5]   6.00-7.00   sec   277 MBytes  2.32 Gbits/sec
[  5]   7.00-8.00   sec   277 MBytes  2.32 Gbits/sec
[  5]   8.00-9.00   sec   277 MBytes  2.33 Gbits/sec
[  5]   9.00-10.00  sec   277 MBytes  2.32 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  sender
[  5]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  receiver

iperf Done.

I am using Manjaro 5.2 as latest kernel was on that and had it on an SD but yeah they will work on Arm.
I need to go back to Armbian and work out why when the driver was suggested it failed and didn't work.
I am not that great with custom driver install and know manjaro a little bit better and new the kernel was much newer.
I will give it a go again but no kernel ring flood and near as damn it 2.5gb on the rockpi4 aint bad. 
 

 

 

Link to comment
Share on other sites

On 7/28/2019 at 8:02 AM, Stuart Naylor said:

Finally got rid of the cdc-ncd driver and used the r8152 driver

 

Fixed/updated driver and tested with Rock64Pro 4.4.y default kernel vs Debian Buster xps13 laptop. Got roughly 2 Gbits/sec in both directions by using dumb Netgear XS508M switch.
 

Link to comment
Share on other sites

@Stuart Naylor Rockchip driver v2.13.0 (2020/04/20) seems to run better -> Odroid N2 http://ix.io/2qv6 vs. my desktop. Both ways something like this:

[  5]   0.00-1.00   sec   233 MBytes  1.96 Gbits/sec   32    628 KBytes       
[  5]   1.00-2.00   sec   279 MBytes  2.34 Gbits/sec    5    735 KBytes       
[  5]   2.00-3.00   sec   281 MBytes  2.36 Gbits/sec    0    805 KBytes       
[  5]   3.00-4.00   sec   246 MBytes  2.07 Gbits/sec   22    686 KBytes       
[  5]   4.00-5.00   sec   250 MBytes  2.10 Gbits/sec   11    741 KBytes       
[  5]   5.00-6.00   sec   248 MBytes  2.08 Gbits/sec   14    567 KBytes       
[  5]   6.00-7.00   sec   248 MBytes  2.08 Gbits/sec    5    619 KBytes       
[  5]   7.00-8.00   sec   249 MBytes  2.09 Gbits/sec   11    669 KBytes       
[  5]   8.00-9.00   sec   246 MBytes  2.07 Gbits/sec    5    717 KBytes       
[  5]   9.00-10.00  sec   246 MBytes  2.07 Gbits/sec   10    758 KBytes 

 

Link to comment
Share on other sites

Its been a while @Igor but yeah eventually with drivers I got great both way access speeds.
I was messing around with drivers but there was a Realtek driver that seemed to do the trick but if there are Rockchip drivers and as above even better.

I dropped the RockPi4 and somehow like a coin it landed edge up on the SD card and has since gathered dust, but also due to the Pi4 that mainly I play with now.
I never got round to benching the RPi4 with those exceptionally good value 2.5Gb USB ethernet adapters, but the adapters from what I found are really good. 
 

Link to comment
Share on other sites

20 hours ago, Stuart Naylor said:

Its been a while


Indeed :P Time goes around pretty fast.

 

20 hours ago, Stuart Naylor said:

I never got round to benching the RPi4 with those exceptionally good value 2.5Gb USB Ethernet adapters, but the adapters from what I found are really good. 

 

I made tests on Odroid XU4, N2 and my x86 desktop. Results are similar, actually a bit better than N2. No Rpi4 Pi around, but I would assume it should be the same.

 

20 hours ago, Stuart Naylor said:

I dropped the RockPi4


I also had an accident with Rockpi 4, but not a fatal one :rolleyes: I manage to forcefully detach audio connector when trying to check audio support.

Link to comment
Share on other sites

Yeah I think they beefed up the audio port as it was a little flakey.

I desoldered the broken sd connector and it will run but just mmc.
Its just gathered dust since the raspberry 4 as the 4 lanes of pci-e are actually hard to populate.

PS my fave Rockpi would be the RK3308 Pi-S if they actually did publish how to interface the x4(x1) VAD mics.
Its an average general purpose SoC  but for voice AI if there was more info it would be exceptional.

Link to comment
Share on other sites

This thread is quite old. Please consider starting a new thread rather than reviving this one.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...

Important Information

Terms of Use - Privacy Policy - Guidelines