Jump to content

Congestion Control


creited

Recommended Posts

Hi,

 

I'm using armbian on a FriendlyElec Zero Pi device as my wireguard server. This is a extremely cheap device and for this reason it was chosen since I don't need powerful performances.

 

It happened that I found a tutorial that switching the Congestion Control for BBR (mine says it is cubic), would allow me to experience performance improvements.

 

I'm not being able to change this parameter in my image already configured using:

root@zeropi:~# sysctl -w net.ipv4.tcp_congestion_control=bbr

The output says:

sysctl: setting key "net.ipv4.tcp_congestion_control": No such file or directory
net.ipv4.tcp_congestion_control = bbr

Using this command:

sysctl net.ipv4.tcp_available_congestion_control

Outputs:

net.ipv4.tcp_available_congestion_control = reno bic cubic westwood highspeed hybla htcp vegas nv veno scalable lp yeah illinois

As far as I understood, the BBR option is not available to be selected. And I really want to have it running in my setup.

 

Is there a way to enable this in my armbian in a way I don't need to start everything from scratch?

 

If the answer is NO, how should I proceed to have an image with this option enabled? If you have a step by step tutorial, it  would be very helpful, since I'm not an expert in building linux.

 

Thank you for your support.

Link to comment
Share on other sites

20.05.0-trunk                    

Since you are using either a 3rd party build or built the kernel package by yourself you should already know your way around and adjust the kernel config to include the modules mentioned above.

 

Uboot loader 2019.10

Not relevant but you missed to update U-boot to 2020.04 which is commonly built with the kernel package.

Link to comment
Share on other sites

12 hours ago, creited said:

Thank you for your support.


https://github.com/armbian/build#support 
We can't possibly cover research and development on your behalf. More of it ...

I have no idea what is missing in the kernel but we will accept your PR to the kernel config https://github.com/armbian/build/tree/master/config/kernel. If you speed up, there will be a release in a week, two. And this functionality will come with an update.

 

12 hours ago, creited said:

If you have a step by step tutorial, it  would be very helpful, since I'm not an expert in building linux


https://docs.armbian.com/Developer-Guide_Build-Preparation/

Personal guidance is not possible.

Link to comment
Share on other sites

On 5/21/2020 at 3:14 PM, Igor said:

I have no idea what is missing in the kernel but we will accept your PR to the kernel config https://github.com/armbian/build/tree/master/config/kernel. If you speed up, there will be a release in a week, two. And this functionality will come with an update.

Already enabled in master (CONFIG_TCP_CONG_BBR=m) at least since 5.4.41

requires modprobe tcp_bbr

 

Link to comment
Share on other sites

5 hours ago, xwiggen said:

Already enabled in master (CONFIG_TCP_CONG_BBR=m) at least since 5.4.41

requires modprobe tcp_bbr

 

Is it possible to update my running version to 5.4.41? Mine says 5.4.35, so modprobe returns an error.

 

@Igor, I have no idea on how to proceed with a pull request. Actually I am not a developer, but I would be happy to help with anything that I could.

 

It seems like enabling tcp_bbr with modprobe shall solve my point. Thanks for everyone that replied.

 

Cleiton

Link to comment
Share on other sites

1 minute ago, creited said:

Is it possible to update my running version to 5.4.41? Mine says 5.4.35, so modprobe returns an error.


At this moment possible by switching to nightly builds but this is not recommend in production. Nightly images are our development builds where things sometimes just break and can remain broken for days. That branch is ... for testing, but currently its safe, since we are near to the release. Go there and go back to stable after the release ...

 

3 minutes ago, creited said:

I have no idea on how to proceed with a pull request.


There are many guides. Perhaps this one is better https://help.github.com/en/github/collaborating-with-issues-and-pull-requests/creating-a-pull-request

 

4 minutes ago, creited said:

Actually I am not a developer, but I would be happy to help with anything that I could.


- reworking documentation

- running projects

- forum moderating

Link to comment
Share on other sites

hmm , recently it came to my attention bbr between both wireguard servers is doing a very bad job:

 

:/etc/sysctl.d# iperf3 -4 -c 192.168.10.2 -t 300 -b 0 -P 1
Connecting to host 192.168.10.2, port 5201
[  5] local 192.168.20.2 port 41804 connected to 192.168.10.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.29 MBytes  10.8 Mbits/sec    0    112 KBytes
[  5]   1.00-2.00   sec   502 KBytes  4.11 Mbits/sec    0    104 KBytes
[  5]   2.00-3.00   sec   753 KBytes  6.17 Mbits/sec    0   98.9 KBytes
[  5]   3.00-4.00   sec   753 KBytes  6.17 Mbits/sec    0    107 KBytes
[  5]   4.00-5.00   sec   753 KBytes  6.17 Mbits/sec    0    104 KBytes
[  5]   5.00-6.00   sec   753 KBytes  6.17 Mbits/sec    0    102 KBytes
[  5]   6.00-7.00   sec   753 KBytes  6.17 Mbits/sec    0    110 KBytes
[  5]   7.00-8.00   sec   753 KBytes  6.17 Mbits/sec    0    107 KBytes
[  5]   8.00-9.00   sec   502 KBytes  4.11 Mbits/sec    0    104 KBytes
^C[  5]   9.00-9.33   sec   251 KBytes  6.29 Mbits/sec    0    102 KBytes

 

 

while westwood ( the one I used years back before bbr came ) is still performing OK ( while 150Mbit constant should be possible with bbr as I had in the past )

 

:/etc/sysctl.d# iperf3 -4 -c 192.168.10.2 -t 300 -b 0 -P 1
Connecting to host 192.168.10.2, port 5201
[  5] local 192.168.20.2 port 41808 connected to 192.168.10.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  12.2 MBytes   103 Mbits/sec    0   6.01 MBytes
[  5]   1.00-2.00   sec  26.2 MBytes   220 Mbits/sec  1319   1.02 MBytes
[  5]   2.00-3.00   sec  12.5 MBytes   105 Mbits/sec    0   1.03 MBytes
[  5]   3.00-4.00   sec  12.5 MBytes   105 Mbits/sec    0   1.04 MBytes
[  5]   4.00-5.00   sec  13.8 MBytes   115 Mbits/sec    0   1.05 MBytes
[  5]   5.00-6.00   sec  13.8 MBytes   115 Mbits/sec    0   1.06 MBytes
[  5]   6.00-7.00   sec  13.8 MBytes   115 Mbits/sec    0   1.06 MBytes
[  5]   7.00-8.00   sec  13.8 MBytes   115 Mbits/sec    0   1.07 MBytes
[  5]   8.00-9.00   sec  12.5 MBytes   105 Mbits/sec    0   1.07 MBytes
[  5]   9.00-10.00  sec  15.0 MBytes   126 Mbits/sec    0   1.08 MBytes
[  5]  10.00-11.00  sec  13.8 MBytes   115 Mbits/sec    0   1.08 MBytes
[  5]  11.00-12.00  sec  12.5 MBytes   105 Mbits/sec    0   1.08 MBytes
[  5]  12.00-13.00  sec  13.8 MBytes   115 Mbits/sec    0   1.08 MBytes
[  5]  13.00-14.00  sec  12.5 MBytes   105 Mbits/sec    0   1.08 MBytes
[  5]  14.00-15.00  sec  13.8 MBytes   115 Mbits/sec    0   1.09 MBytes
[  5]  15.00-16.00  sec  13.8 MBytes   115 Mbits/sec    0   1.09 MBytes
[  5]  16.00-17.00  sec  13.8 MBytes   115 Mbits/sec    0   1.09 MBytes
[  5]  17.00-18.00  sec  12.5 MBytes   105 Mbits/sec    0   1.10 MBytes
[  5]  18.00-19.00  sec  13.8 MBytes   115 Mbits/sec    0   1.10 MBytes
[  5]  19.00-20.00  sec  13.8 MBytes   115 Mbits/sec    0   1.10 MBytes
[  5]  20.00-21.00  sec  12.5 MBytes   105 Mbits/sec    0   1.10 MBytes
[  5]  21.00-22.00  sec  13.8 MBytes   115 Mbits/sec    0   1.10 MBytes
[  5]  22.00-23.00  sec  13.8 MBytes   115 Mbits/sec    0   1.10 MBytes
[  5]  23.00-24.00  sec  15.0 MBytes   126 Mbits/sec    0   1.10 MBytes
[  5]  24.00-25.00  sec  12.5 MBytes   105 Mbits/sec    0   1.10 MBytes
[  5]  25.00-26.00  sec  13.8 MBytes   115 Mbits/sec    0   1.10 MBytes
[  5]  26.00-27.00  sec  15.0 MBytes   126 Mbits/sec    0   1.11 MBytes
[  5]  26.00-27.00  sec  15.0 MBytes   126 Mbits/sec    0   1.11 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -

 

 

Just wondering is this related to the kernel or is there a hardware module not set in the H6 boards ( two are orangepioneplus and see similar speeds between opioneplus and neo2 )

Perhaps oneof you chaps have an idea?

 

cheers

Link to comment
Share on other sites

hmm, this needs further analysis.

It appears if I upload from my side ( where I currently reside ) to my remote site I get awful upload speeds on the H6 ( and H5 ) : ( no congestion even set ) and no VPN even 

 

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.57 MBytes  13.2 Mbits/sec    2   20.5 KBytes
[  5]   1.00-2.00   sec   440 KBytes  3.61 Mbits/sec    0   45.1 KBytes
[  5]   2.00-3.00   sec   880 KBytes  7.21 Mbits/sec    0   62.9 KBytes
[  5]   3.00-4.00   sec   880 KBytes  7.21 Mbits/sec    3   47.9 KBytes
[  5]   4.00-5.00   sec   880 KBytes  7.21 Mbits/sec    3   20.5 KBytes
[  5]   5.00-6.00   sec   880 KBytes  7.21 Mbits/sec    0   61.5 KBytes
^C[  5]   6.00-6.26   sec  0.00 Bytes  0.00 bits/sec    4   20.5 KBytes

 

 

while on my windows pc it comes at least to 20Mbit, while 40Mbit is max ( and also reported to several "speed testers' on the net :

 

[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  2.38 MBytes  19.8 Mbits/sec
[  4]   1.00-2.00   sec  3.12 MBytes  26.2 Mbits/sec
[  4]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec
[  4]   3.00-4.00   sec  3.00 MBytes  25.1 Mbits/sec
[  4]   4.00-5.01   sec  3.12 MBytes  26.0 Mbits/sec
[  4]   5.01-6.01   sec  2.75 MBytes  23.1 Mbits/sec
[  4]   6.01-7.00   sec  3.00 MBytes  25.3 Mbits/sec
[  4]   7.00-8.00   sec  2.12 MBytes  17.9 Mbits/sec
[  4]   8.00-9.01   sec  1.38 MBytes  11.5 Mbits/sec
[  4]   9.01-9.07   sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -

 

My latop is WiFi while H6 and H5 boards are wired to my router directly

 

 

 

Put a RPi4 next to it ( DietPi ) and all of the sudden indeed max speed ( 40 Mbit ):


[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  6.56 MBytes  55.0 Mbits/sec  424    450 KBytes
[  5]   1.00-2.00   sec  5.00 MBytes  41.9 Mbits/sec   18    388 KBytes
[  5]   2.00-3.00   sec  5.00 MBytes  41.9 Mbits/sec    0    376 KBytes
[  5]   3.00-4.00   sec  5.00 MBytes  41.9 Mbits/sec    0    398 KBytes
[  5]   4.00-5.00   sec  5.00 MBytes  41.9 Mbits/sec    0    412 KBytes
[  5]   5.00-6.00   sec  5.00 MBytes  41.9 Mbits/sec    0    416 KBytes
[  5]   6.00-7.00   sec  3.75 MBytes  31.5 Mbits/sec    0    416 KBytes
[  5]   7.00-8.00   sec  5.00 MBytes  41.9 Mbits/sec    0    416 KBytes
[  5]   8.00-9.00   sec  5.00 MBytes  41.9 Mbits/sec    0    418 KBytes
[  5]   9.00-10.00  sec  5.00 MBytes  41.9 Mbits/sec    0    428 KBytes
[  5]  10.00-11.00  sec  5.00 MBytes  41.9 Mbits/sec    0    444 KBytes
[  5]  11.00-12.00  sec  5.00 MBytes  41.9 Mbits/sec    0    476 KBytes
[  5]  12.00-13.00  sec  5.00 MBytes  41.9 Mbits/sec    9    375 KBytes

 

 

just out of box, also reverted tweaks ( congestion etc ) on H6 board and reboot but nowhere near 40 Mbit, 

are there realtek driver issues in kernel 5.10 that cause this behaviour - I remember last month there were issues and things were held back  for Allwinner platform on 5.8

 

Must admit if I spin up another iperf3 half of speed is gained on Rpi4 but when that is happening spinning up yet another iperf restores this speed.

That looks to me some optimization is needed but I see different behaviour on the allwinner boards ... VERY STRANGE ...

 

PS: I am bypassing VPN on both platforms currently to see what is going on. 

Link to comment
Share on other sites

at this stage I have continuous 40Mbit upload ( RPi4 ) and other way round ( H6 or H5 board )  site to my Rpi4 disappointing speed using only these "tweaks"

 

net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = bbr

 

 

[  5]   0.00-1.00   sec  1.76 MBytes  14.8 Mbits/sec    0    110 KBytes
[  5]   1.00-2.00   sec   440 KBytes  3.60 Mbits/sec    0    102 KBytes
[  5]   2.00-3.00   sec   440 KBytes  3.60 Mbits/sec    0   93.5 KBytes
[  5]   3.00-4.00   sec   440 KBytes  3.60 Mbits/sec    0   96.2 KBytes
[  5]   4.00-5.00   sec   879 KBytes  7.20 Mbits/sec    0   96.2 KBytes
[  5]   5.00-6.00   sec   440 KBytes  3.60 Mbits/sec    0   90.8 KBytes

 

 

using westwood as congesion control changes stuff somewhat as indicated earlier.

This makes me wonder "what is going on with TX ( and RX ) in the allwinner/ realtek driver ( RTL8211 ) , patch?

 

Again all these results straight over Internet, no vpn invovled yet ....
 


 

Link to comment
Share on other sites

well I decided to bring in the r4s and flashed latest dev image ( 5.10.9-rockchip64 ).

Long story short .. using westwood both ways seem to be meeting my needs, using bbr to site is also fine - but from site to home bbr is rubbish 

below results:

 

- fresh dev image built r4s , connected to "  enp1s0 " and results below


- without changing anything: 
iperf3 -4 -c somewhere.dynu.net -t 300 -b 0 -P 1

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  5.10 MBytes  42.8 Mbits/sec  501    391 KBytes
[  5]   1.00-2.00   sec  3.75 MBytes  31.5 Mbits/sec    0    268 KBytes
[  5]   2.00-3.00   sec  3.75 MBytes  31.5 Mbits/sec    0    287 KBytes
[  5]   3.00-4.00   sec  3.75 MBytes  31.5 Mbits/sec    0    304 KBytes
[  5]   4.00-5.00   sec  3.75 MBytes  31.5 Mbits/sec    0    320 KBytes
[  5]   5.00-6.00   sec  3.75 MBytes  31.4 Mbits/sec    0    334 KBytes
[  5]   6.00-7.00   sec  2.50 MBytes  21.0 Mbits/sec    0    347 KBytes
[  5]   7.00-8.00   sec  3.75 MBytes  31.5 Mbits/sec    0    361 KBytes
[  5]   8.00-9.00   sec  2.50 MBytes  21.0 Mbits/sec    0    372 KBytes
[  5]   9.00-10.00  sec  3.75 MBytes  31.5 Mbits/sec    0    384 KBytes
[  5]  10.00-11.00  sec  2.50 MBytes  21.0 Mbits/sec    0    395 KBytes
[  5]  11.00-12.00  sec  3.75 MBytes  31.5 Mbits/sec    0    407 KBytes
[  5]  12.00-13.00  sec  3.75 MBytes  31.5 Mbits/sec    9    212 KBytes
[  5]  13.00-14.00  sec  2.50 MBytes  21.0 Mbits/sec    0    234 KBytes
[  5]  14.00-15.00  sec  3.75 MBytes  31.5 Mbits/sec    0    253 KBytes
[  5]  15.00-16.00  sec  3.75 MBytes  31.5 Mbits/sec    0    271 KBytes
[  5]  16.00-17.00  sec  2.50 MBytes  21.0 Mbits/sec    0    286 KBytes
[  5]  17.00-18.00  sec  3.75 MBytes  31.5 Mbits/sec    0    302 KBytes
[  5]  18.00-19.00  sec  2.50 MBytes  21.0 Mbits/sec    0    316 KBytes
[  5]  19.00-20.00  sec  3.75 MBytes  31.5 Mbits/sec    0    331 KBytes
[  5]  20.00-21.00  sec  2.50 MBytes  21.0 Mbits/sec    0    345 KBytes
[  5]  21.00-22.00  sec  3.75 MBytes  31.5 Mbits/sec    5    182 KBytes
[  5]  22.00-23.00  sec  3.75 MBytes  31.5 Mbits/sec    0    205 KBytes
[  5]  23.00-24.00  sec  2.50 MBytes  21.0 Mbits/sec    0    227 KBytes
[  5]  24.00-25.00  sec  3.75 MBytes  31.5 Mbits/sec    0    247 KBytes
[  5]  25.00-26.00  sec  3.75 MBytes  31.5 Mbits/sec    0    265 KBytes
[  5]  26.00-27.00  sec  2.50 MBytes  21.0 Mbits/sec    0    282 KBytes
[  5]  27.00-28.00  sec  3.75 MBytes  31.5 Mbits/sec    0    298 KBytes
[  5]  28.00-29.00  sec  3.75 MBytes  31.5 Mbits/sec    0    313 KBytes
[  5]  29.00-30.00  sec  2.50 MBytes  21.0 Mbits/sec    0    328 KBytes
[  5]  30.00-31.00  sec  3.75 MBytes  31.5 Mbits/sec    0    342 KBytes
[  5]  31.00-32.00  sec  3.75 MBytes  31.5 Mbits/sec    0    360 KBytes
[  5]  32.00-33.00  sec  5.00 MBytes  41.9 Mbits/sec    0    379 KBytes
[  5]  33.00-34.00  sec  5.00 MBytes  41.9 Mbits/sec    0    395 KBytes
[  5]  34.00-35.00  sec  5.00 MBytes  41.9 Mbits/sec    0    413 KBytes
[  5]  35.00-36.00  sec  5.00 MBytes  41.9 Mbits/sec    0    429 KBytes


- minimal kernel tuning:

net.core.default_qdisc = fq1
net.ipv4.tcp_congestion_control = bbr


iperf3 -4 -c somewhere.go.ro -t 300 -b 0 -P 1

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  6.50 MBytes  54.6 Mbits/sec  588    623 KBytes
[  5]   1.00-2.00   sec  5.00 MBytes  41.9 Mbits/sec  116    637 KBytes
[  5]   2.00-3.00   sec  5.00 MBytes  41.9 Mbits/sec   71    645 KBytes
[  5]   3.00-4.00   sec  5.00 MBytes  41.9 Mbits/sec   53    591 KBytes
[  5]   4.00-5.00   sec  5.00 MBytes  41.9 Mbits/sec   73    591 KBytes
[  5]   5.00-6.00   sec  3.75 MBytes  31.5 Mbits/sec   63    648 KBytes
[  5]   6.00-7.00   sec  5.00 MBytes  41.9 Mbits/sec  171    645 KBytes
[  5]   7.00-8.00   sec  5.00 MBytes  42.0 Mbits/sec  138    692 KBytes
[  5]   8.00-9.00   sec  5.00 MBytes  41.9 Mbits/sec  122    640 KBytes
[  5]   9.00-10.00  sec  3.75 MBytes  31.4 Mbits/sec  221    645 KBytes
[  5]  10.00-11.00  sec  3.75 MBytes  31.5 Mbits/sec  122    541 KBytes
[  5]  11.00-12.00  sec  5.00 MBytes  41.9 Mbits/sec    1    591 KBytes
[  5]  12.00-13.00  sec  3.75 MBytes  31.5 Mbits/sec   64    514 KBytes
[  5]  13.00-14.00  sec  5.00 MBytes  41.9 Mbits/sec  102    648 KBytes
[  5]  14.00-15.00  sec  5.00 MBytes  41.9 Mbits/sec   61    645 KBytes
[  5]  15.00-16.00  sec  5.00 MBytes  41.9 Mbits/sec   38    596 KBytes
[  5]  16.00-17.00  sec  5.00 MBytes  41.9 Mbits/sec   63    593 KBytes
[  5]  17.00-18.00  sec  5.00 MBytes  41.9 Mbits/sec   49    593 KBytes
[  5]  18.00-19.00  sec  5.00 MBytes  41.9 Mbits/sec   40    593 KBytes
[  5]  19.00-20.00  sec  5.00 MBytes  41.9 Mbits/sec   74    632 KBytes
[  5]  20.00-21.00  sec  2.50 MBytes  21.0 Mbits/sec  147    623 KBytes
[  5]  21.00-22.00  sec  6.25 MBytes  52.5 Mbits/sec   48    670 KBytes
[  5]  22.00-23.00  sec  3.75 MBytes  31.5 Mbits/sec   77    656 KBytes
[  5]  23.00-24.00  sec  5.00 MBytes  41.9 Mbits/sec   64    643 KBytes
[  5]  24.00-25.00  sec  5.00 MBytes  42.0 Mbits/sec  115    645 KBytes
[  5]  25.00-26.00  sec  5.00 MBytes  41.9 Mbits/sec   70    604 KBytes
[  5]  26.00-27.00  sec  5.00 MBytes  41.9 Mbits/sec  113    442 KBytes
[  5]  27.00-28.00  sec  5.00 MBytes  41.9 Mbits/sec   40    602 KBytes
[  5]  28.00-29.00  sec  5.00 MBytes  41.9 Mbits/sec   78    662 KBytes
[  5]  29.00-30.00  sec  5.00 MBytes  41.9 Mbits/sec   42    684 KBytes
[  5]  30.00-31.00  sec  3.75 MBytes  31.5 Mbits/sec  427   5.47 KBytes
[  5]  31.00-32.00  sec  2.50 MBytes  21.0 Mbits/sec  160    689 KBytes
[  5]  32.00-33.00  sec  5.00 MBytes  41.9 Mbits/sec  222    405 KBytes
[  5]  33.00-34.00  sec  5.00 MBytes  42.0 Mbits/sec   48    656 KBytes
[  5]  34.00-35.00  sec  5.00 MBytes  41.9 Mbits/sec   88    684 KBytes
[  5]  35.00-36.00  sec  5.00 MBytes  42.0 Mbits/sec  238    436 KBytes


now other way round site to home:
- orangepioneplus ( kernel 5.10.4 )

 

net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = bbr

 

iperf3 -4 -c local.dynu.net -t 300 -b 0 -P 1

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.96 MBytes  16.4 Mbits/sec    0    120 KBytes
[  5]   1.00-2.00   sec   503 KBytes  4.12 Mbits/sec    0    107 KBytes
[  5]   2.00-3.00   sec  1006 KBytes  8.25 Mbits/sec    0    107 KBytes
[  5]   3.00-4.00   sec   503 KBytes  4.12 Mbits/sec    0    101 KBytes
[  5]   4.00-5.00   sec  1006 KBytes  8.24 Mbits/sec    0   98.4 KBytes
[  5]   5.00-6.00   sec  1006 KBytes  8.25 Mbits/sec    0    101 KBytes
[  5]   6.00-7.00   sec   503 KBytes  4.12 Mbits/sec    0    104 KBytes
[  5]   7.00-8.00   sec  1006 KBytes  8.25 Mbits/sec    0    101 KBytes
[  5]   8.00-9.00   sec   503 KBytes  4.12 Mbits/sec    0   98.4 KBytes
[  5]   9.00-10.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  10.00-11.00  sec   503 KBytes  4.12 Mbits/sec    0ipe       98.4 KBytes
[  5]  11.00-12.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  12.00-13.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  13.00-14.00  sec   503 KBytes  4.12 Mbits/sec    0   98.4 KBytes
[  5]  14.00-15.00  sec   503 KBytes  4.12 Mbits/sec    0   5.47 KBytes
[  5]  15.00-16.00  sec  1006 KBytes  8.25 Mbits/sec    0    109 KBytes
[  5]  16.00-17.00  sec   503 KBytes  4.12 Mbits/sec    0    107 KBytes
[  5]  17.00-18.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  18.00-19.00  sec   503 KBytes  4.12 Mbits/sec    0   98.4 KBytes
[  5]  19.00-20.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  20.00-21.00  sec  1006 KBytes  8.25 Mbits/sec    0    109 KBytes
[  5]  21.00-22.00  sec   503 KBytes  4.12 Mbits/sec    0    109 KBytes
[  5]  22.00-23.00  sec  1006 KBytes  8.25 Mbits/sec    0    107 KBytes
[  5]  23.00-24.00  sec   503 KBytes  4.12 Mbits/sec    0    104 KBytes
[  5]  24.00-25.00  sec  1006 KBytes  8.25 Mbits/sec    0    101 KBytes
[  5]  25.00-26.00  sec  1006 KBytes  8.25 Mbits/sec    0    104 KBytes
[  5]  26.00-27.00  sec   503 KBytes  4.12 Mbits/sec    0    107 KBytes
[  5]  27.00-28.00  sec  1006 KBytes  8.25 Mbits/sec    0    112 KBytes
[  5]  28.00-29.00  sec   503 KBytes  4.12 Mbits/sec    0    104 KBytes
[  5]  29.00-30.00  sec  1006 KBytes  8.25 Mbits/sec    0    101 KBytes
[  5]  30.00-31.00  sec   503 KBytes  4.12 Mbits/sec    0    101 KBytes
[  5]  31.00-32.00  sec  1006 KBytes  8.25 Mbits/sec    0    109 KBytes
[  5]  32.00-33.00  sec   503 KBytes  4.12 Mbits/sec    0   98.4 KBytes
[  5]  33.00-34.00  sec  1006 KBytes  8.25 Mbits/sec    0    112 KBytes
[  5]  34.00-35.00  sec  1006 KBytes  8.24 Mbits/sec    0    107 KBytes
[  5]  35.00-36.00  sec   503 KBytes  4.12 Mbits/sec    0    109 KBytes

 

 

net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = westwood


iperf3 -4 -c local.dynu.net -t 300 -b 0 -P 1

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  28.0 MBytes   235 Mbits/sec    0   6.29 MBytes
[  5]   1.00-2.00   sec  17.5 MBytes   147 Mbits/sec  1672   1.06 MBytes
[  5]   2.00-3.00   sec  13.8 MBytes   115 Mbits/sec  124    937 KBytes
[  5]   3.00-4.00   sec  18.8 MBytes   157 Mbits/sec    0    962 KBytes
[  5]   4.00-5.00   sec  17.5 MBytes   147 Mbits/sec    0    987 KBytes
[  5]   5.00-6.00   sec  20.0 MBytes   168 Mbits/sec    0   1014 KBytes
[  5]   6.00-7.00   sec  17.5 MBytes   147 Mbits/sec   71    518 KBytes
[  5]   7.00-8.00   sec  18.8 MBytes   157 Mbits/sec    0    956 KBytes
[  5]   8.00-9.00   sec  17.5 MBytes   147 Mbits/sec    0    983 KBytes
[  5]   9.00-10.00  sec  17.5 MBytes   147 Mbits/sec   40    916 KBytes
[  5]  10.00-11.00  sec  16.2 MBytes   136 Mbits/sec    0    941 KBytes
[  5]  11.00-12.00  sec  18.8 MBytes   157 Mbits/sec    0    967 KBytes
[  5]  12.00-13.00  sec  18.8 MBytes   157 Mbits/sec    0    994 KBytes
[  5]  13.00-14.00  sec  16.2 MBytes   136 Mbits/sec   54    921 KBytes
[  5]  14.00-15.00  sec  17.5 MBytes   147 Mbits/sec    0    947 KBytes
[  5]  15.00-16.00  sec  18.8 MBytes   157 Mbits/sec    0    973 KBytes
[  5]  16.00-17.00  sec  16.2 MBytes   136 Mbits/sec   36    897 KBytes
[  5]  17.00-18.00  sec  17.5 MBytes   147 Mbits/sec    0    923 KBytes
[  5]  18.00-19.00  sec  17.5 MBytes   147 Mbits/sec    0    950 KBytes
[  5]  19.00-20.00  sec  18.8 MBytes   157 Mbits/sec    0    975 KBytes
[  5]  20.00-21.00  sec  18.8 MBytes   157 Mbits/sec    0   1002 KBytes
[  5]  21.00-22.00  sec  16.2 MBytes   136 Mbits/sec   71    927 KBytes
[  5]  22.00-23.00  sec  17.5 MBytes   147 Mbits/sec    0    952 KBytes
[  5]  23.00-24.00  sec  18.8 MBytes   157 Mbits/sec    0    979 KBytes
[  5]  24.00-25.00  sec  16.2 MBytes   136 Mbits/sec   43    906 KBytes
[  5]  25.00-26.00  sec  17.5 MBytes   147 Mbits/sec    0    932 KBytes
[  5]  26.00-27.00  sec  18.8 MBytes   157 Mbits/sec    0    958 KBytes
[  5]  27.00-28.00  sec  17.5 MBytes   147 Mbits/sec    0    984 KBytes
[  5]  28.00-29.00  sec  17.5 MBytes   147 Mbits/sec   53    913 KBytes
[  5]  29.00-30.00  sec  17.5 MBytes   147 Mbits/sec    0    939 KBytes
[  5]  30.00-31.00  sec  17.5 MBytes   147 Mbits/sec    0    965 KBytes
[  5]  31.00-32.00  sec  17.5 MBytes   147 Mbits/sec    0    990 KBytes
[  5]  32.00-33.00  sec  17.5 MBytes   147 Mbits/sec   68    905 KBytes
[  5]  33.00-34.00  sec  17.5 MBytes   147 Mbits/sec    0    931 KBytes
[  5]  34.00-35.00  sec  18.8 MBytes   157 Mbits/sec    0    957 KBytes
[  5]  35.00-36.00  sec  17.5 MBytes   147 Mbits/sec    0    983 KBytes

 

 

once more 

now local to site ( r4s to site )

 

net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = westwood

 

 

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  6.46 MBytes  54.1 Mbits/sec  430   58.8 KBytes
[  5]   1.00-2.00   sec  1.25 MBytes  10.5 Mbits/sec    0   82.0 KBytes
[  5]   2.00-3.00   sec  1.25 MBytes  10.5 Mbits/sec    0    107 KBytes
[  5]   3.00-4.00   sec  2.50 MBytes  21.0 Mbits/sec    0    131 KBytes
[  5]   4.00-5.00   sec  2.50 MBytes  21.0 Mbits/sec    0    154 KBytes
[  5]   5.00-6.00   sec  2.50 MBytes  21.0 Mbits/sec    0    179 KBytes
[  5]   6.00-7.00   sec  2.50 MBytes  21.0 Mbits/sec    0    202 KBytes
[  5]   7.00-8.00   sec  3.75 MBytes  31.5 Mbits/sec    0    227 KBytes
[  5]   8.00-9.00   sec  5.00 MBytes  42.0 Mbits/sec    0    250 KBytes
[  5]   9.00-10.00  sec  3.75 MBytes  31.5 Mbits/sec    0    275 KBytes
[  5]  10.00-11.00  sec  5.00 MBytes  41.9 Mbits/sec    0    297 KBytes
[  5]  11.00-12.00  sec  5.00 MBytes  41.9 Mbits/sec    0    319 KBytes
[  5]  12.00-13.00  sec  5.00 MBytes  41.9 Mbits/sec    0    339 KBytes
[  5]  13.00-14.00  sec  3.75 MBytes  31.5 Mbits/sec    0    358 KBytes
[  5]  14.00-15.00  sec  5.00 MBytes  41.9 Mbits/sec    0    376 KBytes
[  5]  15.00-16.00  sec  5.00 MBytes  41.9 Mbits/sec    0    394 KBytes
[  5]  16.00-17.00  sec  5.00 MBytes  41.9 Mbits/sec    0    410 KBytes
[  5]  17.00-18.00  sec  5.00 MBytes  41.9 Mbits/sec    0    427 KBytes
[  5]  18.00-19.00  sec  5.00 MBytes  41.9 Mbits/sec    0    442 KBytes
[  5]  19.00-20.00  sec  5.00 MBytes  41.9 Mbits/sec    0    457 KBytes
[  5]  20.00-21.00  sec  3.75 MBytes  31.5 Mbits/sec   25    235 KBytes
[  5]  21.00-22.00  sec  5.00 MBytes  41.9 Mbits/sec    0    260 KBytes
[  5]  22.00-23.00  sec  3.75 MBytes  31.5 Mbits/sec    0    283 KBytes
[  5]  23.00-24.00  sec  5.00 MBytes  41.9 Mbits/sec    0    306 KBytes
[  5]  24.00-25.00  sec  5.00 MBytes  41.9 Mbits/sec    0    328 KBytes
[  5]  25.00-26.00  sec  5.00 MBytes  41.9 Mbits/sec    0    347 KBytes
[  5]  26.00-27.00  sec  5.00 MBytes  41.9 Mbits/sec    0    366 KBytes
[  5]  27.00-28.00  sec  5.00 MBytes  41.9 Mbits/sec    0    384 KBytes
[  5]  28.00-29.00  sec  3.75 MBytes  31.4 Mbits/sec    0    401 KBytes
[  5]  29.00-30.00  sec  5.00 MBytes  41.9 Mbits/sec    0    417 KBytes
[  5]  30.00-31.00  sec  5.00 MBytes  41.9 Mbits/sec    0    433 KBytes
[  5]  31.00-32.00  sec  5.00 MBytes  41.9 Mbits/sec    0    448 KBytes
[  5]  32.00-33.00  sec  5.00 MBytes  41.9 Mbits/sec    0    463 KBytes
[  5]  33.00-34.00  sec  5.00 MBytes  41.9 Mbits/sec   29    243 KBytes
[  5]  34.00-35.00  sec  3.75 MBytes  31.5 Mbits/sec    0    268 KBytes
[  5]  35.00-36.00  sec  5.00 MBytes  41.9 Mbits/sec    0    291 KBytes

 

 

this is directly over Internet, thus no VPN yet.

I really wonder what is going on as using H5/H6 allwinners give horrific results.

why uploading on the allwinner platform is limited ( though 150Mbit is fine with me )

Link to comment
Share on other sites

bumped my OpiOnePlus H6 boards to kernel 5.12 and surprise surprise , BBR is working as it should again ...

I really wonder what was causing this as in kernel 5.10 and 11 I had to use westwood ( with cake )...

 

net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = bbr

 

shows 250Mbit ( meanwhile line upgraded which is max upload speed )

root@vpn01:~# iperf3 -4 -c 192.168.10.2 -t 300 -b0 -P1
Connecting to host 192.168.10.2, port 5201
[  5] local 192.168.20.2 port 47462 connected to 192.168.10.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  28.4 MBytes   238 Mbits/sec    0   7.71 MBytes
[  5]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec  1789   1.81 MBytes
[  5]   2.00-3.00   sec  26.2 MBytes   220 Mbits/sec  3780   1.96 MBytes
[  5]   3.00-4.00   sec  30.0 MBytes   252 Mbits/sec  3389   1.66 MBytes
[  5]   4.00-5.00   sec  27.5 MBytes   231 Mbits/sec  4158   2.27 MBytes
[  5]   5.00-6.00   sec  28.8 MBytes   241 Mbits/sec  2252   5.84 MBytes
[  5]   6.00-7.00   sec  30.0 MBytes   252 Mbits/sec  2507   5.85 MBytes
[  5]   7.00-8.00   sec  26.2 MBytes   220 Mbits/sec  3921   2.12 MBytes
[  5]   8.00-9.00   sec  30.0 MBytes   252 Mbits/sec  2773   5.94 MBytes
[  5]   9.00-10.00  sec  27.4 MBytes   230 Mbits/sec  3675   2.02 MBytes
[  5]  10.00-11.00  sec  28.8 MBytes   241 Mbits/sec  3512   1.88 MBytes
^C[  5]  11.00-11.22  sec  7.50 MBytes   289 Mbits/sec  319   2.68 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-11.22  sec   326 MBytes   244 Mbits/sec  32075             sender

 

 

Link to comment
Share on other sites

This thread is quite old. Please consider starting a new thread rather than reviving this one.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...

Important Information

Terms of Use - Privacy Policy - Guidelines