creited Posted May 21, 2020 Posted May 21, 2020 Hi, I'm using armbian on a FriendlyElec Zero Pi device as my wireguard server. This is a extremely cheap device and for this reason it was chosen since I don't need powerful performances. It happened that I found a tutorial that switching the Congestion Control for BBR (mine says it is cubic), would allow me to experience performance improvements. I'm not being able to change this parameter in my image already configured using: root@zeropi:~# sysctl -w net.ipv4.tcp_congestion_control=bbr The output says: sysctl: setting key "net.ipv4.tcp_congestion_control": No such file or directory net.ipv4.tcp_congestion_control = bbr Using this command: sysctl net.ipv4.tcp_available_congestion_control Outputs: net.ipv4.tcp_available_congestion_control = reno bic cubic westwood highspeed hybla htcp vegas nv veno scalable lp yeah illinois As far as I understood, the BBR option is not available to be selected. And I really want to have it running in my setup. Is there a way to enable this in my armbian in a way I don't need to start everything from scratch? If the answer is NO, how should I proceed to have an image with this option enabled? If you have a step by step tutorial, it would be very helpful, since I'm not an expert in building linux. Thank you for your support.
Werner Posted May 21, 2020 Posted May 21, 2020 Whenever asking for support please provide the output of armbianmonitor -u Check if tcp_htcp and tcp_cubic kernel modules are loaded.
creited Posted May 21, 2020 Author Posted May 21, 2020 Hi, Here is the output of armbianmonitor -u: http://ix.io/2mTm Thank you!
Werner Posted May 21, 2020 Posted May 21, 2020 20.05.0-trunk Since you are using either a 3rd party build or built the kernel package by yourself you should already know your way around and adjust the kernel config to include the modules mentioned above. Uboot loader 2019.10 Not relevant but you missed to update U-boot to 2020.04 which is commonly built with the kernel package.
Igor Posted May 21, 2020 Posted May 21, 2020 12 hours ago, creited said: Thank you for your support. https://github.com/armbian/build#support We can't possibly cover research and development on your behalf. More of it ... I have no idea what is missing in the kernel but we will accept your PR to the kernel config https://github.com/armbian/build/tree/master/config/kernel. If you speed up, there will be a release in a week, two. And this functionality will come with an update. 12 hours ago, creited said: If you have a step by step tutorial, it would be very helpful, since I'm not an expert in building linux https://docs.armbian.com/Developer-Guide_Build-Preparation/ Personal guidance is not possible.
xwiggen Posted May 23, 2020 Posted May 23, 2020 On 5/21/2020 at 3:14 PM, Igor said: I have no idea what is missing in the kernel but we will accept your PR to the kernel config https://github.com/armbian/build/tree/master/config/kernel. If you speed up, there will be a release in a week, two. And this functionality will come with an update. Already enabled in master (CONFIG_TCP_CONG_BBR=m) at least since 5.4.41 requires modprobe tcp_bbr
creited Posted May 23, 2020 Author Posted May 23, 2020 5 hours ago, xwiggen said: Already enabled in master (CONFIG_TCP_CONG_BBR=m) at least since 5.4.41 requires modprobe tcp_bbr Is it possible to update my running version to 5.4.41? Mine says 5.4.35, so modprobe returns an error. @Igor, I have no idea on how to proceed with a pull request. Actually I am not a developer, but I would be happy to help with anything that I could. It seems like enabling tcp_bbr with modprobe shall solve my point. Thanks for everyone that replied. Cleiton
Igor Posted May 23, 2020 Posted May 23, 2020 1 minute ago, creited said: Is it possible to update my running version to 5.4.41? Mine says 5.4.35, so modprobe returns an error. At this moment possible by switching to nightly builds but this is not recommend in production. Nightly images are our development builds where things sometimes just break and can remain broken for days. That branch is ... for testing, but currently its safe, since we are near to the release. Go there and go back to stable after the release ... 3 minutes ago, creited said: I have no idea on how to proceed with a pull request. There are many guides. Perhaps this one is better https://help.github.com/en/github/collaborating-with-issues-and-pull-requests/creating-a-pull-request 4 minutes ago, creited said: Actually I am not a developer, but I would be happy to help with anything that I could. - reworking documentation - running projects - forum moderating
creited Posted May 24, 2020 Author Posted May 24, 2020 What should I add to sources.list in order to enable nightly images to be installed? Or to update to 5.4.41, another process should be performed?
Igor Posted May 24, 2020 Posted May 24, 2020 2 minutes ago, creited said: What should I add to sources.list armbian-config -> system -> nightly
izumiko Posted December 12, 2020 Posted December 12, 2020 after this commit(Move sunxi/64 current to 5.7, legacy to 5.4), bbr was disabled again.
Werner Posted December 12, 2020 Posted December 12, 2020 Send PR to enable again and become contributor
izumiko Posted December 14, 2020 Posted December 14, 2020 On 12/12/2020 at 10:54 PM, Werner said: Send PR to enable again and become contributor PR is sent, cheers 2
dolphs Posted January 20, 2021 Posted January 20, 2021 hmm , recently it came to my attention bbr between both wireguard servers is doing a very bad job: :/etc/sysctl.d# iperf3 -4 -c 192.168.10.2 -t 300 -b 0 -P 1 Connecting to host 192.168.10.2, port 5201 [ 5] local 192.168.20.2 port 41804 connected to 192.168.10.2 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 1.29 MBytes 10.8 Mbits/sec 0 112 KBytes [ 5] 1.00-2.00 sec 502 KBytes 4.11 Mbits/sec 0 104 KBytes [ 5] 2.00-3.00 sec 753 KBytes 6.17 Mbits/sec 0 98.9 KBytes [ 5] 3.00-4.00 sec 753 KBytes 6.17 Mbits/sec 0 107 KBytes [ 5] 4.00-5.00 sec 753 KBytes 6.17 Mbits/sec 0 104 KBytes [ 5] 5.00-6.00 sec 753 KBytes 6.17 Mbits/sec 0 102 KBytes [ 5] 6.00-7.00 sec 753 KBytes 6.17 Mbits/sec 0 110 KBytes [ 5] 7.00-8.00 sec 753 KBytes 6.17 Mbits/sec 0 107 KBytes [ 5] 8.00-9.00 sec 502 KBytes 4.11 Mbits/sec 0 104 KBytes ^C[ 5] 9.00-9.33 sec 251 KBytes 6.29 Mbits/sec 0 102 KBytes while westwood ( the one I used years back before bbr came ) is still performing OK ( while 150Mbit constant should be possible with bbr as I had in the past ) :/etc/sysctl.d# iperf3 -4 -c 192.168.10.2 -t 300 -b 0 -P 1 Connecting to host 192.168.10.2, port 5201 [ 5] local 192.168.20.2 port 41808 connected to 192.168.10.2 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 12.2 MBytes 103 Mbits/sec 0 6.01 MBytes [ 5] 1.00-2.00 sec 26.2 MBytes 220 Mbits/sec 1319 1.02 MBytes [ 5] 2.00-3.00 sec 12.5 MBytes 105 Mbits/sec 0 1.03 MBytes [ 5] 3.00-4.00 sec 12.5 MBytes 105 Mbits/sec 0 1.04 MBytes [ 5] 4.00-5.00 sec 13.8 MBytes 115 Mbits/sec 0 1.05 MBytes [ 5] 5.00-6.00 sec 13.8 MBytes 115 Mbits/sec 0 1.06 MBytes [ 5] 6.00-7.00 sec 13.8 MBytes 115 Mbits/sec 0 1.06 MBytes [ 5] 7.00-8.00 sec 13.8 MBytes 115 Mbits/sec 0 1.07 MBytes [ 5] 8.00-9.00 sec 12.5 MBytes 105 Mbits/sec 0 1.07 MBytes [ 5] 9.00-10.00 sec 15.0 MBytes 126 Mbits/sec 0 1.08 MBytes [ 5] 10.00-11.00 sec 13.8 MBytes 115 Mbits/sec 0 1.08 MBytes [ 5] 11.00-12.00 sec 12.5 MBytes 105 Mbits/sec 0 1.08 MBytes [ 5] 12.00-13.00 sec 13.8 MBytes 115 Mbits/sec 0 1.08 MBytes [ 5] 13.00-14.00 sec 12.5 MBytes 105 Mbits/sec 0 1.08 MBytes [ 5] 14.00-15.00 sec 13.8 MBytes 115 Mbits/sec 0 1.09 MBytes [ 5] 15.00-16.00 sec 13.8 MBytes 115 Mbits/sec 0 1.09 MBytes [ 5] 16.00-17.00 sec 13.8 MBytes 115 Mbits/sec 0 1.09 MBytes [ 5] 17.00-18.00 sec 12.5 MBytes 105 Mbits/sec 0 1.10 MBytes [ 5] 18.00-19.00 sec 13.8 MBytes 115 Mbits/sec 0 1.10 MBytes [ 5] 19.00-20.00 sec 13.8 MBytes 115 Mbits/sec 0 1.10 MBytes [ 5] 20.00-21.00 sec 12.5 MBytes 105 Mbits/sec 0 1.10 MBytes [ 5] 21.00-22.00 sec 13.8 MBytes 115 Mbits/sec 0 1.10 MBytes [ 5] 22.00-23.00 sec 13.8 MBytes 115 Mbits/sec 0 1.10 MBytes [ 5] 23.00-24.00 sec 15.0 MBytes 126 Mbits/sec 0 1.10 MBytes [ 5] 24.00-25.00 sec 12.5 MBytes 105 Mbits/sec 0 1.10 MBytes [ 5] 25.00-26.00 sec 13.8 MBytes 115 Mbits/sec 0 1.10 MBytes [ 5] 26.00-27.00 sec 15.0 MBytes 126 Mbits/sec 0 1.11 MBytes [ 5] 26.00-27.00 sec 15.0 MBytes 126 Mbits/sec 0 1.11 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - Just wondering is this related to the kernel or is there a hardware module not set in the H6 boards ( two are orangepioneplus and see similar speeds between opioneplus and neo2 ) Perhaps oneof you chaps have an idea? cheers
dolphs Posted January 21, 2021 Posted January 21, 2021 hmm, this needs further analysis. It appears if I upload from my side ( where I currently reside ) to my remote site I get awful upload speeds on the H6 ( and H5 ) : ( no congestion even set ) and no VPN even : [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 1.57 MBytes 13.2 Mbits/sec 2 20.5 KBytes [ 5] 1.00-2.00 sec 440 KBytes 3.61 Mbits/sec 0 45.1 KBytes [ 5] 2.00-3.00 sec 880 KBytes 7.21 Mbits/sec 0 62.9 KBytes [ 5] 3.00-4.00 sec 880 KBytes 7.21 Mbits/sec 3 47.9 KBytes [ 5] 4.00-5.00 sec 880 KBytes 7.21 Mbits/sec 3 20.5 KBytes [ 5] 5.00-6.00 sec 880 KBytes 7.21 Mbits/sec 0 61.5 KBytes ^C[ 5] 6.00-6.26 sec 0.00 Bytes 0.00 bits/sec 4 20.5 KBytes while on my windows pc it comes at least to 20Mbit, while 40Mbit is max ( and also reported to several "speed testers' on the net : [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 2.38 MBytes 19.8 Mbits/sec [ 4] 1.00-2.00 sec 3.12 MBytes 26.2 Mbits/sec [ 4] 2.00-3.00 sec 3.25 MBytes 27.3 Mbits/sec [ 4] 3.00-4.00 sec 3.00 MBytes 25.1 Mbits/sec [ 4] 4.00-5.01 sec 3.12 MBytes 26.0 Mbits/sec [ 4] 5.01-6.01 sec 2.75 MBytes 23.1 Mbits/sec [ 4] 6.01-7.00 sec 3.00 MBytes 25.3 Mbits/sec [ 4] 7.00-8.00 sec 2.12 MBytes 17.9 Mbits/sec [ 4] 8.00-9.01 sec 1.38 MBytes 11.5 Mbits/sec [ 4] 9.01-9.07 sec 0.00 Bytes 0.00 bits/sec - - - - - - - - - - - - - - - - - - - - - - - - - My latop is WiFi while H6 and H5 boards are wired to my router directly Put a RPi4 next to it ( DietPi ) and all of the sudden indeed max speed ( 40 Mbit ): [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 6.56 MBytes 55.0 Mbits/sec 424 450 KBytes [ 5] 1.00-2.00 sec 5.00 MBytes 41.9 Mbits/sec 18 388 KBytes [ 5] 2.00-3.00 sec 5.00 MBytes 41.9 Mbits/sec 0 376 KBytes [ 5] 3.00-4.00 sec 5.00 MBytes 41.9 Mbits/sec 0 398 KBytes [ 5] 4.00-5.00 sec 5.00 MBytes 41.9 Mbits/sec 0 412 KBytes [ 5] 5.00-6.00 sec 5.00 MBytes 41.9 Mbits/sec 0 416 KBytes [ 5] 6.00-7.00 sec 3.75 MBytes 31.5 Mbits/sec 0 416 KBytes [ 5] 7.00-8.00 sec 5.00 MBytes 41.9 Mbits/sec 0 416 KBytes [ 5] 8.00-9.00 sec 5.00 MBytes 41.9 Mbits/sec 0 418 KBytes [ 5] 9.00-10.00 sec 5.00 MBytes 41.9 Mbits/sec 0 428 KBytes [ 5] 10.00-11.00 sec 5.00 MBytes 41.9 Mbits/sec 0 444 KBytes [ 5] 11.00-12.00 sec 5.00 MBytes 41.9 Mbits/sec 0 476 KBytes [ 5] 12.00-13.00 sec 5.00 MBytes 41.9 Mbits/sec 9 375 KBytes just out of box, also reverted tweaks ( congestion etc ) on H6 board and reboot but nowhere near 40 Mbit, are there realtek driver issues in kernel 5.10 that cause this behaviour - I remember last month there were issues and things were held back for Allwinner platform on 5.8 Must admit if I spin up another iperf3 half of speed is gained on Rpi4 but when that is happening spinning up yet another iperf restores this speed. That looks to me some optimization is needed but I see different behaviour on the allwinner boards ... VERY STRANGE ... PS: I am bypassing VPN on both platforms currently to see what is going on.
dolphs Posted January 21, 2021 Posted January 21, 2021 at this stage I have continuous 40Mbit upload ( RPi4 ) and other way round ( H6 or H5 board ) : site to my Rpi4 disappointing speed using only these "tweaks" net.core.default_qdisc = fq net.ipv4.tcp_congestion_control = bbr [ 5] 0.00-1.00 sec 1.76 MBytes 14.8 Mbits/sec 0 110 KBytes [ 5] 1.00-2.00 sec 440 KBytes 3.60 Mbits/sec 0 102 KBytes [ 5] 2.00-3.00 sec 440 KBytes 3.60 Mbits/sec 0 93.5 KBytes [ 5] 3.00-4.00 sec 440 KBytes 3.60 Mbits/sec 0 96.2 KBytes [ 5] 4.00-5.00 sec 879 KBytes 7.20 Mbits/sec 0 96.2 KBytes [ 5] 5.00-6.00 sec 440 KBytes 3.60 Mbits/sec 0 90.8 KBytes using westwood as congesion control changes stuff somewhat as indicated earlier. This makes me wonder "what is going on with TX ( and RX ) in the allwinner/ realtek driver ( RTL8211 ) , patch? Again all these results straight over Internet, no vpn invovled yet ....
dolphs Posted January 21, 2021 Posted January 21, 2021 well I decided to bring in the r4s and flashed latest dev image ( 5.10.9-rockchip64 ). Long story short .. using westwood both ways seem to be meeting my needs, using bbr to site is also fine - but from site to home bbr is rubbish below results: - fresh dev image built r4s , connected to " enp1s0 " and results below - without changing anything: iperf3 -4 -c somewhere.dynu.net -t 300 -b 0 -P 1 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 5.10 MBytes 42.8 Mbits/sec 501 391 KBytes [ 5] 1.00-2.00 sec 3.75 MBytes 31.5 Mbits/sec 0 268 KBytes [ 5] 2.00-3.00 sec 3.75 MBytes 31.5 Mbits/sec 0 287 KBytes [ 5] 3.00-4.00 sec 3.75 MBytes 31.5 Mbits/sec 0 304 KBytes [ 5] 4.00-5.00 sec 3.75 MBytes 31.5 Mbits/sec 0 320 KBytes [ 5] 5.00-6.00 sec 3.75 MBytes 31.4 Mbits/sec 0 334 KBytes [ 5] 6.00-7.00 sec 2.50 MBytes 21.0 Mbits/sec 0 347 KBytes [ 5] 7.00-8.00 sec 3.75 MBytes 31.5 Mbits/sec 0 361 KBytes [ 5] 8.00-9.00 sec 2.50 MBytes 21.0 Mbits/sec 0 372 KBytes [ 5] 9.00-10.00 sec 3.75 MBytes 31.5 Mbits/sec 0 384 KBytes [ 5] 10.00-11.00 sec 2.50 MBytes 21.0 Mbits/sec 0 395 KBytes [ 5] 11.00-12.00 sec 3.75 MBytes 31.5 Mbits/sec 0 407 KBytes [ 5] 12.00-13.00 sec 3.75 MBytes 31.5 Mbits/sec 9 212 KBytes [ 5] 13.00-14.00 sec 2.50 MBytes 21.0 Mbits/sec 0 234 KBytes [ 5] 14.00-15.00 sec 3.75 MBytes 31.5 Mbits/sec 0 253 KBytes [ 5] 15.00-16.00 sec 3.75 MBytes 31.5 Mbits/sec 0 271 KBytes [ 5] 16.00-17.00 sec 2.50 MBytes 21.0 Mbits/sec 0 286 KBytes [ 5] 17.00-18.00 sec 3.75 MBytes 31.5 Mbits/sec 0 302 KBytes [ 5] 18.00-19.00 sec 2.50 MBytes 21.0 Mbits/sec 0 316 KBytes [ 5] 19.00-20.00 sec 3.75 MBytes 31.5 Mbits/sec 0 331 KBytes [ 5] 20.00-21.00 sec 2.50 MBytes 21.0 Mbits/sec 0 345 KBytes [ 5] 21.00-22.00 sec 3.75 MBytes 31.5 Mbits/sec 5 182 KBytes [ 5] 22.00-23.00 sec 3.75 MBytes 31.5 Mbits/sec 0 205 KBytes [ 5] 23.00-24.00 sec 2.50 MBytes 21.0 Mbits/sec 0 227 KBytes [ 5] 24.00-25.00 sec 3.75 MBytes 31.5 Mbits/sec 0 247 KBytes [ 5] 25.00-26.00 sec 3.75 MBytes 31.5 Mbits/sec 0 265 KBytes [ 5] 26.00-27.00 sec 2.50 MBytes 21.0 Mbits/sec 0 282 KBytes [ 5] 27.00-28.00 sec 3.75 MBytes 31.5 Mbits/sec 0 298 KBytes [ 5] 28.00-29.00 sec 3.75 MBytes 31.5 Mbits/sec 0 313 KBytes [ 5] 29.00-30.00 sec 2.50 MBytes 21.0 Mbits/sec 0 328 KBytes [ 5] 30.00-31.00 sec 3.75 MBytes 31.5 Mbits/sec 0 342 KBytes [ 5] 31.00-32.00 sec 3.75 MBytes 31.5 Mbits/sec 0 360 KBytes [ 5] 32.00-33.00 sec 5.00 MBytes 41.9 Mbits/sec 0 379 KBytes [ 5] 33.00-34.00 sec 5.00 MBytes 41.9 Mbits/sec 0 395 KBytes [ 5] 34.00-35.00 sec 5.00 MBytes 41.9 Mbits/sec 0 413 KBytes [ 5] 35.00-36.00 sec 5.00 MBytes 41.9 Mbits/sec 0 429 KBytes - minimal kernel tuning: net.core.default_qdisc = fq1 net.ipv4.tcp_congestion_control = bbr iperf3 -4 -c somewhere.go.ro -t 300 -b 0 -P 1 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 6.50 MBytes 54.6 Mbits/sec 588 623 KBytes [ 5] 1.00-2.00 sec 5.00 MBytes 41.9 Mbits/sec 116 637 KBytes [ 5] 2.00-3.00 sec 5.00 MBytes 41.9 Mbits/sec 71 645 KBytes [ 5] 3.00-4.00 sec 5.00 MBytes 41.9 Mbits/sec 53 591 KBytes [ 5] 4.00-5.00 sec 5.00 MBytes 41.9 Mbits/sec 73 591 KBytes [ 5] 5.00-6.00 sec 3.75 MBytes 31.5 Mbits/sec 63 648 KBytes [ 5] 6.00-7.00 sec 5.00 MBytes 41.9 Mbits/sec 171 645 KBytes [ 5] 7.00-8.00 sec 5.00 MBytes 42.0 Mbits/sec 138 692 KBytes [ 5] 8.00-9.00 sec 5.00 MBytes 41.9 Mbits/sec 122 640 KBytes [ 5] 9.00-10.00 sec 3.75 MBytes 31.4 Mbits/sec 221 645 KBytes [ 5] 10.00-11.00 sec 3.75 MBytes 31.5 Mbits/sec 122 541 KBytes [ 5] 11.00-12.00 sec 5.00 MBytes 41.9 Mbits/sec 1 591 KBytes [ 5] 12.00-13.00 sec 3.75 MBytes 31.5 Mbits/sec 64 514 KBytes [ 5] 13.00-14.00 sec 5.00 MBytes 41.9 Mbits/sec 102 648 KBytes [ 5] 14.00-15.00 sec 5.00 MBytes 41.9 Mbits/sec 61 645 KBytes [ 5] 15.00-16.00 sec 5.00 MBytes 41.9 Mbits/sec 38 596 KBytes [ 5] 16.00-17.00 sec 5.00 MBytes 41.9 Mbits/sec 63 593 KBytes [ 5] 17.00-18.00 sec 5.00 MBytes 41.9 Mbits/sec 49 593 KBytes [ 5] 18.00-19.00 sec 5.00 MBytes 41.9 Mbits/sec 40 593 KBytes [ 5] 19.00-20.00 sec 5.00 MBytes 41.9 Mbits/sec 74 632 KBytes [ 5] 20.00-21.00 sec 2.50 MBytes 21.0 Mbits/sec 147 623 KBytes [ 5] 21.00-22.00 sec 6.25 MBytes 52.5 Mbits/sec 48 670 KBytes [ 5] 22.00-23.00 sec 3.75 MBytes 31.5 Mbits/sec 77 656 KBytes [ 5] 23.00-24.00 sec 5.00 MBytes 41.9 Mbits/sec 64 643 KBytes [ 5] 24.00-25.00 sec 5.00 MBytes 42.0 Mbits/sec 115 645 KBytes [ 5] 25.00-26.00 sec 5.00 MBytes 41.9 Mbits/sec 70 604 KBytes [ 5] 26.00-27.00 sec 5.00 MBytes 41.9 Mbits/sec 113 442 KBytes [ 5] 27.00-28.00 sec 5.00 MBytes 41.9 Mbits/sec 40 602 KBytes [ 5] 28.00-29.00 sec 5.00 MBytes 41.9 Mbits/sec 78 662 KBytes [ 5] 29.00-30.00 sec 5.00 MBytes 41.9 Mbits/sec 42 684 KBytes [ 5] 30.00-31.00 sec 3.75 MBytes 31.5 Mbits/sec 427 5.47 KBytes [ 5] 31.00-32.00 sec 2.50 MBytes 21.0 Mbits/sec 160 689 KBytes [ 5] 32.00-33.00 sec 5.00 MBytes 41.9 Mbits/sec 222 405 KBytes [ 5] 33.00-34.00 sec 5.00 MBytes 42.0 Mbits/sec 48 656 KBytes [ 5] 34.00-35.00 sec 5.00 MBytes 41.9 Mbits/sec 88 684 KBytes [ 5] 35.00-36.00 sec 5.00 MBytes 42.0 Mbits/sec 238 436 KBytes now other way round site to home: - orangepioneplus ( kernel 5.10.4 ) net.core.default_qdisc = fq net.ipv4.tcp_congestion_control = bbr iperf3 -4 -c local.dynu.net -t 300 -b 0 -P 1 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 1.96 MBytes 16.4 Mbits/sec 0 120 KBytes [ 5] 1.00-2.00 sec 503 KBytes 4.12 Mbits/sec 0 107 KBytes [ 5] 2.00-3.00 sec 1006 KBytes 8.25 Mbits/sec 0 107 KBytes [ 5] 3.00-4.00 sec 503 KBytes 4.12 Mbits/sec 0 101 KBytes [ 5] 4.00-5.00 sec 1006 KBytes 8.24 Mbits/sec 0 98.4 KBytes [ 5] 5.00-6.00 sec 1006 KBytes 8.25 Mbits/sec 0 101 KBytes [ 5] 6.00-7.00 sec 503 KBytes 4.12 Mbits/sec 0 104 KBytes [ 5] 7.00-8.00 sec 1006 KBytes 8.25 Mbits/sec 0 101 KBytes [ 5] 8.00-9.00 sec 503 KBytes 4.12 Mbits/sec 0 98.4 KBytes [ 5] 9.00-10.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 10.00-11.00 sec 503 KBytes 4.12 Mbits/sec 0ipe 98.4 KBytes [ 5] 11.00-12.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 12.00-13.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 13.00-14.00 sec 503 KBytes 4.12 Mbits/sec 0 98.4 KBytes [ 5] 14.00-15.00 sec 503 KBytes 4.12 Mbits/sec 0 5.47 KBytes [ 5] 15.00-16.00 sec 1006 KBytes 8.25 Mbits/sec 0 109 KBytes [ 5] 16.00-17.00 sec 503 KBytes 4.12 Mbits/sec 0 107 KBytes [ 5] 17.00-18.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 18.00-19.00 sec 503 KBytes 4.12 Mbits/sec 0 98.4 KBytes [ 5] 19.00-20.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 20.00-21.00 sec 1006 KBytes 8.25 Mbits/sec 0 109 KBytes [ 5] 21.00-22.00 sec 503 KBytes 4.12 Mbits/sec 0 109 KBytes [ 5] 22.00-23.00 sec 1006 KBytes 8.25 Mbits/sec 0 107 KBytes [ 5] 23.00-24.00 sec 503 KBytes 4.12 Mbits/sec 0 104 KBytes [ 5] 24.00-25.00 sec 1006 KBytes 8.25 Mbits/sec 0 101 KBytes [ 5] 25.00-26.00 sec 1006 KBytes 8.25 Mbits/sec 0 104 KBytes [ 5] 26.00-27.00 sec 503 KBytes 4.12 Mbits/sec 0 107 KBytes [ 5] 27.00-28.00 sec 1006 KBytes 8.25 Mbits/sec 0 112 KBytes [ 5] 28.00-29.00 sec 503 KBytes 4.12 Mbits/sec 0 104 KBytes [ 5] 29.00-30.00 sec 1006 KBytes 8.25 Mbits/sec 0 101 KBytes [ 5] 30.00-31.00 sec 503 KBytes 4.12 Mbits/sec 0 101 KBytes [ 5] 31.00-32.00 sec 1006 KBytes 8.25 Mbits/sec 0 109 KBytes [ 5] 32.00-33.00 sec 503 KBytes 4.12 Mbits/sec 0 98.4 KBytes [ 5] 33.00-34.00 sec 1006 KBytes 8.25 Mbits/sec 0 112 KBytes [ 5] 34.00-35.00 sec 1006 KBytes 8.24 Mbits/sec 0 107 KBytes [ 5] 35.00-36.00 sec 503 KBytes 4.12 Mbits/sec 0 109 KBytes net.core.default_qdisc = fq net.ipv4.tcp_congestion_control = westwood iperf3 -4 -c local.dynu.net -t 300 -b 0 -P 1 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 28.0 MBytes 235 Mbits/sec 0 6.29 MBytes [ 5] 1.00-2.00 sec 17.5 MBytes 147 Mbits/sec 1672 1.06 MBytes [ 5] 2.00-3.00 sec 13.8 MBytes 115 Mbits/sec 124 937 KBytes [ 5] 3.00-4.00 sec 18.8 MBytes 157 Mbits/sec 0 962 KBytes [ 5] 4.00-5.00 sec 17.5 MBytes 147 Mbits/sec 0 987 KBytes [ 5] 5.00-6.00 sec 20.0 MBytes 168 Mbits/sec 0 1014 KBytes [ 5] 6.00-7.00 sec 17.5 MBytes 147 Mbits/sec 71 518 KBytes [ 5] 7.00-8.00 sec 18.8 MBytes 157 Mbits/sec 0 956 KBytes [ 5] 8.00-9.00 sec 17.5 MBytes 147 Mbits/sec 0 983 KBytes [ 5] 9.00-10.00 sec 17.5 MBytes 147 Mbits/sec 40 916 KBytes [ 5] 10.00-11.00 sec 16.2 MBytes 136 Mbits/sec 0 941 KBytes [ 5] 11.00-12.00 sec 18.8 MBytes 157 Mbits/sec 0 967 KBytes [ 5] 12.00-13.00 sec 18.8 MBytes 157 Mbits/sec 0 994 KBytes [ 5] 13.00-14.00 sec 16.2 MBytes 136 Mbits/sec 54 921 KBytes [ 5] 14.00-15.00 sec 17.5 MBytes 147 Mbits/sec 0 947 KBytes [ 5] 15.00-16.00 sec 18.8 MBytes 157 Mbits/sec 0 973 KBytes [ 5] 16.00-17.00 sec 16.2 MBytes 136 Mbits/sec 36 897 KBytes [ 5] 17.00-18.00 sec 17.5 MBytes 147 Mbits/sec 0 923 KBytes [ 5] 18.00-19.00 sec 17.5 MBytes 147 Mbits/sec 0 950 KBytes [ 5] 19.00-20.00 sec 18.8 MBytes 157 Mbits/sec 0 975 KBytes [ 5] 20.00-21.00 sec 18.8 MBytes 157 Mbits/sec 0 1002 KBytes [ 5] 21.00-22.00 sec 16.2 MBytes 136 Mbits/sec 71 927 KBytes [ 5] 22.00-23.00 sec 17.5 MBytes 147 Mbits/sec 0 952 KBytes [ 5] 23.00-24.00 sec 18.8 MBytes 157 Mbits/sec 0 979 KBytes [ 5] 24.00-25.00 sec 16.2 MBytes 136 Mbits/sec 43 906 KBytes [ 5] 25.00-26.00 sec 17.5 MBytes 147 Mbits/sec 0 932 KBytes [ 5] 26.00-27.00 sec 18.8 MBytes 157 Mbits/sec 0 958 KBytes [ 5] 27.00-28.00 sec 17.5 MBytes 147 Mbits/sec 0 984 KBytes [ 5] 28.00-29.00 sec 17.5 MBytes 147 Mbits/sec 53 913 KBytes [ 5] 29.00-30.00 sec 17.5 MBytes 147 Mbits/sec 0 939 KBytes [ 5] 30.00-31.00 sec 17.5 MBytes 147 Mbits/sec 0 965 KBytes [ 5] 31.00-32.00 sec 17.5 MBytes 147 Mbits/sec 0 990 KBytes [ 5] 32.00-33.00 sec 17.5 MBytes 147 Mbits/sec 68 905 KBytes [ 5] 33.00-34.00 sec 17.5 MBytes 147 Mbits/sec 0 931 KBytes [ 5] 34.00-35.00 sec 18.8 MBytes 157 Mbits/sec 0 957 KBytes [ 5] 35.00-36.00 sec 17.5 MBytes 147 Mbits/sec 0 983 KBytes once more now local to site ( r4s to site ) net.core.default_qdisc = fq net.ipv4.tcp_congestion_control = westwood [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 6.46 MBytes 54.1 Mbits/sec 430 58.8 KBytes [ 5] 1.00-2.00 sec 1.25 MBytes 10.5 Mbits/sec 0 82.0 KBytes [ 5] 2.00-3.00 sec 1.25 MBytes 10.5 Mbits/sec 0 107 KBytes [ 5] 3.00-4.00 sec 2.50 MBytes 21.0 Mbits/sec 0 131 KBytes [ 5] 4.00-5.00 sec 2.50 MBytes 21.0 Mbits/sec 0 154 KBytes [ 5] 5.00-6.00 sec 2.50 MBytes 21.0 Mbits/sec 0 179 KBytes [ 5] 6.00-7.00 sec 2.50 MBytes 21.0 Mbits/sec 0 202 KBytes [ 5] 7.00-8.00 sec 3.75 MBytes 31.5 Mbits/sec 0 227 KBytes [ 5] 8.00-9.00 sec 5.00 MBytes 42.0 Mbits/sec 0 250 KBytes [ 5] 9.00-10.00 sec 3.75 MBytes 31.5 Mbits/sec 0 275 KBytes [ 5] 10.00-11.00 sec 5.00 MBytes 41.9 Mbits/sec 0 297 KBytes [ 5] 11.00-12.00 sec 5.00 MBytes 41.9 Mbits/sec 0 319 KBytes [ 5] 12.00-13.00 sec 5.00 MBytes 41.9 Mbits/sec 0 339 KBytes [ 5] 13.00-14.00 sec 3.75 MBytes 31.5 Mbits/sec 0 358 KBytes [ 5] 14.00-15.00 sec 5.00 MBytes 41.9 Mbits/sec 0 376 KBytes [ 5] 15.00-16.00 sec 5.00 MBytes 41.9 Mbits/sec 0 394 KBytes [ 5] 16.00-17.00 sec 5.00 MBytes 41.9 Mbits/sec 0 410 KBytes [ 5] 17.00-18.00 sec 5.00 MBytes 41.9 Mbits/sec 0 427 KBytes [ 5] 18.00-19.00 sec 5.00 MBytes 41.9 Mbits/sec 0 442 KBytes [ 5] 19.00-20.00 sec 5.00 MBytes 41.9 Mbits/sec 0 457 KBytes [ 5] 20.00-21.00 sec 3.75 MBytes 31.5 Mbits/sec 25 235 KBytes [ 5] 21.00-22.00 sec 5.00 MBytes 41.9 Mbits/sec 0 260 KBytes [ 5] 22.00-23.00 sec 3.75 MBytes 31.5 Mbits/sec 0 283 KBytes [ 5] 23.00-24.00 sec 5.00 MBytes 41.9 Mbits/sec 0 306 KBytes [ 5] 24.00-25.00 sec 5.00 MBytes 41.9 Mbits/sec 0 328 KBytes [ 5] 25.00-26.00 sec 5.00 MBytes 41.9 Mbits/sec 0 347 KBytes [ 5] 26.00-27.00 sec 5.00 MBytes 41.9 Mbits/sec 0 366 KBytes [ 5] 27.00-28.00 sec 5.00 MBytes 41.9 Mbits/sec 0 384 KBytes [ 5] 28.00-29.00 sec 3.75 MBytes 31.4 Mbits/sec 0 401 KBytes [ 5] 29.00-30.00 sec 5.00 MBytes 41.9 Mbits/sec 0 417 KBytes [ 5] 30.00-31.00 sec 5.00 MBytes 41.9 Mbits/sec 0 433 KBytes [ 5] 31.00-32.00 sec 5.00 MBytes 41.9 Mbits/sec 0 448 KBytes [ 5] 32.00-33.00 sec 5.00 MBytes 41.9 Mbits/sec 0 463 KBytes [ 5] 33.00-34.00 sec 5.00 MBytes 41.9 Mbits/sec 29 243 KBytes [ 5] 34.00-35.00 sec 3.75 MBytes 31.5 Mbits/sec 0 268 KBytes [ 5] 35.00-36.00 sec 5.00 MBytes 41.9 Mbits/sec 0 291 KBytes this is directly over Internet, thus no VPN yet. I really wonder what is going on as using H5/H6 allwinners give horrific results. why uploading on the allwinner platform is limited ( though 150Mbit is fine with me )
dolphs Posted January 25, 2021 Posted January 25, 2021 tried my rockpi4a , similar results ( bad ) as H5 and H6. Once switched to legacy 4.4 kernel, things rock and faster results again. really wonder what is causing this: patch, kernel realtek driver, both / something else : lost?!
dolphs Posted May 26, 2021 Posted May 26, 2021 bumped my OpiOnePlus H6 boards to kernel 5.12 and surprise surprise , BBR is working as it should again ... I really wonder what was causing this as in kernel 5.10 and 11 I had to use westwood ( with cake )... net.core.default_qdisc = fq net.ipv4.tcp_congestion_control = bbr shows 250Mbit ( meanwhile line upgraded which is max upload speed ) root@vpn01:~# iperf3 -4 -c 192.168.10.2 -t 300 -b0 -P1 Connecting to host 192.168.10.2, port 5201 [ 5] local 192.168.20.2 port 47462 connected to 192.168.10.2 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 28.4 MBytes 238 Mbits/sec 0 7.71 MBytes [ 5] 1.00-2.00 sec 35.0 MBytes 294 Mbits/sec 1789 1.81 MBytes [ 5] 2.00-3.00 sec 26.2 MBytes 220 Mbits/sec 3780 1.96 MBytes [ 5] 3.00-4.00 sec 30.0 MBytes 252 Mbits/sec 3389 1.66 MBytes [ 5] 4.00-5.00 sec 27.5 MBytes 231 Mbits/sec 4158 2.27 MBytes [ 5] 5.00-6.00 sec 28.8 MBytes 241 Mbits/sec 2252 5.84 MBytes [ 5] 6.00-7.00 sec 30.0 MBytes 252 Mbits/sec 2507 5.85 MBytes [ 5] 7.00-8.00 sec 26.2 MBytes 220 Mbits/sec 3921 2.12 MBytes [ 5] 8.00-9.00 sec 30.0 MBytes 252 Mbits/sec 2773 5.94 MBytes [ 5] 9.00-10.00 sec 27.4 MBytes 230 Mbits/sec 3675 2.02 MBytes [ 5] 10.00-11.00 sec 28.8 MBytes 241 Mbits/sec 3512 1.88 MBytes ^C[ 5] 11.00-11.22 sec 7.50 MBytes 289 Mbits/sec 319 2.68 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-11.22 sec 326 MBytes 244 Mbits/sec 32075 sender
Tido Posted May 27, 2021 Posted May 27, 2021 22 hours ago, dolphs said: bumped my OpiOnePlus H6 boards to kernel 5.12 and surprise surprise All your post may need more formatting changes. Tips: use spoiler when adding a long text
Recommended Posts