AaronNGray

@Igor @amazingfate I would appreciate a fix or any guidance on this issue please.

With Debian Bookworm on BananaPi-M7 when Viewsonic VX3276-2K-MHD WQHD 2560x1440 the display is the wrong resolution only supporting upto 1920x1080 or 2560x1080 for ViewSonic 32” monitor config. It also fails to resync when turned off and on again or another source is selected on and the BPi-M7 is reselected, resulting in a flickering white backgound. Armbian_25.2.1_Bananapim7_bookworm_vendor_6.1.99_xfce_desktop.img with apt-get update & apt-get upgrade Armbian 25.2.3 bookworm 12 Linux bananapim7 6.1.99-vendor-rk35xx Ubuntu works fine and supports the Viewsonic VX3276-2K-MHD WQHD on 2560x1440 for this but has a display area issue when changing the scaling where 3/4 of the screen is black on x2. I will file this separately. Armbian_25.2.1_Bananapim7_noble_current_6.12.13_xfce_desktop.img with apt-get update & apt-get upgrade Armbian 25.2.3 noble 24.04 https://armbian.atlassian.net/jira/software/c/projects/AR/issues/AR-2641?jql=project %3D "AR" ORDER BY created DESC

No new firmware updates, so ordered WD Blue SN580 2TB SSD, which is now working fine and has been soak tested over night and is running fine. My next issue is finding the right kernel. I would still like to use Debian if possible as well.

Okay, feeling very stupid now, sorry for so much noise ! I tried a different SSD - SK Hynix HFS256GD9TNG-L2A0A BA and its working perfectly passing the fio 20 minute test. The new out of the box Samsung 970 Plus NVMe seems to be faulty ! The Samsung is giving the following :- ``` $ sudo smartctl --all /dev/nvme0n1 [smartctl 7.4 2023-08-01 r5530 [aarch64-linux-6.1.75-vendor-rk35xx] (local build) Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number: Samsung SSD 970 EVO Plus 2TB Serial Number: S6P1NF0WA20535R Firmware Version: 4B2QEXM7 PCI Vendor/Subsystem ID: 0x144d IEEE OUI Identifier: 0x002538 Total NVM Capacity: 2,000,398,934,016 [2.00 TB] Unallocated NVM Capacity: 0 Controller ID: 6 NVMe Version: 1.3 Number of Namespaces: 1 Namespace 1 Size/Capacity: 2,000,398,934,016 [2.00 TB] Namespace 1 Utilization: 38,269,112,320 [38.2 GB] Namespace 1 Formatted LBA Size: 512 Namespace 1 IEEE EUI-64: 002538 5a31b1287c Local Time is: Tue Dec 10 00:54:31 2024 GMT Firmware Updates (0x16): 3 Slots, no Reset required Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test Optional NVM Commands (0x0057): Comp Wr_Unc DS_Mngmt Sav/Sel_Feat Timestmp Log Page Attributes (0x0f): S/H_per_NS Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Maximum Data Transfer Size: 128 Pages Warning Comp. Temp. Threshold: 82 Celsius Critical Comp. Temp. Threshold: 85 Celsius Supported Power States St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat 0 + 7.59W - - 0 0 0 0 0 0 1 + 7.59W - - 1 1 1 1 0 200 2 + 7.59W - - 2 2 2 2 0 1000 3 - 0.0500W - - 3 3 3 3 2000 1200 4 - 0.0050W - - 4 4 4 4 500 9500 Supported LBA Sizes (NSID 0x1) Id Fmt Data Metadt Rel_Perf 0 + 512 0 0 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 29 Celsius Available Spare: 100% Available Spare Threshold: 10% Percentage Used: 0% Data Units Read: 8,405 [4.30 GB] Data Units Written: 272,389 [139 GB] Host Read Commands: 103,937 Host Write Commands: 621,088 Controller Busy Time: 3 Power Cycles: 372 Power On Hours: 25 Unsafe Shutdowns: 339 Media and Data Integrity Errors: 0 Error Information Log Entries: 0 Warning Comp. Temperature Time: 0 Critical Comp. Temperature Time: 0 Temperature Sensor 1: 29 Celsius Temperature Sensor 2: 36 Celsius Error Information (NVMe Log 0x01, 16 of 64 entries) No Errors Logged Read Self-test Log failed: Invalid Field in Command (0x002) ``` I will try updating the firmware.

@amazingfate You need to try at least 10 minutes initially for the fault to occur.

@eselarm I have several Samsung 970 EVO Plus NVMe M.2 SSD'a :- https://www.samsung.com/uk/memory-storage/nvme-ssd/970-evo-plus-nvme-m-2-ssd-2tb-mz-v7s2t0bw/ I also have an old SK Hynix HFS256GD9TNG-L2A0A BA I will test with once its backed up. Can people please give what make of M.2 NVMe they are using with the RK3588 SBC's please ?

@amazingfate I have a v1.1 board which seems to be the most common version AFAICT

@going Not sure but the NVMe might be the common factor.

@eselarm I have several Samsung 970 EVO Plus NVMe M.2 SSD'a :- https://www.samsung.com/uk/memory-storage/nvme-ssd/970-evo-plus-nvme-m-2-ssd-2tb-mz-v7s2t0bw/ I also have an old SK Hynix HFS256GD9TNG-L2A0A BA I will test with.

@amazingfate Would you look on your board to see if there is any sign of a version number or any other codes on it please ? Also, would you mind either giving a link or uploading your OS image to Google Drive so I can try running it please ? I will take my board out of its case and examine it properly first thing tomorrow. Thank you for all your help !

Armbian 24.11.1 Ubuntu Nobel Gnome - BananaPi-M7 $ uname -a Linux bananapim7 6.1.75-vendor-rk35xx #1 SMP Tue Nov 12 08:48:32 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux $ sudo fio --name=randwrite --ioengine=sync --rw=write --bs=4k --numjobs=1 --size=1G --runtime=120s --time_based --directory=/mnt/nvme0n1p1 randwrite: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1 fio-3.36 Starting 1 process Jobs: 1 (f=1): [W(1)][100.0%][w=932MiB/s][w=239k IOPS][eta 00m:00s] randwrite: (groupid=0, jobs=1): err= 0: pid=5992: Mon Dec 9 23:30:24 2024 write: IOPS=161k, BW=628MiB/s (659MB/s)(74.0GiB/120602msec); 0 zone resets clat (usec): min=3, max=484604, avg= 4.52, stdev=419.98 lat (usec): min=3, max=484605, avg= 4.61, stdev=419.98 clat percentiles (nsec): | 1.00th=[ 3504], 5.00th=[ 3504], 10.00th=[ 3504], 20.00th=[ 3504], | 30.00th=[ 3792], 40.00th=[ 3792], 50.00th=[ 3792], 60.00th=[ 3792], | 70.00th=[ 3792], 80.00th=[ 4080], 90.00th=[ 4640], 95.00th=[ 4640], | 99.00th=[ 6432], 99.50th=[ 8160], 99.90th=[11712], 99.95th=[13376], | 99.99th=[19584] bw ( KiB/s): min= 3848, max=991048, per=100.00%, avg=663199.83, stdev=303212.13, samples=234 iops : min= 962, max=247762, avg=165799.98, stdev=75803.01, samples=234 lat (usec) : 4=77.06%, 10=22.68%, 20=0.25%, 50=0.01%, 100=0.01% lat (usec) : 250=0.01%, 500=0.01%, 750=0.01% lat (msec) : 4=0.01%, 10=0.01%, 50=0.01%, 100=0.01%, 250=0.01% lat (msec) : 500=0.01% cpu : usr=11.32%, sys=79.07%, ctx=41238, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,19398657,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): WRITE: bw=628MiB/s (659MB/s), 628MiB/s-628MiB/s (659MB/s-659MB/s), io=74.0GiB (79.5GB), run=120602-120602msec $ sudo fio --name=randwrite --ioengine=sync --rw=write --bs=4k --numjobs=1 --size=1G --runtime=600s --time_based --directory=/mnt/nvme0n1p1 randwrite: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1 fio-3.36 Starting 1 process fio: io_u error on file /mnt/nvme0n1p1/randwrite.0.0: Input/output error: write offset=0, buflen=4096 fio: pid=6257, err=5/file:io_u.c:1896, func=io_u error, error=Input/output error randwrite: (groupid=0, jobs=1): err= 5 (file:io_u.c:1896, func=io_u error, error=Input/output error): pid=6257: Mon Dec 9 23:38:19 2024 write: IOPS=37.5k, BW=146MiB/s (154MB/s)(6144MiB/41945msec); 0 zone resets clat (usec): min=3, max=354943, avg= 4.95, stdev=494.19 lat (usec): min=3, max=354944, avg= 5.05, stdev=494.19 clat percentiles (nsec): | 1.00th=[ 3504], 5.00th=[ 3504], 10.00th=[ 3504], 20.00th=[ 3504], | 30.00th=[ 3792], 40.00th=[ 3792], 50.00th=[ 3792], 60.00th=[ 3792], | 70.00th=[ 4384], 80.00th=[ 4640], 90.00th=[ 4960], 95.00th=[ 5856], | 99.00th=[ 8160], 99.50th=[11328], 99.90th=[21120], 99.95th=[24960], | 99.99th=[36096] bw ( KiB/s): min=44894, max=943952, per=100.00%, avg=599182.00, stdev=308987.51, samples=21 iops : min=11223, max=235988, avg=149795.48, stdev=77246.82, samples=21 lat (usec) : 4=62.59%, 10=36.72%, 20=0.57%, 50=0.11%, 100=0.01% lat (usec) : 500=0.01%, 750=0.01% lat (msec) : 500=0.01% cpu : usr=2.61%, sys=19.77%, ctx=79, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,1572865,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): WRITE: bw=146MiB/s (154MB/s), 146MiB/s-146MiB/s (154MB/s-154MB/s), io=6144MiB (6442MB), run=41945-41945msec Still getting the same issue : ( @amazingfate I am wondering since the sige7 seems AFAICT to be produced by SINOVOiP BPi as theres a BPi logo on one I have seen that this maybe a board version issue ? https://www.armsom.org/sige7

The BananaPi-M7 NVMe issue is in the original Ubuntu Desktop 22.04.3 v5.10.160 kernel 5.release from Armbian too, detectable with fio.

Hi @Igor just to let you know what I am actually after a headless target machine with 32GB of RAM and 1/2 TB of NVMe SSD. The only reason I wanted a GUI and Browser was for easy reporting for state. To fill you in I am actually trying to get a Green low power ARM solution for a number of Climate Change related projects from serving websites, social media system, and also a dedicated crawler and search engine for scientific fields. I have been using Debian since 2017 on BananaPi-M3's, before then two pairs of dual rsync'ed Fujitsu-Siemens Primergy 470 then separately dual rync'ed HP DL 140 G3's servers from 2006 RedHat Fedora Core 4 to Fedora 22 in 2016. I had 36 hours of downtime due to internet outages and a power outage, and one hour which was my fault

@amazingfate This is failing repeatedly indeterminately on 6.1.84-vendor-rk35xx on my build of Armbian Debian on BananaPi-M7.

@eselarm @Igor Unfortunaely on BananPi-M7 a self built Linux bananapim7 6.1.84-vendor-rk35xx kernel still has PCIe M2 NVMe stability issues when running `stress --verbose --hdd 4` after a period on 5 or so minutes. @amazingfate Can you please run a `stress --verbose --hdd 4` for 20 minutes just to verify the sige7 is stable. If so I might get one myself. @going I would much appreciate your input on this. The USB C monitoring device I got does not have minimums only maximums so its very hard to gain any useful information from it. Even with monitioring using a test meter with minimums valid minimums are hard to obtain. Ideally a separate RPi I2C monitoring device is required to know what is going on. Armbian Debian seems very unstable especially at startup or with FireFox tabs dying on startup and Chromium not even starting up. Building a 6.1.84-vendor-rk35xx and 6.12.2 Ubuntu Nobel builds for further testing...

@going I am testing the Kernel and the PCIe M2 controller. THe NVME is fine and will not suffer from these number of rewrites.

I turned off the errors readonly mode off in `/etc/fstab` and its running along the stress --verbose --hdd 4` test as suspected. I am wondering if errors can be detected and acted upon in a different manor by the filing system ? I may try btrfs as amother test when I can do so.

@Igor It would be lovely to have temperature monitoring on the System Monitor Resources page !

@eselarm Many thanks I will follow these leads up either tomorrow if I get time or next week if not. https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/6/html/power_management_guide/aspm Okay I need to try 6.1.84-vendor then ! Ordered a USB-C PD analyser, many thanks !

$ uname -a Linux bananapim7 6.1.75-vendor-rk35xx #1 SMP Tue Nov 12 08:48:32 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux

I have run CPU stress tests starting at 33.3 degrees C, with 5V (12V) fan on top of metal case. `stress --cpu 4` stabalizing at 55.4 degrees C and `stress --cpu 8` reachiing 57.3 degrees C, with a fan on top of the device and watched the loading and temperature with `armbianmonitor -m` and it seems quite stable. Now have run `stress --verbose --hdd 1` for 20 minutes so far reaching 45.3 degrees C, stabalizing a 44.4 degrees C. run `stress --verbose --hdd 2` for 20 minutes so far rising to 56.4 degrees C, CPU clk 1800/2352 MHz, load about 2.63 max. Waiting for temperature to reduce to 33 degrees C then runnig `stress --verbose --hdd 4` `stress --verbose --hdd 4` is sky rocketting in 5 minutes temperature hitting 62.8 degrees C, CPU clk 1800/2352 MHz, load about 5.00 max. Okay fallen over after 8 minutes, inconclusive results as a result : ( I rerun this test, okay its not temperature it time and load as is susspected, but load and temperature are also a crashing factor for the BananaPi-M7. I would like to monitor the temperature of the NVME. Need to take in to account loading and kernel versions ....., I was getting this happen in less than 5 minutes on Bookworm without a GUI with `stress --hdd 4` I cannot seem to do a select all or highlight more than a pages worth of console text on Gnome, otherwise I would have provided detailed results. This process and instrumentation would be good to automate. I got some DS18B20 TO92 Digital Temperature Sensors which I would like to be able to write a script to enable internal and external case monitoring. I need to run this on debian again but need a GUI to perform the tests without writing a script to combine `stress` and `armbianmonitor -m` Do we have a kernel version that was though to be stable ? Also it might be worth looking at OrangePi 5 and see what results that community is getting.

@Igor Either a databsae or even just a wiki page for each board/device with tables for OS, release, kernel and support would go some way to satisfying this requirement.

I am trying Armbian 24.11.1 Noble Gnome - MESA / VPU - Kernel: 6.1.75, Size: 1.4 GB, Release date: Nov 17, 2024 armbianmonitor -u - https://paste.next.armbian.com/bakevuvuya Install onto eMMC using armbian-install Device seems to be overheating, as I had a failed boot, untill I put a 5V (of 12V) fan ontop. I have found this in the past running `stress`. armbianmonitor -u - https://paste.next.armbian.com/sitakelipu I am getting on both `armbianmonitor -u` 's a "Failed grabbing info (pipe 3 result 22) and sending to server paste.armbian.com `lsblk -a` is not showing the nvme !!! rebooting its there !!! `sudo armbian-install` is hanging before display comes up, and now 'lsblk -a` is not displaying the NVME ! rebooting eMMC allowed me to see the NVME. so continuing... `df` shows Armbian 24.11.1 Noble Gnome, launched on NVME as `/` ! armbianmonitor -u - https://paste.next.armbian.com/pekoxalapo `stress --verbose --hdd 1` ran for 9 minutes befor failing and creating readonly fs.

@going yes hopefully I will get round to doing this stage. I was a low level programmer but never mastered the Linux Kernel other than the basics. Hopefully I can act as a tester and we can get this thing moving forward.

@Igor Its a shame there was not a public record of this. I saw the https://www.armbian.com/bananapi-m7/ page, looked at the Armbian forum for issues, saw none and presumed the board was okay. We should really have detailed uptodate reports on all boards.