antsu Posted March 27, 2021 Posted March 27, 2021 I was trying to avoid opening a new instability topic, but this one seems different enough from the others to deserve it's own discussion. A few days ago I applied the 1G fix (pic attached) to the 2.5G port - which was not in use until then, since all my hardware is 1G max. I did this with the intention of using both ports: the 1G port goes to an isolated VLAN that serves VM images to my Proxmox hosts, and the 2.5G interface (running at 1G speed) serves files to the rest of my network. While the fix appears to work and the port is able to communicate at 1G speeds seemingly fine, after changing to this setup I'm experiencing frequent drops in the USB bus, which causes both the 2.5G port and my USB HDD (which has its own PSU) to disconnect, requiring a reboot to regain connectivity. When this happens, I get these messages in dmesg: [48657.415910] xhci-hcd xhci-hcd.0.auto: xHCI host not responding to stop endpoint command. [48657.415930] xhci-hcd xhci-hcd.0.auto: USBSTS: [48657.429522] xhci-hcd xhci-hcd.0.auto: xHCI host controller not responding, assume dead [48657.429604] xhci-hcd xhci-hcd.0.auto: HC died; cleaning up [48657.429952] r8152 4-1.4:1.0 eth1: Stop submitting intr, status -108 [48657.430068] r8152 4-1.4:1.0 eth1: get_registers -110 [48657.430193] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430223] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430241] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430262] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430327] usb 3-1: USB disconnect, device number 2 [48657.431551] usb 4-1: USB disconnect, device number 2 [48657.431572] usb 4-1.1: USB disconnect, device number 3 [48657.467516] usb 4-1.4: USB disconnect, device number 4 The problem seems to manifest more quickly if I push more data through that interface. I'm running a clean (new) install of Armbian 21.02.3, with OMV and ZFS. Full dmesg and boot log below. Spoiler [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034] [ 0.000000] Linux version 5.10.21-rockchip64 (root@hirsute) (aarch64-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 8.3-2019.03 (arm-rel-8.36)) 8.3.0, GNU ld (GNU Toolchain for the A-profile Architecture 8.3-2019.03 (arm-rel-8.36)) 2.32.0.20190321) #21.02.3 SMP PREEMPT Mon Mar 8 01:05:08 UTC 2021 [ 0.000000] Machine model: Helios64 [ 0.000000] efi: UEFI not found. [ 0.000000] cma: Reserved 128 MiB at 0x00000000ecc00000 [ 0.000000] NUMA: No NUMA configuration found [ 0.000000] NUMA: Faking a node at [mem 0x0000000000200000-0x00000000f7ffffff] [ 0.000000] NUMA: NODE_DATA [mem 0xf77d9100-0xf77dafff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000200000-0x000000003fffffff] [ 0.000000] DMA32 [mem 0x0000000040000000-0x00000000f7ffffff] [ 0.000000] Normal empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000200000-0x00000000f7ffffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000000200000-0x00000000f7ffffff] [ 0.000000] On node 0 totalpages: 1015296 [ 0.000000] DMA zone: 4088 pages used for memmap [ 0.000000] DMA zone: 0 pages reserved [ 0.000000] DMA zone: 261632 pages, LIFO batch:63 [ 0.000000] DMA32 zone: 11776 pages used for memmap [ 0.000000] DMA32 zone: 753664 pages, LIFO batch:63 [ 0.000000] psci: probing for conduit method from DT. [ 0.000000] psci: PSCIv1.0 detected in firmware. [ 0.000000] psci: Using standard PSCI v0.2 function IDs [ 0.000000] psci: MIGRATE_INFO_TYPE not supported. [ 0.000000] psci: SMC Calling Convention v1.0 [ 0.000000] percpu: Embedded 32 pages/cpu s94040 r8192 d28840 u131072 [ 0.000000] pcpu-alloc: s94040 r8192 d28840 u131072 alloc=32*4096 [ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [ 0.000000] Detected VIPT I-cache on CPU0 [ 0.000000] CPU features: detected: ARM erratum 845719 [ 0.000000] CPU features: detected: GIC system register CPU interface [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 999432 [ 0.000000] Policy zone: DMA32 [ 0.000000] Kernel command line: root=UUID=c559a861-be25-4b41-a161-d0c3d75c0089 rootwait rootfstype=ext4 console=ttyS2,1500000 console=tty1 consoleblank=0 loglevel=1 ubootpart=559a8d18-01 usb-storage.quirks=0x2537:0x1066:u,0x2537:0x1068:u,0x1058:0x25a3:u cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory swapaccount=1 [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 0.000000] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.000000] software IO TLB: mapped [mem 0x000000003bfff000-0x000000003ffff000] (64MB) [ 0.000000] Memory: 3739360K/4061184K available (14848K kernel code, 2632K rwdata, 5972K rodata, 4352K init, 580K bss, 190752K reserved, 131072K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=6, Nodes=1 [ 0.000000] rcu: Preemptible hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=6. [ 0.000000] Trampoline variant of Tasks RCU enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=6 [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 [ 0.000000] GICv3: GIC: Using split EOI/Deactivate mode [ 0.000000] GICv3: 256 SPIs implemented [ 0.000000] GICv3: 0 Extended SPIs implemented [ 0.000000] GICv3: Distributor has no Range Selector support [ 0.000000] GICv3: 16 PPIs implemented [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000fef00000 [ 0.000000] ITS [mem 0xfee20000-0xfee3ffff] [ 0.000000] ITS@0x00000000fee20000: allocated 65536 Devices @40100000 (flat, esz 8, psz 64K, shr 0) [ 0.000000] ITS: using cache flushing for cmd queue [ 0.000000] GICv3: using LPI property table @0x00000000400d0000 [ 0.000000] GIC: using cache flushing for LPI property table [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x00000000400e0000 [ 0.000000] GICv3: GIC: PPI partition interrupt-partition-0[0] { /cpus/cpu@0[0] /cpus/cpu@1[1] /cpus/cpu@2[2] /cpus/cpu@3[3] } [ 0.000000] GICv3: GIC: PPI partition interrupt-partition-1[1] { /cpus/cpu@100[4] /cpus/cpu@101[5] } [ 0.000000] random: get_random_bytes called from start_kernel+0x698/0x850 with crng_init=0 [ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (phys). [ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns [ 0.000007] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns [ 0.001519] Console: colour dummy device 80x25 [ 0.001587] printk: console [tty1] enabled [ 0.001719] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=96000) [ 0.001741] pid_max: default: 32768 minimum: 301 [ 0.001908] LSM: Security Framework initializing [ 0.001950] Yama: becoming mindful. [ 0.002095] AppArmor: AppArmor initialized [ 0.002198] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) [ 0.002231] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) [ 0.005942] rcu: Hierarchical SRCU implementation. [ 0.007121] Platform MSI: interrupt-controller@fee20000 domain created [ 0.007775] PCI/MSI: /interrupt-controller@fee00000/interrupt-controller@fee20000 domain created [ 0.010316] EFI services will not be available. [ 0.011034] smp: Bringing up secondary CPUs ... [ 0.012211] Detected VIPT I-cache on CPU1 [ 0.012262] GICv3: CPU1: found redistributor 1 region 0:0x00000000fef20000 [ 0.012282] GICv3: CPU1: using allocated LPI pending table @0x00000000400f0000 [ 0.012360] CPU1: Booted secondary processor 0x0000000001 [0x410fd034] [ 0.013787] Detected VIPT I-cache on CPU2 [ 0.013838] GICv3: CPU2: found redistributor 2 region 0:0x00000000fef40000 [ 0.013858] GICv3: CPU2: using allocated LPI pending table @0x0000000040180000 [ 0.013935] CPU2: Booted secondary processor 0x0000000002 [0x410fd034] [ 0.015392] Detected VIPT I-cache on CPU3 [ 0.015442] GICv3: CPU3: found redistributor 3 region 0:0x00000000fef60000 [ 0.015463] GICv3: CPU3: using allocated LPI pending table @0x0000000040190000 [ 0.015540] CPU3: Booted secondary processor 0x0000000003 [0x410fd034] [ 0.016971] CPU features: detected: Spectre-v2 [ 0.016979] CPU features: detected: Spectre-v4 [ 0.016984] CPU features: detected: ARM errata 1165522, 1319367, or 1530923 [ 0.016992] Detected PIPT I-cache on CPU4 [ 0.017029] GICv3: CPU4: found redistributor 100 region 0:0x00000000fef80000 [ 0.017044] GICv3: CPU4: using allocated LPI pending table @0x00000000401a0000 [ 0.017093] CPU4: Booted secondary processor 0x0000000100 [0x410fd082] [ 0.018365] Detected PIPT I-cache on CPU5 [ 0.018404] GICv3: CPU5: found redistributor 101 region 0:0x00000000fefa0000 [ 0.018419] GICv3: CPU5: using allocated LPI pending table @0x00000000401b0000 [ 0.018469] CPU5: Booted secondary processor 0x0000000101 [0x410fd082] [ 0.018652] smp: Brought up 1 node, 6 CPUs [ 0.018681] SMP: Total of 6 processors activated. [ 0.018694] CPU features: detected: 32-bit EL0 Support [ 0.018705] CPU features: detected: CRC32 instructions [ 0.018716] CPU features: detected: 32-bit EL1 Support [ 0.045491] CPU: All CPU(s) started at EL2 [ 0.045560] alternatives: patching kernel code [ 0.049357] devtmpfs: initialized [ 0.066016] Registered cp15_barrier emulation handler [ 0.066040] Registered setend emulation handler [ 0.066278] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 0.066350] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 0.069344] pinctrl core: initialized pinctrl subsystem [ 0.070017] DMI not present or invalid. [ 0.070627] NET: Registered protocol family 16 [ 0.074014] DMA: preallocated 2048 KiB GFP_KERNEL pool for atomic allocations [ 0.075467] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.076203] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.076288] audit: initializing netlink subsys (disabled) [ 0.076538] audit: type=2000 audit(0.076:1): state=initialized audit_enabled=0 res=1 [ 0.077839] thermal_sys: Registered thermal governor 'fair_share' [ 0.077846] thermal_sys: Registered thermal governor 'bang_bang' [ 0.077854] thermal_sys: Registered thermal governor 'step_wise' [ 0.077861] thermal_sys: Registered thermal governor 'user_space' [ 0.078347] cpuidle: using governor menu [ 0.078682] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. [ 0.078907] ASID allocator initialised with 65536 entries [ 0.080260] Serial: AMBA PL011 UART driver [ 0.142602] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.142616] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages [ 0.142626] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.142634] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages [ 0.149240] cryptd: max_cpu_qlen set to 1000 [ 0.228343] raid6: neonx8 gen() 1668 MB/s [ 0.296495] raid6: neonx8 xor() 1228 MB/s [ 0.364654] raid6: neonx4 gen() 1682 MB/s [ 0.432822] raid6: neonx4 xor() 1265 MB/s [ 0.500988] raid6: neonx2 gen() 1506 MB/s [ 0.569142] raid6: neonx2 xor() 1171 MB/s [ 0.637313] raid6: neonx1 gen() 1178 MB/s [ 0.705465] raid6: neonx1 xor() 933 MB/s [ 0.773625] raid6: int64x8 gen() 995 MB/s [ 0.841838] raid6: int64x8 xor() 576 MB/s [ 0.909955] raid6: int64x4 gen() 986 MB/s [ 0.978123] raid6: int64x4 xor() 591 MB/s [ 1.046275] raid6: int64x2 gen() 927 MB/s [ 1.114448] raid6: int64x2 xor() 523 MB/s [ 1.182610] raid6: int64x1 gen() 729 MB/s [ 1.250779] raid6: int64x1 xor() 390 MB/s [ 1.250786] raid6: using algorithm neonx4 gen() 1682 MB/s [ 1.250793] raid6: .... xor() 1265 MB/s, rmw enabled [ 1.250801] raid6: using neon recovery algorithm [ 1.252261] vcc12v_dcin_bkup: supplied by vcc12v_dcin [ 1.252697] vcc12v_hdd: supplied by vcc12v_dcin_bkup [ 1.266156] vcc5v0_perdev: supplied by vcc12v_dcin_bkup [ 1.266646] pcie_power: supplied by vcc5v0_perdev [ 1.266767] vcc5v0_usb: supplied by vcc5v0_perdev [ 1.266858] vcc5v0_typec: supplied by vcc5v0_usb [ 1.266921] vcc5v0_hdd: supplied by vcc12v_dcin_bkup [ 1.267540] vcc5v0_sys: supplied by vcc12v_dcin_bkup [ 1.268095] vcc3v3_sys_s3: supplied by vcc5v0_sys [ 1.268153] vcc0v9_s3: supplied by vcc3v3_sys_s3 [ 1.268240] avdd_1v8_s0: supplied by vcc3v3_sys_s3 [ 1.268316] vcc3v0_sd: supplied by vcc3v3_sys_s3 [ 1.269331] usblan_power: supplied by vcc5v0_usb [ 1.269920] iommu: Default domain type: Translated [ 1.273379] vgaarb: loaded [ 1.273909] SCSI subsystem initialized [ 1.274155] libata version 3.00 loaded. [ 1.274431] usbcore: registered new interface driver usbfs [ 1.274479] usbcore: registered new interface driver hub [ 1.274527] usbcore: registered new device driver usb [ 1.275267] pps_core: LinuxPPS API ver. 1 registered [ 1.275274] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it> [ 1.275293] PTP clock support registered [ 1.275622] EDAC MC: Ver: 3.0.0 [ 1.276855] NetLabel: Initializing [ 1.276864] NetLabel: domain hash size = 128 [ 1.276870] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.276963] NetLabel: unlabeled traffic allowed by default [ 1.277465] clocksource: Switched to clocksource arch_sys_counter [ 1.401375] VFS: Disk quotas dquot_6.6.0 [ 1.401479] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.402370] AppArmor: AppArmor Filesystem Enabled [ 1.411643] NET: Registered protocol family 2 [ 1.412630] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) [ 1.412878] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.413416] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear) [ 1.414137] TCP: Hash tables configured (established 32768 bind 32768) [ 1.414348] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) [ 1.414519] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) [ 1.414862] NET: Registered protocol family 1 [ 1.414896] NET: Registered protocol family 44 [ 1.414913] PCI: CLS 0 bytes, default 64 [ 1.415158] Trying to unpack rootfs image as initramfs... [ 2.539985] Freeing initrd memory: 15388K [ 2.541309] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available [ 2.541821] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available [ 2.542600] kvm [1]: IPA Size Limit: 40 bits [ 2.543758] kvm [1]: vgic-v2@fff20000 [ 2.543796] kvm [1]: GIC system register CPU interface enabled [ 2.544057] kvm [1]: vgic interrupt IRQ18 [ 2.544362] kvm [1]: Hyp mode initialized successfully [ 2.555092] Initialise system trusted keyrings [ 2.555141] Key type blacklist registered [ 2.555378] workingset: timestamp_bits=44 max_order=20 bucket_order=0 [ 2.561906] zbud: loaded [ 2.563702] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 2.564554] fuse: init (API version 7.32) [ 2.566009] integrity: Platform Keyring initialized [ 2.630363] xor: measuring software checksum speed [ 2.634282] 8regs : 2531 MB/sec [ 2.637677] 32regs : 2917 MB/sec [ 2.641796] arm64_neon : 2398 MB/sec [ 2.641804] xor: using function: 32regs (2917 MB/sec) [ 2.641820] Key type asymmetric registered [ 2.641827] Asymmetric key parser 'x509' registered [ 2.641881] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.642067] io scheduler mq-deadline registered [ 2.642076] io scheduler kyber registered [ 2.642214] io scheduler bfq registered [ 2.661560] rockchip-pcie f8000000.pcie: host bridge /pcie@f8000000 ranges: [ 2.661606] rockchip-pcie f8000000.pcie: MEM 0x00fa000000..0x00fbdfffff -> 0x00fa000000 [ 2.661628] rockchip-pcie f8000000.pcie: IO 0x00fbe00000..0x00fbefffff -> 0x00fbe00000 [ 2.671607] dma-pl330 ff6d0000.dma-controller: Loaded driver for PL330 DMAC-241330 [ 2.671620] dma-pl330 ff6d0000.dma-controller: DBUFF-32x8bytes Num_Chans-6 Num_Peri-12 Num_Events-12 [ 2.673092] dma-pl330 ff6e0000.dma-controller: Loaded driver for PL330 DMAC-241330 [ 2.673105] dma-pl330 ff6e0000.dma-controller: DBUFF-128x8bytes Num_Chans-8 Num_Peri-20 Num_Events-16 [ 2.678834] vdd_log: supplied by regulator-dummy [ 2.680278] Serial: 8250/16550 driver, 8 ports, IRQ sharing disabled [ 2.683575] ff180000.serial: ttyS0 at MMIO 0xff180000 (irq = 44, base_baud = 1500000) is a 16550A [ 2.684637] ff1a0000.serial: ttyS2 at MMIO 0xff1a0000 (irq = 45, base_baud = 1500000) is a 16550A [ 2.684926] printk: console [ttyS2] enabled [ 2.686458] Serial: AMBA driver [ 2.688039] cacheinfo: Unable to detect cache hierarchy for CPU 0 [ 2.700101] loop: module loaded [ 2.708865] libphy: Fixed MDIO Bus: probed [ 2.709643] tun: Universal TUN/TAP device driver, 1.6 [ 2.710803] thunder_xcv, ver 1.0 [ 2.710849] thunder_bgx, ver 1.0 [ 2.710899] nicpf, ver 1.0 [ 2.712093] e1000e: Intel(R) PRO/1000 Network Driver [ 2.712100] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. [ 2.712162] igb: Intel(R) Gigabit Ethernet Network Driver [ 2.712169] igb: Copyright (c) 2007-2014 Intel Corporation. [ 2.712208] igbvf: Intel(R) Gigabit Virtual Function Network Driver [ 2.712215] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. [ 2.712520] sky2: driver version 1.30 [ 2.713265] VFIO - User Level meta-driver version: 0.3 [ 2.732394] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.732431] ehci-pci: EHCI PCI platform driver [ 2.732475] ehci-platform: EHCI generic platform driver [ 2.734894] ehci-platform fe380000.usb: EHCI Host Controller [ 2.734922] ehci-platform fe380000.usb: new USB bus registered, assigned bus number 1 [ 2.736074] ehci-platform fe380000.usb: irq 38, io mem 0xfe380000 [ 2.749488] ehci-platform fe380000.usb: USB 2.0 started, EHCI 1.00 [ 2.749770] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10 [ 2.749780] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.749790] usb usb1: Product: EHCI Host Controller [ 2.749798] usb usb1: Manufacturer: Linux 5.10.21-rockchip64 ehci_hcd [ 2.749806] usb usb1: SerialNumber: fe380000.usb [ 2.750361] hub 1-0:1.0: USB hub found [ 2.750403] hub 1-0:1.0: 1 port detected [ 2.751220] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.751244] ohci-pci: OHCI PCI platform driver [ 2.751300] ohci-platform: OHCI generic platform driver [ 2.751630] ohci-platform fe3a0000.usb: Generic Platform OHCI controller [ 2.751652] ohci-platform fe3a0000.usb: new USB bus registered, assigned bus number 2 [ 2.751786] ohci-platform fe3a0000.usb: irq 39, io mem 0xfe3a0000 [ 2.813718] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.10 [ 2.813730] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.813738] usb usb2: Product: Generic Platform OHCI controller [ 2.813746] usb usb2: Manufacturer: Linux 5.10.21-rockchip64 ohci_hcd [ 2.813755] usb usb2: SerialNumber: fe3a0000.usb [ 2.814265] hub 2-0:1.0: USB hub found [ 2.814308] hub 2-0:1.0: 1 port detected [ 2.815951] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller [ 2.815976] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 3 [ 2.816159] xhci-hcd xhci-hcd.0.auto: hcc params 0x0220fe64 hci version 0x110 quirks 0x0000010002010010 [ 2.816227] xhci-hcd xhci-hcd.0.auto: irq 76, io mem 0xfe900000 [ 2.816656] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10 [ 2.816667] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.816675] usb usb3: Product: xHCI Host Controller [ 2.816684] usb usb3: Manufacturer: Linux 5.10.21-rockchip64 xhci-hcd [ 2.816692] usb usb3: SerialNumber: xhci-hcd.0.auto [ 2.817218] hub 3-0:1.0: USB hub found [ 2.817267] hub 3-0:1.0: 1 port detected [ 2.817643] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller [ 2.817660] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 4 [ 2.817676] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed [ 2.817762] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM. [ 2.817908] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10 [ 2.817918] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.817927] usb usb4: Product: xHCI Host Controller [ 2.817935] usb usb4: Manufacturer: Linux 5.10.21-rockchip64 xhci-hcd [ 2.817943] usb usb4: SerialNumber: xhci-hcd.0.auto [ 2.818461] hub 4-0:1.0: USB hub found [ 2.818511] hub 4-0:1.0: 1 port detected [ 2.818998] usbcore: registered new interface driver usb-storage [ 2.821778] mousedev: PS/2 mouse device common for all mice [ 2.823240] i2c /dev entries driver [ 2.827379] pca953x 2-0020: using no AI [ 2.837324] rk808 0-001b: chip id: 0x0 [ 2.841238] rk808-regulator rk808-regulator: there is no dvs0 gpio [ 2.841270] rk808-regulator rk808-regulator: there is no dvs1 gpio [ 2.841281] rk808-regulator rk808-regulator: max buck steps per change: 4 [ 2.842434] vdd_center: supplied by vcc5v0_sys [ 2.843089] vdd_cpu_l: supplied by vcc5v0_sys [ 2.843446] vcc_ddr_s3: supplied by vcc5v0_sys [ 2.844114] vcc1v8_sys_s3: supplied by vcc5v0_sys [ 2.844770] vcc1v8_dvp: supplied by vcc5v0_sys [ 2.845283] vcc3v0_touch: supplied by vcc5v0_sys [ 2.846634] vcc1v8_s3: supplied by vcc5v0_sys [ 2.846922] vcc_sdio_s0: Bringing 3300000uV into 3000000-3000000uV [ 2.848081] vcc_sdio_s0: supplied by vcc5v0_sys [ 2.848604] vcca3v0_codec: supplied by vcc5v0_sys [ 2.849805] vcc1v5_s3: supplied by vcc5v0_sys [ 2.850312] vcca1v8_codec: supplied by vcc5v0_sys [ 2.851521] vcc3v0_s3: supplied by vcc5v0_sys [ 2.851675] vcc3v3_sys_s0: failed to get the current voltage: -EPROBE_DEFER [ 2.851698] vcc3v3_sys_s0: supplied by vcc3v3_sys_s3 [ 2.852274] vcc3v3_s0: supplied by vcc3v3_sys_s3 [ 2.856656] rk808-rtc rk808-rtc: registered as rtc0 [ 2.857231] rk808-rtc rk808-rtc: setting system clock to 2021-03-26T10:48:14 UTC (1616755694) [ 2.860390] fan53555-regulator 0-0040: FAN53555 Option[8] Rev[1] Detected! [ 2.861728] vcc1v8_sys_s0: supplied by vcc1v8_sys_s3 [ 2.861826] avdd_0v9_s0: supplied by vcc1v8_sys_s3 [ 2.861932] vdd_cpu_b: supplied by vcc5v0_sys [ 2.865041] fan53555-regulator 0-0041: FAN53555 Option[8] Rev[1] Detected! [ 2.866323] vdd_gpu: supplied by vcc5v0_sys [ 2.874108] dw_wdt ff848000.watchdog: No valid TOPs array specified [ 2.876072] sdhci: Secure Digital Host Controller Interface driver [ 2.876081] sdhci: Copyright(c) Pierre Ossman [ 2.876117] Synopsys Designware Multimedia Card Interface Driver [ 2.877574] sdhci-pltfm: SDHCI platform and OF driver helper [ 2.878011] dwmmc_rockchip fe320000.mmc: IDMAC supports 32-bit address mode. [ 2.878044] dwmmc_rockchip fe320000.mmc: Using internal DMA controller. [ 2.878062] dwmmc_rockchip fe320000.mmc: Version ID is 270a [ 2.878140] dwmmc_rockchip fe320000.mmc: DW MMC controller at irq 36,32 bit host data width,256 deep fifo [ 2.878705] dwmmc_rockchip fe320000.mmc: Got CD GPIO [ 2.880843] mmc2: CQHCI version 5.10 [ 2.882320] ledtrig-cpu: registered to indicate activity on CPUs [ 2.883517] hid: raw HID events driver (C) Jiri Kosina [ 2.883652] usbcore: registered new interface driver usbhid [ 2.883660] usbhid: USB HID core driver [ 2.889665] mmc_host mmc1: Bus speed (slot 0) = 400000Hz (slot req 400000Hz, actual 400000HZ div = 0) [ 2.889934] drop_monitor: Initializing network drop monitor service [ 2.890763] NET: Registered protocol family 10 [ 2.903775] random: fast init done [ 2.907276] mmc2: SDHCI controller on fe330000.sdhci [fe330000.sdhci] using ADMA [ 2.944344] Segment Routing with IPv6 [ 2.944462] NET: Registered protocol family 17 [ 2.944634] 8021q: 802.1Q VLAN Support v1.8 [ 2.944700] Key type dns_resolver registered [ 2.945268] registered taskstats version 1 [ 2.945286] Loading compiled-in X.509 certificates [ 2.948881] Loaded X.509 cert 'Build time autogenerated kernel key: 98b5fbd0004968eadd44123544af94c22f57c8e4' [ 2.955599] zswap: loaded using pool zstd/z3fold [ 2.956051] Key type ._fscrypt registered [ 2.956059] Key type .fscrypt registered [ 2.956066] Key type fscrypt-provisioning registered [ 2.959366] Btrfs loaded, crc32c=crc32c-generic [ 2.978782] mmc2: Command Queue Engine enabled [ 2.978820] mmc2: new HS400 Enhanced strobe MMC card at address 0001 [ 2.979918] mmcblk2: mmc2:0001 AJTD4R 14.6 GiB [ 2.980233] mmcblk2boot0: mmc2:0001 AJTD4R partition 1 4.00 MiB [ 2.980560] mmcblk2boot1: mmc2:0001 AJTD4R partition 2 4.00 MiB [ 2.980823] mmcblk2rpmb: mmc2:0001 AJTD4R partition 3 4.00 MiB, chardev (243:0) [ 2.982381] mmcblk2: p1 [ 2.982516] mmc_host mmc1: Bus speed (slot 0) = 148500000Hz (slot req 150000000Hz, actual 148500000HZ div = 0) [ 2.989643] Key type encrypted registered [ 2.989665] AppArmor: AppArmor sha1 policy hashing enabled [ 3.040961] rockchip-pcie f8000000.pcie: host bridge /pcie@f8000000 ranges: [ 3.041009] rockchip-pcie f8000000.pcie: MEM 0x00fa000000..0x00fbdfffff -> 0x00fa000000 [ 3.041032] rockchip-pcie f8000000.pcie: IO 0x00fbe00000..0x00fbefffff -> 0x00fbe00000 [ 3.098770] rockchip-pcie f8000000.pcie: PCI host bridge to bus 0000:00 [ 3.098785] pci_bus 0000:00: root bus resource [bus 00-1f] [ 3.098796] pci_bus 0000:00: root bus resource [mem 0xfa000000-0xfbdfffff] [ 3.098808] pci_bus 0000:00: root bus resource [io 0x0000-0xfffff] (bus address [0xfbe00000-0xfbefffff]) [ 3.098863] pci 0000:00:00.0: [1d87:0100] type 01 class 0x060400 [ 3.099017] pci 0000:00:00.0: supports D1 [ 3.099027] pci 0000:00:00.0: PME# supported from D0 D1 D3hot [ 3.104908] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 3.105163] pci 0000:01:00.0: [197b:0585] type 00 class 0x010601 [ 3.105234] pci 0000:01:00.0: reg 0x10: initial BAR value 0x00000000 invalid [ 3.105244] pci 0000:01:00.0: reg 0x10: [io size 0x0080] [ 3.105280] pci 0000:01:00.0: reg 0x14: initial BAR value 0x00000000 invalid [ 3.105289] pci 0000:01:00.0: reg 0x14: [io size 0x0080] [ 3.105324] pci 0000:01:00.0: reg 0x18: initial BAR value 0x00000000 invalid [ 3.105332] pci 0000:01:00.0: reg 0x18: [io size 0x0080] [ 3.105368] pci 0000:01:00.0: reg 0x1c: initial BAR value 0x00000000 invalid [ 3.105376] pci 0000:01:00.0: reg 0x1c: [io size 0x0080] [ 3.105411] pci 0000:01:00.0: reg 0x20: initial BAR value 0x00000000 invalid [ 3.105419] pci 0000:01:00.0: reg 0x20: [io size 0x0080] [ 3.105473] pci 0000:01:00.0: reg 0x24: [mem 0x00000000-0x00001fff] [ 3.105510] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref] [ 3.105549] pci 0000:01:00.0: Max Payload Size set to 256 (was 128, max 512) [ 3.105903] pci 0000:01:00.0: PME# supported from D3hot [ 3.106149] pci 0000:01:00.0: 8.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x2 link at 0000:00:00.0 (capable of 15.752 Gb/s with 8.0 GT/s PCIe x2 link) [ 3.111786] pci_bus 0000:01: busn_res: [bus 01-1f] end is updated to 01 [ 3.111816] pci 0000:00:00.0: BAR 14: assigned [mem 0xfa000000-0xfa0fffff] [ 3.111841] pci 0000:01:00.0: BAR 6: assigned [mem 0xfa000000-0xfa00ffff pref] [ 3.111852] pci 0000:01:00.0: BAR 5: assigned [mem 0xfa010000-0xfa011fff] [ 3.111873] pci 0000:01:00.0: BAR 0: no space for [io size 0x0080] [ 3.111881] pci 0000:01:00.0: BAR 0: failed to assign [io size 0x0080] [ 3.111890] pci 0000:01:00.0: BAR 1: no space for [io size 0x0080] [ 3.111898] pci 0000:01:00.0: BAR 1: failed to assign [io size 0x0080] [ 3.111907] pci 0000:01:00.0: BAR 2: no space for [io size 0x0080] [ 3.111915] pci 0000:01:00.0: BAR 2: failed to assign [io size 0x0080] [ 3.111923] pci 0000:01:00.0: BAR 3: no space for [io size 0x0080] [ 3.111931] pci 0000:01:00.0: BAR 3: failed to assign [io size 0x0080] [ 3.111939] pci 0000:01:00.0: BAR 4: no space for [io size 0x0080] [ 3.111947] pci 0000:01:00.0: BAR 4: failed to assign [io size 0x0080] [ 3.111961] pci 0000:00:00.0: PCI bridge to [bus 01] [ 3.111974] pci 0000:00:00.0: bridge window [mem 0xfa000000-0xfa0fffff] [ 3.112212] pcieport 0000:00:00.0: enabling device (0000 -> 0002) [ 3.112529] pcieport 0000:00:00.0: PME: Signaling with IRQ 90 [ 3.233493] usb 3-1: new high-speed USB device number 2 using xhci-hcd [ 3.596245] mmc_host mmc1: Timeout sending command (cmd 0x200000 arg 0x0 status 0x80200000) [ 4.096333] dwmmc_rockchip fe320000.mmc: Busy; trying anyway [ 4.096472] pcieport 0000:00:00.0: AER: enabled with IRQ 90 [ 4.096837] ahci 0000:01:00.0: version 3.0 [ 4.096863] ahci 0000:01:00.0: enabling device (0000 -> 0002) [ 4.097513] ahci 0000:01:00.0: SSS flag set, parallel bus scan disabled [ 4.097614] ahci 0000:01:00.0: AHCI 0001.0301 32 slots 5 ports 6 Gbps 0x1f impl SATA mode [ 4.097628] ahci 0000:01:00.0: flags: 64bit ncq sntf stag pm led clo pmp fbs pio slum part ccc apst boh [ 4.101263] scsi host0: ahci [ 4.102033] scsi host1: ahci [ 4.102673] scsi host2: ahci [ 4.103301] scsi host3: ahci [ 4.103934] scsi host4: ahci [ 4.104159] ata1: SATA max UDMA/133 abar m8192@0xfa010000 port 0xfa010100 irq 91 [ 4.104171] ata2: SATA max UDMA/133 abar m8192@0xfa010000 port 0xfa010180 irq 92 [ 4.104181] ata3: SATA max UDMA/133 abar m8192@0xfa010000 port 0xfa010200 irq 93 [ 4.104191] ata4: SATA max UDMA/133 abar m8192@0xfa010000 port 0xfa010280 irq 94 [ 4.104200] ata5: SATA max UDMA/133 abar m8192@0xfa010000 port 0xfa010300 irq 95 [ 4.112256] input: gpio-keys as /devices/platform/gpio-keys/input/input0 [ 4.113049] of_cfs_init [ 4.113116] of_cfs_init: OK [ 4.577498] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 4.578327] ata1.00: supports DRM functions and may not be fully accessible [ 4.578396] ata1.00: ATA-10: CT500MX500SSD1, M3CR023, max UDMA/133 [ 4.578410] ata1.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 32), AA [ 4.579194] ata1.00: supports DRM functions and may not be fully accessible [ 4.579850] ata1.00: configured for UDMA/133 [ 4.580481] scsi 0:0:0:0: Direct-Access ATA CT500MX500SSD1 023 PQ: 0 ANSI: 5 [ 4.582610] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB) [ 4.582628] sd 0:0:0:0: [sda] 4096-byte physical blocks [ 4.582712] sd 0:0:0:0: [sda] Write Protect is off [ 4.582728] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 4.582866] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 4.721528] mmc_host mmc1: Timeout sending command (cmd 0x200000 arg 0x0 status 0x80200000) [ 5.221614] dwmmc_rockchip fe320000.mmc: Busy; trying anyway [ 5.223451] sda: sda1 sda2 sda3 [ 5.223526] usb 3-1: New USB device found, idVendor=2109, idProduct=2815, bcdDevice= 7.04 [ 5.223538] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 5.223547] usb 3-1: Product: USB2.0 Hub [ 5.223555] usb 3-1: Manufacturer: VIA Labs, Inc. [ 5.226961] sd 0:0:0:0: [sda] Attached SCSI disk [ 5.282122] hub 3-1:1.0: USB hub found [ 5.282254] hub 3-1:1.0: 4 ports detected [ 5.376836] usb 4-1: new SuperSpeed Gen 1 USB device number 2 using xhci-hcd [ 5.489530] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.496988] usb 4-1: New USB device found, idVendor=2109, idProduct=0815, bcdDevice= 7.04 [ 5.497000] usb 4-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 5.497010] usb 4-1: Product: USB3.0 Hub [ 5.497018] usb 4-1: Manufacturer: VIA Labs, Inc. [ 5.499437] ata2.00: ATA-10: ST4000VN008-2DR166, SC60, max UDMA/133 [ 5.499452] ata2.00: 7814037168 sectors, multi 0: LBA48 NCQ (depth 32), AA [ 5.501000] ata2.00: configured for UDMA/133 [ 5.501677] scsi 1:0:0:0: Direct-Access ATA ST4000VN008-2DR1 SC60 PQ: 0 ANSI: 5 [ 5.503047] sd 1:0:0:0: [sdb] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB) [ 5.503064] sd 1:0:0:0: [sdb] 4096-byte physical blocks [ 5.503138] sd 1:0:0:0: [sdb] Write Protect is off [ 5.503154] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00 [ 5.503274] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.522073] hub 4-1:1.0: USB hub found [ 5.522242] hub 4-1:1.0: 4 ports detected [ 5.562407] sdb: sdb1 sdb9 [ 5.565341] sd 1:0:0:0: [sdb] Attached SCSI disk [ 5.619654] dwmmc_rockchip fe320000.mmc: Successfully tuned phase to 299 [ 5.619682] mmc1: new ultra high speed SDR104 SDHC card at address aaaa [ 5.620732] mmcblk1: mmc1:aaaa SC32G 29.7 GiB [ 5.626476] mmcblk1: p1 [ 5.977500] ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.993513] ata3.00: ATA-10: ST4000VN008-2DR166, SC60, max UDMA/133 [ 5.993532] ata3.00: 7814037168 sectors, multi 0: LBA48 NCQ (depth 32), AA [ 5.995060] ata3.00: configured for UDMA/133 [ 5.995652] scsi 2:0:0:0: Direct-Access ATA ST4000VN008-2DR1 SC60 PQ: 0 ANSI: 5 [ 5.997033] sd 2:0:0:0: [sdc] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB) [ 5.997050] sd 2:0:0:0: [sdc] 4096-byte physical blocks [ 5.997133] sd 2:0:0:0: [sdc] Write Protect is off [ 5.997149] sd 2:0:0:0: [sdc] Mode Sense: 00 3a 00 00 [ 5.997289] sd 2:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.054919] sdc: sdc1 sdc9 [ 6.057868] sd 2:0:0:0: [sdc] Attached SCSI disk [ 6.169562] usb 4-1.1: new SuperSpeed Gen 1 USB device number 3 using xhci-hcd [ 6.190714] usb 4-1.1: New USB device found, idVendor=1058, idProduct=25a3, bcdDevice=10.30 [ 6.190726] usb 4-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 6.190734] usb 4-1.1: Product: Elements 25A3 [ 6.190743] usb 4-1.1: Manufacturer: Western Digital [ 6.190751] usb 4-1.1: SerialNumber: 395248583834474C [ 6.191769] usb-storage 4-1.1:1.0: USB Mass Storage device detected [ 6.192240] usb-storage 4-1.1:1.0: Quirks match for vid 1058 pid 25a3: 800000 [ 6.192393] scsi host5: usb-storage 4-1.1:1.0 [ 6.273567] usb 4-1.4: new SuperSpeed Gen 1 USB device number 4 using xhci-hcd [ 6.294570] usb 4-1.4: New USB device found, idVendor=0bda, idProduct=8156, bcdDevice=30.00 [ 6.294581] usb 4-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=6 [ 6.294590] usb 4-1.4: Product: USB 10/100/1G/2.5G LAN [ 6.294599] usb 4-1.4: Manufacturer: Realtek [ 6.294607] usb 4-1.4: SerialNumber: 000000001 [ 6.473500] ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.486448] ata4.00: ATA-10: ST4000VN008-2DR166, SC60, max UDMA/133 [ 6.486459] ata4.00: 7814037168 sectors, multi 0: LBA48 NCQ (depth 32), AA [ 6.487945] ata4.00: configured for UDMA/133 [ 6.488591] scsi 3:0:0:0: Direct-Access ATA ST4000VN008-2DR1 SC60 PQ: 0 ANSI: 5 [ 6.489985] sd 3:0:0:0: [sdd] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB) [ 6.490002] sd 3:0:0:0: [sdd] 4096-byte physical blocks [ 6.490077] sd 3:0:0:0: [sdd] Write Protect is off [ 6.490093] sd 3:0:0:0: [sdd] Mode Sense: 00 3a 00 00 [ 6.490215] sd 3:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.552189] sdd: sdd1 sdd9 [ 6.555154] sd 3:0:0:0: [sdd] Attached SCSI disk [ 6.965495] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.975169] ata5.00: ATA-10: ST4000VN008-2DR166, SC60, max UDMA/133 [ 6.975179] ata5.00: 7814037168 sectors, multi 0: LBA48 NCQ (depth 32), AA [ 6.976676] ata5.00: configured for UDMA/133 [ 6.977090] scsi 4:0:0:0: Direct-Access ATA ST4000VN008-2DR1 SC60 PQ: 0 ANSI: 5 [ 6.978329] sd 4:0:0:0: [sde] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB) [ 6.978350] sd 4:0:0:0: [sde] 4096-byte physical blocks [ 6.978425] sd 4:0:0:0: [sde] Write Protect is off [ 6.978441] sd 4:0:0:0: [sde] Mode Sense: 00 3a 00 00 [ 6.978564] sd 4:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 7.035234] sde: sde1 sde9 [ 7.038236] sd 4:0:0:0: [sde] Attached SCSI disk [ 7.044053] Freeing unused kernel memory: 4352K [ 7.053665] Run /init as init process [ 7.053674] with arguments: [ 7.053682] /init [ 7.053688] with environment: [ 7.053696] HOME=/ [ 7.053702] TERM=linux [ 7.053708] ubootpart=559a8d18-01 [ 7.053715] cgroup_enable=memory [ 7.053721] cgroup_memory=1 [ 7.202315] scsi 5:0:0:0: Direct-Access WD Elements 25A3 1030 PQ: 0 ANSI: 6 [ 7.204780] sd 5:0:0:0: [sdf] Spinning up disk... [ 7.705053] input: adc-keys as /devices/platform/adc-keys/input/input1 [ 7.873428] rk_gmac-dwmac fe300000.ethernet: IRQ eth_wake_irq not found [ 7.873536] rk_gmac-dwmac fe300000.ethernet: IRQ eth_lpi not found [ 7.873908] rk_gmac-dwmac fe300000.ethernet: PTP uses main clock [ 7.878462] rk_gmac-dwmac fe300000.ethernet: clock input or output? (input). [ 7.878489] rk_gmac-dwmac fe300000.ethernet: TX delay(0x28). [ 7.878504] rk_gmac-dwmac fe300000.ethernet: RX delay(0x20). [ 7.878530] rk_gmac-dwmac fe300000.ethernet: integrated PHY? (no). [ 7.878653] rk_gmac-dwmac fe300000.ethernet: cannot get clock clk_mac_speed [ 7.878664] rk_gmac-dwmac fe300000.ethernet: clock input from PHY [ 7.887161] rk_gmac-dwmac fe300000.ethernet: init for RGMII [ 7.899327] rk_gmac-dwmac fe300000.ethernet: User ID: 0x10, Synopsys ID: 0x35 [ 7.899346] rk_gmac-dwmac fe300000.ethernet: DWMAC1000 [ 7.899357] rk_gmac-dwmac fe300000.ethernet: DMA HW capability register supported [ 7.899365] rk_gmac-dwmac fe300000.ethernet: RX Checksum Offload Engine supported [ 7.899373] rk_gmac-dwmac fe300000.ethernet: COE Type 2 [ 7.899381] rk_gmac-dwmac fe300000.ethernet: TX Checksum insertion supported [ 7.899389] rk_gmac-dwmac fe300000.ethernet: Wake-Up On Lan supported [ 7.899568] rk_gmac-dwmac fe300000.ethernet: Normal descriptors [ 7.899578] rk_gmac-dwmac fe300000.ethernet: Ring mode enabled [ 7.899586] rk_gmac-dwmac fe300000.ethernet: Enable RX Mitigation via HW Watchdog Timer [ 8.038399] usbcore: registered new interface driver uas [ 8.039728] libphy: stmmac: probed [ 8.039753] RTL8211F Gigabit Ethernet stmmac-0:00: attached PHY driver [RTL8211F Gigabit Ethernet] (mii_bus:phy_addr=stmmac-0:00, irq=POLL) [ 8.039768] RTL8211F Gigabit Ethernet stmmac-0:01: attached PHY driver [RTL8211F Gigabit Ethernet] (mii_bus:phy_addr=stmmac-0:01, irq=POLL) [ 8.094834] random: crng init done [ 8.225517] . [ 8.480919] async_tx: api initialized (async) [ 9.182852] EXT4-fs (mmcblk1p1): mounted filesystem with writeback data mode. Opts: (null) [ 9.253504] . [ 9.813223] systemd[1]: Inserted module 'autofs4' [ 9.880774] systemd[1]: systemd 241 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid) [ 9.881819] systemd[1]: Detected architecture arm64. [ 9.915138] systemd[1]: Set hostname to <derfflinger.lan>. [ 10.090719] dw-apb-uart ff1a0000.serial: forbid DMA for kernel console [ 10.273494] . [ 10.624569] systemd[1]: /lib/systemd/system/rpc-statd.service:13: PIDFile= references path below legacy directory /var/run/, updating /var/run/rpc.statd.pid → /run/rpc.statd.pid; please update the unit file accordingly. [ 10.733822] systemd[1]: /lib/systemd/system/smbd.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/samba/smbd.pid → /run/samba/smbd.pid; please update the unit file accordingly. [ 10.751120] systemd[1]: /lib/systemd/system/nmbd.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/samba/nmbd.pid → /run/samba/nmbd.pid; please update the unit file accordingly. [ 10.778540] systemd[1]: /lib/systemd/system/fancontrol.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/fancontrol.pid → /run/fancontrol.pid; please update the unit file accordingly. [ 10.912401] systemd[1]: zfs-share.service: Found ordering cycle on nfs-server.service/start [ 10.912428] systemd[1]: zfs-share.service: Found dependency on zfs.target/start [ 10.912447] systemd[1]: zfs-share.service: Found dependency on zfs-share.service/start [ 11.026712] lm75 2-004c: supply vs not found, using dummy regulator [ 11.029802] lm75 2-004c: hwmon2: sensor 'lm75' [ 11.061059] spl: loading out-of-tree module taints kernel. [ 11.061814] spl: module verification failed: signature and/or required key missing - tainting kernel [ 11.072348] EXT4-fs (mmcblk1p1): re-mounted. Opts: commit=600,errors=remount-ro [ 11.104083] icp: module license 'CDDL' taints kernel. [ 11.104100] Disabling lock debugging due to kernel taint [ 11.174485] RPC: Registered named UNIX socket transport module. [ 11.174503] RPC: Registered udp transport module. [ 11.174511] RPC: Registered tcp transport module. [ 11.174519] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 11.297546] . [ 11.356362] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 11.665855] ZFS: Loaded module v2.0.3-1~bpo10+1, ZFS pool version 5000, ZFS filesystem version 5 [ 11.957812] rk_gmac-dwmac fe300000.ethernet eth0: PHY [stmmac-0:00] driver [RTL8211F Gigabit Ethernet] (irq=POLL) [ 11.966232] rk_gmac-dwmac fe300000.ethernet eth0: No Safety Features support found [ 11.966265] rk_gmac-dwmac fe300000.ethernet eth0: PTP not supported by HW [ 11.967224] rk_gmac-dwmac fe300000.ethernet eth0: configuring for phy/rgmii link mode [ 12.005891] input: beeper as /devices/platform/beeper/input/input2 [ 12.106905] sd 0:0:0:0: Attached scsi generic sg0 type 0 [ 12.115018] sd 1:0:0:0: Attached scsi generic sg1 type 0 [ 12.115698] sd 2:0:0:0: Attached scsi generic sg2 type 0 [ 12.116898] sd 3:0:0:0: Attached scsi generic sg3 type 0 [ 12.117156] sd 4:0:0:0: Attached scsi generic sg4 type 0 [ 12.117312] sd 5:0:0:0: Attached scsi generic sg5 type 0 [ 12.172139] rockchip-vop ff8f0000.vop: Adding to iommu group 2 [ 12.179954] rockchip-vop ff900000.vop: Adding to iommu group 3 [ 12.220271] mc: Linux media interface: v0.10 [ 12.240501] videodev: Linux video capture interface: v2.00 [ 12.256911] OF: graph: no port node found in /i2c@ff3d0000/typec-portc@22 [ 12.267795] rockchip-drm display-subsystem: bound ff8f0000.vop (ops vop_component_ops [rockchipdrm]) [ 12.267894] [drm] unsupported AFBC format[3231564e] [ 12.269420] rockchip-drm display-subsystem: bound ff900000.vop (ops vop_component_ops [rockchipdrm]) [ 12.269599] rockchip-drm display-subsystem: bound fec00000.dp (ops cdn_dp_component_ops [rockchipdrm]) [ 12.273268] rockchip-drm display-subsystem: [drm] Cannot find any crtc or sizes [ 12.274193] [drm] Initialized rockchip 1.0.0 20140818 for display-subsystem on minor 0 [ 12.276593] cdn-dp fec00000.dp: [drm:cdn_dp_pd_event_work [rockchipdrm]] Not connected. Disabling cdn [ 12.279359] OF: graph: no port node found in /syscon@ff770000/usb2-phy@e450/otg-port [ 12.285183] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller [ 12.285202] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 5 [ 12.285312] xhci-hcd xhci-hcd.3.auto: hcc params 0x0220fe64 hci version 0x110 quirks 0x0000010002010010 [ 12.285327] xhci-hcd xhci-hcd.3.auto: irq 75, io mem 0xfe800000 [ 12.285568] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10 [ 12.285573] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 12.285577] usb usb5: Product: xHCI Host Controller [ 12.285580] usb usb5: Manufacturer: Linux 5.10.21-rockchip64 xhci-hcd [ 12.285583] usb usb5: SerialNumber: xhci-hcd.3.auto [ 12.285931] hub 5-0:1.0: USB hub found [ 12.285954] hub 5-0:1.0: 1 port detected [ 12.286137] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller [ 12.286147] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 6 [ 12.286154] xhci-hcd xhci-hcd.3.auto: Host supports USB 3.0 SuperSpeed [ 12.286198] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM. [ 12.286265] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10 [ 12.286269] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 12.286272] usb usb6: Product: xHCI Host Controller [ 12.286275] usb usb6: Manufacturer: Linux 5.10.21-rockchip64 xhci-hcd [ 12.286278] usb usb6: SerialNumber: xhci-hcd.3.auto [ 12.286643] hub 6-0:1.0: USB hub found [ 12.286663] hub 6-0:1.0: 1 port detected [ 12.321518] .ready [ 12.323127] sd 5:0:0:0: [sdf] Very big device. Trying to use READ CAPACITY(16). [ 12.323301] sd 5:0:0:0: [sdf] 27344699392 512-byte logical blocks: (14.0 TB/12.7 TiB) [ 12.323308] sd 5:0:0:0: [sdf] 4096-byte physical blocks [ 12.323613] sd 5:0:0:0: [sdf] Write Protect is off [ 12.323621] sd 5:0:0:0: [sdf] Mode Sense: 47 00 10 08 [ 12.323937] sd 5:0:0:0: [sdf] No Caching mode page found [ 12.323945] sd 5:0:0:0: [sdf] Assuming drive cache: write through [ 12.336496] rockchip-rga ff680000.rga: HW Version: 0x03.02 [ 12.336931] rockchip-rga ff680000.rga: Registered rockchip-rga as /dev/video0 [ 12.344976] rockchip_vdec: module is from the staging directory, the quality is unknown, you have been warned. [ 12.346046] rkvdec ff660000.video-codec: Adding to iommu group 1 [ 12.367793] hantro_vpu: module is from the staging directory, the quality is unknown, you have been warned. [ 12.370055] hantro-vpu ff650000.video-codec: Adding to iommu group 0 [ 12.371138] hantro-vpu ff650000.video-codec: registered rockchip,rk3399-vpu-enc as /dev/video2 [ 12.371364] hantro-vpu ff650000.video-codec: registered rockchip,rk3399-vpu-dec as /dev/video3 [ 12.374119] panfrost ff9a0000.gpu: clock rate = 500000000 [ 12.377938] panfrost ff9a0000.gpu: mali-t860 id 0x860 major 0x2 minor 0x0 status 0x0 [ 12.377980] panfrost ff9a0000.gpu: features: 00000000,100e77bf, issues: 00000000,24040400 [ 12.377987] panfrost ff9a0000.gpu: Features: L2:0x07120206 Shader:0x00000000 Tiler:0x00000809 Mem:0x1 MMU:0x00002830 AS:0xff JS:0x7 [ 12.377993] panfrost ff9a0000.gpu: shader_present=0xf l2_present=0x1 [ 12.404677] [drm] Initialized panfrost 1.1.0 20180908 for ff9a0000.gpu on minor 1 [ 12.406494] sdf: sdf1 sdf9 [ 12.409005] sd 5:0:0:0: [sdf] Attached SCSI disk [ 12.475003] cdn-dp fec00000.dp: [drm:cdn_dp_pd_event_work [rockchipdrm]] Not connected. Disabling cdn [ 12.706056] usb 4-1.4: reset SuperSpeed Gen 1 USB device number 4 using xhci-hcd [ 12.720502] cdn-dp fec00000.dp: [drm:cdn_dp_pd_event_work [rockchipdrm]] Not connected. Disabling cdn [ 12.842267] r8152 4-1.4:1.0 (unnamed net_device) (uninitialized): netif_napi_add() called with weight 256 [ 12.857698] r8152 4-1.4:1.0 eth1: v2.14.0 (2020/09/24) [ 12.857721] r8152 4-1.4:1.0 eth1: This product is covered by one or more of the following patents: US6,570,884, US6,115,776, and US6,327,625. [ 12.857946] usbcore: registered new interface driver r8152 [ 13.285587] rockchip-drm display-subsystem: [drm] Cannot find any crtc or sizes [ 13.376212] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: user_xattr,usrjquota=aquota.user,grpjquota=aquota.group,jqfmt=vfsv0,acl [ 13.617036] cdn-dp fec00000.dp: [drm:cdn_dp_pd_event_work [rockchipdrm]] Not connected. Disabling cdn [ 16.066439] rk_gmac-dwmac fe300000.ethernet eth0: Link is Up - 1Gbps/Full - flow control off [ 16.066483] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 16.517337] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready [ 16.518338] r8152 4-1.4:1.0 eth1: carrier on [ 23.267240] systemd[1]: Started Import ZFS pools by cache file. [ 23.268818] systemd[1]: Reached target ZFS pool import target. [ 23.275788] systemd[1]: Starting Wait for ZFS Volume (zvol) links in /dev... [ 23.278492] systemd[1]: Starting Mount ZFS filesystems... [ 23.384824] systemd[1]: Started Wait for ZFS Volume (zvol) links in /dev. [ 23.385403] systemd[1]: Reached target ZFS volumes are ready. [ 24.112115] systemd[1]: Started Mount ZFS filesystems. [ 24.113331] systemd[1]: Reached target Local File Systems. [ 24.118830] systemd[1]: Starting Cleanup PHP session files... [ 24.119585] systemd[1]: Condition check resulted in Mark the need to relabel after reboot being skipped. [ 24.416171] systemd-journald[1500]: Received request to flush runtime journal from PID 1 [ 35.809318] vcc5v0_typec: disabling [ 65.064158] softdog: initialized. soft_noboot=0 soft_margin=60 sec soft_panic=0 (nowayout=0) [ 65.064166] softdog: soft_reboot_cmd=<not set> soft_active_on_boot=0 [ 6299.289436] NFSD: Using UMH upcall client tracking operations. [ 6299.289445] NFSD: starting 90-second grace period (net f00000e1) [48657.415910] xhci-hcd xhci-hcd.0.auto: xHCI host not responding to stop endpoint command. [48657.415930] xhci-hcd xhci-hcd.0.auto: USBSTS: [48657.429522] xhci-hcd xhci-hcd.0.auto: xHCI host controller not responding, assume dead [48657.429604] xhci-hcd xhci-hcd.0.auto: HC died; cleaning up [48657.429952] r8152 4-1.4:1.0 eth1: Stop submitting intr, status -108 [48657.430068] r8152 4-1.4:1.0 eth1: get_registers -110 [48657.430193] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430223] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430241] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430262] r8152 4-1.4:1.0 eth1: Tx status -108 [48657.430327] usb 3-1: USB disconnect, device number 2 [48657.431551] usb 4-1: USB disconnect, device number 2 [48657.431572] usb 4-1.1: USB disconnect, device number 3 [48657.467516] usb 4-1.4: USB disconnect, device number 4 Spoiler DDR Version 1.24 20191016 In soft reset SRX channel 0 CS = 0 MR0=0x18 MR4=0x1 MR5=0x1 MR8=0x10 MR12=0x72 MR14=0x72 MR18=0x0 MR19=0x0 MR24=0x8 MR25=0x0 channel 1 CS = 0 MR0=0x18 MR4=0x1 MR5=0x1 MR8=0x10 MR12=0x72 MR14=0x72 MR18=0x0 MR19=0x0 MR24=0x8 MR25=0x0 channel 0 training pass! channel 1 training pass! change freq to 416MHz 0,1 Channel 0: LPDDR4,416MHz Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB Channel 1: LPDDR4,416MHz Bus Width=32 Col=10 Bank=8 Row=16 CS=1 Die Bus-Width=16 Size=2048MB 256B stride channel 0 CS = 0 MR0=0x18 MR4=0x1 MR5=0x1 MR8=0x10 MR12=0x72 MR14=0x72 MR18=0x0 MR19=0x0 MR24=0x8 MR25=0x0 channel 1 CS = 0 MR0=0x18 MR4=0x1 MR5=0x1 MR8=0x10 MR12=0x72 MR14=0x72 MR18=0x0 MR19=0x0 MR24=0x8 MR25=0x0 channel 0 training pass! channel 1 training pass! channel 0, cs 0, advanced training done channel 1, cs 0, advanced training done change freq to 856MHz 1,0 ch 0 ddrconfig = 0x101, ddrsize = 0x40 ch 1 ddrconfig = 0x101, ddrsize = 0x40 pmugrf_os_reg[2] = 0x32C1F2C1, stride = 0xD ddr_set_rate to 328MHZ ddr_set_rate to 666MHZ ddr_set_rate to 928MHZ channel 0, cs 0, advanced training done channel 1, cs 0, advanced training done ddr_set_rate to 416MHZ, ctl_index 0 ddr_set_rate to 856MHZ, ctl_index 1 support 416 856 328 666 928 MHz, current 856MHz OUT Boot1: 2019-03-14, version: 1.19 CPUId = 0x0 ChipType = 0x10, 322 SdmmcInit=2 0 BootCapSize=100000 UserCapSize=14910MB FwPartOffset=2000 , 100000 mmc0:cmd5,20 SdmmcInit=0 0 BootCapSize=0 UserCapSize=30436MB FwPartOffset=2000 , 0 StorageInit ok = 78095 SecureMode = 0 SecureInit read PBA: 0x4 SecureInit read PBA: 0x404 SecureInit read PBA: 0x804 SecureInit read PBA: 0xc04 SecureInit read PBA: 0x1004 SecureInit read PBA: 0x1404 SecureInit read PBA: 0x1804 SecureInit read PBA: 0x1c04 SecureInit ret = 0, SecureMode = 0 atags_set_bootdev: ret:(0) GPT 0x3380ec0 signature is wrong recovery gpt... GPT 0x3380ec0 signature is wrong recovery gpt fail! LoadTrust Addr:0x4000 No find bl30.bin No find bl32.bin Load uboot, ReadLba = 2000 Load OK, addr=0x200000, size=0xe5b60 RunBL31 0x40000 NOTICE: BL31: v1.3(debug):42583b6 NOTICE: BL31: Built : 07:55:13, Oct 15 2019 NOTICE: BL31: Rockchip release version: v1.1 INFO: GICv3 with legacy support detected. ARM GICV3 driver initialized in EL3 INFO: Using opteed sec cpu_context! INFO: boot cpu mask: 0 INFO: plat_rockchip_pmu_init(1190): pd status 3e INFO: BL31: Initializing runtime services WARNING: No OPTEE provided by BL2 boot loader, Booting device without OPTEE initialization. SMC`s destined for OPTEE will return SMC_UNK ERROR: Error initializing runtime service opteed_fast INFO: BL31: Preparing for EL3 exit to normal world INFO: Entry point address = 0x200000 INFO: SPSR = 0x3c9 U-Boot 2020.10-armbian (Mar 08 2021 - 14:54:58 +0000) SoC: Rockchip rk3399 Reset cause: unknown reset DRAM: 3.9 GiB PMIC: RK808 SF: Detected w25q128 with page size 256 Bytes, erase size 4 KiB, total 16 MiB MMC: mmc@fe320000: 1, sdhci@fe330000: 0 Loading Environment from MMC... *** Warning - bad CRC, using default environment In: serial Out: serial Err: serial Model: Helios64 Revision: 1.2 - 4GB non ECC Net: eth0: ethernet@fe300000 scanning bus for devices... starting USB... Bus usb@fe380000: USB EHCI 1.00 Bus dwc3: usb maximum-speed not found Register 2000140 NbrPorts 2 Starting the controller USB XHCI 1.10 scanning bus usb@fe380000 for devices... 1 USB Device(s) found scanning bus dwc3 for devices... cannot reset port 4!? Device NOT ready Request Sense returned 02 04 01 5 USB Device(s) found scanning usb for storage devices... 0 Storage Device(s) found Hit any key to stop autoboot: 0 switch to partitions #0, OK mmc1 is current device Scanning mmc 1:1... Found U-Boot script /boot/boot.scr 3185 bytes read in 6 ms (517.6 KiB/s) ## Executing script at 00500000 Boot script loaded from mmc 1 182 bytes read in 5 ms (35.2 KiB/s) 15760315 bytes read in 672 ms (22.4 MiB/s) 28582400 bytes read in 1213 ms (22.5 MiB/s) 81843 bytes read in 13 ms (6 MiB/s) 2698 bytes read in 10 ms (262.7 KiB/s) Applying kernel provided DT fixup script (rockchip-fixup.scr) ## Executing script at 09000000 Moving Image from 0x2080000 to 0x2200000, end=3de0000 ## Loading init Ramdisk from Legacy Image at 06000000 ... Image Name: uInitrd Image Type: AArch64 Linux RAMDisk Image (gzip compressed) Data Size: 15760251 Bytes = 15 MiB Load Address: 00000000 Entry Point: 00000000 Verifying Checksum ... OK ## Flattened Device Tree blob at 01f00000 Booting using the fdt blob at 0x1f00000 Loading Ramdisk to f4fe7000, end f5eeeb7b ... OK Loading Device Tree to 00000000f4f6a000, end 00000000f4fe6fff ... OK Starting kernel ... 0 Quote
antsu Posted March 30, 2021 Author Posted March 30, 2021 This time it survived a little longer, but sure enough, today I woke up to my H64 unreachable on the 2.5G port again: [255036.090052] xhci-hcd xhci-hcd.0.auto: xHCI host not responding to stop endpoint command. [255036.090061] xhci-hcd xhci-hcd.0.auto: USBSTS: [255036.103643] xhci-hcd xhci-hcd.0.auto: xHCI host controller not responding, assume dead [255036.103681] xhci-hcd xhci-hcd.0.auto: HC died; cleaning up [255036.103734] r8152 4-1.4:1.0 eth1: Stop submitting intr, status -108 [255036.103774] r8152 4-1.4:1.0 eth1: get_registers -110 [255036.103822] r8152 4-1.4:1.0 eth1: Tx status -108 [255036.103831] r8152 4-1.4:1.0 eth1: Tx status -108 [255036.103839] r8152 4-1.4:1.0 eth1: Tx status -108 [255036.103850] r8152 4-1.4:1.0 eth1: Tx status -108 [255036.103868] usb 3-1: USB disconnect, device number 2 [255036.109516] usb 4-1: USB disconnect, device number 2 [255036.109526] usb 4-1.1: USB disconnect, device number 3 [255036.131518] usb 4-1.4: USB disconnect, device number 4 [255429.047792] zio pool=backups vdev=/dev/disk/by-id/usb-WD_Elements_XXXX_XXXXXXXXXXXXXXX-0:0-part1 error=5 type=1 offset=3186896842752 size=4096 flags=180880 [255429.047897] zio pool=backups vdev=/dev/disk/by-id/usb-WD_Elements_XXXX_XXXXXXXXXXXXXXX-0:0-part1 error=5 type=1 offset=270336 size=8192 flags=b08c1 [255429.047937] zio pool=backups vdev=/dev/disk/by-id/usb-WD_Elements_XXXX_XXXXXXXXXXXXXXX-0:0-part1 error=5 type=1 offset=14000475086848 size=8192 flags=b08c1 [255429.047966] zio pool=backups vdev=/dev/disk/by-id/usb-WD_Elements_XXXX_XXXXXXXXXXXXXXX-0:0-part1 error=5 type=1 offset=14000475348992 size=8192 flags=b08c1 [255429.048323] WARNING: Pool 'backups' has encountered an uncorrectable I/O failure and has been suspended. [255433.136397] WARNING: Pool 'backups' has encountered an uncorrectable I/O failure and has been suspended. I'm going back to using just the 1G port for now, since my H64 has been much more stable after the IO scheduler changes suggested by @ShadowDance in another thread, but happy to do more tests if anyone wants to try to figure out what's happening. 0 Quote
aprayoga Posted April 1, 2021 Posted April 1, 2021 Thank you for the report. The error code is different compared to the one reported here, which already fixed on this PR. We will investigate this issue 0 Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.