w0ndersp00n

January 26, 2021

Thanks for this Too bad in no cases my C2 wants to boot up I guess I should burn a new image all together. I still don't understand what went wrong during that last update... Guess I'm happy that I still can access the files on the eMMC card.

January 25, 2021

A few weeks ago, after a firmware-upgrade my C2 bricked. It's blue led didn't flash any more and no serial console was available. Since I had everything setup just right I wanted to recover it using these steps here: https://docs.armbian.com/User-Guide_Recovery/#replacing-boot

Off course I replaced the packages with the ones for the C2. Specifically:

After following all the steps, I don't seem to have an uInitrd. I don't know if that would help booting up again, but from the symlinks section it's the only file missing after following all the steps:

image.png.29f96067c805301a2a315d9334354626.png

Does anybody know what went wrong or guide me towards the right steps to recover my C2?

January 25, 2021

Hi, No haven't had any progress as an Armbian firmware upgrade broke my C2 :( Currently still working on getting it back up and running without a new install but I don't seem to succeed...

January 5, 2021

Well, my C2 doesn’t seem to have a console so I guess I need to recover it another way. My N2 thankfully didn’t crash after the update. It had a power outage...

I’ll check out the autotests later. Need to deal with some private stuff first, then recover the C2 and then I’ll be able to get tinkering again.

December 28, 2020

It seems I was too late to notice this topic. My C2 “died” as well, as it no longer boots. I didn’t have a backup script in place yet. I’ve ordered an UART cable, which should arrive this week. Hopefully I understand how this work and be able to resurrect Armbian.

I’ll just need to make sure not to reboot my N2, since I updated it as well, but didn’t reboot yet.

November 23, 2020

That's strange - it only happens to my new Armbian installs. But I've assigned static IP Addresses for now, to see if that fixes this issue

November 23, 2020

Armbianmonitor:

http://ix.io/2Fbx

With my OPi Zero, I noticed that at random times the ethernet connection somehow gets disabled. The only way to recover is by power cycling. I use the device as Pi-Hole (so when ethernet gets disconnected, I don't have internet anymore), print server and UniFi controller.

I decided to swap it for my Odroid C2. Odd enough the C2 has the same issue. Maybe someone can help me with this?

When powercycled, the Odroid with the latest Armbian (installed two days ago) is all up and running fine. It can connect to the internet, I can SSH into it. The ethernet led is flashing orange, so the gigabit connection is available. However, at rondom times the ethernet leds are both disabled. At this point, the C2 is still alive, but there's no way to access it without power cycling. I've tried removing the ethernet cable and connecting it again, hoping Armbian would recognize the connection - what happens in this case is that the green led will flash a few times (100Mbit) but the device is still offline.

I've added some information from the log here before rebooting. This information keeps repeating in the log files... Hopefully someone can guide my as how to get the connection stable.

Spoiler


Nov 23 06:00:14 localhost NetworkManager[2219]: <warn>  [1606107614.7172] dhcp4 (eth0): request timed out
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.7183] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.7860] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 6807
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.7863] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.7897] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.7973] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:00:14 localhost NetworkManager[2219]: <warn>  [1606107614.8046] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8094] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8358] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8470] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8493] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8571] manager: NetworkManager state is now CONNECTING
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8619] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8719] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.8781] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:00:14 localhost NetworkManager[2219]: <info>  [1606107614.9001] dhcp4 (eth0): dhclient started with pid 6869
Nov 23 06:00:59 localhost NetworkManager[2219]: <warn>  [1606107659.7124] dhcp4 (eth0): request timed out
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7125] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7290] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 6869
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7291] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7299] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7315] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:00:59 localhost NetworkManager[2219]: <warn>  [1606107659.7331] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:00:59 localhost NetworkManager[2219]: <info>  [1606107659.7342] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7126] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7151] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7156] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7172] manager: NetworkManager state is now CONNECTING
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7183] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7206] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7219] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:05:59 localhost NetworkManager[2219]: <info>  [1606107959.7275] dhcp4 (eth0): dhclient started with pid 7194
Nov 23 06:06:44 localhost NetworkManager[2219]: <warn>  [1606108004.7119] dhcp4 (eth0): request timed out
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.7132] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.7836] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7194
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.7846] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.7925] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.8128] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:06:44 localhost NetworkManager[2219]: <warn>  [1606108004.8311] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.8429] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9060] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9156] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9162] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9176] manager: NetworkManager state is now CONNECTING
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9186] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9212] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9225] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:06:44 localhost NetworkManager[2219]: <info>  [1606108004.9281] dhcp4 (eth0): dhclient started with pid 7256
Nov 23 06:07:29 localhost NetworkManager[2219]: <warn>  [1606108049.7211] dhcp4 (eth0): request timed out
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7213] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7377] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7256
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7378] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7386] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7403] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:07:29 localhost NetworkManager[2219]: <warn>  [1606108049.7418] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7428] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7488] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7512] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7517] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7532] manager: NetworkManager state is now CONNECTING
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7542] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7565] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7578] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:07:29 localhost NetworkManager[2219]: <info>  [1606108049.7635] dhcp4 (eth0): dhclient started with pid 7295
Nov 23 06:08:14 localhost NetworkManager[2219]: <warn>  [1606108094.7220] dhcp4 (eth0): request timed out
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.7231] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.7931] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7295
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.7939] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8019] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8166] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:08:14 localhost NetworkManager[2219]: <warn>  [1606108094.8238] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8287] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8542] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8653] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8675] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8751] manager: NetworkManager state is now CONNECTING
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8797] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8897] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.8957] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:08:14 localhost NetworkManager[2219]: <info>  [1606108094.9177] dhcp4 (eth0): dhclient started with pid 7356
Nov 23 06:08:59 localhost NetworkManager[2219]: <warn>  [1606108139.7215] dhcp4 (eth0): request timed out
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7217] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7543] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7356
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7545] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7553] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7569] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:08:59 localhost NetworkManager[2219]: <warn>  [1606108139.7584] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:08:59 localhost NetworkManager[2219]: <info>  [1606108139.7594] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8093] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8375] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8435] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8632] manager: NetworkManager state is now CONNECTING
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8754] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.8999] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.9157] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:13:59 localhost NetworkManager[2219]: <info>  [1606108439.9637] dhcp4 (eth0): dhclient started with pid 7732
Nov 23 06:14:45 localhost NetworkManager[2219]: <warn>  [1606108485.7230] dhcp4 (eth0): request timed out
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.7243] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.7939] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7732
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.7947] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.8028] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.8232] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:14:45 localhost NetworkManager[2219]: <warn>  [1606108485.8414] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.8533] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9010] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9035] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9043] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9058] manager: NetworkManager state is now CONNECTING
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9069] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9092] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9105] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:14:45 localhost NetworkManager[2219]: <info>  [1606108485.9161] dhcp4 (eth0): dhclient started with pid 7796
Nov 23 06:15:30 localhost NetworkManager[2219]: <warn>  [1606108530.7220] dhcp4 (eth0): request timed out
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.7230] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.7615] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7796
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.7623] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.7705] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.7924] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:15:30 localhost NetworkManager[2219]: <warn>  [1606108530.8106] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8219] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8278] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8303] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8308] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8322] manager: NetworkManager state is now CONNECTING
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8333] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8355] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8370] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:15:30 localhost NetworkManager[2219]: <info>  [1606108530.8426] dhcp4 (eth0): dhclient started with pid 7844
Nov 23 06:16:15 localhost NetworkManager[2219]: <warn>  [1606108575.7225] dhcp4 (eth0): request timed out
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.7235] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.7936] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7844
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.7944] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.8025] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.8236] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:16:15 localhost NetworkManager[2219]: <warn>  [1606108575.8429] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.8549] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9177] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9369] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9375] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9390] manager: NetworkManager state is now CONNECTING
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9400] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9423] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9436] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:16:15 localhost NetworkManager[2219]: <info>  [1606108575.9494] dhcp4 (eth0): dhclient started with pid 7907
Nov 23 06:17:00 localhost NetworkManager[2219]: <warn>  [1606108620.7216] dhcp4 (eth0): request timed out
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7217] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7543] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 7907
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7544] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7552] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7570] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:17:00 localhost NetworkManager[2219]: <warn>  [1606108620.7586] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:17:00 localhost NetworkManager[2219]: <info>  [1606108620.7596] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7743] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7769] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7774] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7789] manager: NetworkManager state is now CONNECTING
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7800] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7823] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7836] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:22:00 localhost NetworkManager[2219]: <info>  [1606108920.7894] dhcp4 (eth0): dhclient started with pid 8256
Nov 23 06:22:45 localhost NetworkManager[2219]: <warn>  [1606108965.7229] dhcp4 (eth0): request timed out
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.7242] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.7938] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 8256
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.7946] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8024] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8229] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:22:45 localhost NetworkManager[2219]: <warn>  [1606108965.8412] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8532] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8650] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8674] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8679] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8694] manager: NetworkManager state is now CONNECTING
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8705] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8728] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8741] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:22:45 localhost NetworkManager[2219]: <info>  [1606108965.8798] dhcp4 (eth0): dhclient started with pid 8289
Nov 23 06:23:30 localhost NetworkManager[2219]: <warn>  [1606109010.7226] dhcp4 (eth0): request timed out
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.7236] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.7925] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 8289
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.7928] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.7969] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8048] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:23:30 localhost NetworkManager[2219]: <warn>  [1606109010.8117] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8168] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8422] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8533] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8555] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8634] manager: NetworkManager state is now CONNECTING
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8682] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8782] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.8845] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:23:30 localhost NetworkManager[2219]: <info>  [1606109010.9065] dhcp4 (eth0): dhclient started with pid 8349
Nov 23 06:24:15 localhost NetworkManager[2219]: <warn>  [1606109055.7138] dhcp4 (eth0): request timed out
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.7149] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.7846] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 8349
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.7853] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.7936] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.8141] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:24:15 localhost NetworkManager[2219]: <warn>  [1606109055.8324] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.8444] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.8985] policy: auto-activating connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9009] device (eth0): Activation: starting connection 'Wired connection 1' (7ab967fe-0741-36ca-8183-0c391be8c3da)
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9014] device (eth0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed')
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9029] manager: NetworkManager state is now CONNECTING
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9039] device (eth0): state change: prepare -> config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9062] device (eth0): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed')
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9075] dhcp4 (eth0): activation: beginning transaction (timeout in 45 seconds)
Nov 23 06:24:15 localhost NetworkManager[2219]: <info>  [1606109055.9132] dhcp4 (eth0): dhclient started with pid 8385
Nov 23 06:25:00 localhost NetworkManager[2219]: <warn>  [1606109100.7141] dhcp4 (eth0): request timed out
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7143] dhcp4 (eth0): state changed unknown -> timeout
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7307] dhcp4 (eth0): canceled DHCP transaction, DHCP client pid 8385
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7308] dhcp4 (eth0): state changed timeout -> done
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7316] device (eth0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7333] manager: NetworkManager state is now CONNECTED_LOCAL
Nov 23 06:25:00 localhost NetworkManager[2219]: <warn>  [1606109100.7348] device (eth0): Activation: failed for connection 'Wired connection 1'
Nov 23 06:25:00 localhost NetworkManager[2219]: <info>  [1606109100.7359] device (eth0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
Nov 23 11:17:10 localhost kernel: [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
Nov 23 11:17:10 localhost kernel: [    0.000000] Linux version 5.9.6-meson64 (root@xeon) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #20.08.22 SMP PREEMPT Sun Nov 8 12:50:14 CET 2020
Nov 23 11:17:10 localhost kernel: [    0.000000] Machine model: Hardkernel ODROID-C2

September 7, 2020

I never heard of Teedy before... It has a beautiful UI though. But considering it's written in Java, I can't call it lightweight. Every Java app I run uses about 6 times the amount of memory compared to Python apps. Rust or C/C++ would be best, considering most ARM boards don't get more than 4GB's of RAM.

I might try it out on an old C2, to get a feeling of how it compares to the other ones.

April 29, 2020

On 4/25/2020 at 12:25 PM, Tido said:

After reading the whole documentation it is time to wrap up some of the open points.

Do you have some particular things or just in general, maybe also it is not so nice structured?

In general, a lot of things are not documented or are documented as comments within the code and config files. So besides the documentation, you need to read the code and config files to figure out how everything works.

On 4/25/2020 at 12:25 PM, Tido said:

is this a large package or rather small and it makes sense to include it in any case?

This is a small package, but probably not worthwile since it's only helpful for storing text-based documents, which isn't the core.

On 4/25/2020 at 12:25 PM, Tido said:

But there is a command to re-run the tagging algorithm

True, but it doesn't fix the fact that the database is locked during operations, making it sometimes annoying to work with Paperless. I'm going to find out if it is possible to use MariaDB or PostgreSQL, since they only lock records and not the complete database for writing.

On 4/25/2020 at 12:25 PM, Tido said:

Where did you find this information or how did you do that. Did you define the Volumes outside of /var/lib/docker/ ?

I didn't, it's not documented. I've read the docker documentation and found out how I was able to use my own locations for volumes. I'll upload my docker-compose.yml sometime.

On 4/25/2020 at 12:25 PM, Tido said:

But you scan documents still with 300dpi ?

Yes, the scanned documents are still 300dpi. I actually think it is 600dpi in my case.

On 4/25/2020 at 12:25 PM, Tido said:

Did look for or write some parsers.py?

Yes, some people are trying this, but it isn't very easy since Paperless in it's core wasn't designed for this.

17 hours ago, Tido said:
fair enough, but where do I place such a file? In the documentation it says:
# After a document is consumed, Paperless can trigger an arbitrary script if you like. This script will be passed a number of 
# arguments for you to work with.  The default is blank, which means nothing will be executed.  For more
# information, take a look at the docs:
# http://paperless.readthedocs.org/en/latest/consumption.html#hooking-into-the-consumption-process
PAPERLESS_POST_CONSUME_SCRIPT="/path/to/an/arbitrary/script.sh"
/home/paperless/ because this one is created with step 7. of the docker installation? (I guess unless I got it simply by one of my many try & error)

Well, I give it a shot. /home/paperless/post_consume_script.sh

You should probably place the script in a folder on your host and then use file mapping to map a file from the host to the container: https://docs.docker.com/compose/compose-file/#volumes

April 16, 2020

2 hours ago, Tido said:

Voila, back in town

I don't understand, it says in the man page: Inotify can be used to monitor individual files, or to monitor directories.

So, this seems to be a necessary function. I looked within Paperless in the log and saw by accident that the: PARSE FAILURE for /consume/Kaufbeleg_digitec_AMD_Ryzen_186722.pdf Actually, was missing permission on the file I pasted there. So, quick and dirty: chmod 0777 *

In my case `disable-notify` is needed, because my consume folder is on a NFS-network location. inotify doesn't work on network locations, so new files would never be processed. Because I'm using NFS, rights are not an issue (if you set the UID and GID to the same from the NFS server.)

Quote

Reading my comment above, my PDF files were scanned and it grabed the right invoice date from the file. As I am writing... your step below maybe only necessary for scanned OCR docs, and if so, why. I mean the sorting order gets destroyed.

Regarding the date: in the Netherlands we use DMY dates. I noticed that Paperless wouldn't detect any correct date when this was set to YMD.

Quote

I guess I wanted to much. So, let's start little:

The scanner shall put the scanned documents into a folder. Based on the document I would like to use a naming schema and a tool can help with shortcuts to easy rename the scanned document (Autokey-py3). Finally, it should be put into the consume folder of Paperless - something like this could move it based on a rule: https://github.com/benjaminoakes/maid or a tool that 5 minutes after the file-name changed from the format of the scanner, it puts it into the consume folder of Paperless.

I guess this idea is nice, but I still don't understand how that script would be able to define the correct filename. E.g. my scanner scans to my NAS and it sets a default filename, which always is the serial number of the scanner, appended with a number. So ABC7483393939_000001.pdf. There would be no way for any software to know what this file is. So that's where Paperless and OCR come in, reading and automatically tagging it.

I guess the only way to make this work, is to indeed scan to a 'pre-Paperless' location and pre-process it. Paperless however does support POST-OCR scripts, so maybe it would be worthwile to check that out. I assume you can change the Title (Filename) of the consumed file, based on the OCR results:

Quote

"Correspondents you can set some Match keywords" - in your case either a person or a shop name?
Did you have add MediaMarkt so it would match it to the bon?

Yes, so in the match field I've added `mediamarkt "media markt" redcoon`, so all scans containing those strings will automatically be assigned to correspondent MediaMarkt.

April 15, 2020

18 hours ago, Tido said:

Mayan simply boots automagically within the boot process. How do you handle it with Paperless?

This is the same with Paperless as it is with Mayan. By setting the restart policy in the docker-compose file or in the docker run command. I use “unless-stopped”.

April 14, 2020

I haven’t tested exporting documents yet. I did notice that when downloading a file, the filename will become ‘Date of the file_Title of document’.

Title of document is the original filename, if you didn’t change it.

Documentation regarding exporting all files: https://paperless.readthedocs.io/en/latest/utilities.html#the-exporter

I’ve been using Paperless for a few moments now and I have to say it really seems to be what I was looking for.

On a technical level I’ve seen that the documents are saved with numeric filename (00000010.pdf), while Mayan uses UIDs. I don’t know which is better, but since Paperless seems to have quite a large community of home users, I assume that any issues regarding this would’ve been noticed by now.

April 13, 2020

So after playing around with Paperless for a few hours and with a few testruns, I have to admit I'm starting to get more positive. The downside still is that documentation is lacking and that development seems slowed down quite a bit. On the plus side, when you know what to do, this tool can work very well for you.

Some less positive points:

It doesn't support Office-type of files. So no docx, odt, xlsx, etc. This issue isn't too big, since I'm using it mostly for files I received/scanned. And if I receive an Office-type of document, it isn't very hard converting it to PDF.
It does support TXT, CSV and MD files. However, the default Dockerfile doesn't account for this functionality. So you'll need to add 'ghostscript-fonts' to the added packages, or add it to the consumer container manually afterwards if you want to use this.
While consuming, it's impossible to add new tags or correspondents due to SQLite being locked.

Some more positive points:

By additionally mounting paperless.conf via the volumes in both containers, a lot of configuration changes can be made. And easier then sh-ing into the containers.
- E.g. encryption of saved files can be enabled
- You can set the date order (default YMD, I set it to DMY)
  - This is very worthwile, because with this, Paperless will read the OCR'ed file and detect the date of the file. I successfully tested this with some invoices.
- You can set the default language for tesseract. I set it to Dutch, and this really speeds up the process of consuming documents, instead of trying English first, before any other languages.
- Also I've set the OCR quality to 150dpi instead of 300dpi, which also helps speeding up the OCR process. Since my scanner is high quality, I don't assume this will become an issue.
- And most important: you can enable "forgiving OCR", which means that a file is consumed, even if OCR failed!
In tags and correspondents you can set some Match keywords to search for. If Paperless finds those, the correspondent and or tags will automatically be added to the consumed document. I added an invoice from a retailer, and after consuming, the date was correct, the correspontent was correct and the right tags were added

I'm going to scan some files and upload them to my development box to test if everything will still work as expected. If it does, I might replace Mayan wih Paperless.

Edit: In the image you can see two POS-tickets I scanned, which were from 2015. Paperless automatically found the correct correspondent, MediaMarkt. In the first run I tried to see if it would automatically find the correct date (July 2), which was correct. On the second run I wanted to know if automatic tagging worked (bon), and that worked.

It isn't flawless, especially with these POS-tickets degrading over time. E.g. for some IKEA tickets Paperless was unable to determine the correct date. I guess that this issue will be smaller with recent tickets without the amount of degradation these have.

Paperless.png.547ec644cf2362d5fcedb94779c2bb14.png

April 13, 2020

It’s true that initial setup of Paperless is quite ok. However, as you noticed, you have to use the command line in order to change settings and setup the user. Basically everything to setup happens via the CLI.

In my case I also had to disable inotify. This is once again a specific setting which needs to be changed before starting the container, because otherwise it would never detect any of my files in the consume directory.

The consumption process on my side is also less reliable than with Mayan.

It’s very slow. Where Mayan processes a PDF including OCR with in seconds I need to wait minutes on Paperless
When Paperless is unable to execute OCR or detects a language for which you haven’t installed tesserae-ocr, than the consumption fails and your document is never added. There is no way to override it. Because of some reason Paperless thought one of my documents was in Portuguese, so it simply doesn’t process it.
It’s impossible to add files other that PDF, JPG and TIFF. Mayan will convert DOCX and ODT to PDF while processing the file.

On the other hand:

Paperless gives me the ability to quickly search on correspondent, date and text in the file which is the basic functionality I’m looking for. This works out of the box, while you need to configure this with Mayan.

So I’m still very much on the fence regarding Paperless... I still prefer=er Mayan, but it’s resource requirements are out of the roof...

So neither Mayan or Paperless will (by default) rename files. Mayan will not do that, because it’s Metadata-driven. You should use metadata and I think you can setup rules to add specific metadata when some text has been found in the OCR data.

Paperless can’t do that, but when reading the manual, you probably can write a hook function in order to do that after the consumption.

Also most DMS systems can export all files, I’d desired, using specific naming conventions.

37 minutes ago, Tido said:

Yesterday evening I was looking for films on YT and came across this one : Open Source Document Management System - Papermerge

Warning, it is pretty new and maybe not as feature rich, but it looks good what he shows: https://www.youtube.com/watch?v=U_x8fOhuMTI

https://github.com/ciur/papermerge

I have seen this application as well indeed. But my biggest gripe is that it tries to be a file system, with conventions such as folders. For my the file names are irrelevant. My requirements are:

Categorise on sender (correspondent)
Categorise on type of document (tagging)
OCR
Search on date, correspondent, tag and document text

I don’t want another file system. I want to use metadata in order to find my files. So with these requirements Paperless should be a fit, but I’m still not liking the small issues I’ve found until now.

Edit: I just found out about https://github.com/the-paperless-project/paperless/blob/1c956652f360e58409c8fca148b7662585dd1087/paperless.conf.example. Maybe this file should be added to volumes in order to change settings somewhat more easy.

April 12, 2020

I don't know why it failed. But here are the steps I took to get Paperless running next to Mayan on my dev/test Odroid:

git clone https://github.com/the-paperless-project/paperless.git
cd paperless
cp docker-compose.yml.example docker-compose.yml
cp docker-compose.env.example docker-compose.env
docker-compose up -d

I edited docker-compose.env to change variables for Timezone and OCR Languages:

TZ=Europe/Amsterdam
PAPERLESS_OCR_LANGUAGES=nld deu eng

With these steps, Paperless will be build and run on port 8000. This process takes about 15 minutes on my Odroid C2.

Maybe you can try again with these steps.

One thing I did notice already: the consumption of PDF files takes waaaay longer with Paperless then with Mayan. But in my short test this application actually seems worthwile. I'm going to test it further as well.

April 11, 2020

No problem! I want it for private use. It’s true wat you say about paperless, that it supports web upload (HTTP POST). The big difference is that you need to create/write/develop the form to upload a document yourself. A lot of functionality lacks out of the box.

In Mayan, you simply go to the settings and enable a web form for the upload and it works. So Mayan has a larger footprint, but is also more complete in my opinion. Actually, there is about nothing you can do regarding settings from the Web UI with Paperless, in contrary to Mayan.

Maybe I haven’t looked at it long enough, but if such features would be user friendly to enable and work with, then I’d probably opt for paperless.

Still some functions that make me feel that Mayan also is a great solution for personal use:

Custom metadata (such as who send a document, which category, date, etc)
Custom indexes: it’s possible to navigate documents using the custom metadata (e.g. I want to look through my invoices which I received in January of 2020)
Besides these configuration steps everything works out of the box

Have you installed Paperless and compared it to Mayan? I’m very curious if you may find it different.

April 11, 2020

10 hours ago, Tido said:

I don't know what you had to tweak on the script and if you sent a merge-request to the Mayan Gitlab, because as it is, it doesn't work.

tesseract-ocr languages ... to improve the script in such a way, only makes sense if there is the chance to improve it in general I guess? (see next comment)

The changes made are in no way valuable for upstream. The original script simply pulls the AMD64 image from Docker Hub, which is way quicker and easier than building the image during setup.

10 hours ago, Tido said:

So, instead of checking what is really necessary the script simply does everything? Could the script be changed so it only updates the Mayan image and attaches the Postgres & Redis?

Or could the part be copied to create the Mayan-only image and re-attach the Postgres & Redis (like having one script for inital build and another script for the update)?

Probably creating a second script to only update the Mayan image and container would be a simpler solution. However, recreating the containers for Postgres and Redis barely takes up measurable time on my C2. So it's not worth the effort. I assume higher end boards, such as N2 and Rock Pi 4 wouldn't even notice this part of the script.

The more interesting question would be: how to know if a new version was released and trigger a new build? Best practice obviously is not to do that on production systems, but otherwise you'd have to monitor the Mayan releases yourself and then decide when to trigger the new build. Unless you schedule the build.

10 hours ago, Tido said:

I am looking for a DMS for a long time. There is another DMS Paperless, similar idea, but smaller: https://paperless.readthedocs.io/en/latest/setup.html#setup-installation-docker could this be a better solution?

I've looked at Paperless myself as well. About a year ago the developer announced he wouldn't be very active anymore. I just noticed that the community took over, so I quickly did a test and these are my findings:

Paperless, just like Mayan, only offers an AMD64 image, so ARM images should be build by yourself
On my C2, Building Paperless takes about 10 - 15 minutes, compared to the 1 hour from Mayan
Memory consumption out of the box is about 50 MiB, versus Mayan's 350 MiB on my C2
Building the image is way more fiddly, and scripting it would require too much effort
- You need to clone the Git repo
- You need to edit some config files
- And from that moment you can start building

My conclusion would be that anyone who would like to use Paperless should build the image with the instructions from Paperless manual. After you've build the image, you probably can build new versions again after refreshing from Git.

After playing arount with Paperless, I found it less suitable for me. I also am looking for a DMS, and Mayan offers way more flexibility and more features regarding sorting files, searching, metadata etc. Paperless doesn't even allow for a web upload of a file, which is something that I need.

April 10, 2020

4 hours ago, Tido said:

I just give it a try on the Rock Pi 4b: INSTALL_DOCKER=true sh get-mayan-edms.sh

The script did quite a lot. I think at one point it even updated the whole system but I cannot find and see any code in the script doing that, unless armbian is configured to do unattended update.. well I also found that Thunderbird & OpenOffice is back. So, who knows what else has changed lately.

As you have mentioned before it took almost an hour. Now and then I checked htop, the SoC didn't go above 60° so I guess the busiest part was on the SDcard.

This script doesn't update the system, it only installs docker when the variable is set. But great to know the build also worked for the Rock Pi!

4 hours ago, Tido said:

would this solve it? https://docs.mayan-edms.com/chapters/docker/customizing.html?

Maybe... I could add an additional variable where you can enter the tesseract-ocr languages. But if this script would eventually be called from Softy, the question would never be asked, so a default install is performed.

4 hours ago, Tido said:

If I were installing WordPress, I had a WordPress-Container, an Apache and a Postgres. These I would have to 'connect' to eachother. And I could update each container-image independent of the others, right?

And if so, why is it different for Mayan?

The Mayan containers can be updated independently, but this script was made for easy set-up. So it'll remove all the containers and create them again on every build. The used images for Postgres and Redis stays the same, the container just gets a new id.

4 hours ago, Tido said:

I wonder why the Memory line is completely filled while it only reports 1.43GB usage:

I think the yellow line is the cache and is available for other applications when they need it. Mine shows almost the same:

afbeelding.png.858a6b73f49ad559f00370afaf751685.png

April 10, 2020

Yes, I guess updating would be quicker. But I personally wouldn't want to try; if a new version in a container would fail, it's easier to roll back.

I also changed the script a little bit. I figured that the version number is stored in the Git repo, so I'm using that in the script. So the current script is able to always build the newest Mayan version and start a container with that version.

April 9, 2020

No, installing on bare metal wouldn't lower memory usage. Maybe 1 or 2MiB from the Docker overhead, but isn't worth the trouble of installing Mayan. I'd still recommend a container (Docker or podman). Mayan has high system requirements: https://docs.mayan-edms.com/parts/installation.html#minimum-hardware-requirements

Considering this it simply doesn't make sense to install it on lower end ARM devices. It should have at least 1GiB of RAM, but that is the bare minimum. 2GiB is recommended, so a Raspberry Pi 3 would be the bare minimum for running Mayan EDMS. But a Pi 4 or Odroid C2 with 2GB would be a better choice.

April 9, 2020

3 hours ago, Tido said:

I have to admit I am a total noob if it comes to Docker. Are there some tools to improve building such an image or tweaks to bring down building time (reuse some parts the next time) ?

Considering the complexity and all the dependencies I doubt it. The buildfile for Mayan EDMS uses Debian Slim and removes a lot of packages during the build in order to keep the resulting image as small as possible. It theoretically would be possible to to switch to Alpine, but considering all dependencies for Mayan I don't think it's worth the trouble.

For every new version of Mayan a new image should be build. So that would mean an hour of time from a C2 or RPi3. For anything lower end I wouldn't even consider Mayan EDMS, it's way to heavy.

Right now I'm trying to figure out if I can extend the script in order to automatically get the latest version number from here: https://docs.mayan-edms.com/releases/index.html or here: https://pypi.org/project/mayan-edms/

If I'm able to do that, then this script will be able to automatically build the latest version and use it to create the container.

I've never installed Mayan using Softy, so I don't know if the user can change the Environmental Variables before the script actually starts.

April 9, 2020

So with a few modifications in the script from Mayan I was able to build the image on my C2. Building on the C2 with Class 10 SD Card takes about 50 minutes, so I assume that a Raspberry Pi 3 might need more than 1 hour.

However there are some issues which I haven't figured out, since I usually don't write or edit shell scripts.

The default Installation script pulls mayanedms:latest, however during the build a versioned image is created. This means that the variable DOCKER_MAYAN_IMAGE should be updated for every new version. I don't know if there is some automatic way to do this or if the script needs updating after every release.
Right now it's not possible to add additional tesseract-ocr languages. They should be added when creating the container, but since that happens in the script the only way to do that is to remove the container after the script finishes and create it again with the right environmental variable.

Another small gripe is the memory usage. On my C2 it uses about 900MiB of memory and on my N2 about 1300MiB, so that's quite a lot.

Besides those bullets it pretty much works ok on my Odroid C2 and N2.

https://gist.github.com/w0ndersp00n/86cd913616d64eb90674aedf4b6f6d0d

April 5, 2020

Building on the N2 takes about 5 to 10 minutes, so it's not that bad. The resulting image is about 1.2 GB in size.

I'm not really someone who can write great scripts, but I'll get out my old C2 and try to make a script that builds the image and then starts Docker with it.

April 5, 2020

Actually, the current Dockerfile is working for aarch64. I've tested it on my N2. The issue is that the GitLab CI right now seems to lack the option to build ARM images, that's why they're not supplied. You have to build on the platform for which the image should be.

On my N2 I followed this guide: https://docs.mayan-edms.com/chapters/docker/building.html

I only changed the tag in the Makefile, because I didn't know if it would conflict.

After building locally, you can start the container. As of now I haven't noticed any issues, but haven't been using it longer than a few hours.

Basically, the script in Armbian Config to install Mayan EDMS will never work, because it tries to use an AMD64/x64 image. It could be possible to change the script, so that the SBC will build the image itself. Another option is, if anyone has experience with it, to automatically build the aarch64 image and publish it on the Docker Hub.

April 4, 2020

The default Mayan EDMS docker image is only built for AMD-64. It doesn't work on ARM, so this will never work.

Someone might write a Dockerfile for armhf and or aarch64, which we can use for this, or Mayan should be installed on bare metal.

See:

Sign In

Forums

Store

Crowdfunding

Applications

Events

Raffles

Community Map

Posts posted by w0ndersp00n

Important Information