belegdol Posted January 10, 2022 Posted January 10, 2022 (edited) Armbianmonitor: http://ix.io/3LM4 Hello, I have recently upgraded OMV to version 6 and armbian to bullseye alongside it: https://forum.openmediavault.org/index.php?thread/41361-odroid-hc1-armbian-update-report/ Since the upgrade, I am getting daily emails from armbian-truncate-logs with the following content: Spoiler [0;1;38;5;185mJournal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000501-0005d513e7226c26.journal is truncated, ignoring file.[0m Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e63fd8387-4776da5b1e9dd6f3.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a4a51b-87ba53078992bfa5.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a4a140-b35ae9abf787edae.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a3258e-c7aba7539735db3b.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a32012-ca3c7661c922afba.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a30ac0-aedc088d247a140d.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a30681-a55dcd06694596c8.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2ea709fb-9ed166ca6e53c2ff.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2ea70533-d499487ff39624c0.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e341a38-b58dae80ccbb7c87.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e3417f6-7a9fec1bb8a1b3f7.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e3412b5-c7fb31d00135222b.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e341019-934fb8415cd40f91.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fb49c-7cf988dd2f664e3f.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fb270-66dc045e95d36496.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fae48-f3f01a9cb62d8b1c.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fabca-bb27481fdfb1f890.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2f9349-700a878c5b79152d.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d52e2e2f9242-fe8248d773b88d8a.journal~ (4.0K). Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000000-0000000000000000.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b19a-0005d4fded950953.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b38c-0005d4ffb75b9065.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b572-0005d50161433b92.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b75c-0005d502f8a68305.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b94f-0005d504c2631f64.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-0000000000000001-0005d505f297fe4e.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000bd79-0005d50705c4e189.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000bf66-0005d508d6a665bc.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c15b-0005d50ab24a1923.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c348-0005d50c7885cebb.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c539-0005d50e3782286a.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c729-0005d510014ec802.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@baf75df6e52d418c8c04ceed18842c30-000000000000c756-0005d510197fd60b.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-0000000000000001-0005d5107aa56535.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d5107aaa3489-a8751f0289eed60a.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-00000000000002c5-0005d5107aab2059.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-000000000000042d-0005d5107af9965d.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@87e66865628244fdbc41665a50089cb4-00000000000004d7-0005d5107f970502.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-0000000000000001-0005d510908cae71.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d5109091a7db-6ee4991a90d609e3.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-00000000000002c9-0005d5109092920d.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d51090929e1e-584ca9aa3dbfe3df.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-0000000000000433-0005d51090e347b5.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@ceee62826fcf4169aed887af96d8a622-0000000000000507-0005d510971971cb.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-0000000000000001-0005d510999e4b9e.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-00000000000002c8-0005d51099a387a0.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000045d-0005d5109fb54784.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-00000000000004f9-0005d510a75d59c2.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000063d-0005d5118e3dfb01.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-00000000000006c9-0005d5120ae34980.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000080c-0005d512c1ceb772.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-0000000000000875-0005d51319748bab.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-0000000000000001-0005d513b76dc4c7.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d513b7737844-b633ccf7eb74d687.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-00000000000002cf-0005d513b7763a61.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d513b7765fe2-32d72f86dd595ef1.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-0000000000000478-0005d513b7f5f7dc.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@d9e92d67191948fbb44fe1afc4fa0d9b-00000000000004ae-0005d513b9fbc39f.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000001-0005d513be8d3d75.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-00000000000002d1-0005d513be9222f1.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d513be92247e-bc989cbce4d1503e.journal~ (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000466-0005d513dea5d241.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000501-0005d513e7226c26.journal (564.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-000000000000063f-0005d514cbf6f439.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000853-0005d5161fbae3eb.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000a47-0005d517f4303b95.journal (640.0K). Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-00000000000012ec-0005d51f82ff598e.journal (640.0K). Vacuuming done, freed 30.0M of archived journals from /var/log/journal/1ded17e370994bc2bfab08257042ce4c. Vacuuming done, freed 0B of archived journals from /var/log/journal. Vacuuming done, freed 0B of archived journals from /run/log/journal. I am not sure if this is expected or not, but I was not getting these with OMV 5. Edited February 5, 2022 by TRS-80 put long output inside spoiler 0 Quote
Igor Posted January 11, 2022 Posted January 11, 2022 Probably this is due OMV but not 100% sure. Try tweaking things here: https://github.com/armbian/build/blob/master/packages/bsp/common/usr/lib/armbian/armbian-truncate-logs#L32 /usr/lib/armbian/armbian-truncate-logs on your filesystem. Then we can fix this within next release. If this is a problem. This script is executed with cron and crond is the one that alerts you. 0 Quote
belegdol Posted January 11, 2022 Author Posted January 11, 2022 (edited) The command on its own seems to be fine: $ [ /var/log/journal ] && sudo journalctl --vacuum-size=5M Vacuuming done, freed 0B of archived journals from /var/log/journal. Vacuuming done, freed 0B of archived journals from /var/log/journal/1ded17e370994bc2bfab08257042ce4c. Vacuuming done, freed 0B of archived journals from /run/log/journal. The question is why am I getting the email. Does cron always send a message, or only if it finds a problem? If it is the latter, maybe lack of space in /var/log is an issue: Spoiler [26628.214110] systemd-journald[607]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [113028.779917] systemd-journald[607]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [113028.780668] systemd-journald[607]: Failed to create new system journal: No space left on device [113028.781250] systemd-journald[607]: Failed to create new user journal: No space left on device [113028.781716] systemd-journald[607]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message [113028.781980] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113028.782503] systemd-journald[607]: Failed to open system journal: No space left on device [113028.788252] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113028.788778] systemd-journald[607]: Failed to open system journal: No space left on device [113028.788892] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113028.789350] systemd-journald[607]: Failed to open system journal: No space left on device [113028.789955] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113028.790402] systemd-journald[607]: Failed to open system journal: No space left on device [113028.790511] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113028.790936] systemd-journald[607]: Failed to open system journal: No space left on device [113029.076074] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113029.076625] systemd-journald[607]: Failed to open system journal: No space left on device [113029.076745] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113029.077471] systemd-journald[607]: Failed to open system journal: No space left on device [113029.078089] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113029.078556] systemd-journald[607]: Failed to open system journal: No space left on device [113029.078669] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113029.079063] systemd-journald[607]: Failed to open system journal: No space left on device [113036.609932] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113036.610928] systemd-journald[607]: Failed to open system journal: No space left on device [113036.611158] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113036.612008] systemd-journald[607]: Failed to open system journal: No space left on device [113086.679884] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.680792] systemd-journald[607]: Failed to open system journal: No space left on device [113086.680981] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.681952] systemd-journald[607]: Failed to open system journal: No space left on device [113086.686431] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.687256] systemd-journald[607]: Failed to open system journal: No space left on device [113086.687839] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.688560] systemd-journald[607]: Failed to open system journal: No space left on device [113086.785037] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.785797] systemd-journald[607]: Failed to open system journal: No space left on device [113086.786029] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [113086.786464] systemd-journald[607]: Failed to open system journal: No space left on device [113146.868735] systemd-journald[607]: Failed to open system journal: No space left on device [113146.868993] systemd-journald[607]: Failed to open system journal: No space left on device [113146.871035] systemd-journald[607]: Failed to open system journal: No space left on device [113146.871310] systemd-journald[607]: Failed to open system journal: No space left on device [113146.938203] systemd-journald[607]: Failed to open system journal: No space left on device [113146.938404] systemd-journald[607]: Failed to open system journal: No space left on device [113207.001264] systemd-journald[607]: Failed to open system journal: No space left on device [113207.002216] systemd-journald[607]: Failed to open system journal: No space left on device [113207.009388] systemd-journald[607]: Failed to open system journal: No space left on device [113207.010285] systemd-journald[607]: Failed to open system journal: No space left on device [113207.097300] systemd-journald[607]: Failed to open system journal: No space left on device [113207.097454] systemd-journald[607]: Failed to open system journal: No space left on device [113267.163403] systemd-journald[607]: Failed to open system journal: No space left on device [113267.164291] systemd-journald[607]: Failed to open system journal: No space left on device [113267.171425] systemd-journald[607]: Failed to open system journal: No space left on device [113267.172404] systemd-journald[607]: Failed to open system journal: No space left on device [113267.273327] systemd-journald[607]: Failed to open system journal: No space left on device [113267.273597] systemd-journald[607]: Failed to open system journal: No space left on device [113326.341104] systemd-journald[607]: Failed to open system journal: No space left on device [113326.341766] systemd-journald[607]: Failed to open system journal: No space left on device [113326.346878] systemd-journald[607]: Failed to open system journal: No space left on device [113326.347178] systemd-journald[607]: Failed to open system journal: No space left on device [113326.350062] systemd-journald[607]: Failed to open system journal: No space left on device [113326.350340] systemd-journald[607]: Failed to open system journal: No space left on device [113326.353332] systemd-journald[607]: Failed to open system journal: No space left on device [113326.353563] systemd-journald[607]: Failed to open system journal: No space left on device [113326.364300] systemd-journald[607]: Failed to open system journal: No space left on device [113326.364627] systemd-journald[607]: Failed to open system journal: No space left on device [113326.453178] systemd-journald[607]: Failed to open system journal: No space left on device [113326.453803] systemd-journald[607]: Failed to open system journal: No space left on device [113386.500083] systemd-journald[607]: Failed to open system journal: No space left on device [113386.500396] systemd-journald[607]: Failed to open system journal: No space left on device [113386.503305] systemd-journald[607]: Failed to open system journal: No space left on device [113386.503540] systemd-journald[607]: Failed to open system journal: No space left on device [113386.613565] systemd-journald[607]: Failed to open system journal: No space left on device [113386.613952] systemd-journald[607]: Failed to open system journal: No space left on device [113446.667018] systemd-journald[607]: Failed to open system journal: No space left on device [113446.667324] systemd-journald[607]: Failed to open system journal: No space left on device [113446.671876] systemd-journald[607]: Failed to open system journal: No space left on device [113446.672219] systemd-journald[607]: Failed to open system journal: No space left on device [113446.779780] systemd-journald[607]: Failed to open system journal: No space left on device [113446.780345] systemd-journald[607]: Failed to open system journal: No space left on device [113506.821245] systemd-journald[607]: Failed to open system journal: No space left on device [113506.821448] systemd-journald[607]: Failed to open system journal: No space left on device [113506.822899] systemd-journald[607]: Failed to open system journal: No space left on device [113506.823055] systemd-journald[607]: Failed to open system journal: No space left on device [113506.919419] systemd-journald[607]: Failed to open system journal: No space left on device [113506.919894] systemd-journald[607]: Failed to open system journal: No space left on device [113566.976432] systemd-journald[607]: Failed to open system journal: No space left on device [113566.976674] systemd-journald[607]: Failed to open system journal: No space left on device [113566.979690] systemd-journald[607]: Failed to open system journal: No space left on device [113566.979939] systemd-journald[607]: Failed to open system journal: No space left on device [113566.995377] systemd-journald[607]: Failed to open system journal: No space left on device [113566.995622] systemd-journald[607]: Failed to open system journal: No space left on device [113567.002051] systemd-journald[607]: Failed to open system journal: No space left on device [113567.002414] systemd-journald[607]: Failed to open system journal: No space left on device [113567.013187] systemd-journald[607]: Failed to open system journal: No space left on device [113567.013569] systemd-journald[607]: Failed to open system journal: No space left on device [113567.066317] systemd-journald[607]: Failed to open system journal: No space left on device [113567.066498] systemd-journald[607]: Failed to open system journal: No space left on device [113567.183691] systemd-journald[607]: Failed to open system journal: No space left on device [113567.183932] systemd-journald[607]: Failed to open system journal: No space left on device [113567.667739] systemd-journald[607]: Failed to open system journal: No space left on device [113567.669067] systemd-journald[607]: Failed to open system journal: No space left on device [113567.671704] systemd-journald[607]: Failed to open system journal: No space left on device [113567.672238] systemd-journald[607]: Failed to open system journal: No space left on device [113627.119848] systemd-journald[607]: Failed to open system journal: No space left on device [113627.120585] systemd-journald[607]: Failed to open system journal: No space left on device [113627.125737] systemd-journald[607]: Failed to open system journal: No space left on device [113627.126504] systemd-journald[607]: Failed to open system journal: No space left on device [113627.216154] systemd-journald[607]: Failed to open system journal: No space left on device [113627.216482] systemd-journald[607]: Failed to open system journal: No space left on device [113627.799278] systemd-journald[607]: Failed to open system journal: No space left on device [113627.800450] systemd-journald[607]: Failed to open system journal: No space left on device [113686.261036] systemd-journald[607]: Failed to open system journal: No space left on device [113686.261247] systemd-journald[607]: Failed to open system journal: No space left on device [113686.262684] systemd-journald[607]: Failed to open system journal: No space left on device [113686.262841] systemd-journald[607]: Failed to open system journal: No space left on device [113686.360601] systemd-journald[607]: Failed to open system journal: No space left on device [113686.360948] systemd-journald[607]: Failed to open system journal: No space left on device [113746.435822] systemd-journald[607]: Failed to open system journal: No space left on device [113746.436750] systemd-journald[607]: Failed to open system journal: No space left on device [113746.445572] systemd-journald[607]: Failed to open system journal: No space left on device [113746.445857] systemd-journald[607]: Failed to open system journal: No space left on device [113746.448816] systemd-journald[607]: Failed to open system journal: No space left on device [113746.449361] systemd-journald[607]: Failed to open system journal: No space left on device [113746.450591] systemd-journald[607]: Failed to open system journal: No space left on device [113746.450865] systemd-journald[607]: Failed to open system journal: No space left on device [113746.544196] systemd-journald[607]: Failed to open system journal: No space left on device [113746.544430] systemd-journald[607]: Failed to open system journal: No space left on device [113746.545632] systemd-journald[607]: Failed to open system journal: No space left on device [113746.545846] systemd-journald[607]: Failed to open system journal: No space left on device [113746.546349] systemd-journald[607]: Failed to open system journal: No space left on device [113746.546562] systemd-journald[607]: Failed to open system journal: No space left on device [113806.589357] systemd-journald[607]: Failed to open system journal: No space left on device [113806.589675] systemd-journald[607]: Failed to open system journal: No space left on device [113806.592839] systemd-journald[607]: Failed to open system journal: No space left on device [113806.593158] systemd-journald[607]: Failed to open system journal: No space left on device [113806.595177] systemd-journald[607]: Failed to open system journal: No space left on device [113806.595409] systemd-journald[607]: Failed to open system journal: No space left on device [113806.596137] systemd-journald[607]: Failed to open system journal: No space left on device [113806.596370] systemd-journald[607]: Failed to open system journal: No space left on device [113806.705618] systemd-journald[607]: Failed to open system journal: No space left on device [113806.705943] systemd-journald[607]: Failed to open system journal: No space left on device [113806.707790] systemd-journald[607]: Failed to open system journal: No space left on device [113806.708107] systemd-journald[607]: Failed to open system journal: No space left on device [113806.708787] systemd-journald[607]: Failed to open system journal: No space left on device [113806.709249] systemd-journald[607]: Failed to open system journal: No space left on device [113866.778570] systemd-journald[607]: Failed to open system journal: No space left on device [113866.780453] systemd-journald[607]: Failed to open system journal: No space left on device [113866.792830] systemd-journald[607]: Failed to open system journal: No space left on device [113866.794099] systemd-journald[607]: Failed to open system journal: No space left on device [113866.802560] systemd-journald[607]: Failed to open system journal: No space left on device [113866.803391] systemd-journald[607]: Failed to open system journal: No space left on device [113866.806297] systemd-journald[607]: Failed to open system journal: No space left on device [113866.806978] systemd-journald[607]: Failed to open system journal: No space left on device [113866.859344] systemd-journald[607]: Failed to open system journal: No space left on device [113866.859552] systemd-journald[607]: Failed to open system journal: No space left on device [113866.859986] systemd-journald[607]: Failed to open system journal: No space left on device [113866.860152] systemd-journald[607]: Failed to open system journal: No space left on device [113866.860503] systemd-journald[607]: Failed to open system journal: No space left on device [113866.860658] systemd-journald[607]: Failed to open system journal: No space left on device [113926.912306] systemd-journald[607]: Failed to open system journal: No space left on device [113926.912757] systemd-journald[607]: Failed to open system journal: No space left on device [113926.915166] systemd-journald[607]: Failed to open system journal: No space left on device [113926.915412] systemd-journald[607]: Failed to open system journal: No space left on device [113926.917013] systemd-journald[607]: Failed to open system journal: No space left on device [113926.917245] systemd-journald[607]: Failed to open system journal: No space left on device [113926.918643] systemd-journald[607]: Failed to open system journal: No space left on device [113926.918847] systemd-journald[607]: Failed to open system journal: No space left on device [113926.919602] systemd-journald[607]: Failed to open system journal: No space left on device [113926.919823] systemd-journald[607]: Failed to open system journal: No space left on device [113926.920907] systemd-journald[607]: Failed to open system journal: No space left on device [113926.921105] systemd-journald[607]: Failed to open system journal: No space left on device [113926.921531] systemd-journald[607]: Failed to open system journal: No space left on device [113926.921737] systemd-journald[607]: Failed to open system journal: No space left on device [113926.922159] systemd-journald[607]: Failed to open system journal: No space left on device [113926.922352] systemd-journald[607]: Failed to open system journal: No space left on device [113926.922749] systemd-journald[607]: Failed to open system journal: No space left on device [113926.922950] systemd-journald[607]: Failed to open system journal: No space left on device [113926.927739] systemd-journald[607]: Failed to open system journal: No space left on device [113926.928024] systemd-journald[607]: Failed to open system journal: No space left on device [113926.931047] systemd-journald[607]: Failed to open system journal: No space left on device [113926.931291] systemd-journald[607]: Failed to open system journal: No space left on device [113926.935058] systemd-journald[607]: Failed to open system journal: No space left on device [113926.935309] systemd-journald[607]: Failed to open system journal: No space left on device [113926.946344] systemd-journald[607]: Failed to open system journal: No space left on device [113926.946606] systemd-journald[607]: Failed to open system journal: No space left on device [113926.948120] systemd-journald[607]: Failed to open system journal: No space left on device [113926.948408] systemd-journald[607]: Failed to open system journal: No space left on device [113926.949006] systemd-journald[607]: Failed to open system journal: No space left on device [113926.949268] systemd-journald[607]: Failed to open system journal: No space left on device [113927.048069] systemd-journald[607]: Failed to open system journal: No space left on device [113927.048221] systemd-journald[607]: Failed to open system journal: No space left on device [113927.048967] systemd-journald[607]: Failed to open system journal: No space left on device [113927.049107] systemd-journald[607]: Failed to open system journal: No space left on device [113927.049540] systemd-journald[607]: Failed to open system journal: No space left on device [113927.049697] systemd-journald[607]: Failed to open system journal: No space left on device [113930.693376] systemd-journald[607]: Failed to open system journal: No space left on device [113930.693727] systemd-journald[607]: Failed to open system journal: No space left on device [113931.386103] systemd-journald[607]: Failed to open system journal: No space left on device [113931.386386] systemd-journald[607]: Failed to open system journal: No space left on device [113931.388444] systemd-journald[607]: Failed to open system journal: No space left on device [113931.388766] systemd-journald[607]: Failed to open system journal: No space left on device [113931.390198] systemd-journald[607]: Failed to open system journal: No space left on device [113931.390584] systemd-journald[607]: Failed to open system journal: No space left on device [113931.392101] systemd-journald[607]: Failed to open system journal: No space left on device [113931.392513] systemd-journald[607]: Failed to open system journal: No space left on device [113931.393039] systemd-journald[607]: Failed to open system journal: No space left on device [113931.393240] systemd-journald[607]: Failed to open system journal: No space left on device [113931.393744] systemd-journald[607]: Failed to open system journal: No space left on device [113931.393940] systemd-journald[607]: Failed to open system journal: No space left on device [113931.394447] systemd-journald[607]: Failed to open system journal: No space left on device [113931.394667] systemd-journald[607]: Failed to open system journal: No space left on device [113931.395742] systemd-journald[607]: Failed to open system journal: No space left on device [113931.395957] systemd-journald[607]: Failed to open system journal: No space left on device [113931.396586] systemd-journald[607]: Failed to open system journal: No space left on device [113931.396813] systemd-journald[607]: Failed to open system journal: No space left on device [113931.397838] systemd-journald[607]: Failed to open system journal: No space left on device [113931.398042] systemd-journald[607]: Failed to open system journal: No space left on device [113931.398607] systemd-journald[607]: Failed to open system journal: No space left on device [113931.398821] systemd-journald[607]: Failed to open system journal: No space left on device [113931.400094] systemd-journald[607]: Failed to open system journal: No space left on device [113931.400337] systemd-journald[607]: Failed to open system journal: No space left on device [113931.402246] systemd-journald[607]: Failed to open system journal: No space left on device [113931.402447] systemd-journald[607]: Failed to open system journal: No space left on device [113931.403474] systemd-journald[607]: Failed to open system journal: No space left on device [113931.403704] systemd-journald[607]: Failed to open system journal: No space left on device [113931.404393] systemd-journald[607]: Failed to open system journal: No space left on device [113931.404602] systemd-journald[607]: Failed to open system journal: No space left on device [113931.405469] systemd-journald[607]: Failed to open system journal: No space left on device [113931.405700] systemd-journald[607]: Failed to open system journal: No space left on device [113931.406393] systemd-journald[607]: Failed to open system journal: No space left on device [113931.406616] systemd-journald[607]: Failed to open system journal: No space left on device [113931.407408] systemd-journald[607]: Failed to open system journal: No space left on device [113931.407630] systemd-journald[607]: Failed to open system journal: No space left on device [113931.408257] systemd-journald[607]: Failed to open system journal: No space left on device [113931.408444] systemd-journald[607]: Failed to open system journal: No space left on device [113931.409072] systemd-journald[607]: Failed to open system journal: No space left on device [113931.409260] systemd-journald[607]: Failed to open system journal: No space left on device [113931.410965] systemd-journald[607]: Failed to open system journal: No space left on device [113931.411185] systemd-journald[607]: Failed to open system journal: No space left on device [113931.412106] systemd-journald[607]: Failed to open system journal: No space left on device [113931.412324] systemd-journald[607]: Failed to open system journal: No space left on device [113931.412940] systemd-journald[607]: Failed to open system journal: No space left on device [113931.413115] systemd-journald[607]: Failed to open system journal: No space left on device [113931.413805] systemd-journald[607]: Failed to open system journal: No space left on device [113931.413988] systemd-journald[607]: Failed to open system journal: No space left on device [113931.414540] systemd-journald[607]: Failed to open system journal: No space left on device [113931.414717] systemd-journald[607]: Failed to open system journal: No space left on device [113931.415382] systemd-journald[607]: Failed to open system journal: No space left on device [113931.415541] systemd-journald[607]: Failed to open system journal: No space left on device [113931.415963] systemd-journald[607]: Failed to open system journal: No space left on device [113931.416124] systemd-journald[607]: Failed to open system journal: No space left on device [113931.416692] systemd-journald[607]: Failed to open system journal: No space left on device [113931.416876] systemd-journald[607]: Failed to open system journal: No space left on device [113931.417358] systemd-journald[607]: Failed to open system journal: No space left on device [113931.417535] systemd-journald[607]: Failed to open system journal: No space left on device [113931.418248] systemd-journald[607]: Failed to open system journal: No space left on device [113931.418422] systemd-journald[607]: Failed to open system journal: No space left on device [113931.418954] systemd-journald[607]: Failed to open system journal: No space left on device [113931.419112] systemd-journald[607]: Failed to open system journal: No space left on device [113931.419688] systemd-journald[607]: Failed to open system journal: No space left on device [113931.419875] systemd-journald[607]: Failed to open system journal: No space left on device [113931.421721] systemd-journald[607]: Failed to open system journal: No space left on device [113931.421896] systemd-journald[607]: Failed to open system journal: No space left on device [113931.422413] systemd-journald[607]: Failed to open system journal: No space left on device [113931.422619] systemd-journald[607]: Failed to open system journal: No space left on device [113931.422944] systemd-journald[607]: Failed to open system journal: No space left on device [113931.423073] systemd-journald[607]: Failed to open system journal: No space left on device [113931.423351] systemd-journald[607]: Failed to open system journal: No space left on device [113931.423483] systemd-journald[607]: Failed to open system journal: No space left on device [113931.423757] systemd-journald[607]: Failed to open system journal: No space left on device [113931.423891] systemd-journald[607]: Failed to open system journal: No space left on device [113931.424168] systemd-journald[607]: Failed to open system journal: No space left on device [113931.424302] systemd-journald[607]: Failed to open system journal: No space left on device [113931.424585] systemd-journald[607]: Failed to open system journal: No space left on device [113931.424718] systemd-journald[607]: Failed to open system journal: No space left on device [113931.425033] systemd-journald[607]: Failed to open system journal: No space left on device [113931.425171] systemd-journald[607]: Failed to open system journal: No space left on device [113931.425469] systemd-journald[607]: Failed to open system journal: No space left on device [113931.425602] systemd-journald[607]: Failed to open system journal: No space left on device [113931.425904] systemd-journald[607]: Failed to open system journal: No space left on device [113931.426049] systemd-journald[607]: Failed to open system journal: No space left on device [113931.426352] systemd-journald[607]: Failed to open system journal: No space left on device [113931.426487] systemd-journald[607]: Failed to open system journal: No space left on device [113931.426773] systemd-journald[607]: Failed to open system journal: No space left on device [113931.426918] systemd-journald[607]: Failed to open system journal: No space left on device [113931.427213] systemd-journald[607]: Failed to open system journal: No space left on device [113931.427348] systemd-journald[607]: Failed to open system journal: No space left on device [113931.427680] systemd-journald[607]: Failed to open system journal: No space left on device [113931.427836] systemd-journald[607]: Failed to open system journal: No space left on device [113931.428124] systemd-journald[607]: Failed to open system journal: No space left on device [113931.428261] systemd-journald[607]: Failed to open system journal: No space left on device [113931.428559] systemd-journald[607]: Failed to open system journal: No space left on device [113931.428738] systemd-journald[607]: Failed to open system journal: No space left on device [113931.429014] systemd-journald[607]: Failed to open system journal: No space left on device [113931.429147] systemd-journald[607]: Failed to open system journal: No space left on device [113931.429523] systemd-journald[607]: Failed to open system journal: No space left on device [113931.429659] systemd-journald[607]: Failed to open system journal: No space left on device [113931.431519] systemd-journald[607]: Failed to open system journal: No space left on device [113931.431648] systemd-journald[607]: Failed to open system journal: No space left on device [113931.431925] systemd-journald[607]: Failed to open system journal: No space left on device [113931.432056] systemd-journald[607]: Failed to open system journal: No space left on device [113931.432337] systemd-journald[607]: Failed to open system journal: No space left on device [113931.432465] systemd-journald[607]: Failed to open system journal: No space left on device [113931.432738] systemd-journald[607]: Failed to open system journal: No space left on device [113931.432869] systemd-journald[607]: Failed to open system journal: No space left on device [113931.433142] systemd-journald[607]: Failed to open system journal: No space left on device [113931.433275] systemd-journald[607]: Failed to open system journal: No space left on device [113931.433561] systemd-journald[607]: Failed to open system journal: No space left on device [113931.433705] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434007] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434135] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434410] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434547] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434822] systemd-journald[607]: Failed to open system journal: No space left on device [113931.434949] systemd-journald[607]: Failed to open system journal: No space left on device [113931.435229] systemd-journald[607]: Failed to open system journal: No space left on device [113931.435360] systemd-journald[607]: Failed to open system journal: No space left on device [113931.435635] systemd-journald[607]: Failed to open system journal: No space left on device [113931.435763] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436037] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436167] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436439] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436571] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436845] systemd-journald[607]: Failed to open system journal: No space left on device [113931.436979] systemd-journald[607]: Failed to open system journal: No space left on device [113931.437260] systemd-journald[607]: Failed to open system journal: No space left on device [113931.437388] systemd-journald[607]: Failed to open system journal: No space left on device [113931.437662] systemd-journald[607]: Failed to open system journal: No space left on device [113931.437791] systemd-journald[607]: Failed to open system journal: No space left on device [113931.438060] systemd-journald[607]: Failed to open system journal: No space left on device [113931.438189] systemd-journald[607]: Failed to open system journal: No space left on device [113931.438477] systemd-journald[607]: Failed to open system journal: No space left on device [113931.438615] systemd-journald[607]: Failed to open system journal: No space left on device [113931.438901] systemd-journald[607]: Failed to open system journal: No space left on device [113931.439035] systemd-journald[607]: Failed to open system journal: No space left on device [113931.439362] systemd-journald[607]: Failed to open system journal: No space left on device [113931.439511] systemd-journald[607]: Failed to open system journal: No space left on device [113931.441529] systemd-journald[607]: Failed to open system journal: No space left on device [113931.441668] systemd-journald[607]: Failed to open system journal: No space left on device [113931.441957] systemd-journald[607]: Failed to open system journal: No space left on device [113931.442094] systemd-journald[607]: Failed to open system journal: No space left on device [113931.442400] systemd-journald[607]: Failed to open system journal: No space left on device [113931.442529] systemd-journald[607]: Failed to open system journal: No space left on device [113931.442813] systemd-journald[607]: Failed to open system journal: No space left on device [113931.442945] systemd-journald[607]: Failed to open system journal: No space left on device [113931.443226] systemd-journald[607]: Failed to open system journal: No space left on device [113931.443354] systemd-journald[607]: Failed to open system journal: No space left on device [113931.443631] systemd-journald[607]: Failed to open system journal: No space left on device [113931.443763] systemd-journald[607]: Failed to open system journal: No space left on device [113931.444038] systemd-journald[607]: Failed to open system journal: No space left on device [113931.444165] systemd-journald[607]: Failed to open system journal: No space left on device [113931.444461] systemd-journald[607]: Failed to open system journal: No space left on device [113931.444612] systemd-journald[607]: Failed to open system journal: No space left on device [113931.444929] systemd-journald[607]: Failed to open system journal: No space left on device [113931.445077] systemd-journald[607]: Failed to open system journal: No space left on device [113931.445396] systemd-journald[607]: Failed to open system journal: No space left on device [113931.445542] systemd-journald[607]: Failed to open system journal: No space left on device [113931.445847] systemd-journald[607]: Failed to open system journal: No space left on device [113931.445978] systemd-journald[607]: Failed to open system journal: No space left on device Right now /var/log has 29 MB out of 50 MB free so it looks like it fills up intermittently. Most of it is taken by /var/log/samba, despite logging set to 0 and max_log_size set to 1000 in smb.conf. Are logs from /var/log.hdd restored to /var/log on boot? I did some samba debugging back in November, maybe this is the culprit. ETA: I deleted /var/log/samba/log..old and /var/log.hdd/samba/log..old as this file was over 10 MB in size, let'see if it helps. Edited February 5, 2022 by TRS-80 put long output inside spoiler (and code block) 0 Quote
teknoid Posted January 16, 2022 Posted January 16, 2022 Am 11.1.2022 um 21:31 schrieb belegdol: The question is why am I getting the email. Does cron always send a message, or only if it finds a problem? If it is the latter, maybe lack of space in /var/log is an issue: Cron always sends the stdout messages from any scipt via mail. Nothing wrong with that. 0 Quote
belegdol Posted January 16, 2022 Author Posted January 16, 2022 It appears that cleaning up some disk space and removing the corrupted journals from /var/log and /var/log.hdd was enough to stop the emails. 0 Quote
belegdol Posted February 5, 2022 Author Posted February 5, 2022 (edited) I investigated further and the core of the problem appears to be that /var/log is regularly running out of space on my board: Spoiler [Mon Jan 31 00:15:03 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Mon Jan 31 17:55:27 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Mon Jan 31 17:55:27 2022] proc: Bad value for 'hidepid' [Mon Jan 31 17:55:34 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Mon Jan 31 17:56:13 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Mon Jan 31 17:56:13 2022] proc: Bad value for 'hidepid' [Mon Jan 31 17:56:15 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Tue Feb 1 00:00:15 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Tue Feb 1 00:00:15 2022] systemd-journald[611]: Failed to create new system journal: No space left on device [Tue Feb 1 00:00:15 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Tue Feb 1 17:55:25 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Tue Feb 1 17:55:25 2022] proc: Bad value for 'hidepid' [Tue Feb 1 17:55:34 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Wed Feb 2 00:00:05 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Wed Feb 2 17:55:23 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Wed Feb 2 17:55:24 2022] proc: Bad value for 'hidepid' [Wed Feb 2 17:55:31 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Thu Feb 3 00:00:08 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Thu Feb 3 17:55:22 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Thu Feb 3 17:55:22 2022] proc: Bad value for 'hidepid' [Thu Feb 3 17:55:30 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Fri Feb 4 00:00:13 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Fri Feb 4 16:26:33 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Fri Feb 4 16:26:34 2022] proc: Bad value for 'hidepid' [Fri Feb 4 16:26:37 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Fri Feb 4 17:16:36 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Fri Feb 4 17:16:36 2022] proc: Bad value for 'hidepid' [Fri Feb 4 17:16:39 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Fri Feb 4 17:55:21 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Fri Feb 4 17:55:21 2022] proc: Bad value for 'hidepid' [Fri Feb 4 17:55:29 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Sat Feb 5 00:00:15 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Sat Feb 5 00:00:15 2022] systemd-journald[611]: Failed to create new system journal: No space left on device [Sat Feb 5 00:00:15 2022] systemd-journald[611]: Failed to create new user journal: No space left on device [Sat Feb 5 00:00:15 2022] systemd-journald[611]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message [Sat Feb 5 00:00:15 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:15 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device [Sat Feb 5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device I am not sure what is causing this as whenever I check the free space during the day, there seems to be more than enough available: $ sudo df -h Filesystem Size Used Avail Use% Mounted on udev 926M 0 926M 0% /dev tmpfs 200M 4.0M 196M 2% /run /dev/mmcblk0p2 15G 1.8G 12G 13% / tmpfs 996M 0 996M 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 996M 8.0K 996M 1% /tmp /dev/sda1 458G 277G 182G 61% /srv/dev-disk-by-label-omv armbian-ramlog 50M 6.9M 44M 14% /var/log /dev/mmcblk0p1 58M 36M 21M 64% /boot tmpfs 200M 0 200M 0% /run/user/1000 $ sudo du -h /var/log --max-depth=2 0 /var/log/watchdog 0 /var/log/unattended-upgrades 0 /var/log/sysstat 0 /var/log/samba/cores 172K /var/log/samba 0 /var/log/salt 0 /var/log/runit/ssh 0 /var/log/runit 0 /var/log/proftpd 0 /var/log/private 0 /var/log/openmediavault 108K /var/log/nginx 6.3M /var/log/journal/1ded17e370994bc2bfab08257042ce4c 6.3M /var/log/journal 12K /var/log/cron-apt 0 /var/log/chrony 0 /var/log/apt 6.9M /var/log 50 MB still seems to be the default. I guess I need to check around midnight to be sure. Edited February 5, 2022 by TRS-80 put long output inside spoiler (and code block) 0 Quote
belegdol Posted February 5, 2022 Author Posted February 5, 2022 It appears that my journal gets filled with the following every minute: Feb 05 07:32:01 odroidxu4 CRON[25944]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:32:01 odroidxu4 CRON[25945]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1) Feb 05 07:32:01 odroidxu4 CRON[25944]: pam_unix(cron:session): session closed for user root Feb 05 07:33:01 odroidxu4 CRON[25955]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:33:01 odroidxu4 CRON[25956]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1) Feb 05 07:33:01 odroidxu4 CRON[25955]: pam_unix(cron:session): session closed for user root Feb 05 07:34:01 odroidxu4 CRON[25966]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:34:01 odroidxu4 CRON[25967]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1) Feb 05 07:34:01 odroidxu4 CRON[25966]: pam_unix(cron:session): session closed for user root Feb 05 07:35:01 odroidxu4 CRON[25994]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:35:01 odroidxu4 CRON[25993]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:35:01 odroidxu4 CRON[25995]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Feb 05 07:35:01 odroidxu4 CRON[25996]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1) Feb 05 07:35:01 odroidxu4 CRON[25994]: pam_unix(cron:session): session closed for user root Feb 05 07:35:01 odroidxu4 CRON[25993]: pam_unix(cron:session): session closed for user root Feb 05 07:36:01 odroidxu4 CRON[26006]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Feb 05 07:36:01 odroidxu4 CRON[26007]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1) Feb 05 07:36:01 odroidxu4 CRON[26006]: pam_unix(cron:session): session closed for user root I found this: https://forum.openmediavault.org/index.php?thread/29944-omv-systemlog-full-of-errors-spam/ Hopefully the fix there will stop the log spam and prevent the log mount from filling up. 0 Quote
belegdol Posted February 10, 2022 Author Posted February 10, 2022 I think I am slowly starting to understand where these issues are coming from. I cleaned up /var/log.hdd/journal by running $ sudo journalctl --dir=/var/log.hdd/journal/1ded17e370994bc2bfab08257042ce4c/ --vacuum-time 1w as long as there was only around 40 mb or so of logs in the stored journal, all was fine. Tonight the space on /var/log ran out again: Quote [Mon Feb 7 20:53:20 2022] br-414d6e053a23: port 1(veth4564418) entered disabled state [Mon Feb 7 20:53:20 2022] device veth4564418 left promiscuous mode [Mon Feb 7 20:53:20 2022] br-414d6e053a23: port 1(veth4564418) entered disabled state [Tue Feb 8 00:00:07 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Tue Feb 8 17:55:12 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Tue Feb 8 17:55:12 2022] proc: Bad value for 'hidepid' [Tue Feb 8 17:55:20 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Tue Feb 8 17:55:55 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Tue Feb 8 17:55:55 2022] proc: Bad value for 'hidepid' [Tue Feb 8 17:55:58 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Tue Feb 8 18:02:15 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Tue Feb 8 18:02:15 2022] proc: Bad value for 'hidepid' [Tue Feb 8 18:02:18 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Tue Feb 8 18:29:29 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Tue Feb 8 18:29:29 2022] proc: Bad value for 'hidepid' [Tue Feb 8 18:29:32 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Wed Feb 9 00:00:11 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Wed Feb 9 17:55:11 2022] r8152 6-1:1.0 enx001e06326076: carrier off [Wed Feb 9 17:55:11 2022] proc: Bad value for 'hidepid' [Wed Feb 9 17:55:18 2022] r8152 6-1:1.0 enx001e06326076: carrier on [Thu Feb 10 00:00:04 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating. [Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to create new system journal: No space left on device [Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to create new user journal: No space left on device [Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message [Thu Feb 10 00:00:04 2022] systemd-journald[609]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing. [Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to open system journal: No space left on device I checked, and the stored journal is 49 MB: $ sudo du -h /var/log.hdd --max-depth=1 24K /var/log.hdd/unattended-upgrades 164K /var/log.hdd/apt 20K /var/log.hdd/cron-apt 200K /var/log.hdd/nginx 0 /var/log.hdd/proftpd 100K /var/log.hdd/samba 0 /var/log.hdd/private 0 /var/log.hdd/sysstat 0 /var/log.hdd/chrony 0 /var/log.hdd/openmediavault 28K /var/log.hdd/salt 0 /var/log.hdd/watchdog 49M /var/log.hdd/journal 0 /var/log.hdd/runit 55M /var/log.hdd Does armbian-ramlog and/or armbian-truncate-logs need to put the systemd logs from /var/log.hdd to /var/log in order to do its job? Right now the log in /var/log is only 6.3 MB so I find it unlikely to grow to over 50 MB in 5 hours: $ sudo du -h /var/log --max-depth=1 0 /var/log/watchdog 0 /var/log/unattended-upgrades 0 /var/log/sysstat 52K /var/log/samba 0 /var/log/salt 0 /var/log/runit 0 /var/log/proftpd 0 /var/log/private 0 /var/log/openmediavault 192K /var/log/nginx 6.3M /var/log/journal 8.0K /var/log/cron-apt 0 /var/log/chrony 0 /var/log/apt 7.0M /var/log 0 Quote
Guest Posted March 11, 2022 Posted March 11, 2022 Hi, Got the exact same issue on an Odroid-HC4 Bullseye. Looking at /etc/systemd/journald.conf SystemMaxUse is set to 40M but the default value for MaxLevelStore is “debug” which includes all log messages from “emerg” to “debug”. I'll try to set it to 4 or “warning” or something like that. 0 Quote
Trillien Posted April 8, 2022 Posted April 8, 2022 Hi, I've got the same behavior using OpenMediaVault 6.0.21 on an Helios64 using Linux 5.15.25-rockchip64. I tried to extend /dev/zram1 size from 50M to 150M. # configuration values for the armbian-ram-logging service # # enable the armbian-ram-logging service? ENABLED=true # # size of the tmpfs mount -- please keep in mind to adjust /etc/default/armbian> SIZE=150M # # use rsync instead of cp -r # requires rsync installed, may provide better performance # due to copying only new and changed files USE_RSYNC=true kobol@helios64:~$ sudo zramctl NAME ALGORITHM DISKSIZE DATA COMPR TOTAL STREAMS MOUNTPOINT /dev/zram1 zstd 150M 16.4M 1.4M 3M 6 /var/log /dev/zram0 lzo-rle 1.9G 4K 74B 12K 6 [SWAP] After rebooting, /var/log size actually increased and the email flow stopped for a while. Until it reached a critical threshold I guess. So far, I've got one email per day saying the logs are truncated. However as I checked /var/log, it has plenty of room still. kobol@helios64:~$ df -h Filesystem Size Used Avail Use% Mounted on udev 1.9G 0 1.9G 0% /dev tmpfs 387M 13M 374M 4% /run /dev/mmcblk1p1 15G 2.1G 12G 15% / tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 1.9G 0 1.9G 0% /tmp /dev/zram1 146M 17M 119M 13% /var/log /dev/md0 1.8T 772G 1.1T 43% /srv/dev-disk-by-uuid-835fd1cc-3d15-41e4-a782-d4a4b66a415a tmpfs 387M 0 387M 0% /run/user/1000 For info, please have below memory consumption of /var/log.hdd: kobol@helios64:~$ sudo du -h /var/log.hdd 12K /var/log.hdd/unattended-upgrades 180K /var/log.hdd/nginx 32K /var/log.hdd/salt 4.0K /var/log.hdd/samba/cores/nmbd 4.0K /var/log.hdd/samba/cores/smbd 12K /var/log.hdd/samba/cores 6.4M /var/log.hdd/samba 4.0K /var/log.hdd/watchdog 24K /var/log.hdd/cron-apt 32K /var/log.hdd/proftpd 4.0K /var/log.hdd/private 4.0K /var/log.hdd/chrony 4.0K /var/log.hdd/openmediavault 4.0K /var/log.hdd/sysstat 124K /var/log.hdd/apt 136M /var/log.hdd/journal/736dbda275634e9d985f9e5ae956b2a2 136M /var/log.hdd/journal 4.0K /var/log.hdd/runit/ssh 8.0K /var/log.hdd/runit 153M /var/log.hdd 0 Quote
jba Posted April 20, 2022 Posted April 20, 2022 Seems to be the same problem I reported here: 0 Quote
Olinn Posted April 22, 2022 Posted April 22, 2022 Hello, I've the same problem since my install of armbian on a new Odroid-HC4 in December/January : the same daily mail message from armbian-truncate-logs, the log size that seems to be quite enough (even increased from 50Mo to 250Mo), and during the day a log size quite low (around 10/15% of total /var/log/ size, command "df /var/log/ --output=pcent | tail -1 |cut -d "%" -f 1"), until around midnight where size explodes I've also spent time to investigate, and I think the problem is related to journalctl and/or sysstat. Here are some clues i've found. journalctl : I don't understand it well, but I have often corrupted files when I used "journalctl --verify", and maybe logrotate and/or armbian-truncate-logs don't manage well for journalctl ? ... sysstat : I didn't know sysstat before, it is used to record the system resources usage (IO, memory, ...). On my system it runs every ten minutes. And it is called again at 23:59 to "rotate statistics file", cf /etc/cron.d/sysstat : Quote # Additional run at 23:59 to rotate the statistics file 59 23 * * * root command -v debian-sa1 > /dev/null && debian-sa1 60 2 Maybe the data are somewhere else (where?), and it tries to write them in /var/log/sysstat on midnight for the last day which has just been over ? yesterday, I noted that at 00:00, /var/log/journal size went suddenly from 10/20Mo to 215Mo (!), and there were a lot of corrupted files. Quote journalctl --verify Journal file /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@81c16816f5834d5f864d47a4a028b0ca-000000000009e92d-0005d881e950a996.journal is truncated, ignoring file. PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system.journal PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000007197a-0005dd294165b926.journal PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-0000000000070c20-0005dd24cbbad867.journal PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006fdf0-0005dd1f40c897e4.journal PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006f026-0005dd19e34f38a7.journal PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006e25b-0005dd143c33f3a4.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@4ffb50ef4c67402aa0d4f4b055e3a975-00000000000f9da4-0005da2d89c98d05.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d6d4a12ffd6c-ecd9195f8e562273.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b4bcc8b7f1d9478c917dce8d54b241cc-0000000000038012-0005d6cb6f2a488c.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d9a8d389ae01-b7156b6f342d9974.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@71815cc958e84d7b8fc3bf7415f7db68-0000000000016067-0005d366d54596a1.journal 09d9a0: Invalid object entry array item (2/4): 14a675f1574d14ae 09d9a0: Invalid object contents: Bad message File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@1d0a1e123daf45caa95940ad92c63f68-0000000000009d9f-0005d32293fb5309.journal:09d9a0 (of 2621440 bytes, 24%). FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@1d0a1e123daf45caa95940ad92c63f68-0000000000009d9f-0005d32293fb5309.journal (Bad message) PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a5a369-c1d8d0d02a72d571.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a66d9a-620e986c406fda88.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-0000000000007f4a-0005d57a09443a7c.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b59258d7871b47ecac2dd31b4ea0f89b-000000000006b99c-0005d7bbb061c499.journal 13a1a0: Data object references invalid entry at 13e698 File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@ce16e2286f0441c18779dec3588a9d13-0000000000000001-0005d2920b2e0af3.journal:13e5b0 (of 2621440 bytes, 49%). FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@ce16e2286f0441c18779dec3588a9d13-0000000000000001-0005d2920b2e0af3.journal (Bad message) PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@2de10a230205467db8070f8e1aac0994-0000000000103148-0005da5cc1846c03.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@5ae38fa5a6f945da9ffebbeb21d2940c-00000000000da396-0005d9915ae68d19.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@21bce3db33a24b9a8c4be79e3e54f1b4-000000000001875c-0005d6447593433b.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@78af018e952f4a07b001249e1451a718-000000000003efb3-0005d6f037dc0967.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a6d50d-f2056ccd65f3c025.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d9e52d17c34d-edb8a7fbe532b17b.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000002133-0005d5c3848469ca.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d82a9c875e15-10f8a78354c1b589.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@a96b28917c424612952cd12157be72a1-0000000000075ab7-0005d7eebfab32d8.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@90d27081ac6246dfa4a1a6091f4be642-00000000000147c1-0005d358aa74cd37.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d65bee1e3410-ed945b6f2b2372d7.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@beeceac083c7496d8b55f8edf00cfde3-00000000000d10be-0005d967868acb50.journal 0a89c8: Data object references invalid entry at 0b3580 File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da97247a4d64-9acb1f03513473fe.journal~:0b33a0 (of 2621440 bytes, 28%). FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da97247a4d64-9acb1f03513473fe.journal~ (Bad message) PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@00a8a968702d4afd961b7d7df7f39398-00000000000b87a6-0005d8fb4481365d.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@6f196ea75fb443fdb7bfbb1dfd5e1378-00000000000ef4ee-0005d9f2b98d541d.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-0000000000006e15-0005d56f6b4a817c.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f739b53582974485aec0b4c5e888650a-0000000000067f2c-0005d7b11271aaac.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@78af018e952f4a07b001249e1451a718-000000000003c2e6-0005d6ddbe593f51.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f739b53582974485aec0b4c5e888650a-0000000000067007-0005d7aa5dd0159b.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@bf67142a55d04275b25f681b45b34beb-00000000000ea44d-0005d9e4323b8680.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-000000000000e43d-0005d5b0611e971c.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000006d56-0005d5ec96c8caa3.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@557496f6f6d447308db88eb878e5b542-000000000009ffef-0005d88c1e832246.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000005062-0005d5dccd8f1972.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@ef07570adafe43b487b135007c40b712-000000000006120c-0005d78e25c2097e.journal 0acc00: Unused data (entry_offset==0) 0acc68: Unused data (entry_offset==0) 0acec8: Invalid object File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@cd59f1733c84419c9018b62c74d6a8a9-0000000000045f83-0005d70f54c865d9.journal:0acec8 (of 2621440 bytes, 27%). FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@cd59f1733c84419c9018b62c74d6a8a9-0000000000045f83-0005d70f54c865d9.journal (Bad message) PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@2558106be0d34291b5c7a7de3362b5b9-00000000000e0cb8-0005d9ae698b785f.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b4bcc8b7f1d9478c917dce8d54b241cc-0000000000036fb3-0005d6c26a88bf05.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f3b970c19d37487eb16d1f7a9b803eac-000000000005c8a7-0005d77cd321016a.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da71fe077640-fb5b563cacd6f436.journal~ PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@599f02277d204383a80b0c78d45b9289-000000000005991a-0005d772e8026534.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@93fb6e36e8a742faac7fcaef89b000a0-00000000000c14cf-0005d92c831752cf.journal PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@08e0c896de3748c5888dc1f92b54eb9f-0000000000004802-0005d55a413e775e.journal ^C████████████████████████████████████████████████████████████████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 63% on my (sys)log, a task which may be strongly related to this issue is logrotate (there are not other entry at 00:00 which should be linked to this problem, I don't think it is "man-db regeneration") : Quote Apr 21 00:00:02 odroidhc4 systemd[1]: Starting Rotate log files... Any idea ? I don't know what I can do in addition to that. Thanks Olinn 0 Quote
Trillien Posted November 11, 2022 Posted November 11, 2022 Hi, According to the exchange on the thread below, adding the option --delete wasn't totally helpful. The thread refers to a change request on Github: https://github.com/armbian/build/pull/3779 As I understand, a fix is already applied on the source files. Fix details are discussed here: https://github.com/armbian/build/pull/3967 Specifically, additions and deletions on 3 files are detailed here: https://github.com/smlinux/armbian-tanix-tx6/commit/9087e8fd7158a06947fe5811232795451fb43f76 I've just checked the files on my system and they don't reflect the change yet on Github. So I've manually applied the change on my system: /etc/cron.d/armbian-truncate-logs Add this line at the end of the file: @reboot root /usr/lib/armbian/armbian-truncate-logs /usr/lib/armbian/armbian-ramlog Save the current version of the file, and deactivate it sudo mv /usr/lib/armbian/armbian-ramlog /usr/lib/armbian/armbian-ramlog.old sudo chmod -x /usr/lib/armbian/armbian-ramlog.old Create a new file /usr/lib/armbian/armbian-ramlog using Github details Activate the file sudo chmod +x /usr/lib/armbian/armbian-ramlog /usr/lib/armbian/armbian-truncate-logs Save the current version of the file, and deactivate it sudo mv /usr/lib/armbian/armbian-truncate-log /usr/lib/armbian/armbian-truncate-log.old sudo chmod -x /usr/lib/armbian/armbian-truncate-log.old Create a new file /usr/lib/armbian/armbian-truncate-log using Github details Activate the file sudo chmod +x /usr/lib/armbian/armbian-truncate-log I'll see whether it solves the issue... 0 Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.