Jump to content
  • 0

Odroid HC1: daily email from armbian-truncate-logs

belegdol

Asked by belegdol,

 Share

Question

belegdol

belegdol

Posted
Posted (edited)
Armbianmonitor:
http://ix.io/3LM4

Hello,

I have recently upgraded OMV to version 6 and armbian to bullseye alongside it:

https://forum.openmediavault.org/index.php?thread/41361-odroid-hc1-armbian-update-report/

Since the upgrade, I am getting daily emails from armbian-truncate-logs with the following content:

 

Spoiler 
[0;1;38;5;185mJournal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000501-0005d513e7226c26.journal is truncated, ignoring file.[0m
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e63fd8387-4776da5b1e9dd6f3.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a4a51b-87ba53078992bfa5.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a4a140-b35ae9abf787edae.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a3258e-c7aba7539735db3b.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a32012-ca3c7661c922afba.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a30ac0-aedc088d247a140d.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e31a30681-a55dcd06694596c8.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2ea709fb-9ed166ca6e53c2ff.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2ea70533-d499487ff39624c0.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e341a38-b58dae80ccbb7c87.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e3417f6-7a9fec1bb8a1b3f7.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e3412b5-c7fb31d00135222b.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e341019-934fb8415cd40f91.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fb49c-7cf988dd2f664e3f.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fb270-66dc045e95d36496.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fae48-f3f01a9cb62d8b1c.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2fabca-bb27481fdfb1f890.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d52e2e2f9349-700a878c5b79152d.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d52e2e2f9242-fe8248d773b88d8a.journal~ (4.0K).
Deleted empty archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000000-0000000000000000.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b19a-0005d4fded950953.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b38c-0005d4ffb75b9065.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b572-0005d50161433b92.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b75c-0005d502f8a68305.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@8ba2ff0171204efb96c424e2acb591c7-000000000000b94f-0005d504c2631f64.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-0000000000000001-0005d505f297fe4e.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000bd79-0005d50705c4e189.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000bf66-0005d508d6a665bc.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c15b-0005d50ab24a1923.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c348-0005d50c7885cebb.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c539-0005d50e3782286a.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@c7688876310f4cfda2d405c789c7758c-000000000000c729-0005d510014ec802.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@baf75df6e52d418c8c04ceed18842c30-000000000000c756-0005d510197fd60b.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-0000000000000001-0005d5107aa56535.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d5107aaa3489-a8751f0289eed60a.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-00000000000002c5-0005d5107aab2059.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4f0997a2acb742f380e3d276192ae4c8-000000000000042d-0005d5107af9965d.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@87e66865628244fdbc41665a50089cb4-00000000000004d7-0005d5107f970502.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-0000000000000001-0005d510908cae71.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d5109091a7db-6ee4991a90d609e3.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-00000000000002c9-0005d5109092920d.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d51090929e1e-584ca9aa3dbfe3df.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@4a4d1f4fa87145c48c93599e81c0dd8f-0000000000000433-0005d51090e347b5.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@ceee62826fcf4169aed887af96d8a622-0000000000000507-0005d510971971cb.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-0000000000000001-0005d510999e4b9e.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-00000000000002c8-0005d51099a387a0.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000045d-0005d5109fb54784.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-00000000000004f9-0005d510a75d59c2.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000063d-0005d5118e3dfb01.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-00000000000006c9-0005d5120ae34980.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@7fdca15447094d63ba9b8b6af38287dc-000000000000080c-0005d512c1ceb772.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@f2914651d4de4c5393ae4ebd7b57bab2-0000000000000875-0005d51319748bab.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-0000000000000001-0005d513b76dc4c7.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d513b7737844-b633ccf7eb74d687.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-00000000000002cf-0005d513b7763a61.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@0005d513b7765fe2-32d72f86dd595ef1.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@f9b13bd7e51c4934806113bf4000ec30-0000000000000478-0005d513b7f5f7dc.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@d9e92d67191948fbb44fe1afc4fa0d9b-00000000000004ae-0005d513b9fbc39f.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000001-0005d513be8d3d75.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-00000000000002d1-0005d513be9222f1.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@0005d513be92247e-bc989cbce4d1503e.journal~ (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000466-0005d513dea5d241.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000@8682aaf9b65f4db593fdb2f01a8b3fbc-0000000000000501-0005d513e7226c26.journal (564.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-000000000000063f-0005d514cbf6f439.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000853-0005d5161fbae3eb.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-0000000000000a47-0005d517f4303b95.journal (640.0K).
Deleted archived journal /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system@80ee9256fd7547bd9d9e324129f1ce5c-00000000000012ec-0005d51f82ff598e.journal (640.0K).
Vacuuming done, freed 30.0M of archived journals from /var/log/journal/1ded17e370994bc2bfab08257042ce4c.
Vacuuming done, freed 0B of archived journals from /var/log/journal.
Vacuuming done, freed 0B of archived journals from /run/log/journal.

 

 

I am not sure if this is expected or not, but I was not getting these with OMV 5.

Edited by TRS-80
put long output inside spoiler
0
Link to comment
Share on other sites

12 answers to this question

Recommended Posts

  • 0
Igor

Igor

Posted
Posted

Probably this is due OMV but not 100% sure. Try tweaking things here:
https://github.com/armbian/build/blob/master/packages/bsp/common/usr/lib/armbian/armbian-truncate-logs#L32

/usr/lib/armbian/armbian-truncate-logs on your filesystem.

 

Then we can fix this within next release. If this is a problem.

 

This script is executed with cron and crond is the one that alerts you.

0
Link to comment
Share on other sites

Help us fund some #badass gear for our continuous integration build framework

  • 0
belegdol

belegdol

Posted
  • Author
Posted (edited)

The command on its own seems to be fine:

  

$ [ /var/log/journal ] && sudo journalctl --vacuum-size=5M
Vacuuming done, freed 0B of archived journals from /var/log/journal.
Vacuuming done, freed 0B of archived journals from /var/log/journal/1ded17e370994bc2bfab08257042ce4c.
Vacuuming done, freed 0B of archived journals from /run/log/journal.

 

The question is why am I getting the email. Does cron always send a message, or only if it finds a problem? If it is the latter, maybe lack of space in /var/log is an issue:

 

Spoiler 
[26628.214110] systemd-journald[607]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[113028.779917] systemd-journald[607]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[113028.780668] systemd-journald[607]: Failed to create new system journal: No space left on device
[113028.781250] systemd-journald[607]: Failed to create new user journal: No space left on device
[113028.781716] systemd-journald[607]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message
[113028.781980] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113028.782503] systemd-journald[607]: Failed to open system journal: No space left on device
[113028.788252] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113028.788778] systemd-journald[607]: Failed to open system journal: No space left on device
[113028.788892] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113028.789350] systemd-journald[607]: Failed to open system journal: No space left on device
[113028.789955] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113028.790402] systemd-journald[607]: Failed to open system journal: No space left on device
[113028.790511] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113028.790936] systemd-journald[607]: Failed to open system journal: No space left on device
[113029.076074] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113029.076625] systemd-journald[607]: Failed to open system journal: No space left on device
[113029.076745] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113029.077471] systemd-journald[607]: Failed to open system journal: No space left on device
[113029.078089] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113029.078556] systemd-journald[607]: Failed to open system journal: No space left on device
[113029.078669] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113029.079063] systemd-journald[607]: Failed to open system journal: No space left on device
[113036.609932] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113036.610928] systemd-journald[607]: Failed to open system journal: No space left on device
[113036.611158] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113036.612008] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.679884] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.680792] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.680981] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.681952] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.686431] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.687256] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.687839] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.688560] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.785037] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.785797] systemd-journald[607]: Failed to open system journal: No space left on device
[113086.786029] systemd-journald[607]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[113086.786464] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.868735] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.868993] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.871035] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.871310] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.938203] systemd-journald[607]: Failed to open system journal: No space left on device
[113146.938404] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.001264] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.002216] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.009388] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.010285] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.097300] systemd-journald[607]: Failed to open system journal: No space left on device
[113207.097454] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.163403] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.164291] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.171425] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.172404] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.273327] systemd-journald[607]: Failed to open system journal: No space left on device
[113267.273597] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.341104] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.341766] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.346878] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.347178] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.350062] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.350340] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.353332] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.353563] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.364300] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.364627] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.453178] systemd-journald[607]: Failed to open system journal: No space left on device
[113326.453803] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.500083] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.500396] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.503305] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.503540] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.613565] systemd-journald[607]: Failed to open system journal: No space left on device
[113386.613952] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.667018] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.667324] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.671876] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.672219] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.779780] systemd-journald[607]: Failed to open system journal: No space left on device
[113446.780345] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.821245] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.821448] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.822899] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.823055] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.919419] systemd-journald[607]: Failed to open system journal: No space left on device
[113506.919894] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.976432] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.976674] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.979690] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.979939] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.995377] systemd-journald[607]: Failed to open system journal: No space left on device
[113566.995622] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.002051] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.002414] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.013187] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.013569] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.066317] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.066498] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.183691] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.183932] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.667739] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.669067] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.671704] systemd-journald[607]: Failed to open system journal: No space left on device
[113567.672238] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.119848] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.120585] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.125737] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.126504] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.216154] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.216482] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.799278] systemd-journald[607]: Failed to open system journal: No space left on device
[113627.800450] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.261036] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.261247] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.262684] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.262841] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.360601] systemd-journald[607]: Failed to open system journal: No space left on device
[113686.360948] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.435822] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.436750] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.445572] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.445857] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.448816] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.449361] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.450591] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.450865] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.544196] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.544430] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.545632] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.545846] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.546349] systemd-journald[607]: Failed to open system journal: No space left on device
[113746.546562] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.589357] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.589675] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.592839] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.593158] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.595177] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.595409] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.596137] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.596370] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.705618] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.705943] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.707790] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.708107] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.708787] systemd-journald[607]: Failed to open system journal: No space left on device
[113806.709249] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.778570] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.780453] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.792830] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.794099] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.802560] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.803391] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.806297] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.806978] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.859344] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.859552] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.859986] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.860152] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.860503] systemd-journald[607]: Failed to open system journal: No space left on device
[113866.860658] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.912306] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.912757] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.915166] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.915412] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.917013] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.917245] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.918643] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.918847] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.919602] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.919823] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.920907] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.921105] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.921531] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.921737] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.922159] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.922352] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.922749] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.922950] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.927739] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.928024] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.931047] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.931291] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.935058] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.935309] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.946344] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.946606] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.948120] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.948408] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.949006] systemd-journald[607]: Failed to open system journal: No space left on device
[113926.949268] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.048069] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.048221] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.048967] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.049107] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.049540] systemd-journald[607]: Failed to open system journal: No space left on device
[113927.049697] systemd-journald[607]: Failed to open system journal: No space left on device
[113930.693376] systemd-journald[607]: Failed to open system journal: No space left on device
[113930.693727] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.386103] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.386386] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.388444] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.388766] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.390198] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.390584] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.392101] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.392513] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.393039] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.393240] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.393744] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.393940] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.394447] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.394667] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.395742] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.395957] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.396586] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.396813] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.397838] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.398042] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.398607] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.398821] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.400094] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.400337] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.402246] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.402447] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.403474] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.403704] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.404393] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.404602] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.405469] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.405700] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.406393] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.406616] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.407408] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.407630] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.408257] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.408444] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.409072] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.409260] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.410965] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.411185] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.412106] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.412324] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.412940] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.413115] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.413805] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.413988] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.414540] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.414717] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.415382] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.415541] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.415963] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.416124] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.416692] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.416876] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.417358] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.417535] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.418248] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.418422] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.418954] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.419112] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.419688] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.419875] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.421721] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.421896] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.422413] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.422619] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.422944] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.423073] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.423351] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.423483] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.423757] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.423891] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.424168] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.424302] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.424585] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.424718] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.425033] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.425171] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.425469] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.425602] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.425904] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.426049] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.426352] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.426487] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.426773] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.426918] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.427213] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.427348] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.427680] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.427836] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.428124] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.428261] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.428559] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.428738] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.429014] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.429147] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.429523] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.429659] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.431519] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.431648] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.431925] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.432056] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.432337] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.432465] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.432738] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.432869] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.433142] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.433275] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.433561] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.433705] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434007] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434135] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434410] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434547] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434822] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.434949] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.435229] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.435360] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.435635] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.435763] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436037] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436167] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436439] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436571] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436845] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.436979] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.437260] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.437388] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.437662] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.437791] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.438060] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.438189] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.438477] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.438615] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.438901] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.439035] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.439362] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.439511] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.441529] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.441668] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.441957] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.442094] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.442400] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.442529] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.442813] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.442945] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.443226] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.443354] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.443631] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.443763] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.444038] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.444165] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.444461] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.444612] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.444929] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.445077] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.445396] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.445542] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.445847] systemd-journald[607]: Failed to open system journal: No space left on device
[113931.445978] systemd-journald[607]: Failed to open system journal: No space left on device

 

 

Right now /var/log has 29 MB out of 50 MB free so it looks like it fills up intermittently. Most of it is taken by /var/log/samba, despite logging set to 0 and max_log_size set to 1000 in smb.conf. Are logs from /var/log.hdd restored to /var/log on boot? I did some samba debugging back in November, maybe this is the culprit.

 

ETA: I deleted /var/log/samba/log..old and /var/log.hdd/samba/log..old as this file was over 10 MB in size, let'see if it helps.

 

Edited by TRS-80
put long output inside spoiler (and code block)
0
Link to comment
Share on other sites
  • 0
teknoid

teknoid

Posted
Posted
Am 11.1.2022 um 21:31 schrieb belegdol:

The question is why am I getting the email. Does cron always send a message, or only if it finds a problem? If it is the latter, maybe lack of space in /var/log is an issue:

 

Cron always sends the stdout messages from any scipt via mail. Nothing wrong with that.

0
Link to comment
Share on other sites
  • 0
belegdol

belegdol

Posted
  • Author
Posted (edited)

I investigated further and the core of the problem appears to be that /var/log is regularly running out of space on my board:

 

Spoiler 
[Mon Jan 31 00:15:03 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Mon Jan 31 17:55:27 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Mon Jan 31 17:55:27 2022] proc: Bad value for 'hidepid'
[Mon Jan 31 17:55:34 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Mon Jan 31 17:56:13 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Mon Jan 31 17:56:13 2022] proc: Bad value for 'hidepid'
[Mon Jan 31 17:56:15 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Tue Feb  1 00:00:15 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Tue Feb  1 00:00:15 2022] systemd-journald[611]: Failed to create new system journal: No space left on device
[Tue Feb  1 00:00:15 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Tue Feb  1 17:55:25 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Tue Feb  1 17:55:25 2022] proc: Bad value for 'hidepid'
[Tue Feb  1 17:55:34 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Wed Feb  2 00:00:05 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Wed Feb  2 17:55:23 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Wed Feb  2 17:55:24 2022] proc: Bad value for 'hidepid'
[Wed Feb  2 17:55:31 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Thu Feb  3 00:00:08 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Thu Feb  3 17:55:22 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Thu Feb  3 17:55:22 2022] proc: Bad value for 'hidepid'
[Thu Feb  3 17:55:30 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Fri Feb  4 00:00:13 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Fri Feb  4 16:26:33 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Fri Feb  4 16:26:34 2022] proc: Bad value for 'hidepid'
[Fri Feb  4 16:26:37 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Fri Feb  4 17:16:36 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Fri Feb  4 17:16:36 2022] proc: Bad value for 'hidepid'
[Fri Feb  4 17:16:39 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Fri Feb  4 17:55:21 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Fri Feb  4 17:55:21 2022] proc: Bad value for 'hidepid'
[Fri Feb  4 17:55:29 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: Failed to create new system journal: No space left on device
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: Failed to create new user journal: No space left on device
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:15 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:00:16 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:01:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device
[Sat Feb  5 00:02:04 2022] systemd-journald[611]: Failed to open system journal: No space left on device

 

 

I am not sure what is causing this as whenever I check the free space during the day, there seems to be more than enough available:

  

$ sudo df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            926M     0  926M   0% /dev
tmpfs           200M  4.0M  196M   2% /run
/dev/mmcblk0p2   15G  1.8G   12G  13% /
tmpfs           996M     0  996M   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           996M  8.0K  996M   1% /tmp
/dev/sda1       458G  277G  182G  61% /srv/dev-disk-by-label-omv
armbian-ramlog   50M  6.9M   44M  14% /var/log
/dev/mmcblk0p1   58M   36M   21M  64% /boot
tmpfs           200M     0  200M   0% /run/user/1000
$ sudo du -h /var/log --max-depth=2
0	/var/log/watchdog
0	/var/log/unattended-upgrades
0	/var/log/sysstat
0	/var/log/samba/cores
172K	/var/log/samba
0	/var/log/salt
0	/var/log/runit/ssh
0	/var/log/runit
0	/var/log/proftpd
0	/var/log/private
0	/var/log/openmediavault
108K	/var/log/nginx
6.3M	/var/log/journal/1ded17e370994bc2bfab08257042ce4c
6.3M	/var/log/journal
12K	/var/log/cron-apt
0	/var/log/chrony
0	/var/log/apt
6.9M	/var/log

 

50 MB still seems to be the default. I guess I need to check around midnight to be sure.

 

Edited by TRS-80
put long output inside spoiler (and code block)
0
Link to comment
Share on other sites
  • 0
belegdol

belegdol

Posted
  • Author
Posted

It appears that my journal gets filled with the following every minute: 

Feb 05 07:32:01 odroidxu4 CRON[25944]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:32:01 odroidxu4 CRON[25945]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1)
Feb 05 07:32:01 odroidxu4 CRON[25944]: pam_unix(cron:session): session closed for user root
Feb 05 07:33:01 odroidxu4 CRON[25955]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:33:01 odroidxu4 CRON[25956]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1)
Feb 05 07:33:01 odroidxu4 CRON[25955]: pam_unix(cron:session): session closed for user root
Feb 05 07:34:01 odroidxu4 CRON[25966]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:34:01 odroidxu4 CRON[25967]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1)
Feb 05 07:34:01 odroidxu4 CRON[25966]: pam_unix(cron:session): session closed for user root
Feb 05 07:35:01 odroidxu4 CRON[25994]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:35:01 odroidxu4 CRON[25993]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:35:01 odroidxu4 CRON[25995]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 05 07:35:01 odroidxu4 CRON[25996]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1)
Feb 05 07:35:01 odroidxu4 CRON[25994]: pam_unix(cron:session): session closed for user root
Feb 05 07:35:01 odroidxu4 CRON[25993]: pam_unix(cron:session): session closed for user root
Feb 05 07:36:01 odroidxu4 CRON[26006]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Feb 05 07:36:01 odroidxu4 CRON[26007]: (root) CMD (for i in `pgrep "ftpd|nfsiod|smbd|afpd|cnid"` ; do ionice -c1 -p $i ; taskset -c -p 4-7 $i ; done >/dev/null 2>&1)
Feb 05 07:36:01 odroidxu4 CRON[26006]: pam_unix(cron:session): session closed for user root

I found this: https://forum.openmediavault.org/index.php?thread/29944-omv-systemlog-full-of-errors-spam/

Hopefully the fix there will stop the log spam and prevent the log mount from filling up.

0
Link to comment
Share on other sites
  • 0
belegdol

belegdol

Posted
  • Author
Posted

I think I am slowly starting to understand where these issues are coming from. I cleaned up /var/log.hdd/journal by running 

$ sudo journalctl --dir=/var/log.hdd/journal/1ded17e370994bc2bfab08257042ce4c/ --vacuum-time 1w

as long as there was only around 40 mb or so of logs in the stored journal, all was fine. Tonight the space on /var/log ran out again:

Quote

[Mon Feb  7 20:53:20 2022] br-414d6e053a23: port 1(veth4564418) entered disabled state
[Mon Feb  7 20:53:20 2022] device veth4564418 left promiscuous mode
[Mon Feb  7 20:53:20 2022] br-414d6e053a23: port 1(veth4564418) entered disabled state
[Tue Feb  8 00:00:07 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Tue Feb  8 17:55:12 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Tue Feb  8 17:55:12 2022] proc: Bad value for 'hidepid'
[Tue Feb  8 17:55:20 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Tue Feb  8 17:55:55 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Tue Feb  8 17:55:55 2022] proc: Bad value for 'hidepid'
[Tue Feb  8 17:55:58 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Tue Feb  8 18:02:15 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Tue Feb  8 18:02:15 2022] proc: Bad value for 'hidepid'
[Tue Feb  8 18:02:18 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Tue Feb  8 18:29:29 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Tue Feb  8 18:29:29 2022] proc: Bad value for 'hidepid'
[Tue Feb  8 18:29:32 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Wed Feb  9 00:00:11 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Wed Feb  9 17:55:11 2022] r8152 6-1:1.0 enx001e06326076: carrier off
[Wed Feb  9 17:55:11 2022] proc: Bad value for 'hidepid'
[Wed Feb  9 17:55:18 2022] r8152 6-1:1.0 enx001e06326076: carrier on
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal: Journal file corrupted, rotating.
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to create new system journal: No space left on device
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to create new user journal: No space left on device
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to read journal file /var/log/journal/1ded17e370994bc2bfab08257042ce4c/user-1000.journal for rotation, trying to move it out of the way: Bad message
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: File /var/log/journal/1ded17e370994bc2bfab08257042ce4c/system.journal corrupted or uncleanly shut down, renaming and replacing.
[Thu Feb 10 00:00:04 2022] systemd-journald[609]: Failed to open system journal: No space left on device

I checked, and the stored journal is 49 MB: 

$ sudo du -h /var/log.hdd --max-depth=1
24K	/var/log.hdd/unattended-upgrades
164K	/var/log.hdd/apt
20K	/var/log.hdd/cron-apt
200K	/var/log.hdd/nginx
0	/var/log.hdd/proftpd
100K	/var/log.hdd/samba
0	/var/log.hdd/private
0	/var/log.hdd/sysstat
0	/var/log.hdd/chrony
0	/var/log.hdd/openmediavault
28K	/var/log.hdd/salt
0	/var/log.hdd/watchdog
49M	/var/log.hdd/journal
0	/var/log.hdd/runit
55M	/var/log.hdd

Does armbian-ramlog and/or armbian-truncate-logs need to put the systemd logs from /var/log.hdd to /var/log in order to do its job? Right now the log in /var/log is only 6.3 MB so I find it unlikely to grow to over 50 MB in 5 hours: 

$ sudo du -h /var/log --max-depth=1
0	/var/log/watchdog
0	/var/log/unattended-upgrades
0	/var/log/sysstat
52K	/var/log/samba
0	/var/log/salt
0	/var/log/runit
0	/var/log/proftpd
0	/var/log/private
0	/var/log/openmediavault
192K	/var/log/nginx
6.3M	/var/log/journal
8.0K	/var/log/cron-apt
0	/var/log/chrony
0	/var/log/apt
7.0M	/var/log

 

0
Link to comment
Share on other sites
  • 0
houdini_69

houdini_69

Posted
Posted

Hi,

Got the exact same issue on an Odroid-HC4 Bullseye. Looking at /etc/systemd/journald.conf SystemMaxUse is set to 40M but the default value for MaxLevelStore is “debug” which includes all log messages from “emerg” to “debug”. I'll try to set it to 4 or “warning” or something like that.

 

0
Link to comment
Share on other sites
  • 0
Trillien

Trillien

Posted
Posted

Hi,

I've got the same behavior using OpenMediaVault 6.0.21 on an Helios64 using Linux 5.15.25-rockchip64.

 

I tried to extend /dev/zram1 size from 50M to 150M. 

# configuration values for the armbian-ram-logging service
#
# enable the armbian-ram-logging service?
ENABLED=true
#
# size of the tmpfs mount -- please keep in mind to adjust /etc/default/armbian>
SIZE=150M
#
# use rsync instead of cp -r
# requires rsync installed, may provide better performance
# due to copying only new and changed files
USE_RSYNC=true

  

kobol@helios64:~$ sudo zramctl
NAME       ALGORITHM DISKSIZE  DATA COMPR TOTAL STREAMS MOUNTPOINT
/dev/zram1 zstd          150M 16.4M  1.4M    3M       6 /var/log
/dev/zram0 lzo-rle       1.9G    4K   74B   12K       6 [SWAP]

 

After rebooting, /var/log size actually increased and the email flow stopped for a while. Until it reached a critical threshold I guess.

So far, I've got one email per day saying the logs are truncated. However as I checked /var/log, it has plenty of room still. 

kobol@helios64:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            1.9G     0  1.9G   0% /dev
tmpfs           387M   13M  374M   4% /run
/dev/mmcblk1p1   15G  2.1G   12G  15% /
tmpfs           1.9G     0  1.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           1.9G     0  1.9G   0% /tmp
/dev/zram1      146M   17M  119M  13% /var/log
/dev/md0        1.8T  772G  1.1T  43% /srv/dev-disk-by-uuid-835fd1cc-3d15-41e4-a782-d4a4b66a415a
tmpfs           387M     0  387M   0% /run/user/1000

 

For info, please have below memory consumption of /var/log.hdd: 

kobol@helios64:~$ sudo du -h /var/log.hdd
12K     /var/log.hdd/unattended-upgrades
180K    /var/log.hdd/nginx
32K     /var/log.hdd/salt
4.0K    /var/log.hdd/samba/cores/nmbd
4.0K    /var/log.hdd/samba/cores/smbd
12K     /var/log.hdd/samba/cores
6.4M    /var/log.hdd/samba
4.0K    /var/log.hdd/watchdog
24K     /var/log.hdd/cron-apt
32K     /var/log.hdd/proftpd
4.0K    /var/log.hdd/private
4.0K    /var/log.hdd/chrony
4.0K    /var/log.hdd/openmediavault
4.0K    /var/log.hdd/sysstat
124K    /var/log.hdd/apt
136M    /var/log.hdd/journal/736dbda275634e9d985f9e5ae956b2a2
136M    /var/log.hdd/journal
4.0K    /var/log.hdd/runit/ssh
8.0K    /var/log.hdd/runit
153M    /var/log.hdd

 

0
Link to comment
Share on other sites
  • 0
Olinn

Olinn

Posted
Posted

Hello,

 

I've the same problem since my install of armbian on a new Odroid-HC4 in December/January : the same daily mail message from armbian-truncate-logs, the log size that seems to be quite enough (even increased from 50Mo to 250Mo), and during the day a log size quite low (around 10/15% of total /var/log/ size, command "df /var/log/ --output=pcent | tail -1 |cut -d "%" -f 1"), until around midnight where size explodes

I've also spent time to investigate, and I think the problem is related to journalctl and/or sysstat. Here are some clues i've found.

 

  • journalctl : I don't understand it well, but I have often corrupted files when I used "journalctl --verify", and maybe logrotate and/or armbian-truncate-logs don't manage well for journalctl ? ...

 

  • sysstat : I didn't know sysstat before, it is used to record the system resources usage (IO, memory, ...). On my system it runs every ten minutes. And it is called again at 23:59 to "rotate statistics file", cf  /etc/cron.d/sysstat  :
Quote

# Additional run at 23:59 to rotate the statistics file
59 23 * * * root command -v debian-sa1 > /dev/null && debian-sa1 60 2

Maybe the data are somewhere else (where?), and it tries to write them in /var/log/sysstat on midnight for the last day which has just been over ?

 

  • yesterday, I noted that at 00:00, /var/log/journal size went suddenly from 10/20Mo to 215Mo (!), and there were a lot of corrupted files.
Quote

journalctl --verify

Journal file /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@81c16816f5834d5f864d47a4a028b0ca-000000000009e92d-0005d881e950a996.journal is truncated, ignoring file.

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system.journal

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000007197a-0005dd294165b926.journal

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-0000000000070c20-0005dd24cbbad867.journal

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006fdf0-0005dd1f40c897e4.journal

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006f026-0005dd19e34f38a7.journal

PASS: /run/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@855995fcef3e4e66b1bb1099ac0a0d50-000000000006e25b-0005dd143c33f3a4.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@4ffb50ef4c67402aa0d4f4b055e3a975-00000000000f9da4-0005da2d89c98d05.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d6d4a12ffd6c-ecd9195f8e562273.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b4bcc8b7f1d9478c917dce8d54b241cc-0000000000038012-0005d6cb6f2a488c.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d9a8d389ae01-b7156b6f342d9974.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@71815cc958e84d7b8fc3bf7415f7db68-0000000000016067-0005d366d54596a1.journal

09d9a0: Invalid object entry array item (2/4): 14a675f1574d14ae

09d9a0: Invalid object contents: Bad message

File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@1d0a1e123daf45caa95940ad92c63f68-0000000000009d9f-0005d32293fb5309.journal:09d9a0 (of 2621440 bytes, 24%).

FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@1d0a1e123daf45caa95940ad92c63f68-0000000000009d9f-0005d32293fb5309.journal (Bad message)

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a5a369-c1d8d0d02a72d571.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a66d9a-620e986c406fda88.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-0000000000007f4a-0005d57a09443a7c.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b59258d7871b47ecac2dd31b4ea0f89b-000000000006b99c-0005d7bbb061c499.journal

13a1a0: Data object references invalid entry at 13e698

File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@ce16e2286f0441c18779dec3588a9d13-0000000000000001-0005d2920b2e0af3.journal:13e5b0 (of 2621440 bytes, 49%).

FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@ce16e2286f0441c18779dec3588a9d13-0000000000000001-0005d2920b2e0af3.journal (Bad message)

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@2de10a230205467db8070f8e1aac0994-0000000000103148-0005da5cc1846c03.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@5ae38fa5a6f945da9ffebbeb21d2940c-00000000000da396-0005d9915ae68d19.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@21bce3db33a24b9a8c4be79e3e54f1b4-000000000001875c-0005d6447593433b.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@78af018e952f4a07b001249e1451a718-000000000003efb3-0005d6f037dc0967.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d69847a6d50d-f2056ccd65f3c025.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d9e52d17c34d-edb8a7fbe532b17b.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000002133-0005d5c3848469ca.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d82a9c875e15-10f8a78354c1b589.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@a96b28917c424612952cd12157be72a1-0000000000075ab7-0005d7eebfab32d8.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@90d27081ac6246dfa4a1a6091f4be642-00000000000147c1-0005d358aa74cd37.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005d65bee1e3410-ed945b6f2b2372d7.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@beeceac083c7496d8b55f8edf00cfde3-00000000000d10be-0005d967868acb50.journal

0a89c8: Data object references invalid entry at 0b3580

File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da97247a4d64-9acb1f03513473fe.journal~:0b33a0 (of 2621440 bytes, 28%).

FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da97247a4d64-9acb1f03513473fe.journal~ (Bad message)

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@00a8a968702d4afd961b7d7df7f39398-00000000000b87a6-0005d8fb4481365d.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@6f196ea75fb443fdb7bfbb1dfd5e1378-00000000000ef4ee-0005d9f2b98d541d.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-0000000000006e15-0005d56f6b4a817c.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f739b53582974485aec0b4c5e888650a-0000000000067f2c-0005d7b11271aaac.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@78af018e952f4a07b001249e1451a718-000000000003c2e6-0005d6ddbe593f51.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f739b53582974485aec0b4c5e888650a-0000000000067007-0005d7aa5dd0159b.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@bf67142a55d04275b25f681b45b34beb-00000000000ea44d-0005d9e4323b8680.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f84ecd5545cf426e99a1bcf9572d1c35-000000000000e43d-0005d5b0611e971c.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000006d56-0005d5ec96c8caa3.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@557496f6f6d447308db88eb878e5b542-000000000009ffef-0005d88c1e832246.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@7bcda84658d14a17a4ec95c136a0b908-0000000000005062-0005d5dccd8f1972.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@ef07570adafe43b487b135007c40b712-000000000006120c-0005d78e25c2097e.journal

0acc00: Unused data (entry_offset==0)

0acc68: Unused data (entry_offset==0)

0acec8: Invalid object

File corruption detected at /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@cd59f1733c84419c9018b62c74d6a8a9-0000000000045f83-0005d70f54c865d9.journal:0acec8 (of 2621440 bytes, 27%).

FAIL: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@cd59f1733c84419c9018b62c74d6a8a9-0000000000045f83-0005d70f54c865d9.journal (Bad message)

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@2558106be0d34291b5c7a7de3362b5b9-00000000000e0cb8-0005d9ae698b785f.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@b4bcc8b7f1d9478c917dce8d54b241cc-0000000000036fb3-0005d6c26a88bf05.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@f3b970c19d37487eb16d1f7a9b803eac-000000000005c8a7-0005d77cd321016a.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@0005da71fe077640-fb5b563cacd6f436.journal~

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/user-1000@599f02277d204383a80b0c78d45b9289-000000000005991a-0005d772e8026534.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@93fb6e36e8a742faac7fcaef89b000a0-00000000000c14cf-0005d92c831752cf.journal

PASS: /var/log/journal/578fad741bf6468fb78f23bffb01f0a1/system@08e0c896de3748c5888dc1f92b54eb9f-0000000000004802-0005d55a413e775e.journal

^C████████████████████████████████████████████████████████████████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 63%

 

  • on my (sys)log, a task which may be strongly related to this issue is logrotate (there are not other entry at 00:00 which should be linked to this problem, I don't think it is "man-db regeneration") :
Quote

Apr 21 00:00:02 odroidhc4 systemd[1]: Starting Rotate log files...

 

Any idea ? I don't know what I can do in addition to that.

 

Thanks

 

Olinn

0
Link to comment
Share on other sites
  • 0
Trillien

Trillien

Posted
Posted

Hi,

According to the exchange on the thread below, adding the option --delete wasn't totally helpful.

 

The thread refers to a change request on Github: https://github.com/armbian/build/pull/3779

As I understand, a fix is already applied on the source files. Fix details are discussed here: https://github.com/armbian/build/pull/3967

Specifically, additions and deletions on 3 files are detailed here: https://github.com/smlinux/armbian-tanix-tx6/commit/9087e8fd7158a06947fe5811232795451fb43f76

 

I've just checked the files on my system and they don't reflect the change yet on Github. So I've manually applied the change on my system:

 

  • /etc/cron.d/armbian-truncate-logs

Add this line at the end of the file: 

@reboot root /usr/lib/armbian/armbian-truncate-logs

 

  • /usr/lib/armbian/armbian-ramlog

Save the current version of the file, and deactivate it 

sudo mv /usr/lib/armbian/armbian-ramlog /usr/lib/armbian/armbian-ramlog.old
sudo chmod -x /usr/lib/armbian/armbian-ramlog.old

Create a new file /usr/lib/armbian/armbian-ramlog using Github details

Activate the file 

sudo chmod +x /usr/lib/armbian/armbian-ramlog

 

  • /usr/lib/armbian/armbian-truncate-logs

Save the current version of the file, and deactivate it 

sudo mv /usr/lib/armbian/armbian-truncate-log /usr/lib/armbian/armbian-truncate-log.old
sudo chmod -x /usr/lib/armbian/armbian-truncate-log.old

Create a new file /usr/lib/armbian/armbian-truncate-log using Github details

Activate the file 

sudo chmod +x /usr/lib/armbian/armbian-truncate-log

 

I'll see whether it solves the issue...

 

0
Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Answer this question...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
 Share
Go to question listing
×
×
  • Create New...

Important Information

Terms of Use - Privacy Policy - Guidelines

  I accept