SOLVED Pi 4 storage used up in weeks?

[dazza120]

Anyone else having issues with there Pi4 storage SD card being totally full in the matter of weeks? This is a 32gb card running buster but the archive version so is only a 1Gb download OS then it expands to 3Gb or 4Gb which leaves a lot of room for storage still I have only got MMM-Remote-Control-repositories MMM-Remote-control —mmm-SystemStatus mmm-nest-status mmm-hue-lights MMM-NOAA3 with just these I’m left with 0gb of space in the matter is weeks. Is this happening to anyone else?

[johnnyboy]

Did you format the SD to use ALL the available space, for MM? and not just allocate it a small portion?

[dazza120]

@johnnyboy yes but now thinking it’s a dud card from amazon as this is how much is showing as used and that’s not equivalent to 28Gb

Size Used Avail Use% Mounted on
/dev/root 30G 28G 0 100% /
devtmpfs 1.8G 0 1.8G 0% /dev
tmpfs 1.9G 16K 1.9G 1% /dev/shm
tmpfs 1.9G 8.5M 1.9G 1% /run
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup
/dev/mmcblk0p1 253M 40M 213M 16% /boot
tmpfs 386M 0 386M 0% /run/user/1000

[evroom]

@dazza120

I would suspect either /tmp being filled up or some log directory being filled up.
Or a log file going AWOL.

You can try to find out which directory under / is using the most:

$ sudo find / -xdev -maxdepth 1 -type d -exec du -s {} \; | sort -rn

When it is working again (perhaps after a reboot you have enough space again), you can look periodically which files are touched / created in the last 60 minutes:

$ sudo find / -xdev -mmin -60 -type f -exec ls -als  {} \;

[dazza120]

@evroom hi the first pi code just comes up no access and the other code comes up with a lot of other code thats above my pay grade lol, you could be right but its writting something like a Gb every two hours.

[evroom]

@dazza120
Hi,
I have no idea what you mean with “first pi code” and “the other code”.
2 Pi’s with 2 Magic Mirror instances running?

Do you have ssh access to your Pi 4?
If / is 100% full it normally does not allow you to.
You need to have access again and disable all your modules.
Then check if the / usage is increasing.
If not, or in normal quantity, then allow the modules again one by one, checking the usage after every step.

A reboot might grant you access again, or you might need to take the card out and use a card reader to have access via your PC.
Cleanup /tmp and try to boot from it with your Pi again.

Free space :

sudo df -h /

Usage:

sudo du -sh /
sudo du -sh /tmp 
sudo du -sh /home/pi

Until you have access, trouble shooting is not possible.

Good luck.

[dazza120]

Hi found its the MagicMirror-error.log in /home/pi/.pm2/logs its 7.9Gb and MagicMirror-out.log in /home/pi/.pm2/logs is 3.3Gb with your help ive found it but how do i fix it? looks like its @cowboysdude Module MMM-NOAA3 that is causing the issue never had an issue with this before @cowboysdude can you help?

TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)
    at IncomingMessage.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1083:12)
    at Object.onceWrapper (events.js:273:13)
    at IncomingMessage.emit (events.js:187:15)
    at endReadableNT (_stream_readable.js:1090:12)
TypeError: Cannot read property 'pollution' of undefined
    at Object.parseAIR (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:182:35)
    at Request._callback (/home/pi/MagicMirror/modules/MMM-NOAA3/providers/ds.js:174:28)
    at Request.self.callback (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:185:22)
    at Request.emit (events.js:182:13)
    at Request.<anonymous> (/home/pi/MagicMirror/modules/MMM-NOAA3/node_modules/request/request.js:1161:10)
    at Request.emit (events.js:182:13)

[dazza120]

I have disabled the NAAO3 module and enabled the default Weather is working fine, stable 25Gb left of space on the SD card. log file is now just 3bytes so hundred percent MMM-NAAO3 is causing the excessive storage useage.

[evroom]

@dazza120
Hi,

I found this to keep the pm2 log under control, pm2-logrotate:

http://pm2.keymetrics.io/docs/usage/log-management/#pm2-logrotate-module

Of course the module needs to be fixed, but this could prevent you from getting a full log again.

I do not have it in use myself.

[dazza120]

@evroom thanks but I’ll wait for a fix, everything is running great at the mo so the mirror is nearly ready to go back on the wall I don’t really want to be taking it down again so I’ll wait for a hard fix. But thanks a lot for your help