Upgraded, failed back, now mirror constantly restarts

ember1205

The device is restarting for what appears to be out of memory / swap space issues. Every time the system crashes and restarts, /dev/shm is at zero available space.

This location appears to be where the processes are storing content from the image files that are being loaded and it’s apparently causing something to overrun the available space. I have added images, but that was a couple of weeks ago (before even applying the OS updates) and everything ran perfectly fine.

sdetweil

@ember1205 df -k will show you what is used

the top looks like this

Filesystem      1K-blocks       Used  Available Use% Mounted on
udev             24555800          0   24555800   0% /dev
tmpfs             4931772       4108    4927664   1% /run
/dev/nvme0n1p1 1921217360  889131676  944193092  49% /
tmpfs            24658844    1769768   22889076   8% /dev/shm
tmpfs                5120          4       5116   1% /run/lock
tmpfs            24658844          0   24658844   0% /sys/fs/cgroup

with appropriate names for your system

free -m will show u memory and swap space

ember1205

Pretty sure it’s an out of memory issue. Once it crashes, the free memory jumps way up then trends back down once it restarts.

I’ve also discovered that this seems to be purely a “client” problem as I can connect to the Pi from a remote machine using a web browser and it will run just fine without any hiccups while the local client on the Pi crashes about every 60-70 seconds which correlates to two load intervals for photos. Maybe the MMM-ImagesPhotos module isn’t releasing memory properly?

ember1205

After a LOT of different attempts at upgrades, fail-backs, new installs, etc., I believe I finally corrected the issue…

It appears that PM2 was either somehow corrupted during an update attempt or just simply too far out of date. Attempting to run PM2 with certain command options (like stop or even status) was resulting in errors indicating some sort of circular reference. After doing a forced upgrade to the latest version, it stopped showing these errors and the mirror is to running as expected.

I did make some additional changes that include copying the core MM directory off to another linux host where I now run the mirror as a server. The RPi is now purely a client and it loads noticeably quicker as a result.

sdetweil

@ember1205 thx. I will add checking pm2 to the upgrade script