default calendar fetching issues

nowayto

I’m using default calendar with calendarExt3
Actually I’m using 2 .ics, one for holidays and one for private, both are Google cals and sometimes module has fetching issues.
I can’t figure what the problem is because behaviour is strange.

These are the cases that happened to me, everytimes on startup:

no default calendar events, no ext3 events
default and ext3 shows only holiday events
default shows nothing, ext3 shows some events

emlowe

I had considerable problems with running on a model A - but I found dietPI (https://dietpi.com/) to be a solid distro that works well even when using the default electron GUI front-end. (Previously OOM’d consistently)

Note, also I frequently have trouble with the calendar events appears as there seems to be some problem in the websocket communication layer (this bug: https://github.com/MagicMirrorOrg/MagicMirror/issues/3380)

I basically use MMM-RemoteControl to force a refresh in a daily cron job (curl http://localhost:8080/api/refresh) and this works. Why? No One knows

sdetweil

@nowayto have you installed the broadcast fix?

https://forum.magicmirror.builders/topic/19282/version-2-30-0-calendar-fix-for-clipping-broadcast-events

sdetweil

@nowayto default calendar NEVER displays past events

sdetweil

@nowayto other thing is how ext3 processes broadcasts

it doesn’t want to flash the screen on every update
calendar module procceses each calendar independently, do events arrive at different times

there are two settings
waitFetch how long to wait for All events (5 seconds)
update cycle??? how often to redraw. (30 mjns)

nowayto

@sdetweil I though I applied the fix in the past, although I’m not 100% sure.
But I don’t think the issue is ext3 related.

In my opinion sometimes default calendar don’t fetch the calendars, especially at the morning.
When it happen I don’t see any lines and a error message appear.
I don’t remember the message and now it’s working.
In the last one hour I tried to restart MM some times but now seems working, everything ok, no error message.
If it will appear, I’ll write it here

sdetweil

@nowayto to check on the fix

git branch

in the MagicMirror folder

nowayto

@sdetweil

git branch

_fix_clipping
master

Error appeared now:
" Error in the calendar module. Check logs for more detail."

I don’t know where to find calendar logs but with “pm2 logs”
I don’t see any errors information about calendar issue, just something about another module.

/home/MYUSER/.pm2/logs/mm-error.log last 15 lines:
0|mm | socket: {
0|mm | localAddress: 'MMIPADDRESS,
0|mm | localPort: MMPORT,
0|mm | remoteAddress: undefined,
0|mm | remotePort: undefined,
0|mm | remoteFamily: undefined,
0|mm | timeout: undefined,
0|mm | bytesWritten: 322,
0|mm | bytesRead: 0
0|mm | }
0|mm | }
0|mm | }
0|mm | [2025-03-19 13:30:59.574] [ERROR] Failed to retrieve repo info for MMM-Growatt: Error: Command failed: cd /home/MYUSER/MagicMirror/modules/MMM-Growatt && git fetch -n --dry-run
0|mm | fatal: unable to access ‘https://github.com/dekinet/MMM-Growatt.git/’: Empty reply from server
0|mm |

I don’t think this could be related to calendar issue

sdetweil

@nowayto

ok, on the right branch

yes, when run with pm2, then pm2 logs is the way…

there are two sections of the output

the .error(stderr) and .out(stdout)

can you look in the .out?

the folder for the pm2 logs is

~/.pm2/logs

note the leading dot on .pm2

nowayto

@sdetweil

It’s very long.

I checked the end paragraph ad I saw just errors from growatt module.
Do I have to search something in particular?

sdetweil

@nowayto said in default calendar fetching issues:

Do I have to search something in particular?

I do not know

can you recreate this if un restart MagicMirror? does it always fail in the morning?

pm2 is really for production use,

if you can repeat it

pm2 stop all
cd ~/MagicMirror
npm start &>somefile.txt

wait til failure
ctrl-q on MagicMirror screen
then examine the somefile.txt

nowayto

@sdetweil

Recreated 2 times.

First time calendar loaded Holidays calendar only

[2025-03-19 22:23:55.917] [LOG] Create new calendarfetcher for url: https://calendar.google.com/calendar/ical/**MYCAL**>
[2025-03-19 22:23:56.467] [LOG] Create new calendarfetcher for url: https://calendar.google.com/calendar/ical/**HOLIDAYPUBLICCAL**/publ>
[2025-03-19 22:23:56.675] [LOG] Create new newsfetcher for url: https://www.ansa.it/sito/ansait_rss.xml - Interval: 300000
[2025-03-19 22:23:56.698] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:23:56.836] [LOG] MMM-Formula1 received a notification: CONFIG
[2025-03-19 22:23:56.838] [LOG] MMM-Formula1 is requesting the SCHEDULE on url https://api.jolpi.ca/ergast/f1/2025.json
[2025-03-19 22:24:02.687] [INFO] updatenotification: Updater Class Loaded!
[2025-03-19 22:24:02.733] [INFO] updatenotification: Checking PM2 using…
[2025-03-19 22:24:02.735] [INFO] updatenotification: [PM2] You are not using pm2
[2025-03-19 22:24:02.740] [INFO] Checking git for module: MMM-CalendarExt3
[2025-03-19 22:24:03.525] [INFO] Checking git for module: MMM-Growatt
[2025-03-19 22:24:03.850] [INFO] Checking git for module: MMM-Formula1
[2025-03-19 22:24:04.283] [INFO] Checking git for module: MMM-RAIN-MAP
[2025-03-19 22:24:07.693] [INFO] Checking git for module: MagicMirror
[2025-03-19 22:24:08.072] [LOG] MMM-Formula1 is returning the SCHEDULE for the season
[2025-03-19 22:24:40.393] [INFO] Newsfeed-Fetcher: Broadcasting 28 items.
[2025-03-19 22:24:45.457] [INFO] Calendar-Fetcher: Broadcasting 61 events from https://calendar.google.com/calendar/**MYPRIVCAL**>
[2025-03-19 22:24:46.745] [INFO] Calendar-Fetcher: Broadcasting 36 events from https://calendar.google.com/calendar/**PUBLICHOLIDAYCAL/>
[2025-03-19 22:24:57.986] [LOG] Publishing GROWATT data
[2025-03-19 22:25:51.745] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:25:54.191] [LOG] Publishing GROWATT data
[2025-03-19 22:27:51.368] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:27:53.447] [LOG] Publishing GROWATT data

2nd time I got the error and no calendar loaded:

[2025-03-19 22:32:06.388] [LOG] Create new calendarfetcher for url: https://calendar.google.com/calendar/**PUBLICHOLIDAYCAL**>
[2025-03-19 22:32:07.767] [LOG] Create new calendarfetcher for url: https://calendar.google.com/calendar/**MYPRIVCAL**>
[2025-03-19 22:32:07.881] [LOG] Create new newsfetcher for url: https://www.ansa.it/sito/ansait_rss.xml - Interval: 300000
[2025-03-19 22:32:07.903] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:32:08.057] [INFO] updatenotification: Updater Class Loaded!
[2025-03-19 22:32:08.059] [INFO] updatenotification: Checking PM2 using…
[2025-03-19 22:32:08.063] [INFO] updatenotification: [PM2] You are not using pm2
[2025-03-19 22:32:08.066] [INFO] Checking git for module: MMM-CalendarExt3
[2025-03-19 22:32:08.132] [LOG] MMM-Formula1 received a notification: CONFIG
[2025-03-19 22:32:08.134] [LOG] MMM-Formula1 is requesting the SCHEDULE on url https://api.jolpi.ca/ergast/f1/2025.json
[2025-03-19 22:32:08.516] [INFO] Checking git for module: MMM-Growatt
[2025-03-19 22:32:10.043] [INFO] Checking git for module: MMM-Formula1
[2025-03-19 22:32:11.007] [INFO] Checking git for module: MMM-RAIN-MAP
[2025-03-19 22:32:14.346] [INFO] Newsfeed-Fetcher: Broadcasting 28 items.
[2025-03-19 22:32:14.404] [LOG] MMM-Formula1 is returning the SCHEDULE for the season
[2025-03-19 22:32:14.414] [INFO] Checking git for module: MagicMirror
[2025-03-19 22:32:48.815] [INFO] Calendar-Fetcher: Broadcasting 61 events from https://calendar.google.com/calendar/**MYPRIVCAL**>
[2025-03-19 22:32:50.508] [INFO] Calendar-Fetcher: Broadcasting 36 events from https://calendar.google.com/calendar/**PUBLICHOLIDAYCAL**>
[2025-03-19 22:32:51.949] [LOG] Publishing GROWATT data
[2025-03-19 22:34:08.485] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:34:14.955] [LOG] Publishing GROWATT data
[2025-03-19 22:36:06.721] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:36:09.906] [LOG] Publishing GROWATT data
[2025-03-19 22:37:16.339] [INFO] Newsfeed-Fetcher: Broadcasting 28 items.
[2025-03-19 22:38:07.502] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:38:10.302] [LOG] Publishing GROWATT data
[2025-03-19 22:40:09.496] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:40:12.087] [LOG] Publishing GROWATT data
[2025-03-19 22:42:11.495] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:42:13.869] [LOG] Publishing GROWATT data
[2025-03-19 22:42:16.743] [INFO] Newsfeed-Fetcher: Broadcasting 28 items.
[2025-03-19 22:44:13.525] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:44:15.562] [LOG] Publishing GROWATT data
[2025-03-19 22:46:15.496] [LOG] MMM-Growatt: GROWATT_GET_DATA
[2025-03-19 22:46:17.289] [LOG] Publishing GROWATT data
[2025-03-19 22:47:17.588] [INFO] Newsfeed-Fetcher: Broadcasting 28 items.
[2025-03-19 22:47:20.690] [LOG] Shutting down server…
[2025-03-19 22:47:20.696] [LOG] Stopping module helper: calendar

Honestly… I don’t see nothing strange.
But when this error appear, if I left MM on for a day, it wont load calendar entries.

I have to restart it one or more time till it show entries

sdetweil

@nowayto ok, disable the updatenotification module in config.js

add

disabled:true,
after the
module:line

nowayto

@sdetweil
I did it.
I usually put the “disabled: true” before the module name line, instead of after
Is it different?

sdetweil

@nowayto no. just some users dont know what i mean

nowayto

@sdetweil
behaviour seems the same. I suspect this, could this issues be related to the raspberry pi 3 computing capacity? could it be not enough?

Is there a way to delay the pm2 automatic startup.
For example I though to try a delay of 1-2 minutes so:
1- raspbian startup
2- delay of 1-2 minutes to make sure all the services are up and the cpu is idle
3- mm startup
4- if it’s possible, I will add a delay to the modules startup also, maybe 20 seconds between every module loading

Honestly I checked his capacity a lot of times using the htop, free and cpu temperature command.
With my amazement I see everytime an amount of free memory, low cpu load and good cpu temp (like 40 to 50 degrees)

But if there is a way to delay everything, I’ll just check if with a “calmly” startup It will go better

sdetweil

@nowayto i do not know on pm2

you could put a sleep 120
in the mm.sh to wait a while

how is swap space?

free -m

pi02w only has 512mb

nowayto

@sdetweil
Yes I agree, the memory is very limiting.
Although mine is a Pi3 model A, but the memory is 512mb like the pi02w.
When I started the project I had something different in my mind and now I’m pushing it to the limit.

But as I said I checked everytime the CPU temperature, memory and generally resources usage from “htop” command.

This morning MM started with calendar error, I did a “pm2 restart mm” and goes OK.

Now I put “sleep 120” inside mm.sh as first line
I restarted it now

Memory BEFORE restart was this
total used free shared buff/cache available
Mem: 427 156 90 70 179 147
Swap: 1023 231 792

Not so good but not so bad, same time.

I’ll check if this delay could help.
Is there a way to put a little delay between the loading of every module ? Maybe 5/10 seconds, I though it could be very helpful on a limited machine like mine :)

sdetweil

@nowayto there is no way to delay loading

emlowe

I had considerable problems with running on a model A - but I found dietPI (https://dietpi.com/) to be a solid distro that works well even when using the default electron GUI front-end. (Previously OOM’d consistently)

Note, also I frequently have trouble with the calendar events appears as there seems to be some problem in the websocket communication layer (this bug: https://github.com/MagicMirrorOrg/MagicMirror/issues/3380)

I basically use MMM-RemoteControl to force a refresh in a daily cron job (curl http://localhost:8080/api/refresh) and this works. Why? No One knows

nowayto

@emlowe I have a similar problem, I solved modifing mm.sh with

sleep 30
DISPLAY=:0 npm start
sleep 60
pm2 restart mm

“pm2 restart mm” does a refresh like you do with RemoteControl