Calendar not updating

mspk

@sdetweil said in Calendar not updating:

@matt216 I have not had others with no updates, but others w missing events

Hi, I’m pretty new here, so sorry if I mess something up. I think I have the same problem. Installed MM yesterday (so pretty vanilla setup), the only module I added is the MMM-CalendarExt3.
I configured everything as it should be (I hope at least), but for some reason, my calendars are not beeing updated and one is not beeing show at all… I don’t know what to do anymore, maybe you guys have an idea.

Here is my error: ```
0|MagicMirror | [09.01.2024 12:28.43.248] [ERROR] Calendar Error. Could not fetch calendar: https://calendar.google.com/[MyCalendarNameHere]/basic.ics
TypeError: fetch failed
0|MagicMirror | at Object.fetch (node:internal/deps/undici/undici:11576:11) {
0|MagicMirror | cause: Error: write EPIPE
0|MagicMirror | at WriteWrap.onWriteComplete [as oncomplete] (node:internal/stream_base_commons:94:16)
0|MagicMirror | at handleWriteReq (node:internal/stream_base_commons:58:21)
0|MagicMirror | at writeGeneric (node:internal/stream_base_commons:149:15)
0|MagicMirror | at TLSSocket._writeGeneric (node:net:931:11)
0|MagicMirror | at TLSSocket._write (node:net:943:8)
0|MagicMirror | at writeOrBuffer (node:internal/streams/writable:392:12)
0|MagicMirror | at _write (node:internal/streams/writable:333:10)
0|MagicMirror | at TLSSocket.write (node:internal/streams/writable:337:10)
0|MagicMirror | at write (node:internal/deps/undici/undici:10124:18)
0|MagicMirror | at _resume (node:internal/deps/undici/undici:10037:33)
0|MagicMirror | at resume (node:internal/deps/undici/undici:9938:7)
0|MagicMirror | at [dispatch] (node:internal/deps/undici/undici:9286:11)
0|MagicMirror | at Client.Intercept (node:internal/deps/undici/undici:9017:20)
0|MagicMirror | at Client.dispatch (node:internal/deps/undici/undici:7772:44)
0|MagicMirror | at [dispatch] (node:internal/deps/undici/undici:7991:32)
0|MagicMirror | at Pool.dispatch (node:internal/deps/undici/undici:7772:44) {
0|MagicMirror | errno: -32,
0|MagicMirror | code: ‘EPIPE’,
0|MagicMirror | syscall: ‘write’
0|MagicMirror | }
0|MagicMirror | }

Thanks!

sdetweil

@mspk I think you have the wrong calendar url , you need the ical format url, not the embed url
mine is like

https://calendar.google.com/calendar/ical/sdetweil%40gmail.com/private-fhkjsadfhsdflk'sdfk/basic.ics

mspk

@sdetweil said in Calendar not updating:

I think you have the wrong calendar url , you need the ical format url, not the embed url
mine is like

You mean the public one? Because for some reason, 3 of the 5 calendars work just fine with the private ICal Format address.

matt216

@sdetweil I think you are potentially right. For baikal I have followed such advice as here: https://forum.magicmirror.builders/topic/434/caldav/4?_=1704811423495 where it was advised just adding ?export to the end of the cal URL to generate the ics file, but it is not an actual ics link.
I shall work along those lines…

sdetweil

@matt216 i test others problems by building an ics FILE and using the url

http://localhost:mirror_port/modules/default/calendar/????.ics

so it doesn’t have to be ON a ‘server’… just has to be an ICS format file.
linking to google, the url returns that data when the calendar does a get request
same as for the local file. BUT we depend on the data changing…
the cal module does not know that ‘this’ fetch was or was not different than the last fetch.
we don’t keep a diff… we just get the current data and present it.

if it didn’t change then nothing changes

matt216

@sdetweil Trying this.
Steps:

add new test event scheduled tomorrow
verify event on another device, proving calendar server sync
curl .ics file from server, find test event
set calendar module as described in your post above

Result:
calendar loads successfully, but still does not show new event.

Event as shown in ics file:

BEGIN:VEVENT
CREATED:20240109T161646Z
DTEND;TZID=Europe/London:20240110T170000
DTSTAMP:20240109T161647Z
DTSTART;TZID=Europe/London:20240110T160000
LAST-MODIFIED:20240109T161646Z
SEQUENCE:0
SUMMARY:test54321
TRANSP:OPAQUE
UID:156ED8F1-9BDA-43D2-BE7C-DDEFE18E95EF
URL;VALUE=URI:
X-APPLE-CREATOR-IDENTITY:com.apple.mobilecal
X-APPLE-CREATOR-TEAM-IDENTITY:0000000000
END:VEVENT

I think MagicMirror does not like the baikal server - no events created since I migrated from iCloud to self-hosted baikal are showing. Can you see anything unusual in the ics event above @sdetweil ?

matt216

@sdetweil so I’ve just spun up a radicale calendar server and added a few test events, then some more - works perfectly!

Looks like a problem with baikal integration

sdetweil

@matt216 no. i created an ics and ran mm against it

[09.01.2024 10:42.53.207] [LOG]   Create new calendarfetcher for url: http://localhost:8090/modules/default/calendar/testbalkan.ics - Interval: 604800000
...
[09.01.2024 10:42.53.336] [DEBUG] parsed data={"156ED8F1-9BDA-43D2-BE7C-DDEFE18E95EF":{"type":"VEVENT","params":[],"created":"2024-01-09T16:16:46.000Z","end":"2024-01-10T17:00:00.000Z","dtstamp":"2024-01-09T16:16:47.000Z","start":"2024-01-10T16:00:00.000Z","datetype":"date-time","lastmodified":"2024-01-09T16:16:46.000Z","sequence":"0","summary":"test54321","transparency":"OPAQUE","uid":"156ED8F1-9BDA-43D2-BE7C-DDEFE18E95EF","url":{"params":{"VALUE":"URI"},"val":""},"APPLE-CREATOR-IDENTITY":"com.apple.mobilecal","APPLE-CREATOR-TEAM-IDENTITY":"0000000000"},"vcalendar":{"type":"VCALENDAR"}}
[09.01.2024 10:42.53.337] [DEBUG] There are 2 calendar entries.
[09.01.2024 10:42.53.338] [DEBUG] Processing entry...
[09.01.2024 10:42.53.339] [DEBUG] Event:
{"type":"VEVENT","params":[],"created":"2024-01-09T16:16:46.000Z","end":"2024-01-10T17:00:00.000Z","dtstamp":"2024-01-09T16:16:47.000Z","start":"2024-01-10T16:00:00.000Z","datetype":"date-time","lastmodified":"2024-01-09T16:16:46.000Z","sequence":"0","summary":"test54321","transparency":"OPAQUE","uid":"156ED8F1-9BDA-43D2-BE7C-DDEFE18E95EF","url":{"params":{"VALUE":"URI"},"val":""},"APPLE-CREATOR-IDENTITY":"com.apple.mobilecal","APPLE-CREATOR-TEAM-IDENTITY":"0000000000"}
[09.01.2024 10:42.53.339] [DEBUG] start: Wed Jan 10 2024 10:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.339] [DEBUG] end:: Wed Jan 10 2024 11:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.339] [DEBUG] duration: 3600000
[09.01.2024 10:42.53.340] [DEBUG] title: test54321
[09.01.2024 10:42.53.340] [DEBUG] full day event =false
[09.01.2024 10:42.53.340] [DEBUG] initial tz=Europe/London
[09.01.2024 10:42.53.340] [DEBUG] corrected tz=Europe/London
[09.01.2024 10:42.53.341] [DEBUG] start date/time=Wed Jan 10 2024 10:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.341] [DEBUG] start offset=0
[09.01.2024 10:42.53.341] [DEBUG] start date/time w tz =Wed Jan 10 2024 10:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.342] [DEBUG] event date=Wed Jan 10 2024 10:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.342] [DEBUG] event offset=0 hour=16 event date=Wed Jan 10 2024 10:00:00 GMT-0600 (Central Standard Time)
[09.01.2024 10:42.53.342] [DEBUG] adjustHours=0
[09.01.2024 10:42.53.342] [DEBUG] saving event: test54321
[09.01.2024 10:42.53.342] [DEBUG] Processing entry...
[09.01.2024 10:42.53.342] [INFO]  Calendar-Fetcher: Broadcasting 1 events from http://localhost:8090/modules/default/calendar/testbalkan.ics.

sdetweil

@matt216 can u send me the curl ics from the baikal server where the events don’t show??
(if you are willing)
rename to .txt

matt216

@sdetweil this is from the curl’d ics file, showing one of the events that will not display on the mirror display:

BEGIN:VEVENT
CREATED:20240109T161646Z
DTEND;TZID=Europe/London:20240110T170000
DTSTAMP:20240109T161647Z
DTSTART;TZID=Europe/London:20240110T160000
LAST-MODIFIED:20240109T161646Z
SEQUENCE:0
SUMMARY:test54321
TRANSP:OPAQUE
UID:156ED8F1-9BDA-43D2-BE7C-DDEFE18E95EF
URL;VALUE=URI:
X-APPLE-CREATOR-IDENTITY:com.apple.mobilecal
X-APPLE-CREATOR-TEAM-IDENTITY:0000000000
END:VEVENT

I’d be happy to send over the contents of the ics file before events start, if that would be helpful? Far too much personal family info to send the whole thing, Im afraid (again, no offence intended)!

sdetweil

@matt216 I used that event in an ICS and it displays just fine.

so I think this is not the events but some communications problem.

the fact that you have it working with another local hosting server tells me it’s something other than the data

matt216

Initial testing with the apache version of the baikal container looks promising (I’m currently having problems with the nginx version). Will continue testing along these lines…

matt216

OK interesting. I created a brand new calendar server. Empty. Added one event to it and configured the mirror calendar module to use this server. It shows the one single event ok. I added a second new event to the calendar and this also shows on the mirror. Seems to work as expected - new events are showing!

Then I import my whole famlly calendar and run the same test. I now have 5 family events showing on the calendar. But if I add a new event that should show within my 5 events, it does not show. :(

Debug logs >somefile.txt show the mirror is picking up the new event from the ics file, it’s just not showing on the display.

matt216

@sdetweil I wonder if I could run a nightly cron job to purge the calendar module or something similar…? Not sure how the calendar fetcher works.
It still feels like the calendar will load an ics link ok the first time, but is not displaying events created since that first load.
Nightly purge and re-connect would be acceptable, I think. Any advice there?

sdetweil

@matt216 there is no way to programmatically trigger a calendar refresh. you have to restart mm

but you could do this w pm2

pm2 restart MagicMirror

(or it’s number)

in the current state does the broadcasting message indicate a change in number of events?

matt216

@sdetweil yes, the broadcasting event number increases by 1 when I add my new event, but the event does not show on the display.

sdetweil

@matt216 can u show me the cal config again… as far as I can tell, the ONLY reason its not displayed is that the count (maximumEntries) clips off the total number of events

actually there are more conditions… in calendar.js
but they are all configurable

			for (const e in calendar) {
				const event = JSON.parse(JSON.stringify(calendar[e])); // clone object

				if (this.config.hidePrivate && event.class === "PRIVATE") {
					// do not add the current event, skip it
					continue;
				}
				if (limitNumberOfEntries) { (//called with true) 
					if (event.endDate < maxPastDaysCompare) {
						continue;
					}
					if (this.config.hideOngoing && event.startDate < now) {
						continue;
					}
					if (this.config.hideDuplicates && this.listContainsEvent(events, event)) {
						continue;
					}
					if (--remainingEntries < 0) {
						break;
					}
				}

and after filtering them out , apply the number of days limit and max entries limit

		// Limit the number of days displayed
		// If limitDays is set > 0, limit display to that number of days
		if (this.config.limitDays > 0) {
			let newEvents = [];
			let lastDate = today.clone().subtract(1, "days").format("YYYYMMDD");
			let days = 0;
			for (const ev of events) {
				let eventDate = moment(ev.startDate, "x").format("YYYYMMDD");
				// if date of event is later than lastdate
				// check if we already are showing max unique days
				if (eventDate > lastDate) {
					// if the only entry in the first day is a full day event that day is not counted as unique
					if (!this.config.limitDaysNeverSkip && newEvents.length === 1 && days === 1 && newEvents[0].fullDayEvent) {
						days--;
					}
					days++;
					if (days > this.config.limitDays) {
						continue;
					} else {
						lastDate = eventDate;
					}
				}
				newEvents.push(ev);
			}
			events = newEvents;
		}

		return events.slice(0, this.config.maximumEntries);

matt216

@sdetweil

{
			module: "calendar",
			header: "--- Calendar testing ---",
			position: "top_left",
			config: {
				fetchInterval: 120000,
				timeFormat: 'absolute',
				maximumEntries: 5,
				broadcastPastEvents: false,
				calendars: [
					{
						url: 'https://my.cal.url/dav.php/calendars/family/default?export',
						auth: 	{
							user: 'family',
							pass: 'pass',
							method: 'basic'
							}
					}
					]
				}
		},

With the maximumEntries I currently have events showing several days in the future. When I am adding events to test this, I add the event to start just a few hours in the future so that it should show within the 5 events.

sdetweil

@matt216 lets make that maximumEvents: 20

for this test

matt216

@sdetweil Updated to 20. This now shows calendar entries all the way to early May but the test event that starts at 20:00 this evening does not show. There are actually lots of events over the next few days that are not showing.