Newsfeed only loads once, then stops udating...

Medo

Hey there!

I just dont get it… My newsfeed is loading only each time, when i reload it from “outside” (as im using VNC at my local PC to alter data on my mirror software one room beside me). After one or two day, the newsfeed data only shows entries from several days ago. No update…
The same when i refresh the site when im logged in to the Pi (one update, after that…nothing)

I replaced the complete code with the github ones. But no effekt. It seems, like it just wont load (like no internet connection). But the Pi is connected to the internet via WLAN as other modules (like weather) have up-to-date data…

Heres my newsfeed code from the config.js - maybe i have overseen something:

{
module: ‘newsfeed’,
position: ‘bottom_bar’, // This can be any of the regions. Best results in center regions.
config: {
// The config property is optional.
// If no config is set, an example calendar is shown.
// See ‘Configuration options’ for more information.
feeds: [
{
title: “Der Spiegel”,
url: “http://www.spiegel.de/schlagzeilen/tops/index.rss”,
},
{
title: “Gala News”,
url: “http://www.gala.de/rss/gala_rss.html”,
}

                            ],
                            showDescription: true
                    }
            },

strawberry 3.141

@Medo any errors in the logs?

Medo

@strawberry-3.141

Okay, the logs. I forgot… :-D

First i tried with “pm logs -lines 1000”

And really, there were errors!

The logs with the error…
------------------------------------------------------------------------------------------------------------<
0|mm | > magicmirror@2.0.0 start /home/pi/MagicMirror
0|mm | > electron js/electron.js
0|mm |
0|mm | Loading config …
0|mm | Loading module helpers …
0|mm | Initializing new module helper …
0|mm | No helper found for module: alert.
0|mm | No helper found for module: clock.
0|mm | Initializing new module helper …
0|mm | No helper found for module: compliments.
0|mm | No helper found for module: currentweather.
0|mm | No helper found for module: weatherforecast.
0|mm | Initializing new module helper …
0|mm | Initializing new module helper …
0|mm | No helper found for module: calendar_monthly.
0|mm | All module helpers loaded.
0|mm | Starting server op port 8080 …
0|mm | Server started …
0|mm | Connecting socket for: MMM-PIR-Sensor
0|mm | Connecting socket for: calendar
0|mm | Starting node helper for: calendar
0|mm | Connecting socket for: newsfeed
0|mm | Starting module: newsfeed
0|mm | Connecting socket for: MMM-Fuel
0|mm | Starting module: MMM-Fuel
0|mm | Sockets connected & modules started …
0|mm | Launching application.
0|mm | Create new calendar fetcher for url: http://localhost:8080/modules/default/calendar/calendardata.ics - Interval: 300000
0|mm | Create new news fetcher for url: http://www.br.de/franken/franken100~rss.xml - Interval: 300000
0|mm | Create new news fetcher for url: https://www.kuketz-blog.de/feed/ - Interval: 300000
0|mm | Whoops! There was an uncaught exception…
0|mm | MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|mm | If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|mm | Whoops! There was an uncaught exception…
0|mm | MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|mm | If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|mm | Whoops! There was an uncaught exception…
0|mm | MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|mm | If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|mm | Whoops! There was an uncaught exception…
0|mm | MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|mm | If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues
0|mm | Whoops! There was an uncaught exception…
0|mm | MagicMirror will not quit, but it might be a good idea to check why this happened. Maybe no internet connection?
0|mm | If you think this really is an issue, please open an issue on GitHub: https://github.com/MichMich/MagicMirror/issues

…but i noticed, that the feeds were some, i used some tries before. So with my actual used feeds - no errors anymore.
But they’re still not updated…
------------------------------------------------------------------------------------------------------------<

|mm | > magicmirror@2.0.0 start /home/pi/MagicMirror
0|mm | > electron js/electron.js
0|mm |
0|mm | Loading config …
0|mm | Loading module helpers …
0|mm | No helper found for module: helloworld.
0|mm | All module helpers loaded.
0|mm | Starting server op port 8080 …
0|mm | Server started …
0|mm | Sockets connected & modules started …
0|mm | Launching application.
0|mm |
0|mm | > magicmirror@2.0.0 start /home/pi/MagicMirror
0|mm | > electron js/electron.js
0|mm |
0|mm | Loading config …
0|mm | Loading module helpers …
0|mm | Initializing new module helper …
0|mm | No helper found for module: alert.
0|mm | No helper found for module: clock.
0|mm | Initializing new module helper …
0|mm | No helper found for module: compliments.
0|mm | No helper found for module: currentweather.
0|mm | No helper found for module: weatherforecast.
0|mm | Initializing new module helper …
0|mm | Initializing new module helper …
0|mm | No helper found for module: calendar_monthly.
0|mm | All module helpers loaded.
0|mm | Starting server op port 8080 …
0|mm | Server started …
0|mm | Connecting socket for: MMM-PIR-Sensor
0|mm | Connecting socket for: calendar
0|mm | Starting node helper for: calendar
0|mm | Connecting socket for: newsfeed
0|mm | Starting module: newsfeed
0|mm | Connecting socket for: MMM-Fuel
0|mm | Starting module: MMM-Fuel
0|mm | Sockets connected & modules started …
0|mm | Launching application.
0|mm | Create new calendar fetcher for url: http://localhost:8080/modules/default/calendar/calendardata.ics - Interval: 300000
0|mm | Create new news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss - Interval: 300000
0|mm | Create new news fetcher for url: http://www.gala.de/rss/gala_rss.html - Interval: 300000
0|mm | Create new news fetcher for url: http://www.metalnews.de/rss/ - Interval: 300000
0|mm | Create new news fetcher for url: http://www.infranken.de/storage/rss/rss/2.0/startseite.xml - Interval: 300000

I also tried to open the MM in Chromium and then hit F12. But i didnt see anything suscpicious there…
------------------------------------------------------------------------------------------------------------<

???

Last i tried “pm2 log mm”. And it gave me some errors:
------------------------------------------------------------------------------------------------------------<

[TAILING] Tailing last 10 lines for [mm] process (change the value with --lines option)
/home/pi/.pm2/logs/mm-error-0.log last 10 lines:
0|mm | at emitOne (events.js:96:13)
0|mm | at SAXStream.emit (events.js:188:7)
0|mm | at Object.me._parser.(anonymous function) [as onopentag] (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:258:17)
0|mm | at emit (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:640:35)
0|mm | at emitNode (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:645:5)
0|mm | at openTag (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:841:5)
0|mm | at Object.write (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:1404:13)
0|mm | at SAXStream.write (/home/pi/MagicMirror/node_modules/sax/lib/sax.js:239:18)
0|mm | at yoshi.write (/home/pi/MagicMirror/node_modules/feedme/lib/feedme.js:41:14)
0|mm | WARNING! Could not validate config file. Please correct syntax errors. Starting with default configuration.

/home/pi/.pm2/logs/mm-out-0.log last 10 lines:
0|mm | Use existing news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss
0|mm | Use existing news fetcher for url: http://www.gala.de/rss/gala_rss.html
0|mm | Use existing news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss
0|mm | Use existing news fetcher for url: http://www.gala.de/rss/gala_rss.html
0|mm | Use existing news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss
0|mm | Use existing news fetcher for url: http://www.gala.de/rss/gala_rss.html
0|mm | Use existing news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss
0|mm | Use existing news fetcher for url: http://www.gala.de/rss/gala_rss.html
0|mm | Use existing news fetcher for url: http://www.spiegel.de/schlagzeilen/tops/index.rss
0|mm | Use existing news fetcher for url: http://www.gala.de/rss/gala_rss.html

Espacially the last log confuses me. Do i have a syntax problem?

Any suggestions how to do further analysis on this or a good hint what to do now?

Medo

Managed to get it working again. Cant say, what went wrong before. Thread can be closed…

lolobyte

@Medo
I tried to inplement multiplr Feeds but my confic will display only the last one.

What is wrong in my config?

            {
                    module: 'newsfeed',
                    position: 'bottom_bar',
                    config: {
                            feeds: [
                                    {
                                    title: "Süddeutsche Zeitung",
                                    url: "http://rss.sueddeutsche.de/rss/Topthemen",
                                    title: "Tagesschau",
                                    url: "http://www.tagesschau.de/xml/rss2",
                   "http://www.stimme.de/storage/rss/rss/regioticker/regioticker.xml"
                                    }
                                    ],
                            showSourceTitle: true,
                            showPublishDate: true
                            }
            },{

Medo

@lolobyte

Try to look at the original files which came in the downloaded package. I also had problems and realized later, that i had forgotten some characters…

In your case, i think you have to put each title and url in parentheses. Look at my example from above and also dont miss commas…

Something like this:

                               {
                                title: "Süddeutsche Zeitung",
                                url: "http://rss.sueddeutsche.de/rss/Topthemen",
                                },
                                title: "Tagesschau",
                                url: "http://www.tagesschau.de/xml/rss2",
                                "http://www.stimme.de/storage/rss/rss/regioticker/regioticker.xml",
                                 }

As i mentioned above - take the original files as reference, go throug it character by character and you will get it some trys later…

lolobyte

@Medo
oh, yes👍 .
Now I see my fault!

Thank you.
I just try it when I’m back home.

Have a nice day

Medo

Sad to say, but my problem keeps coming back.
I installed a fresh version of the MagicMirror software - but still the newsfeed stops updating some times later (hours, days)

Dont know, how to interprete this error log (even dont know, if its the source of my problem) - but i think i got some sort of a connection timeout. But where and why?

See:

pi@raspberrypi:~ $ pm2 logs mm --lines 100
[TAILING] Tailing last 100 lines for [mm] process (change the value with --lines option)
/home/pi/.pm2/logs/mm-error-0.log last 100 lines:
0|mm       | npm ERR! There is likely additional logging output above.
0|mm       | 
0|mm       | npm ERR! Please include the following file with any support request:
0|mm       | npm ERR!     /home/pi/MagicMirror/npm-debug.log
0|mm       | { Error: connect ETIMEDOUT 95.100.183.154:443
0|mm       |     at Object.exports._errnoException (util.js:1026:11)
0|mm       |     at exports._exceptionWithHostPort (util.js:1049:20)
0|mm       |     at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1081:14)
0|mm       |   code: 'ETIMEDOUT',
0|mm       |   errno: 'ETIMEDOUT',
0|mm       |   syscall: 'connect',
0|mm       |   address: '95.100.183.154',
0|mm       |   port: 443 }
0|mm       | { Error: socket hang up
0|mm       |     at createHangUpError (_http_client.js:252:15)
0|mm       |     at TLSSocket.socketCloseListener (_http_client.js:284:23)
0|mm       |     at emitOne (events.js:101:20)
0|mm       |     at TLSSocket.emit (events.js:188:7)
0|mm       |     at TCP._handle.close [as _onclose] (net.js:493:12) code: 'ECONNRESET' }
0|mm       | { Error: getaddrinfo ENOTFOUND www.gala.de www.gala.de:80
0|mm       |     at errnoException (dns.js:28:10)
0|mm       |     at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
0|mm       |   code: 'ENOTFOUND',
0|mm       |   errno: 'ENOTFOUND',
0|mm       |   syscall: 'getaddrinfo',
0|mm       |   hostname: 'www.gala.de',
0|mm       |   host: 'www.gala.de',
0|mm       |   port: 80 }
0|mm       | TypeError: Cannot read property 'statusCode' of undefined
0|mm       |     at Request.request [as _callback] (/home/pi/MagicMirror/modules/MMM-Fuel/node_helper.js:40:25)
0|mm       |     at self.callback (/home/pi/MagicMirror/modules/MMM-Fuel/node_modules/request/request.js:186:22)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at Request.emit (events.js:188:7)
0|mm       |     at Request.onRequestError (/home/pi/MagicMirror/modules/MMM-Fuel/node_modules/request/request.js:845:8)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at ClientRequest.emit (events.js:188:7)
0|mm       |     at TLSSocket.socketErrorListener (_http_client.js:308:9)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at TLSSocket.emit (events.js:188:7)
0|mm       | TypeError: Cannot read property 'statusCode' of undefined
0|mm       |     at Request.request [as _callback] (/home/pi/MagicMirror/modules/MMM-Fuel/node_helper.js:40:25)
0|mm       |     at self.callback (/home/pi/MagicMirror/modules/MMM-Fuel/node_modules/request/request.js:186:22)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at Request.emit (events.js:188:7)
0|mm       |     at Request.onRequestError (/home/pi/MagicMirror/modules/MMM-Fuel/node_modules/request/request.js:845:8)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at ClientRequest.emit (events.js:188:7)
0|mm       |     at TLSSocket.socketErrorListener (_http_client.js:308:9)
0|mm       |     at emitOne (events.js:96:13)
0|mm       |     at TLSSocket.emit (events.js:188:7)
0|mm       | { Error: connect ETIMEDOUT 95.100.183.154:443
0|mm       |     at Object.exports._errnoException (util.js:1026:11)
0|mm       |     at exports._exceptionWithHostPort (util.js:1049:20)
0|mm       |     at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1081:14)
0|mm       |   code: 'ETIMEDOUT',
0|mm       |   errno: 'ETIMEDOUT',
0|mm       |   syscall: 'connect',
0|mm       |   address: '95.100.183.154',
0|mm       |   port: 443 }
0|mm       | { Error: socket hang up
0|mm       |     at createHangUpError (_http_client.js:252:15)
0|mm       |     at TLSSocket.socketCloseListener (_http_client.js:284:23)
0|mm       |     at emitOne (events.js:101:20)
0|mm       |     at TLSSocket.emit (events.js:188:7)
0|mm       |     at TCP._handle.close [as _onclose] (net.js:493:12) code: 'ECONNRESET' }
0|mm       | { Error: connect ETIMEDOUT 95.101.30.23:80
0|mm       |     at Object.exports._errnoException (util.js:1026:11)
0|mm       |     at exports._exceptionWithHostPort (util.js:1049:20)
0|mm       |     at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1081:14)
0|mm       |   code: 'ETIMEDOUT',
0|mm       |   errno: 'ETIMEDOUT',
0|mm       |   syscall: 'connect',
0|mm       |   address: '95.101.30.23',
0|mm       |   port: 80 }
0|mm       | { Error: socket hang up
0|mm       |     at createHangUpError (_http_client.js:252:15)
0|mm       |     at Socket.socketCloseListener (_http_client.js:284:23)
0|mm       |     at emitOne (events.js:101:20)
0|mm       |     at Socket.emit (events.js:188:7)
0|mm       |     at TCP._handle.close [as _onclose] (net.js:493:12) code: 'ECONNRESET' }
0|mm       | { Error: getaddrinfo EAI_AGAIN www.welt.de:443
0|mm       |     at Object.exports._errnoException (util.js:1026:11)
0|mm       |     at errnoException (dns.js:33:15)
0|mm       |     at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
0|mm       |   code: 'EAI_AGAIN',
0|mm       |   errno: 'EAI_AGAIN',
0|mm       |   syscall: 'getaddrinfo',
0|mm       |   hostname: 'www.welt.de',
0|mm       |   host: 'www.welt.de',
0|mm       |   port: 443 }
0|mm       | { Error: getaddrinfo EAI_AGAIN www.gala.de:80
0|mm       |     at Object.exports._errnoException (util.js:1026:11)
0|mm       |     at errnoException (dns.js:33:15)
0|mm       |     at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:76:26)
0|mm       |   code: 'EAI_AGAIN',
0|mm       |   errno: 'EAI_AGAIN',
0|mm       |   syscall: 'getaddrinfo',
0|mm       |   hostname: 'www.gala.de',
0|mm       |   host: 'www.gala.de',
0|mm       |   port: 80 }

Any ideas on this?

Thanks in advance…

poutr

@Medo In my experience the source itself can be an issue. See my post here, I ditched these two RSS feed and no more trouble : https://forum.magicmirror.builders/topic/2116/newsfeed-default-module-get-stuck-after-first-rss-download-and-does-not-refresh-reliably

So it’s not constant behaviour.

Medo

@poutr
Guess what: You were right!

I changed from two rss-feed to only one and also took a site, which provides an URL which ends with .xml
And see: No error since 7 days… The newsfeed is updating frequently and no errors ocurring…
It seems, like there are sites which are not that available as i thought and they drop calls from time to time. But the mirror does not like those…

Perfect! You gave me the right hint! Thanks a lot @poutr!