MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    1. Home
    2. TvE
    3. Posts
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.
    T
    Offline
    • Profile
    • Following 0
    • Followers 0
    • Topics 1
    • Posts 21
    • Groups 0

    Posts

    Recent Best Controversial
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @Ivanov_d
      Maybe we’re observing the same - currently it’s hard for me to tell.

      • You surely have no heat issue (no additional cooling is needed - only to prolong the life of the RPI)

      • OS
        As you hopefully have read in this thread I started with the same OS as you, then “downgraded” to the socalled “legacy” version and still saw the issues. then it suddenly stopped.
        Thus I need to replace to the latest OS and retest

      I have no logical reason to suspect the OS but I need to do the test to be 100% certain…

      • You can follow my test steps (using bisection - remove the handfull of external calls and see which triggers the problem)

      • My guess
        So far I can only conclude that something external provoked the network stack to crash.
        In the end of my testing () I had returned to my original config and no longer see problems
        That something must relate to one of the two services I was using (part of the vanilla config)

      UPDATE!!! - I just looked at my test and wow, this morning I had an error again (my test runs with the monitor turned off, thus I did not see this (I’m working on other tasks at the moment…).

      Looking in the logs I see calendar related issues a few hours before the service stopped

      My error occurred at [21.03.2022 22:39.02.219] in Denmark
      Your error occurred at [22.03.2022 10:27.33.823] in US? (guess deduced from your config)
      That way too close to just be a coincidence…

      I don’t know for how long you have been running your system, but I will now start to suspect that the root cause lies in the calendar service and we both are affected by the same root cause

      I wonder if we can find another source for those data

      (I now regret that I turned of tcpdump for my latest testing…)

      stdout

      [21.03.2022 22:34.06.084] [INFO]  Newsfeed-Fetcher: Broadcasting 20 items.
      [21.03.2022 22:39.02.219] [LOG]   Shutting down server...
      [21.03.2022 22:39.02.225] [LOG]   Stopping module helper: updatenotification
      [21.03.2022 22:39.02.226] [LOG]   Stopping module helper: calendar
      [21.03.2022 22:39.02.227] [LOG]   Stopping module helper: newsfeed
      

      err

      [21.03.2022 16:43.52.620] [WARN]  ^[[33mYou're using a full whitelist configuration to allow for all IPs^[[39m
      [1002:0321/164356.019064:ERROR:viz_main_impl.cc(161)] Exiting GPU process due to errors during initialization
      [1040:0321/164356.860589:ERROR:sandbox_linux.cc(376)] InitializeSandbox() called with multiple threads in process gpu-process.
      [21.03.2022 17:37.30.487] [ERROR] Calendar Error. Could not fetch calendar:  http://calendars.icloud.com/holidays/dk_da.ics FetchError: request to https://calendars.icloud.com/holidays/dk_da.ics failed, reason: connect ETIMEDOUT 17.248.150.146:443
          at ClientRequest.<anonymous> (/home/pi/MagicMirror/node_modules/node-fetch/lib/index.js:1483:11)
          at ClientRequest.emit (node:events:394:28)
          at TLSSocket.socketErrorListener (node:_http_client:447:9)
          at TLSSocket.emit (node:events:394:28)
          at emitErrorNT (node:internal/streams/destroy:157:8)
          at emitErrorCloseNT (node:internal/streams/destroy:122:3)
          at processTicksAndRejections (node:internal/process/task_queues:83:21) {
        type: 'system',
        errno: 'ETIMEDOUT',
        code: 'ETIMEDOUT'
      }
      [21.03.2022 17:44.40.539] [ERROR] Calendar Error. Could not fetch calendar:  http://calendars.icloud.com/holidays/dk_da.ics FetchError: request to https://calendars.icloud.com/holidays/dk_da.ics failed, reason: connect ETIMEDOUT 17.248.150.10:443
          at ClientRequest.<anonymous> (/home/pi/MagicMirror/node_modules/node-fetch/lib/index.js:1483:11)
          at ClientRequest.emit (node:events:394:28)
          at TLSSocket.socketErrorListener (node:_http_client:447:9)
          at TLSSocket.emit (node:events:394:28)
          at emitErrorNT (node:internal/streams/destroy:157:8)
          at emitErrorCloseNT (node:internal/streams/destroy:122:3)
          at processTicksAndRejections (node:internal/process/task_queues:83:21) {
        type: 'system',
        errno: 'ETIMEDOUT',
        code: 'ETIMEDOUT'
      }
      [958:0321/223902.258167:ERROR:zygote_communication_linux.cc(276)] Failed to send GetTerminationStatus message to zygote
      [958:0321/223902.279012:ERROR:zygote_communication_linux.cc(276)] Failed to send GetTerminationStatus message to zygote
      
      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      So - without the lid I get another 2K as - after 15 min - the temperature stabilized around 54-55 degrees centigrades

      * Passive cooling lid  on : 63 -> 58 =  -5
      * Passive cooling lid off : 63 -> 55 =  -8
      * Active  cooling lid  on : 63 -> 49 = -14
      * Active  cooling lid off : 63 -> 42 = -21
      
      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @sdetweil Yeah - that’s perfect (and expected)
      I really have (now stopped) wondering what happened initially :-)

      @thgmirror
      I made a quick test where I have removed the power to the fan to see how much that changes the temperature (aka a passive cooling test).

      • After ca. one hour the temperature rises to a max of 57-58 degrees centigrades
      • For the next hour the temperature is not rising any more
      • Thus a reduction of ~6K

      NB.: I have now removed the lid to see how big (small) a difference that makes

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @thgmirror

      63.4 C? Could be less!

      I have now added one of these [1] to my RPI 3 and returned it to the enclosure (the “starter kit cabinet”).

      The temperature is now 48-49 degrees centigrade after 30 min usage of MM.
      So it reduces the temperature with ~14K - thats nice (if you don’t mind listening to a spinning fan which is actually fairly loud in at least 2 meters distance)…!

      I’ll try passive cooling later…

      Oh! - and I had a 14 day uptime before powering off (the original reason for this thread :-)

      [1] https://uk.rs-online.com/web/p/raspberry-pi-hats-add-ons/2020449

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @sdetweil said in Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service":

      @tve but see his post

      https://forum.magicmirror.builders/topic/16485/temperature-of-a-rpi3

      60 is bad if u can do 30!

      Great post(!)

      (And here I thought that 60 was the normal/expected working temperature)

      I think I’ll add a passive solution (or maybe even an active - but then there is a fan that will die)
      (I have some other - rather expensive - equipment that died due to a dead fan, and unfortunately there was no way to measure the temperature - bad design…)

      I see these two obvious options:

      • https://uk.rs-online.com/web/p/raspberry-pi-hats-add-ons/8679039
      • https://uk.rs-online.com/web/p/raspberry-pi-hats-add-ons/2020449

      The active solution might even add enough cooling even when the fan dies (as it seems that there is a passive “path for the heat” from the CPU
      I should try both :-)

      What is to gain?:
      I am aware that the warmer the chip the shorter it’s life
      (I have complained to a vendor that one of their products got so warm that I burn myself if I touch the enclosure, but they insist that it’s expected - even though I have had to get at least three of my nine devices replaced!
      I think it’s due to a bad design - hence my heat complaint…)

      The rule of thumb is something like this:

      By increasing the device temperature by just 10°C, we have reduced the lifetime by over 2x

      Sources:
      https://jetcool.com/post/semiconductor-lifetime-how-temperature-affects-mean-time-to-failure-device-reliability/

      https://www.electronics-cooling.com/2017/08/10c-increase-temperature-really-reduce-life-electronics-half/#:~:text=If one were to ask,reduces component life by half”.

      BTW: I have not seen any more network-service-instance-crashes, it’s still going strong after 8 days, really weird (but good!)…

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @thgmirror A cron based measuring is a good approach I’ll keep that in mind if I start to suspect temperature (or when I perform a load test my grabber-PI).

      For now I do not think it can be temperature related as it’s very reliable around 60 degrees centigrade

      pi@mirror:~ $ vcgencmd measure_temp
      temp=59.6'C
      
      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @sdetweil Will do!

      @thgmirror Nope no PIR sensor (as in “not yet”)
      My setup is as basic “Hello World!” as it can be (IMHO)
      (The full config can be seen - as a diff to the sample - earlier in this thread)

      The pi have been placed horisontally on my desk during all this testing.
      It is in a cabinet though (the one from the “startet kit”).

      I have measured the temperature (with my hand) and not been alarmed
      Now I can validate my assumption based on your tip, thanx!

      pi@mirror:~ $ vcgencmd measure_temp
      temp=63.4'C
      

      I have read that it’s possible to get add a cooling fin to the CPU, which is something I’ll look in to later (as I am also working on making a replacement for this guy, an image grabber [1].
      You can no longer purchase it (and I can make more captures pr second on my pi) for 1/2 the price, I only need to add this thingy [2]
      I have HelloWorld! for this, I “just” need to add

      • Capture to RAM disk in stead of USB
      • Auto upload to an ftp share (or maybe change this to scp…)
      • Maybe get the pi’s to netboot as well (as I need 10+ of the system)

      But that’s completely irellevant to my MM problem ;-)

      [1 ]https://www.epiphan.com/wp-content/uploads/2014/07/epiphan-vga2ethernet-brochure.pdf
      [2] https://www.epiphan.com/products/avio-4k/

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @sdetweil This is really getting intersting - I have now re-enabled all the config changes so I’m back to my initial config and have been running for four days without a problem.

      I even reproduced the problem on two differerent physical Pi’s (to eliminate HW) before starting to dissect the config…

      So for now I can only conclude that something external was triggering these crashes!

      I can now go back to the latest OS and start adding more stuff to my config (and keep my fingers crossed that I no longer encounter what-ever it was…)

      Thank you for your help!

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      Hmm so my latest config ran for more than 2 days.

      I’m now reverting to the initial config (enabling all four config-changes) and then time will tell

      posted in Troubleshooting
      T
      TvE
    • RE: Every few hours I get "ERROR:network_service_instance_impl.cc(916)] Network service crashed, restarting service"

      @sdetweil Don’t worry about “debug” I just had to read the config in stead of skipping over that part

      I have now reverted to my original config and will enable the different service in bisect style.

      /*
      TvE test log (on legacy OS)
      Re-configured services resulting in crash:
        1 calendar
        2 openweather_current
        3 openweather_forecast
        4 news
      
      A: Sample config
          => 11h and still OK
      
      B: Enable DEBUG log level
      
      C: Disable 2+3 (openweather) Enable 1+4
          => 14 h and still OK
      
      D: Enable 2+3 (openweather) + disable 1+4 (news & calendar)
          => ongoing
      */
      

      So in a few days I should know what’s triggering the issue…

      posted in Troubleshooting
      T
      TvE
    • 1 / 1