• Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
MagicMirror Forum
  • Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
A New Chapter for MagicMirror: The Community Takes the Lead
Read the statement by Michael Teeuw here.

read csv-data and put it in an array

Scheduled Pinned Locked Moved Utilities
313 Posts 3 Posters 409.4k Views 4 Watching
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S Offline
    sdetweil @Perlchamp
    last edited by May 1, 2020, 11:38 AM

    @Perlchamp you converted the array to text format, so now its just one big string…

    	birthdaysArray = JSON.stringify(jsonObj);
    

    to print it out do this

                            birthdaysArray = jsonObj;
    			console.log("birthdaysArray: "+JSON.stringify(jsonObj););
    

    why do you need to sort them?
    as you go thru you can just not save the ones not for today, plus/minus some lookahead

    once you get to the today list you can sort the names if you need to.

    Sam

    How to add modules

    learning how to use browser developers window for css changes

    1 Reply Last reply Reply Quote 0
    • S Offline
      sdetweil @Perlchamp
      last edited by sdetweil May 1, 2020, 1:32 PM May 1, 2020, 1:18 PM

      @Perlchamp said in read csv-data and put it in an array:

      now i’m looking for another one. is the birthdaysArray a json-Array or a javascript-array or … someone told me, it’s an object-Array and that this has nothing to do witch json … but: csvtojson, so …

      json is a TEXT structure…

      but it just so happens that javascript represents objects the same way… so the JSON library provides utilities to convert in both directions.

      json text to object JSON.parse(text)
      object to json text JSON.stringify(object)

      text is text and has no meaning (its called opaque because u cannot tell what it is)

      no reason to split the birthdate, as u won’t do anything with the individual parts
      don’t do work if u don’t need the results

      you do NOT Need to do this data reformatting IN the node helper… you can do it all in the modulename.js file, which would let you use the code debugger in the dev console.
      in the .then of the node_helper csvtojson, just send the data to the module
      self.sendsocketNotification(“have data”, jsonObj)
      and the helper is done

      on the modulename.js side

      socketNotificationReceived(notification, payload){
      if(notification =='have data'){
      
      var now = moment()
      var active_birthdays={}
      for( var birthday of payload) {
      // get 1st 5 chars of birthdate, thru month
      // we will use this as the key in the hash
      var birth_date=birthday.birth.subString(0,4)
      
      // get the birthday as a moment in this year, for comparing
      var birth_date_moment = moment(birth_date+now.getYear(),"DD.MMYYYY")
      
        
      // u can add days to a moment object and then compare if the birthdate is before that date (and after now)
      // so within the next xx days
      
        // if the date is the same or later, don't use time of day
         if(birth_date.startOf('day').isSame(now.startOf('day')){
      
             // birthday is in this month
            // check the hash if we've seen anything for today yet
            // if we haven't see this date yet
            if(active_birthdays[birth_date] == undefined){
                 //  create the holder for its info (array of names) in the hash
                 active_birthdays[birth_date]=[]
            }
            // save the persons name on the list
            active_birthdays[birth_date].push(birthday.name)
           
         }
      }
           // tell MM to call and get our content
           self. updateDom()
      }
      

      at the end, you will have just birthdays in this month and for people with the same day
      a list of people on that day

      in the hash reader (getDom(), Object.keys(active_birthdays) will get you back an array of the
      DD.MM strings that are present

      but you can probably do without that… u know what today is, so if there is an object with todays DD.MM
      then u have the list of people for today

      if u want to allow (in the next 5 days,matching what the node_helper did), using moment, u can add a day, extract the DD.MM, check the hash,
      repeat 4 more times

      Sam

      How to add modules

      learning how to use browser developers window for css changes

      1 Reply Last reply Reply Quote 0
      • P Offline
        Perlchamp
        last edited by May 1, 2020, 4:49 PM

        ok, thank you sam.
        Now I have to process the whole thing first, otherwise my head will burst ;-) …

        1 Reply Last reply Reply Quote 0
        • P Offline
          Perlchamp
          last edited by May 1, 2020, 9:26 PM

          this is the actual node_helper.js:

          var NodeHelper = require("node_helper");
          var moment = require("moment");
          
          // add require of other javascripot components here
          // var xxx = require('yyy'); here
          const csv = require("csvtojson");
          
          var birthdaysArray = [];
          
          
          module.exports = NodeHelper.create({
          
          	init(){
          		console.log("init module helper perlchamp");
          	},
          
          	start() {
          		console.log("Starting module helper: " + this.name);
          		//console.log("Pfad zur csv-Datei: ", this.path + "/data/birthdays.csv");
          
          		moment.locale(config.language);  // set locale
          		
          		// convert the csv-file into a JSON-String
          		const csvFilePath = this.path + '/data/birthdays.csv';
          		csv()
          		.fromFile(csvFilePath)
          		.then((jsonObj)=>{      
          			birthdaysArray = JSON.stringify(jsonObj);
          			
          			// for debugging only
          			//console.log("birthdaysArray: ", birthdaysArray);
          			
          			// send data to [modulname].js
          			self.sendsocketNotification("have data", birthdaysArray)
          
          			// loop thru the array of birthday_info from file (jsonObj),
          			// one 'row' per birthday
          		
          		})		
          	},
          	
          
          	stop(){
          		console.log("Stopping module helper: " + this.name);
          	},
          
          	// handle messages from our module// each notification indicates a different messages
          	// payload is a data structure that is different per message.. up to you to design this
          	socketNotificationReceived(notification, payload) {				
          		// if config message from module
          		if (notification === "CONFIG") {
          			// save payload config info
          			this.config=payload
          			// wait 15 seconds, send a message back to module
          			setTimeout(()=> { this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000)
          		}
          		else if(notification === "????2") {
          		}
          	},
          });
          

          i got an error-message :

          [2020-05-01 23:21:12.072] [WARN]   Unhandled rejection ReferenceError: self is not defined
              at /home/dirk/MagicMirror/modules/perlchamp/node_helper.js:34:4
            
          

          i think this could be the problem:

          // send data to [modulname].js
          self.sendsocketNotification("have data", birthdaysArray)
          
          

          i tried “this.” and without “self.” and “this.” but nothing changed. now i’m searching in the web, maybe i will found some answers ;-)

          1 Reply Last reply Reply Quote 0
          • P Offline
            Perlchamp
            last edited by Perlchamp May 1, 2020, 10:19 PM May 1, 2020, 10:17 PM

            // send data to [modulname].js
            self.sendsocketNotification("have data", birthdaysArray)
            

            i have found a typing error. Socket instead socket. if i than change self. to this. no errror messages will displayed. but still black screen.
            maybe i did not understand how to handle the getDom-section … i will still try …
            but:
            i see no notification in the terminal. ‘have data’ should actually appear there, shouldn’t it ?

            S 1 Reply Last reply May 1, 2020, 10:23 PM Reply Quote 0
            • S Offline
              sdetweil @Perlchamp
              last edited by sdetweil May 1, 2020, 10:27 PM May 1, 2020, 10:23 PM

              @Perlchamp

              do this, you need self

              start() {
              		var self = this
              		console.log("Starting module helper: " + this.name);
              

              the use self

                              self.sendsocketNotification("have data", jsonObj)
              

              u need to send the obj, not the string

              as for black screen , that means the modulename side died…

              f12 on the keyboard or ctrl-shift-i, select the console tab, and look for red text … usually a syntax error…

              Sam

              How to add modules

              learning how to use browser developers window for css changes

              S 1 Reply Last reply May 1, 2020, 10:27 PM Reply Quote 0
              • S Offline
                sdetweil @sdetweil
                last edited by May 1, 2020, 10:27 PM

                @Perlchamp

                i see no notification in the terminal. ‘have data’ should actually appear there, shouldn’t it ?

                no, the message is sent to the modulename.js side of your module…
                using my sample code , right here

                        // messages received from from your node helper (NOT other modules or the system)
                	// payload is a notification dependent data structure, up to you to design between module and node_helper
                	socketNotificationReceived: function(notification, payload) {
                

                Sam

                How to add modules

                learning how to use browser developers window for css changes

                S 1 Reply Last reply May 1, 2020, 10:39 PM Reply Quote 0
                • S Offline
                  sdetweil @sdetweil
                  last edited by sdetweil May 1, 2020, 10:42 PM May 1, 2020, 10:39 PM

                  the two parts look like this

                  --------------------------------------------------------------------------------------------------
                  |                                  browser  side                                                 |
                  |                                       modulename.js (SampleModule.js)                          |
                  |                                                                                                |
                  |     receive (socketNotificationReceived)                send ( sendSocketNotification)         |
                  --------------------------------------------------------------------------------------------------
                                      ^                                                     |
                                      |                                                     |
                  --------------------------------------------------------------------------------------------------
                                      |                                                     |
                                      |                                                     V 
                  --------------------------------------------------------------------------------------------------
                  |      send ( sendSocketNotification)                   receive (socketNotificationReceived)     |
                  |                                                                                                |
                  |                                       node_helper.js                                           |
                  |                                  server side                                                   |
                  --------------------------------------------------------------------------------------------------
                  

                  Sam

                  How to add modules

                  learning how to use browser developers window for css changes

                  1 Reply Last reply Reply Quote 0
                  • P Offline
                    Perlchamp
                    last edited by May 1, 2020, 10:44 PM

                    yes, i understood. here’s my perlchamp.js (only socketNitificationReceived)

                    	// messages received from from your node helper (NOT other modules or the system)
                    	// payload is a notification dependent data structure, up to you to design between module and node_helper
                    	socketNotificationReceived: function(notification, payload) {
                    		Log.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                    		if(notification === "message_from_helper"){
                    			this.config.message = payload;
                    			// tell mirror runtime that our data has changed,
                    			// we will be called back at GetDom() to provide the updated content
                    			this.updateDom(1000)
                    		}
                    
                    		if(notification === "have data"){
                    
                    			Log.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                    			
                    			var now = moment()
                    			var active_birthdays={}
                    
                    			for( var birthday of payload) {
                    				// get 1st 5 chars of birthdate, thru month
                    				// we will use this as the key in the hash
                    				var birth_date = birthday.birth.subString(0,4)
                    				
                    				// for debugging only
                    				Log.log("Tag.Monat :", birth_date)
                    				
                    				// get the birthday as a moment in this year, for comparing
                    				var birth_date_moment = moment(birth_date + now.getYear(),"DD.MMYYYY")
                    
                    				// u can add days to a moment object and then compare 
                    				//     if the birthdate is before that date (and after now)
                    				//     so within the next xx days
                    
                    				// if the date is the same or later, don't use time of day
                    				if(birth_date.startOf('day').isSame(now.startOf('day')){
                    
                    					// birthday is in this month
                    					// check the hash if we've seen anything for today yet
                    					// if we haven't see this date yet
                    					if(active_birthdays[birth_date] == undefined){
                               
                    						//  create the holder for its info (array of 
                    						//		names) in the hash
                    						active_birthdays[birth_date] = []
                    					}
                    					// save the persons name on the list
                    					active_birthdays[birth_date].push(birthday.name)
                    				}
                    			}
                         
                    			// tell MM to call and get our content
                    			self.updateDom();
                    		}     			
                    },
                    
                    S 1 Reply Last reply May 1, 2020, 10:52 PM Reply Quote 0
                    • S Offline
                      sdetweil @Perlchamp
                      last edited by sdetweil May 1, 2020, 11:02 PM May 1, 2020, 10:52 PM

                      @Perlchamp very good… now, I didn’t test the code I wrote, so there are a couple errors…

                      but you should be able to see that code in the developers window, sources tab,
                      navigate on the left tree, modules, your module_name (which has to be perchamp,
                      folder, filename and the register at the top) all have to match)

                      Sam

                      How to add modules

                      learning how to use browser developers window for css changes

                      1 Reply Last reply Reply Quote 0
                      • 1
                      • 2
                      • 25
                      • 26
                      • 27
                      • 28
                      • 29
                      • 30
                      • 31
                      • 32
                      • 27 / 32
                      27 / 32
                      • First post
                        93/313
                        Last post
                      Enjoying MagicMirror? Please consider a donation!
                      MagicMirror created by Michael Teeuw.
                      Forum managed by Sam, technical setup by Karsten.
                      This forum is using NodeBB as its core | Contributors
                      Contact | Privacy Policy