• Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
MagicMirror Forum
  • Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
A New Chapter for MagicMirror: The Community Takes the Lead
Read the statement by Michael Teeuw here.

read csv-data and put it in an array

Scheduled Pinned Locked Moved Utilities
313 Posts 3 Posters 406.6k Views 4 Watching
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S Offline
    sdetweil @Perlchamp
    last edited by sdetweil May 1, 2020, 1:32 PM May 1, 2020, 1:18 PM

    @Perlchamp said in read csv-data and put it in an array:

    now i’m looking for another one. is the birthdaysArray a json-Array or a javascript-array or … someone told me, it’s an object-Array and that this has nothing to do witch json … but: csvtojson, so …

    json is a TEXT structure…

    but it just so happens that javascript represents objects the same way… so the JSON library provides utilities to convert in both directions.

    json text to object JSON.parse(text)
    object to json text JSON.stringify(object)

    text is text and has no meaning (its called opaque because u cannot tell what it is)

    no reason to split the birthdate, as u won’t do anything with the individual parts
    don’t do work if u don’t need the results

    you do NOT Need to do this data reformatting IN the node helper… you can do it all in the modulename.js file, which would let you use the code debugger in the dev console.
    in the .then of the node_helper csvtojson, just send the data to the module
    self.sendsocketNotification(“have data”, jsonObj)
    and the helper is done

    on the modulename.js side

    socketNotificationReceived(notification, payload){
    if(notification =='have data'){
    
    var now = moment()
    var active_birthdays={}
    for( var birthday of payload) {
    // get 1st 5 chars of birthdate, thru month
    // we will use this as the key in the hash
    var birth_date=birthday.birth.subString(0,4)
    
    // get the birthday as a moment in this year, for comparing
    var birth_date_moment = moment(birth_date+now.getYear(),"DD.MMYYYY")
    
      
    // u can add days to a moment object and then compare if the birthdate is before that date (and after now)
    // so within the next xx days
    
      // if the date is the same or later, don't use time of day
       if(birth_date.startOf('day').isSame(now.startOf('day')){
    
           // birthday is in this month
          // check the hash if we've seen anything for today yet
          // if we haven't see this date yet
          if(active_birthdays[birth_date] == undefined){
               //  create the holder for its info (array of names) in the hash
               active_birthdays[birth_date]=[]
          }
          // save the persons name on the list
          active_birthdays[birth_date].push(birthday.name)
         
       }
    }
         // tell MM to call and get our content
         self. updateDom()
    }
    

    at the end, you will have just birthdays in this month and for people with the same day
    a list of people on that day

    in the hash reader (getDom(), Object.keys(active_birthdays) will get you back an array of the
    DD.MM strings that are present

    but you can probably do without that… u know what today is, so if there is an object with todays DD.MM
    then u have the list of people for today

    if u want to allow (in the next 5 days,matching what the node_helper did), using moment, u can add a day, extract the DD.MM, check the hash,
    repeat 4 more times

    Sam

    How to add modules

    learning how to use browser developers window for css changes

    1 Reply Last reply Reply Quote 0
    • P Offline
      Perlchamp
      last edited by May 1, 2020, 4:49 PM

      ok, thank you sam.
      Now I have to process the whole thing first, otherwise my head will burst ;-) …

      1 Reply Last reply Reply Quote 0
      • P Offline
        Perlchamp
        last edited by May 1, 2020, 9:26 PM

        this is the actual node_helper.js:

        var NodeHelper = require("node_helper");
        var moment = require("moment");
        
        // add require of other javascripot components here
        // var xxx = require('yyy'); here
        const csv = require("csvtojson");
        
        var birthdaysArray = [];
        
        
        module.exports = NodeHelper.create({
        
        	init(){
        		console.log("init module helper perlchamp");
        	},
        
        	start() {
        		console.log("Starting module helper: " + this.name);
        		//console.log("Pfad zur csv-Datei: ", this.path + "/data/birthdays.csv");
        
        		moment.locale(config.language);  // set locale
        		
        		// convert the csv-file into a JSON-String
        		const csvFilePath = this.path + '/data/birthdays.csv';
        		csv()
        		.fromFile(csvFilePath)
        		.then((jsonObj)=>{      
        			birthdaysArray = JSON.stringify(jsonObj);
        			
        			// for debugging only
        			//console.log("birthdaysArray: ", birthdaysArray);
        			
        			// send data to [modulname].js
        			self.sendsocketNotification("have data", birthdaysArray)
        
        			// loop thru the array of birthday_info from file (jsonObj),
        			// one 'row' per birthday
        		
        		})		
        	},
        	
        
        	stop(){
        		console.log("Stopping module helper: " + this.name);
        	},
        
        	// handle messages from our module// each notification indicates a different messages
        	// payload is a data structure that is different per message.. up to you to design this
        	socketNotificationReceived(notification, payload) {				
        		// if config message from module
        		if (notification === "CONFIG") {
        			// save payload config info
        			this.config=payload
        			// wait 15 seconds, send a message back to module
        			setTimeout(()=> { this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000)
        		}
        		else if(notification === "????2") {
        		}
        	},
        });
        

        i got an error-message :

        [2020-05-01 23:21:12.072] [WARN]   Unhandled rejection ReferenceError: self is not defined
            at /home/dirk/MagicMirror/modules/perlchamp/node_helper.js:34:4
          
        

        i think this could be the problem:

        // send data to [modulname].js
        self.sendsocketNotification("have data", birthdaysArray)
        
        

        i tried “this.” and without “self.” and “this.” but nothing changed. now i’m searching in the web, maybe i will found some answers ;-)

        1 Reply Last reply Reply Quote 0
        • P Offline
          Perlchamp
          last edited by Perlchamp May 1, 2020, 10:19 PM May 1, 2020, 10:17 PM

          // send data to [modulname].js
          self.sendsocketNotification("have data", birthdaysArray)
          

          i have found a typing error. Socket instead socket. if i than change self. to this. no errror messages will displayed. but still black screen.
          maybe i did not understand how to handle the getDom-section … i will still try …
          but:
          i see no notification in the terminal. ‘have data’ should actually appear there, shouldn’t it ?

          S 1 Reply Last reply May 1, 2020, 10:23 PM Reply Quote 0
          • S Offline
            sdetweil @Perlchamp
            last edited by sdetweil May 1, 2020, 10:27 PM May 1, 2020, 10:23 PM

            @Perlchamp

            do this, you need self

            start() {
            		var self = this
            		console.log("Starting module helper: " + this.name);
            

            the use self

                            self.sendsocketNotification("have data", jsonObj)
            

            u need to send the obj, not the string

            as for black screen , that means the modulename side died…

            f12 on the keyboard or ctrl-shift-i, select the console tab, and look for red text … usually a syntax error…

            Sam

            How to add modules

            learning how to use browser developers window for css changes

            S 1 Reply Last reply May 1, 2020, 10:27 PM Reply Quote 0
            • S Offline
              sdetweil @sdetweil
              last edited by May 1, 2020, 10:27 PM

              @Perlchamp

              i see no notification in the terminal. ‘have data’ should actually appear there, shouldn’t it ?

              no, the message is sent to the modulename.js side of your module…
              using my sample code , right here

                      // messages received from from your node helper (NOT other modules or the system)
              	// payload is a notification dependent data structure, up to you to design between module and node_helper
              	socketNotificationReceived: function(notification, payload) {
              

              Sam

              How to add modules

              learning how to use browser developers window for css changes

              S 1 Reply Last reply May 1, 2020, 10:39 PM Reply Quote 0
              • S Offline
                sdetweil @sdetweil
                last edited by sdetweil May 1, 2020, 10:42 PM May 1, 2020, 10:39 PM

                the two parts look like this

                --------------------------------------------------------------------------------------------------
                |                                  browser  side                                                 |
                |                                       modulename.js (SampleModule.js)                          |
                |                                                                                                |
                |     receive (socketNotificationReceived)                send ( sendSocketNotification)         |
                --------------------------------------------------------------------------------------------------
                                    ^                                                     |
                                    |                                                     |
                --------------------------------------------------------------------------------------------------
                                    |                                                     |
                                    |                                                     V 
                --------------------------------------------------------------------------------------------------
                |      send ( sendSocketNotification)                   receive (socketNotificationReceived)     |
                |                                                                                                |
                |                                       node_helper.js                                           |
                |                                  server side                                                   |
                --------------------------------------------------------------------------------------------------
                

                Sam

                How to add modules

                learning how to use browser developers window for css changes

                1 Reply Last reply Reply Quote 0
                • P Offline
                  Perlchamp
                  last edited by May 1, 2020, 10:44 PM

                  yes, i understood. here’s my perlchamp.js (only socketNitificationReceived)

                  	// messages received from from your node helper (NOT other modules or the system)
                  	// payload is a notification dependent data structure, up to you to design between module and node_helper
                  	socketNotificationReceived: function(notification, payload) {
                  		Log.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                  		if(notification === "message_from_helper"){
                  			this.config.message = payload;
                  			// tell mirror runtime that our data has changed,
                  			// we will be called back at GetDom() to provide the updated content
                  			this.updateDom(1000)
                  		}
                  
                  		if(notification === "have data"){
                  
                  			Log.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                  			
                  			var now = moment()
                  			var active_birthdays={}
                  
                  			for( var birthday of payload) {
                  				// get 1st 5 chars of birthdate, thru month
                  				// we will use this as the key in the hash
                  				var birth_date = birthday.birth.subString(0,4)
                  				
                  				// for debugging only
                  				Log.log("Tag.Monat :", birth_date)
                  				
                  				// get the birthday as a moment in this year, for comparing
                  				var birth_date_moment = moment(birth_date + now.getYear(),"DD.MMYYYY")
                  
                  				// u can add days to a moment object and then compare 
                  				//     if the birthdate is before that date (and after now)
                  				//     so within the next xx days
                  
                  				// if the date is the same or later, don't use time of day
                  				if(birth_date.startOf('day').isSame(now.startOf('day')){
                  
                  					// birthday is in this month
                  					// check the hash if we've seen anything for today yet
                  					// if we haven't see this date yet
                  					if(active_birthdays[birth_date] == undefined){
                             
                  						//  create the holder for its info (array of 
                  						//		names) in the hash
                  						active_birthdays[birth_date] = []
                  					}
                  					// save the persons name on the list
                  					active_birthdays[birth_date].push(birthday.name)
                  				}
                  			}
                       
                  			// tell MM to call and get our content
                  			self.updateDom();
                  		}     			
                  },
                  
                  S 1 Reply Last reply May 1, 2020, 10:52 PM Reply Quote 0
                  • S Offline
                    sdetweil @Perlchamp
                    last edited by sdetweil May 1, 2020, 11:02 PM May 1, 2020, 10:52 PM

                    @Perlchamp very good… now, I didn’t test the code I wrote, so there are a couple errors…

                    but you should be able to see that code in the developers window, sources tab,
                    navigate on the left tree, modules, your module_name (which has to be perchamp,
                    folder, filename and the register at the top) all have to match)

                    Sam

                    How to add modules

                    learning how to use browser developers window for css changes

                    1 Reply Last reply Reply Quote 0
                    • P Offline
                      Perlchamp
                      last edited by Perlchamp May 1, 2020, 11:10 PM May 1, 2020, 11:10 PM

                      i can’t find … so everything’s right ?
                      picture

                      S 1 Reply Last reply May 1, 2020, 11:13 PM Reply Quote 0
                      • 1
                      • 2
                      • 8
                      • 9
                      • 10
                      • 11
                      • 12
                      • 31
                      • 32
                      • 10 / 32
                      10 / 32
                      • First post
                        94/313
                        Last post
                      Enjoying MagicMirror? Please consider a donation!
                      MagicMirror created by Michael Teeuw.
                      Forum managed by Sam, technical setup by Karsten.
                      This forum is using NodeBB as its core | Contributors
                      Contact | Privacy Policy