MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    read csv-data and put it in an array

    Scheduled Pinned Locked Moved Utilities
    313 Posts 3 Posters 495.6k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PerlchampP Offline
      Perlchamp
      last edited by

      i get this for each entry (here i only posted one of them):

      [2020-05-02 17:50:36.803] [LOG]    LOOK >>>>>>{} (/home/dirk/MagicMirror/modules/MMM-Logging/node_helper.js:34 Class.socketNotificationReceived)
      

      empty: {}

      S 1 Reply Last reply Reply Quote 0
      • S Offline
        sdetweil @Perlchamp
        last edited by sdetweil

        @Perlchamp ok, so the data collection didn’t work…

        so I would step thru that code

        what is the 1st row of your csv file? the column headers

        Sam

        How to add modules

        learning how to use browser developers window for css changes

        1 Reply Last reply Reply Quote 0
        • PerlchampP Offline
          Perlchamp
          last edited by

          before you do this. stop. i make an error. the code you posted is not in the notification section. it’s in the getDom section … so i placed it there. was this wrong ?

          S 1 Reply Last reply Reply Quote 0
          • S Offline
            sdetweil @Perlchamp
            last edited by

            @Perlchamp there is NOT an this. updateDom() in the getDom() section…

            still doesn’t change the result… there are no birthdays found that match 02/05

            Sam

            How to add modules

            learning how to use browser developers window for css changes

            1 Reply Last reply Reply Quote 0
            • PerlchampP Offline
              Perlchamp
              last edited by

              the columns are:
              birth, name

              and is called “birthdays.csv”

              the data are:
              23.01.1987,Thomas Roth

              S 1 Reply Last reply Reply Quote 0
              • S Offline
                sdetweil @Perlchamp
                last edited by sdetweil

                @Perlchamp so there are no birthdays for today… we are ONLY selecting for TODAY. not every day

                Sam

                How to add modules

                learning how to use browser developers window for css changes

                1 Reply Last reply Reply Quote 0
                • PerlchampP Offline
                  Perlchamp
                  last edited by

                  why for TODAY ? and not for current MONTH ?
                  getDon:

                  	getDom: function() {
                  		var self = this;
                  		var wrapper = document.createElement("div");
                  		
                  		// tell MM to call and get our content
                  Log.log("LOOK >>>>>>" + JSON.stringify(this.active_birthdays))    // add this line
                  			self.updateDom();                          // before this line in the notification code..
                  
                  		for(var birthday of Object.keys(this.active_birthdays)) {
                  			for(var name of this.active_birthdays[birthday]) {
                  				var m = document.createElement("div");
                  				Log.log("BIRTHDAY >> " + birthday);
                  				Log.log("NAME >> " + name);
                  				m.innerText = birthday + " " + name;
                  				wrapper.appendChild(m);
                  			}
                  		}
                  
                  		// pass the created content back to MM to add to DOM.
                  		return wrapper;
                  	}
                  
                  S 1 Reply Last reply Reply Quote 0
                  • S Offline
                    sdetweil @Perlchamp
                    last edited by

                    @Perlchamp said in read csv-data and put it in an array:

                      // tell MM to call and get our content
                    

                    Log.log(“LOOK >>>>>>” + JSON.stringify(this.active_birthdays)) // add this line
                    self.updateDom();

                    not that way

                    			      // save the persons name and age on the list
                    			      self.active_birthdays[birth_date].push({'name':birthday.name, 'age': now.diff(moment(birthday.birth,'DD.MM.YYYY'), 'years') })			     
                    			   }
                    			}
                         
                    			// tell MM to call and get our content
                    Log.log(JSON.stringify(this.active_birthdays))		  // add this line	
                    			self.updateDom();                 // before this line        
                    		}     		
                    

                    sorry, didn’t see the ‘month’.

                    still doesn’t matter, that birthday is for january, so nothing to show for may

                    change this compare to do only month

                    		  // if the date is the same or later, don't use time of day
                    		   if(birth_date_moment.startOf('day').isSameOrAfter(now.startOf('day')) &&
                    		   	  birth_date_moment.startOf('day').isSameOrBefore(birthday_time_window.startOf('day'))
                    

                    hint, google get month from moment

                    Sam

                    How to add modules

                    learning how to use browser developers window for css changes

                    1 Reply Last reply Reply Quote 0
                    • PerlchampP Offline
                      Perlchamp
                      last edited by

                      i got this:

                      [2020-05-02 18:10:50.465] [LOG]    {} (/home/dirk/MagicMirror/modules/MMM-Logging/node_helper.js:34 Class.socketNotificationReceived)
                      

                      for each entry. i have 5 birthdays in may …

                      S 1 Reply Last reply Reply Quote 0
                      • S Offline
                        sdetweil @Perlchamp
                        last edited by sdetweil

                        @Perlchamp look in the console log, MMM-Logging is redirecting everything there
                        my mmm-logging config

                        		{
                                    module: 'MMM-Logging',
                                    disabled: false,
                                    config: {
                                        // Module functions out of the box with nothing set here.
                                        // See below for configurable options.
                                        echoLocal: true, 
                                        echoRemote: true,
                                        overwriteBrowserMethods: true,
                                        format: "{{message}} ({{folder}}/{{file}}:{{line}} {{method}})",
                                    }
                                },
                        

                        Sam

                        How to add modules

                        learning how to use browser developers window for css changes

                        1 Reply Last reply Reply Quote 0
                        • PerlchampP Offline
                          Perlchamp
                          last edited by

                          i could send you the three files (node_helper.js, MMM-Perlchamp.js, birthdays.csv) via email ?
                          image

                          S 1 Reply Last reply Reply Quote 0
                          • S Offline
                            sdetweil @Perlchamp
                            last edited by

                            @Perlchamp sent chat message

                            Sam

                            How to add modules

                            learning how to use browser developers window for css changes

                            1 Reply Last reply Reply Quote 0
                            • PerlchampP Offline
                              Perlchamp
                              last edited by

                              node_helper.js:

                              var NodeHelper = require("node_helper");
                              var moment = require("moment");
                              // add require of other javascripot components here
                              // var xxx = require('yyy'); here
                              const csv = require("csvtojson");
                              var birthdaysArray = [];
                              
                              module.exports = NodeHelper.create({
                              
                              	init(){
                              		console.log("init module helper MMM-Perlchamp");
                              	},
                              
                              	start() {
                              
                              	},
                              	
                              	stop(){
                              		console.log("Stopping module helper: ",this.name);
                              	},
                              
                              	// handle messages from our module// each notification indicates a different messages
                              	// payload is a data structure that is different per message.. up to you to design this
                              	socketNotificationReceived(notification, payload) {				
                              		var self = this;
                              		console.log("Starting module helper: ",this.name);
                              
                              		// convert the csv-file into a JSON-String
                              		const csvFilePath = this.path + '/data/birthdays.csv';
                              		csv()
                              		.fromFile(csvFilePath)
                              		.then(function(jsonObj) {      
                              			JSON.stringify(jsonObj);
                              
                              			// send data to [modulname].js
                              			self.sendSocketNotification("HAVEDATA", jsonObj);
                              		})		
                              
                              		// if config message from module
                              		if (notification === "CONFIG") {
                              			// save payload config info
                              			this.config = payload;
                              			// wait 15 seconds, send a message back to module
                              			setTimeout(()=> {this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000);
                              		}
                              		else if(notification === "????2") {
                              	
                              		}
                              	},
                              });
                              

                              MMM-Perlchamp.js:

                              Module.register("MMM-Perlchamp", {
                              
                              	defaults: {
                              		language: "de",
                              		dimmEntries: true   // true: dims entries and the associated 
                              							//       symbol when the date has expired.
                              							// false: delete entries and the associated 
                              							//        symbol when the date has expired.
                              	},
                              	
                              	active_birthdays: {
                              		
                              	},
                              
                              
                              	init: function(){
                              		Log.log(this.name + " is in init!");
                              	},
                              
                              	start: function(){
                              		Log.log("Starting module: " + this.name);
                              
                              		// Set locale
                              		moment.locale(config.language);
                              	},
                              
                              	loaded: function(callback) {
                              		Log.log(this.name + " is loaded!");
                              		callback();
                              	},
                              
                              	// return list of other functional scripts to use, if any (like require in node_helper)
                              	getScripts: function() {
                              		return	["moment.js"];
                              	}, 
                              
                              	// return list of stylesheet files to use if any
                              	getStyles: function() {
                              		return 	[this.data.path + "/css/MMM-Perlchamp.css"];
                              	},
                              
                              
                              	// only called if the module header was configured in module config in config.js
                              	getHeader: function() {
                              		return this.data.header;
                              	},
                              
                              	// messages received from other modules and the system (NOT from your node helper)
                              	// payload is a notification dependent data structure
                              	notificationReceived: function(notification, payload, sender) {
                              		// once everybody is loaded up
                              		if(notification === "ALL_MODULES_STARTED"){
                              			// send our config to our node_helper
                              			this.sendSocketNotification("CONFIG",this.config);
                              		}
                              		if (sender) {
                              			Log.log(this.name + " received a module notification: " + notification + " from sender: " + sender.name);
                              		} else {
                              			Log.log(this.name + " received a system notification: " + notification);
                              		}
                              	},
                              	
                              	// messages received from from your node helper (NOT other modules or the system)
                              	// payload is a notification dependent data structure, up to you to design between module and node_helper
                              	socketNotificationReceived: function(notification, payload) {
                              		if(notification === "HAVEDATA") {
                              
                              			var self = this;
                              			Log.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                              			var now = moment();
                              			for(var birthday of payload) {
                              				// get 1st 5 chars of birthdate, thru month
                              				// we will use this as the key in the hash
                              				var birth_date = birthday.birth.substring(0,5);
                              				
                              				// get the birthday as a moment in this year, for comparing
                              				var birth_date_moment = moment(birth_date + now.year(),"DD.MMYYYY");
                              
                              				// u can add days to a moment object and then compare 
                              				//     if the birthdate is before that date (and after now)
                              				//     so within the next xx days
                              
                              				// if the date is the same or later, don't use time of day
                              				if(birth_date_moment.startOf('day').isSameOrAfter(now.startOf('day')) &&
                              		   	  birth_date_moment.startOf('day').isSameOrBefore(birthday_time_window.startOf('day'))) {
                              
                              					// birthday is in this month
                              					// check the hash if we've seen anything for today yet
                              					// if we haven't see this date yet
                              					if(this.active_birthdays[birth_date] == undefined){
                                         
                              						//  create the holder for its info (array of 
                              						//		names) in the hash
                              						this.active_birthdays[birth_date] = [];
                              					}
                              					// save the persons name on the list
                              					self.active_birthdays[birth_date].push({'name':birthday.name, 'age': now.diff(moment(birthday.birth,'DD.MM.YYYY'), 'years') })			     
                              			   }
                              			}
                              //					this.active_birthdays[birth_date].push(birthday.name);
                              //					this.active_birthdays[birth_date].push(birthday.name);
                              //				}
                              //
                              //			}
                              			Log.log("this.active_birthdays >>>>> ", this.active_birthdays);
                              
                              /*			
                              //			var currentMonth = new Date().toLocaleDateString('en', {month:'2-digit'});
                              			var currentMonth = moment().format("MM");
                              			var result = Object.entries(payload
                              			.filter(({birth}) => birth.split('.')[1] === currentMonth)
                              			.reduce((a, {birth, name}) => {
                              				const day = +birth.split('.')[0];
                              				a[day] = [...(a[day] || []), name];
                              				return a
                              			}, {})
                              			).map(([day, name]) => ({day, name})).sort((a, b) => +a.day - b.day);
                              			console.log("LISTE >> ", result);
                              */     
                              
                              
                              			// tell MM to call and get our content
                              			self.updateDom();
                              		}     			
                              	},
                              
                              	// system notification your module is being hidden
                              	// typically you would stop doing UI updates (getDom/updateDom) if the module is hidden
                              	suspend: function() {
                              
                              	},
                              
                              	// system notification your module is being unhidden/shown
                              	// typically you would resume doing UI updates (getDom/updateDom) if the module is shown
                              	resume: function() {
                              
                              	},
                              
                              	// this is the major worker of the module, it provides the displayable content for this module
                              	getDom: function() {
                              		var self = this;
                              		var wrapper = document.createElement("div");
                              		
                              		// tell MM to call and get our content
                              Log.log(JSON.stringify(this.active_birthdays))    // add this line
                              			self.updateDom();                          // before this line in the notification code..
                              
                              		for(var birthday of Object.keys(this.active_birthdays)) {
                              			for(var name of this.active_birthdays[birthday]) {
                              				var m = document.createElement("div");
                              				Log.log("BIRTHDAY >> " + birthday);
                              				Log.log("NAME >> " + name);
                              				m.innerText = birthday + " " + name;
                              				wrapper.appendChild(m);
                              			}
                              		}
                              
                              		// pass the created content back to MM to add to DOM.
                              		return wrapper;
                              	}
                              })
                              

                              birthdays.csv in folder MMM-Perlchamp/data:

                              birth,name
                              03.01.1940,aaa AAAAA
                              06.01.1969,bbb BBBBB
                              15.02.1939,ccc CCCCC
                              07.03.1972,ddd DDDDD
                              10.05.1969,eee EEEEE
                              16.05.2012,fff FFFFF
                              16.05.1988,ggg GGGGG
                              27.05.2002,hhh HHHHH
                              08.07.1976,iiii IIIII
                              13.07.1914,jjj JJJJJ
                              27.08.1968,kkk KKKKK
                              21.09.1967,lll LLLLL
                              13.10.1965,mmm MMMMM
                              16.10.2010,nnn NNNNN
                              23.10.1941,ooo OOOOO
                              19.12.1935,ppp PPPPP
                              

                              MMM-Perlchamp.css in folder MMM-Perlchamp/css

                              .MMM-Perlchamp header {
                                letter-spacing: 0.1em;
                                text-transform: uppercase;
                                font-size: 20px;
                                font-family: "Roboto Condensed", Arial, Helvetica, sans-serif;
                                font-weight: 400;
                                border-bottom: 1px solid #444444;
                                line-height: 20px;
                                padding-bottom: 5px;
                                color: #ffffff;
                              /*
                                font-variant: small-caps;
                              */
                              }
                              
                              
                              
                              S 1 Reply Last reply Reply Quote 0
                              • S Offline
                                sdetweil @Perlchamp
                                last edited by

                                @Perlchamp said in read csv-data and put it in an array:

                                  		if(birth_date_moment.startOf('day').isSameOrAfter(now.startOf('day')) &&
                                     	  birth_date_moment.startOf('day').isSameOrBefore(birthday_time_window.startOf('day'))) {
                                

                                yes it only shows for today+some possible offset… I said u had to fix that to do month comparison

                                Sam

                                How to add modules

                                learning how to use browser developers window for css changes

                                1 Reply Last reply Reply Quote 0
                                • PerlchampP Offline
                                  Perlchamp
                                  last edited by

                                  shame on me, sorry for that. now it’s changed to:

                                  if(birth_date_moment.startOf('month').isSameOrAfter(now.startOf('month')) &&
                                  					birth_date_moment.startOf('month').isSameOrBefore(birthday_time_window.startOf('month'))) {
                                  

                                  nothing changed, i have configured the terminal-window to scroll about 3000 (!) lines, but can’t see the beginning …
                                  image

                                  S 1 Reply Last reply Reply Quote 0
                                  • S Offline
                                    sdetweil @Perlchamp
                                    last edited by

                                    @Perlchamp redirect the terminal window to a file and edit that

                                    do this in the code

                                    				// if the date is the same or later, don't use time of day
                                    			 	//if(birth_date_moment.startOf('day').isSameOrAfter(now.startOf('day')) &&
                                                                    //  birth_date_moment.startOf('day').isSameOrBefore(birthday_time_window.startOf('day'))) {
                                    			   	*/
                                    			   	if( birth_date_moment.month() == now.month() ){
                                    

                                    Sam

                                    How to add modules

                                    learning how to use browser developers window for css changes

                                    1 Reply Last reply Reply Quote 0
                                    • PerlchampP Offline
                                      Perlchamp
                                      last edited by

                                      done, it’s frozen now. must restart …

                                      1 Reply Last reply Reply Quote 0
                                      • PerlchampP Offline
                                        Perlchamp
                                        last edited by

                                        question:
                                        in the

                                        socketNotificationReceived: function(notification, payload) {
                                        		if(notification === "HAVEDATA") {
                                        			var self = this;
                                                       ...
                                        

                                        payload should be the variable in which the jsonString is saved ?

                                        S 1 Reply Last reply Reply Quote 0
                                        • S Offline
                                          sdetweil @Perlchamp
                                          last edited by

                                          @Perlchamp it has the jsonObj from the node_helper

                                          u can call it anything, its just a name

                                          so, if you put a stop right on the var self = this
                                          and then cursor over the work payload in

                                          function(notification, payload)
                                          

                                          it will show you that object content, and u can go up and click on parts to make them expand to examine the contents

                                          Screenshot at 2020-05-02 12-14-08.png

                                          Sam

                                          How to add modules

                                          learning how to use browser developers window for css changes

                                          1 Reply Last reply Reply Quote 0
                                          • PerlchampP Offline
                                            Perlchamp
                                            last edited by

                                            ok, there is a light at the end of the tunnel:
                                            image

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 15
                                            • 16
                                            • 4 / 16
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy