MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    read csv-data and put it in an array

    Scheduled Pinned Locked Moved Utilities
    313 Posts 3 Posters 439.7k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PerlchampP Offline
      Perlchamp
      last edited by

      @sdetweil said in read csv-data and put it in an array:

      ok, went to numbers, SO much easier!!

      ok, i will try. therefor my array don’t match, i think … that’s right ?

      S 1 Reply Last reply Reply Quote 0
      • S Offline
        sdetweil @Perlchamp
        last edited by

        @Perlchamp the new data matches my new code

        Sam

        How to add modules

        learning how to use browser developers window for css changes

        1 Reply Last reply Reply Quote 0
        • PerlchampP Offline
          Perlchamp
          last edited by

          thanks, but now i’m a little bit confused, because my master problem will be, to reorg the array, to combine people with the same date of birth in as list in one row with the day of birth. but let me try …

          S 1 Reply Last reply Reply Quote 0
          • S Offline
            sdetweil @Perlchamp
            last edited by

            @Perlchamp ok, this was just to give you ideas on how to access the data… in a useful way

            Sam

            How to add modules

            learning how to use browser developers window for css changes

            1 Reply Last reply Reply Quote 0
            • PerlchampP Offline
              Perlchamp
              last edited by

              … and I’m very grateful to you for that. I learn from your messages every time. I think it’s great that there are people like you. that also costs time (apart from health, the most important thing in life). Thanks again for that!

              1 Reply Last reply Reply Quote 0
              • PerlchampP Offline
                Perlchamp
                last edited by

                hi sam,
                i have a major problem, that i don’t understand. this is my code in node_helper.js:

                var NodeHelper = require("node_helper");
                var moment = require("moment");
                
                // add require of other javascripot components here
                // var xxx = require('yyy'); here
                const csv = require("csvtojson");
                var birthdaysArray = [];
                
                
                module.exports = NodeHelper.create({
                
                	init(){
                		console.log("init module helper perlchamp");
                	},
                
                	start() {
                		console.log("Starting module helper: " + this.name);
                		//	console.log("Pfad zur csv-Datei: " + this.path + "/data/birthdays.csv");
                		
                		const csvFilePath = this.path + '/data/birthdays.csv';
                		csv()
                		.fromFile(csvFilePath)
                		.then((jsonObj)=>{      
                			birthdaysArray = JSON.stringify(jsonObj);
                			console.log("birthdaysArray: " + birthdaysArray);
                
                			var today_day_month = moment().format("DD.MM");
                			var today_month = moment().format("MM");
                		})
                		
                		console.log("birthdaysArray #2: " + birthdaysArray);
                		
                		// moment.js
                		moment.locale(config.language);  // set locale
                		console.log("aktuelle Zeit: " + moment().format('Do MMMM YYYY, hh:mm:ss'));
                		console.log("aktueller Monat(Zahl): " + moment().format('MM'));
                		console.log("aktueller Monat(Text): " + moment().format('MMM'));
                		console.log("aktueller Tag(Zahl mit führender Null): " + moment().format('DD'));
                		console.log("aktueller Tag(Text): " + moment().format('dddd'));
                		console.log("aktueller Tag(Abkürzung): " + moment().format('dd'));
                		console.log("aktuelles Jahr(Zahl): " + moment().format('YYYY'));
                	},
                
                	stop(){
                		console.log("Stopping module helper: " + this.name);
                	},
                
                	// handle messages from our module// each notification indicates a different messages
                	// payload is a data structure that is different per message.. up to you to design this
                	socketNotificationReceived(notification, payload) {
                		//	console.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                		console.log(this.name + " received a socket notification: " + birthdays);
                		// if config message from module
                		if (notification === "CONFIG") {
                			// save payload config info
                			this.config=payload
                			// wait 15 seconds, send a message back to module
                			setTimeout(()=> { this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000)
                		}
                		else if(notification === "????2") {
                		}
                
                	},
                });
                
                

                why returns

                console.log("birthdaysArray #2: " + birthdaysArray);
                

                nothing.

                many thanks in advance

                S 1 Reply Last reply Reply Quote 0
                • PerlchampP Offline
                  Perlchamp
                  last edited by

                  console.log(this.name + " received a socket notification: " + birthdays);
                  

                  should be

                  console.log(this.name + " received a socket notification: " + birthdaysArray);
                  

                  of course. couldn’t edit it, because of spam-message from board …

                  1 Reply Last reply Reply Quote 0
                  • S Offline
                    sdetweil @Perlchamp
                    last edited by

                    @Perlchamp said in read csv-data and put it in an array:

                    > 	const csvFilePath = this.path + '/data/birthdays.csv';
                    > 		csv()
                    > 		.fromFile(csvFilePath)
                    > 		.then((jsonObj)=>{      
                    > 			birthdaysArray = JSON.stringify(jsonObj);
                    > 			console.log("birthdaysArray: " + birthdaysArray);
                    > 
                    > 			var today_day_month = moment().format("DD.MM");
                    > 			var today_month = moment().format("MM");
                    > 		})
                    > 		
                    > 		console.log("birthdaysArray #2: " + birthdaysArray);
                    

                    welcome to programming with a asyncronous libraries

                    csv().fromFile(csvFilePath) starts a ‘long’ operation,
                    going out to disk, reading in the data, and converting it to json from spreadsheet… (long is milliseconds)

                    the processor should not wait, so it does not, and the next instruction AFTER the start of the fromFile()
                    is console.log("birthdaysArray #2: " + birthdaysArray);

                    	// moment.js
                    	moment.locale(config.language);  // set locale
                    	console.log("aktuelle Zeit: " + moment().format('Do MMMM YYYY, hh:mm:ss'));
                    	console.log("aktueller Monat(Zahl): " + moment().format('MM'));
                    	console.log("aktueller Monat(Text): " + moment().format('MMM'));
                    	console.log("aktueller Tag(Zahl mit führender Null): " + moment().format('DD'));
                    	console.log("aktueller Tag(Text): " + moment().format('dddd'));
                    	console.log("aktueller Tag(Abkürzung): " + moment().format('dd'));
                    	console.log("aktuelles Jahr(Zahl): " + moment().format('YYYY'));
                    

                    and the start function runs out of things to do and returns back to MM…

                    sometime later , the fromFile() will complete, and call the .then() routine with the data

                    (jsonObj)=>{      
                    			birthdaysArray = JSON.stringify(jsonObj);
                    			console.log("birthdaysArray: " + birthdaysArray);
                    
                    			var today_day_month = moment().format("DD.MM");
                    			var today_month = moment().format("MM");
                    		}
                    

                    so, if you need to wait for the data(to prints is content) , then the operations would be inside the .then() handler.

                    Sam

                    How to add modules

                    learning how to use browser developers window for css changes

                    1 Reply Last reply Reply Quote 0
                    • PerlchampP Offline
                      Perlchamp
                      last edited by

                      ok, thanks. to move the code is not heavy ;-) … i’ve found a snippte to sort my birthdaysArray, but that doesn’t match :

                      		const csvFilePath = this.path + '/data/birthdays.csv';
                      		csv()
                      		.fromFile(csvFilePath)
                      		.then((jsonObj)=>{      
                      			birthdaysArray = JSON.stringify(jsonObj);
                      			console.log("birthdaysArray: " + birthdaysArray);
                      			
                      		var result = Object.entries(birthdaysArray.reduce((a, {birth, name}) => {
                      			const day = +birth.split('.')[0];
                      			a[day] = [...(a[day] || []), name];
                      			return a
                      		}, {})).map(([day, name]) => ({day, name})).sort((a, b) => +a.day - b.day)
                      		console.log("sorted birthdays : " + result);
                      
                      		var today_day_month = moment().format("DD.MM");
                      		var today_month = moment().format("MM");
                      		})
                      
                      

                      now i’m looking for another one. is the birthdaysArray a json-Array or a javascript-array or … someone told me, it’s an object-Array and that this has nothing to do witch json … but: csvtojson, so …

                      S 1 Reply Last reply Reply Quote 0
                      • PerlchampP Offline
                        Perlchamp
                        last edited by Perlchamp

                        so i’m bloody happy :

                        var NodeHelper = require("node_helper");
                        var moment = require("moment");
                        
                        // add require of other javascripot components here
                        // var xxx = require('yyy'); here
                        const csv = require("csvtojson");
                        var birthdaysArray = [];
                        
                        
                        module.exports = NodeHelper.create({
                        
                        	init(){
                        		console.log("init module helper perlchamp");
                        	},
                        
                        	start() {
                        		console.log("Starting module helper: " + this.name);
                        		console.log("Pfad zur csv-Datei: ", this.path + "/data/birthdays.csv");
                        		
                        		const csvFilePath = this.path + '/data/birthdays.csv';
                        		csv()
                        		.fromFile(csvFilePath)
                        		.then((jsonObj)=>{      
                        			birthdaysArray = JSON.stringify(jsonObj);
                        			console.log("birthdaysArray: ", birthdaysArray);
                        			
                        		var result = Object.entries(jsonObj.reduce((a, {birth, name}) => {
                        			const day = +birth.split('.')[0];
                        			a[day] = [...(a[day] || []), name];
                        			return a
                        		}, {})).map(([day, name]) => ({day, name})).sort((a, b) => +a.day - b.day)
                        		console.log("sorted birthdays : ", result);
                        
                        		var today_day_month = moment().format("DD.MM");
                        		var today_month = moment().format("MM");
                        		})
                        		
                        	},
                        
                        	stop(){
                        		console.log("Stopping module helper: " + this.name);
                        	},
                        
                        	// handle messages from our module// each notification indicates a different messages
                        	// payload is a data structure that is different per message.. up to you to design this
                        	socketNotificationReceived(notification, payload) {
                        		//	console.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                        		console.log(this.name + " received a socket notification: " + birthdaysArray);
                        		// if config message from module
                        		if (notification === "CONFIG") {
                        			// save payload config info
                        			this.config=payload
                        			// wait 15 seconds, send a message back to module
                        			setTimeout(()=> { this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000)
                        		}
                        		else if(notification === "????2") {
                        		}
                        
                        	},
                        });
                        

                        so now I just have to manage to filter out the people from the complete csv-file who have their birthday in the current month …

                        1 Reply Last reply Reply Quote 0
                        • 1
                        • 2
                        • 7
                        • 8
                        • 9
                        • 10
                        • 11
                        • 31
                        • 32
                        • 9 / 32
                        • First post
                          Last post
                        Enjoying MagicMirror? Please consider a donation!
                        MagicMirror created by Michael Teeuw.
                        Forum managed by Sam, technical setup by Karsten.
                        This forum is using NodeBB as its core | Contributors
                        Contact | Privacy Policy