MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    read csv-data and put it in an array

    Scheduled Pinned Locked Moved Utilities
    313 Posts 3 Posters 495.6k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PerlchampP Offline
      Perlchamp
      last edited by Perlchamp

      ok, now i can see the output of my csvtojson object. now the question about handle this all:
      is it better (csv-file) to call the rows ‘month of birth’, ‘birthday’, ‘year of birth’, ‘name’
      => mai,23,1964,stan smith
      or ‘birth’,name
      => 05.23.1964,stan smith

      how said:
      i want to display the birthdays of the current month, then the name and the age. if people should have birthday at the same day, they should listed, in which the daynumber only displayed once (=> two cells).
      what should happen, if the day of birth is over, i don’t know yet. there will be two options, i think, between the user can choose:

      1. delete the names on the list (with daynumber)
      2. dimm these entries.
        finally it should display like this:
        picture
      S 1 Reply Last reply Reply Quote 0
      • S Do not disturb
        sdetweil @Perlchamp
        last edited by sdetweil

        @Perlchamp welcome to the fun

        its really month and day… year you would only want to know for big event things… 18, 21, 30, 40,50, …

        so, I would reorg the data as a hash (object) by date, and list [array] of people [‘Stan Smith’, ‘Joe Anyone’]

        birthdays = {}
        u can use the moment() object to get the month/day, or had code to extract the part of the date month/day,
        birthdays[birth_date][‘names’] = [‘Stan Smith’, ‘Joe Anyone’]
        then send the birthdays object up to modulename.js

        modulename.js in getDom()
        it uses moment().format(‘MMDD’) or (‘DDMM’) (same as node_helper did)
        then
        if( this.birthdays[date] !=undefined) // if there is something for today
        then can add the names in a for loop to the html to display

        and if you use moment() in modulename, u can add/subtract to look ahead, and it will format the right month/day,
        and u can get the day name

        today,
        tomorrow
        saturday
        sunday,
        next week…

        Sam

        How to add modules

        learning how to use browser developers window for css changes

        1 Reply Last reply Reply Quote 0
        • PerlchampP Offline
          Perlchamp
          last edited by Perlchamp

          uff, now first i have to read some papers for understanding that stuff …
          in the moment i only can see the output of the json-object via terminal. i don’t have them saved in an array or string. i wanted to use a async-method (by await), but it seems that this is the wrong way (error-messages) …
          i think to put the data first in an array couldn’t be wrong so far ?

           {
              Geburtsmonat: 'März',
              Geburtstag: '7',
              Geburtsjahr: '1972',
              Name: 'Julia Ützglütz'
            },
          {
          ...
          }
          
          

          could it ?

          S 1 Reply Last reply Reply Quote 0
          • S Do not disturb
            sdetweil @Perlchamp
            last edited by sdetweil

            @Perlchamp should already be an array of row(of column name/value pairs)…

            the JSON class has stringify(object) to convert json to text,

            console.log(JSON.stringify(results of convert))

            also has parse (from text form of json to object)

            Sam

            How to add modules

            learning how to use browser developers window for css changes

            1 Reply Last reply Reply Quote 0
            • PerlchampP Offline
              Perlchamp
              last edited by

              ok, now i have a dictionary (is that called though?) - always 4 columns (i will change that, if i read how to put it all in an array. in the moment i just have the output via console …)

              [{"Geburtsmonat":"Januar","Geburtstag":"3","Geburtsjahr":"1940","Name":"Renate Stögger"},{...},{...}]
              

              but i’m on the right way, thanks again :-)

              S 1 Reply Last reply Reply Quote 0
              • S Do not disturb
                sdetweil @Perlchamp
                last edited by

                @Perlchamp

                [{"
                

                array [ of objects {}, {}. {} ]
                the names of the object elements are the names of the columns (row 1 in the csv)

                Sam

                How to add modules

                learning how to use browser developers window for css changes

                1 Reply Last reply Reply Quote 0
                • PerlchampP Offline
                  Perlchamp
                  last edited by

                  @sdetweil said in read csv-data and put it in an array:

                  the names of the object elements are the names of the columns (row 1 in the csv)

                  yes i know.
                  i thought it’s an dictionairy and not an array. but it’s ok …

                  S 1 Reply Last reply Reply Quote 0
                  • S Do not disturb
                    sdetweil @Perlchamp
                    last edited by

                    @Perlchamp the [ (open square bracket) means array in javascript

                    the array can be numbers, strings or objects (open squiggly bracket)

                    Sam

                    How to add modules

                    learning how to use browser developers window for css changes

                    1 Reply Last reply Reply Quote 0
                    • PerlchampP Offline
                      Perlchamp
                      last edited by

                      status:
                      i wanted to “play” with the jsonArray, but things like jsonArray[“birth”][0] or jsonArray.birth[3] will not be accepted, although it is listed in many websites … i try and try and read and read, but in the moment no solution. the parameter “length” count the number of letters and numbers ?
                      then I will have to deal with moment () first …

                      S 1 Reply Last reply Reply Quote 0
                      • S Do not disturb
                        sdetweil @Perlchamp
                        last edited by sdetweil

                        @Perlchamp u did not show the code, so I will call the output of the csvtojson() birthday_info

                        example of how to navigate the json data

                        in module there would be no ‘var’ cause of the way the modulename and helper are packaged inside object

                        // if not using numbers but month names 
                        // make indexOf return 1-12, not 0-11 (dummy thing never matched 1st)
                        // fix this with your language abbreviations
                        // usually in lower case, then always convert data to lowercase for compare to prevent having users remember to get the case right
                        var months= ["0", "jan","feb","mar"...."dec"]
                        
                        var today_day_month = moment().format("DDMM")
                        // today would be "3004"
                        // tomorrow will be "0105"
                        // loop thru the array of birthday info from file, one 'row' per birthday
                        
                        for(var birthday of birthday_info) {
                             // get the day/month string in numbers to match output of moment()
                             // get the last 2 chars of the day and month with a 0 on front.. 01-09, 12, ---31, or 01-09,10/11/12
                             if( ("0"+birthday.Geburtstag).subString(-2)+("0"+months.indexOf(birthday.Geburtsmonat.toLowerCase())).subString(-2) 
                                                 == today_month_day) {
                                 // this birthday is for today
                                    condole.log(" birthday on "+ today_day _month+" is for "+birthday.Name);
                             } 
                        }
                        
                        ``

                        Sam

                        How to add modules

                        learning how to use browser developers window for css changes

                        1 Reply Last reply Reply Quote 0
                        • PerlchampP Offline
                          Perlchamp
                          last edited by Perlchamp

                          i didn’t post the code, because it only was a status-info …
                          but here is the code. i think i will first try alone. if there any questions i will post them.
                          here is my array:

                          [{"birth":"12.09.1967", "name":"Otto Billing"},{...}]
                          

                          many thanks in advance

                          S 1 Reply Last reply Reply Quote 0
                          • S Do not disturb
                            sdetweil @Perlchamp
                            last edited by sdetweil

                            @Perlchamp ok, went to numbers, SO much easier!!

                            var today_day_month = moment().format("DD.MM")
                            // today would be "30.04"
                            // tomorrow will be "01.05"
                            // loop thru the array of birthday info from file, one 'row' per birthday
                            
                            for(var birthday of birthday_info) {
                                 if( (birthday.birth.startsWith(today_day_month)) {
                                     // this birthday is for today
                                        console.log(" birthday on "+ today_day_month+" is for "+birthday.name);
                                 } 
                            }
                            

                            Sam

                            How to add modules

                            learning how to use browser developers window for css changes

                            1 Reply Last reply Reply Quote 0
                            • PerlchampP Offline
                              Perlchamp
                              last edited by

                              @sdetweil said in read csv-data and put it in an array:

                              ok, went to numbers, SO much easier!!

                              ok, i will try. therefor my array don’t match, i think … that’s right ?

                              S 1 Reply Last reply Reply Quote 0
                              • S Do not disturb
                                sdetweil @Perlchamp
                                last edited by

                                @Perlchamp the new data matches my new code

                                Sam

                                How to add modules

                                learning how to use browser developers window for css changes

                                1 Reply Last reply Reply Quote 0
                                • PerlchampP Offline
                                  Perlchamp
                                  last edited by

                                  thanks, but now i’m a little bit confused, because my master problem will be, to reorg the array, to combine people with the same date of birth in as list in one row with the day of birth. but let me try …

                                  S 1 Reply Last reply Reply Quote 0
                                  • S Do not disturb
                                    sdetweil @Perlchamp
                                    last edited by

                                    @Perlchamp ok, this was just to give you ideas on how to access the data… in a useful way

                                    Sam

                                    How to add modules

                                    learning how to use browser developers window for css changes

                                    1 Reply Last reply Reply Quote 0
                                    • PerlchampP Offline
                                      Perlchamp
                                      last edited by

                                      … and I’m very grateful to you for that. I learn from your messages every time. I think it’s great that there are people like you. that also costs time (apart from health, the most important thing in life). Thanks again for that!

                                      1 Reply Last reply Reply Quote 0
                                      • PerlchampP Offline
                                        Perlchamp
                                        last edited by

                                        hi sam,
                                        i have a major problem, that i don’t understand. this is my code in node_helper.js:

                                        var NodeHelper = require("node_helper");
                                        var moment = require("moment");
                                        
                                        // add require of other javascripot components here
                                        // var xxx = require('yyy'); here
                                        const csv = require("csvtojson");
                                        var birthdaysArray = [];
                                        
                                        
                                        module.exports = NodeHelper.create({
                                        
                                        	init(){
                                        		console.log("init module helper perlchamp");
                                        	},
                                        
                                        	start() {
                                        		console.log("Starting module helper: " + this.name);
                                        		//	console.log("Pfad zur csv-Datei: " + this.path + "/data/birthdays.csv");
                                        		
                                        		const csvFilePath = this.path + '/data/birthdays.csv';
                                        		csv()
                                        		.fromFile(csvFilePath)
                                        		.then((jsonObj)=>{      
                                        			birthdaysArray = JSON.stringify(jsonObj);
                                        			console.log("birthdaysArray: " + birthdaysArray);
                                        
                                        			var today_day_month = moment().format("DD.MM");
                                        			var today_month = moment().format("MM");
                                        		})
                                        		
                                        		console.log("birthdaysArray #2: " + birthdaysArray);
                                        		
                                        		// moment.js
                                        		moment.locale(config.language);  // set locale
                                        		console.log("aktuelle Zeit: " + moment().format('Do MMMM YYYY, hh:mm:ss'));
                                        		console.log("aktueller Monat(Zahl): " + moment().format('MM'));
                                        		console.log("aktueller Monat(Text): " + moment().format('MMM'));
                                        		console.log("aktueller Tag(Zahl mit führender Null): " + moment().format('DD'));
                                        		console.log("aktueller Tag(Text): " + moment().format('dddd'));
                                        		console.log("aktueller Tag(Abkürzung): " + moment().format('dd'));
                                        		console.log("aktuelles Jahr(Zahl): " + moment().format('YYYY'));
                                        	},
                                        
                                        	stop(){
                                        		console.log("Stopping module helper: " + this.name);
                                        	},
                                        
                                        	// handle messages from our module// each notification indicates a different messages
                                        	// payload is a data structure that is different per message.. up to you to design this
                                        	socketNotificationReceived(notification, payload) {
                                        		//	console.log(this.name + " received a socket notification: " + notification + " - Payload: " + payload);
                                        		console.log(this.name + " received a socket notification: " + birthdays);
                                        		// if config message from module
                                        		if (notification === "CONFIG") {
                                        			// save payload config info
                                        			this.config=payload
                                        			// wait 15 seconds, send a message back to module
                                        			setTimeout(()=> { this.sendSocketNotification("message_from_helper"," this is a test_message")}, 15000)
                                        		}
                                        		else if(notification === "????2") {
                                        		}
                                        
                                        	},
                                        });
                                        
                                        

                                        why returns

                                        console.log("birthdaysArray #2: " + birthdaysArray);
                                        

                                        nothing.

                                        many thanks in advance

                                        S 1 Reply Last reply Reply Quote 0
                                        • PerlchampP Offline
                                          Perlchamp
                                          last edited by

                                          console.log(this.name + " received a socket notification: " + birthdays);
                                          

                                          should be

                                          console.log(this.name + " received a socket notification: " + birthdaysArray);
                                          

                                          of course. couldn’t edit it, because of spam-message from board …

                                          1 Reply Last reply Reply Quote 0
                                          • S Do not disturb
                                            sdetweil @Perlchamp
                                            last edited by

                                            @Perlchamp said in read csv-data and put it in an array:

                                            > 	const csvFilePath = this.path + '/data/birthdays.csv';
                                            > 		csv()
                                            > 		.fromFile(csvFilePath)
                                            > 		.then((jsonObj)=>{      
                                            > 			birthdaysArray = JSON.stringify(jsonObj);
                                            > 			console.log("birthdaysArray: " + birthdaysArray);
                                            > 
                                            > 			var today_day_month = moment().format("DD.MM");
                                            > 			var today_month = moment().format("MM");
                                            > 		})
                                            > 		
                                            > 		console.log("birthdaysArray #2: " + birthdaysArray);
                                            

                                            welcome to programming with a asyncronous libraries

                                            csv().fromFile(csvFilePath) starts a ‘long’ operation,
                                            going out to disk, reading in the data, and converting it to json from spreadsheet… (long is milliseconds)

                                            the processor should not wait, so it does not, and the next instruction AFTER the start of the fromFile()
                                            is console.log("birthdaysArray #2: " + birthdaysArray);

                                            	// moment.js
                                            	moment.locale(config.language);  // set locale
                                            	console.log("aktuelle Zeit: " + moment().format('Do MMMM YYYY, hh:mm:ss'));
                                            	console.log("aktueller Monat(Zahl): " + moment().format('MM'));
                                            	console.log("aktueller Monat(Text): " + moment().format('MMM'));
                                            	console.log("aktueller Tag(Zahl mit führender Null): " + moment().format('DD'));
                                            	console.log("aktueller Tag(Text): " + moment().format('dddd'));
                                            	console.log("aktueller Tag(Abkürzung): " + moment().format('dd'));
                                            	console.log("aktuelles Jahr(Zahl): " + moment().format('YYYY'));
                                            

                                            and the start function runs out of things to do and returns back to MM…

                                            sometime later , the fromFile() will complete, and call the .then() routine with the data

                                            (jsonObj)=>{      
                                            			birthdaysArray = JSON.stringify(jsonObj);
                                            			console.log("birthdaysArray: " + birthdaysArray);
                                            
                                            			var today_day_month = moment().format("DD.MM");
                                            			var today_month = moment().format("MM");
                                            		}
                                            

                                            so, if you need to wait for the data(to prints is content) , then the operations would be inside the .then() handler.

                                            Sam

                                            How to add modules

                                            learning how to use browser developers window for css changes

                                            1 Reply Last reply Reply Quote 0

                                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                            With your input, this post could be even better 💗

                                            Register Login
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 15
                                            • 16
                                            • 4 / 16
                                            • First post
                                              Last post
                                            Enjoying MagicMirror? Please consider a donation!
                                            MagicMirror created by Michael Teeuw.
                                            Forum managed by Sam, technical setup by Karsten.
                                            This forum is using NodeBB as its core | Contributors
                                            Contact | Privacy Policy