MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    HTML or IFrame Scraping Help

    Scheduled Pinned Locked Moved Requests
    iframescrapingparsing
    4 Posts 3 Posters 1.7k Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      brycedewitt
      last edited by

      the short question
      tl;dr I’m trying to figure out how to parse through and scrape values from a specific webpage and display within module (specifically, this page).

      the long question
      My university has a webpage that displays current activity levels at all gyms on campus. I’m able to simply display the entire page using the IFrame module, but it’s messy and gives me a lot of data and structure that I don’t particularly need. Essentially, I’m trying to find a way to parse through the HTML and just grab the name of the facility and it’s associated value, and display it as a simple bar chart. I’m pretty well-versed in Java, but this is my first Javascript project, so I’d just appreciate some general direction on where to start/if it’s even possible.

      Thanks guys.

      E strawberry 3.141S 2 Replies Last reply Reply Quote 0
      • E Offline
        E3V3A @brycedewitt
        last edited by

        @brycedewitt You should definitely try to give Tabulator a shot. AFAIK, Tabulator has a HTML table to JSON converter and is very flexible in making awesome tables. Warning, is that it may be a bit overkill for what you want to do…

        "Everything I do (here) is for free – altruism is the way!"
        MMM-FlightsAbove, MMM-Tabulator, MMM-Assistant (co-maintainer)

        1 Reply Last reply Reply Quote 0
        • B Offline
          brycedewitt
          last edited by

          I’m not as overly concerned with the finished product as I am about just figuring my way through some cool stuff on the way, so I’ll definitely give that a go, thanks.

          1 Reply Last reply Reply Quote 0
          • strawberry 3.141S Offline
            strawberry 3.141 Project Sponsor Module Developer @brycedewitt
            last edited by

            @brycedewitt In this part of my module I’m scraping a website of a parcel carrier, so it’s possible https://github.com/fewieden/MMM-ShipmentTracking/blob/master/carriers/DHL.js

            Please create a github issue if you need help, so I can keep track

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            Enjoying MagicMirror? Please consider a donation!
            MagicMirror created by Michael Teeuw.
            Forum managed by Sam, technical setup by Karsten.
            This forum is using NodeBB as its core | Contributors
            Contact | Privacy Policy