MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    HTML or IFrame Scraping Help

    Scheduled Pinned Locked Moved Requests
    iframescrapingparsing
    4 Posts 3 Posters 2.1k Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      brycedewitt
      last edited by

      the short question
      tl;dr I’m trying to figure out how to parse through and scrape values from a specific webpage and display within module (specifically, this page).

      the long question
      My university has a webpage that displays current activity levels at all gyms on campus. I’m able to simply display the entire page using the IFrame module, but it’s messy and gives me a lot of data and structure that I don’t particularly need. Essentially, I’m trying to find a way to parse through the HTML and just grab the name of the facility and it’s associated value, and display it as a simple bar chart. I’m pretty well-versed in Java, but this is my first Javascript project, so I’d just appreciate some general direction on where to start/if it’s even possible.

      Thanks guys.

      E strawberry 3.141S 2 Replies Last reply Reply Quote 0
      • E Offline
        E3V3A @brycedewitt
        last edited by

        @brycedewitt You should definitely try to give Tabulator a shot. AFAIK, Tabulator has a HTML table to JSON converter and is very flexible in making awesome tables. Warning, is that it may be a bit overkill for what you want to do…

        "Everything I do (here) is for free – altruism is the way!"
        MMM-FlightsAbove, MMM-Tabulator, MMM-Assistant (co-maintainer)

        1 Reply Last reply Reply Quote 0
        • B Offline
          brycedewitt
          last edited by

          I’m not as overly concerned with the finished product as I am about just figuring my way through some cool stuff on the way, so I’ll definitely give that a go, thanks.

          1 Reply Last reply Reply Quote 0
          • strawberry 3.141S Offline
            strawberry 3.141 Project Sponsor Module Developer @brycedewitt
            last edited by

            @brycedewitt In this part of my module I’m scraping a website of a parcel carrier, so it’s possible https://github.com/fewieden/MMM-ShipmentTracking/blob/master/carriers/DHL.js

            Please create a github issue if you need help, so I can keep track

            1 Reply Last reply Reply Quote 0

            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

            With your input, this post could be even better 💗

            Register Login
            • 1 / 1
            • First post
              Last post
            Enjoying MagicMirror? Please consider a donation!
            MagicMirror created by Michael Teeuw.
            Forum managed by Sam, technical setup by Karsten.
            This forum is using NodeBB as its core | Contributors
            Contact | Privacy Policy