• Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
MagicMirror Forum
  • Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
A New Chapter for MagicMirror: The Community Takes the Lead
Read the statement by Michael Teeuw here.

HTML or IFrame Scraping Help

Scheduled Pinned Locked Moved Requests
iframescrapingparsing
4 Posts 3 Posters 1.7k Views 3 Watching
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • B Offline
    brycedewitt
    last edited by Mar 4, 2018, 9:52 PM

    the short question
    tl;dr I’m trying to figure out how to parse through and scrape values from a specific webpage and display within module (specifically, this page).

    the long question
    My university has a webpage that displays current activity levels at all gyms on campus. I’m able to simply display the entire page using the IFrame module, but it’s messy and gives me a lot of data and structure that I don’t particularly need. Essentially, I’m trying to find a way to parse through the HTML and just grab the name of the facility and it’s associated value, and display it as a simple bar chart. I’m pretty well-versed in Java, but this is my first Javascript project, so I’d just appreciate some general direction on where to start/if it’s even possible.

    Thanks guys.

    E S 2 Replies Last reply Mar 4, 2018, 10:28 PM Reply Quote 0
    • E Offline
      E3V3A @brycedewitt
      last edited by Mar 4, 2018, 10:28 PM

      @brycedewitt You should definitely try to give Tabulator a shot. AFAIK, Tabulator has a HTML table to JSON converter and is very flexible in making awesome tables. Warning, is that it may be a bit overkill for what you want to do…

      "Everything I do (here) is for free – altruism is the way!"
      MMM-FlightsAbove, MMM-Tabulator, MMM-Assistant (co-maintainer)

      1 Reply Last reply Reply Quote 0
      • B Offline
        brycedewitt
        last edited by Mar 4, 2018, 10:51 PM

        I’m not as overly concerned with the finished product as I am about just figuring my way through some cool stuff on the way, so I’ll definitely give that a go, thanks.

        1 Reply Last reply Reply Quote 0
        • S Offline
          strawberry 3.141 Project Sponsor Module Developer @brycedewitt
          last edited by Mar 4, 2018, 11:13 PM

          @brycedewitt In this part of my module I’m scraping a website of a parcel carrier, so it’s possible https://github.com/fewieden/MMM-ShipmentTracking/blob/master/carriers/DHL.js

          Please create a github issue if you need help, so I can keep track

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          1 / 1
          • First post
            1/4
            Last post
          Enjoying MagicMirror? Please consider a donation!
          MagicMirror created by Michael Teeuw.
          Forum managed by Sam, technical setup by Karsten.
          This forum is using NodeBB as its core | Contributors
          Contact | Privacy Policy