MagicMirror Forum
    • Recent
    • Tags
    • Unsolved
    • Solved
    • MagicMirror² Repository
    • Documentation
    • 3rd-Party-Modules
    • Donate
    • Discord
    • Register
    • Login
    A New Chapter for MagicMirror: The Community Takes the Lead
    Read the statement by Michael Teeuw here.

    Get JSON data stuck behind CAPTCHA click???? i.e. US Gas Prices

    Scheduled Pinned Locked Moved Development
    jsongas pricescaptcha
    3 Posts 3 Posters 2.0k Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • H Offline
      hsukup1
      last edited by hsukup1

      Any suggestions on how to get the up-to-date gas prices in any US locality, such as from this URL:

      https://www.geico.com/save/local-gas-prices/

      Unfortunately (albeit understandably) there is a CAPTCHA to click before the prices are returned.

      Any suggestions on an alternate source? Gas Buddy and the like doesn’t work well in rural US as the last consumer update on prices in my area was 3 years ago.

      I contacted Mapquest API…they said that although they provide gas price data to humans on their website, it is not available for scripts running automated requests publicly (they also get data from OPIS).

      Contacted OPIS customer support for APIs…no options to access this data for free from the primary source (OPIS).

      Whichever source should get their updates from OPIS which charges a hefty price for their API use and is not feasable for end-users like me.

      N E 2 Replies Last reply Reply Quote 0
      • N Offline
        ninjabreadman @hsukup1
        last edited by ninjabreadman

        @hsukup1 It’s not an easy problem. The crowdsourced solutions are not good, and the private solutions are not cheap. There’s MyGasFeed, but like GasBuddy it relies on crowdsourced data. Do you need station-specific data? AAA has state and municipal data available on their website.

        It looks like Geico also offers prices via the mobile app. You could install it, perform the search, and inspect the traffic and query. It could very well be making unobfuscated calls to the API. Just keep in mind that relying on that method, it may eventually break (especially if you attract attention with abuse of the API).

        Problem with config or JavaScript? Copy/paste it into JSHint.
        Check out the detailed walkthroughs on install, config, modules, etc.

        1 Reply Last reply Reply Quote 1
        • E Offline
          E3V3A @hsukup1
          last edited by

          @hsukup1
          Download their Android app and extract the APK file. then search for their URL (and API key if any).

          "Everything I do (here) is for free – altruism is the way!"
          MMM-FlightsAbove, MMM-Tabulator, MMM-Assistant (co-maintainer)

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          Enjoying MagicMirror? Please consider a donation!
          MagicMirror created by Michael Teeuw.
          Forum managed by Sam, technical setup by Karsten.
          This forum is using NodeBB as its core | Contributors
          Contact | Privacy Policy