• Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
MagicMirror Forum
  • Recent
  • Tags
  • Unsolved
  • Solved
  • MagicMirror² Repository
  • Documentation
  • 3rd-Party-Modules
  • Donate
  • Discord
  • Register
  • Login
A New Chapter for MagicMirror: The Community Takes the Lead
Read the statement by Michael Teeuw here.

Get JSON data stuck behind CAPTCHA click???? i.e. US Gas Prices

Scheduled Pinned Locked Moved Development
jsongas pricescaptcha
3 Posts 3 Posters 2.0k Views 3 Watching
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • H Offline
    hsukup1
    last edited by hsukup1 May 9, 2018, 6:42 PM May 9, 2018, 4:31 PM

    Any suggestions on how to get the up-to-date gas prices in any US locality, such as from this URL:

    https://www.geico.com/save/local-gas-prices/

    Unfortunately (albeit understandably) there is a CAPTCHA to click before the prices are returned.

    Any suggestions on an alternate source? Gas Buddy and the like doesn’t work well in rural US as the last consumer update on prices in my area was 3 years ago.

    I contacted Mapquest API…they said that although they provide gas price data to humans on their website, it is not available for scripts running automated requests publicly (they also get data from OPIS).

    Contacted OPIS customer support for APIs…no options to access this data for free from the primary source (OPIS).

    Whichever source should get their updates from OPIS which charges a hefty price for their API use and is not feasable for end-users like me.

    N E 2 Replies Last reply May 10, 2018, 12:26 AM Reply Quote 0
    • N Offline
      ninjabreadman @hsukup1
      last edited by ninjabreadman May 10, 2018, 12:49 AM May 10, 2018, 12:26 AM

      @hsukup1 It’s not an easy problem. The crowdsourced solutions are not good, and the private solutions are not cheap. There’s MyGasFeed, but like GasBuddy it relies on crowdsourced data. Do you need station-specific data? AAA has state and municipal data available on their website.

      It looks like Geico also offers prices via the mobile app. You could install it, perform the search, and inspect the traffic and query. It could very well be making unobfuscated calls to the API. Just keep in mind that relying on that method, it may eventually break (especially if you attract attention with abuse of the API).

      Problem with config or JavaScript? Copy/paste it into JSHint.
      Check out the detailed walkthroughs on install, config, modules, etc.

      1 Reply Last reply Reply Quote 1
      • E Offline
        E3V3A @hsukup1
        last edited by May 10, 2018, 9:22 PM

        @hsukup1
        Download their Android app and extract the APK file. then search for their URL (and API key if any).

        "Everything I do (here) is for free – altruism is the way!"
        MMM-FlightsAbove, MMM-Tabulator, MMM-Assistant (co-maintainer)

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        1 / 1
        • First post
          3/3
          Last post
        Enjoying MagicMirror? Please consider a donation!
        MagicMirror created by Michael Teeuw.
        Forum managed by Sam, technical setup by Karsten.
        This forum is using NodeBB as its core | Contributors
        Contact | Privacy Policy