93

It would be nice to be able to bring to light the price gouging that is taking place in Canada with regards to grocery stores.

you are viewing a single comment's thread
view the rest of the comments
[-] danielquinn@lemmy.ca 17 points 1 year ago

The project is Open source, so you might be able to leverage it for Canadian data. All you need is:

  • Understanding of the expected format for the project
  • Access to data from Canadian retailers. This can be acquired via APIs (these are usually free) or by scraping their sites.
[-] JohnnyCanuck@lemmy.ca 11 points 1 year ago

At the bottom of the chain on mastodon the creator says they use the search APIs of the store websites. I wouldn't have expected those to be easily accessible!

[-] danielquinn@lemmy.ca 4 points 1 year ago

Yeah a lot of chains even have a documented, developer-friendly API. If that's not available though, you can usually figure out the API just by looking at the calls your browser makes when visiting a page. Most sites use a REST API for catalog pages that's then rendered out with JavaScript.

If that doesn't work, then you can usually scrape everything with Selenium. It's a little harder to do, but still quite manageable, though that usually has to be a background job, as it's slow.

this post was submitted on 16 Sep 2023
93 points (100.0% liked)

Canada

7200 readers
390 users here now

What's going on Canada?



Communities


๐Ÿ Meta


๐Ÿ—บ๏ธ Provinces / Territories


๐Ÿ™๏ธ Cities / Local Communities


๐Ÿ’ SportsHockey

Football (NFL)

  • List of All Teams: unknown

Football (CFL)

  • List of All Teams: unknown

Baseball

Basketball

Soccer


๐Ÿ’ป Universities


๐Ÿ’ต Finance / Shopping


๐Ÿ—ฃ๏ธ Politics


๐Ÿ Social and Culture


Rules

Reminder that the rules for lemmy.ca also apply here. See the sidebar on the homepage:

https://lemmy.ca


founded 3 years ago
MODERATORS