Scraping Amazon Reviews for Users

User Story

  • As a: M.L. Developer,
  • I want: lots of user-book reviews (ratings)
  • so that: my machine learning algorithm can be more accurate.

Functional Requirements

  • From the books in our database, create users who have reviewed the books
  • When you click on a users name, you can see their reviews for all their books:
  • Modify the Users table to indicate if the user is allowed to log on, and where they came from (copied from Amazon, or created on the site)
  • Only add amazon users when they have rated at minimum 2 books from our database
    • You can add books to the database if you want to do a reverse lookup (the scraping scripts work if you provide it with an amazon url)

Description

Amazon publishes all of the book reviews and have users with unique identifiers attached to each of them. We can use this data to bolster our data for the machine learning algorithm.

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information