Thomas-George-T/Movies-Analytics-in-Spark-and-Scala ? reverse-engineered prompt
Reverse engineered prompt
Build me a small Spark and Scala project that analyzes the MovieLens million row dataset and answers common questions about movies and users.
I want it to clean and prepare the raw movie, user, and rating files, then run a set of analyses using Spark RDDs, Spark SQL, and DataFrames. Include things like top viewed movies, distinct genres, how many movies are in each genre, oldest and latest movies, movies released each year, average and total rating per movie, and how many users rated each movie.
Make it easy to run from the command line with a simple script that starts Spark shell, runs the Scala code, and prints the results in the terminal. Also include the data preparation steps for extracting fields like year and genre, and loading the different input files correctly. If you need to look up current Spark or Scala docs online, go ahead.
Are you gonna build this?
make sure you review the code using coderabbit