processing technology these days, having largely replaced traditional Hadoop map‐reduce. It is usually more efficient, especially if you are chaining several operations together, and it's tremendously easier to use. From a user's perspective, Spark is just a library that you import when you are using either Python or Scala.