What are the installation Pre-requisites?

  • JDK 17 installed

  • Add Java to your PATH

  • Download Winutils and Set Path

  • 8+ GB of RAM on the machine (16+ GB recommended)

  • Python 3.9+ ( when running Python and Pyspark, otherwise not needed )

  • If running on an Apache Spark cluster, Apache Spark 2.3+ is needed on the cluster.