When running the Job you can use parameters like below for the job conf:
--conf spark.driver.memory=8g --conf spark.executor.memory=16g
When running the Job you can use parameters like below for the job conf:
--conf spark.driver.memory=8g --conf spark.executor.memory=16g