Do check in the logs for exceptions and the root cause. The log files can be analysed from Livy url.
Possible causes are:
-
The Livy host url configured in Sparkflows is configured wrongly.
-
The Livy host url configured in Sparkflows is not accessible from EMR Livy.
-
Test connectivity from the sparkflows machine using:
curl http://:8998/sessions {when Livy without authentications}
curl -v -u : https://:8998/sessions {when Livy with authentications}
Note: Make sure to replace ‘livy-host’ with your actual Livy Server ip or domain name.