Why do I not see any response after submitting a job to Livy?

Setup & Configuration Livy
1

Do check in the logs for exceptions and the root cause. The log files can be analysed from Livy url.

Possible causes are:

  • The Postback Url configured in Sparkflows is configured wrongly.

  • The Postback Url configured in Sparkflows is not accessible from EMR Livy.

  • Test connectivity from the Apache Spark cluster to the postback URL from one of the machines of the cluster (EMR) using:

    curl https://<alb-host>/ -v

Note: Make sure to replace ‘alb-host’ with your load balancer’s domain name.