Why does the Livy test connection fail with the error “Not able to access resource, please check the host URL”?

Do check in the logs for exceptions and the root cause. The log files can be analysed from Livy url.

Possible causes are:

  • The Livy host url configured in Sparkflows is configured wrongly.

  • The Livy host url configured in Sparkflows is not accessible from EMR Livy.

  • Test connectivity from the sparkflows machine using:

    curl http://:8998/sessions {when Livy without authentications}
    curl -v -u : https://:8998/sessions {when Livy with authentications}

Note: Make sure to replace ‘livy-host’ with your actual Livy Server ip or domain name.