Yes, Sparkflows engine lets you trigger Airflow pipelines which in turn can trigger the workflows to be run on EMR cluster and then it can collect back the results and show up in Sparkflows UI.
For more details, refer to the pages below:
Yes, Sparkflows engine lets you trigger Airflow pipelines which in turn can trigger the workflows to be run on EMR cluster and then it can collect back the results and show up in Sparkflows UI.
For more details, refer to the pages below: